2024-09-12T02:42:04.800 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T02:42:05.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:42:05.621 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642 branch: squid description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901642' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - but it is still running - objects unfound and apparently lost - MDS_SLOW_METADATA_IO - MDS_TRIM sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA2OAyg21ZkXs20P4AxxQ9o8XDB0tyIniMNh+ebfXCmV8Gy+fMKztGF65HS0Nb/t9MmU8ombojtwRKzxImCdBLg= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJf8DopiplFazTS1kIMSwtpbBthz2EV9TYOHJOiSuEsJAMW/K3XxiWEXlGfS9XQNp3T1PuI1grsUiQ+YiRiKDlY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - thrashosds: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T02:42:05.621 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T02:42:05.622 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T02:42:05.622 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T02:42:05.623 INFO:teuthology.task.internal:Checking packages... 2024-09-12T02:42:05.646 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T02:42:05.646 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T02:42:05.646 INFO:teuthology.packaging:ref: None 2024-09-12T02:42:05.646 INFO:teuthology.packaging:tag: None 2024-09-12T02:42:05.646 INFO:teuthology.packaging:branch: squid 2024-09-12T02:42:05.647 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:42:05.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-12T02:42:05.846 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314-g086c737f-1jammy 2024-09-12T02:42:05.847 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T02:42:05.856 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T02:42:05.857 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T02:42:05.862 INFO:teuthology.task.internal:Saving configuration 2024-09-12T02:42:05.885 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T02:42:05.891 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T02:42:05.918 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:36:29.899467', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINBumUvF95OzVYhCixQUPOvX1Gvkpm/Uj0oKKzMrGEw8'} 2024-09-12T02:42:05.939 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 02:36:29.897924', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMA970MXPVz8CForx1YyORS1ZRQ6V0hdZ88peH8xuAlm'} 2024-09-12T02:42:05.939 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T02:42:05.945 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-12T02:42:05.945 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-12T02:42:05.946 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T02:42:06.007 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcadc67f490>, signals=[15]) 2024-09-12T02:42:06.007 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T02:42:06.013 INFO:teuthology.task.internal:Opening connections... 2024-09-12T02:42:06.013 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T02:42:06.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:42:06.105 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:42:06.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:42:06.185 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T02:42:06.192 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-09-12T02:42:06.197 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-09-12T02:42:06.197 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-09-12T02:42:06.247 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T02:42:06.247 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2024-09-12T02:42:06.247 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="22.04" 2024-09-12T02:42:06.248 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T02:42:06.248 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=jammy 2024-09-12T02:42:06.248 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2024-09-12T02:42:06.248 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2024-09-12T02:42:06.248 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T02:42:06.248 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T02:42:06.248 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T02:42:06.248 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T02:42:06.248 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=jammy 2024-09-12T02:42:06.249 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-09-12T02:42:06.273 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-09-12T02:42:06.277 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-09-12T02:42:06.278 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-09-12T02:42:06.324 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T02:42:06.324 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2024-09-12T02:42:06.324 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04" 2024-09-12T02:42:06.324 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T02:42:06.324 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy 2024-09-12T02:42:06.324 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2024-09-12T02:42:06.324 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2024-09-12T02:42:06.324 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T02:42:06.325 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T02:42:06.325 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T02:42:06.325 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T02:42:06.325 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy 2024-09-12T02:42:06.325 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-09-12T02:42:06.348 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T02:42:06.358 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T02:42:06.450 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T02:42:06.451 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:42:06.453 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-09-12T02:42:06.458 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T02:42:06.466 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T02:42:06.466 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:42:06.501 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-09-12T02:42:06.509 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T02:42:06.560 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T02:42:06.575 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T02:42:06.575 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-12T02:42:06.575 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-12T02:42:06.576 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:42:06.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:42:06.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-12T02:42:06.748 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:42:06.749 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T02:42:06.749 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-12T02:42:06.755 INFO:teuthology.orchestra.run.smithi063.stdout:5.15.0-56-generic 2024-09-12T02:42:06.755 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:42:06.755 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T02:42:06.756 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-12T02:42:06.756 DEBUG:teuthology.orchestra.run.smithi063:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-12T02:42:06.814 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:hint: 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:hint: git config --global init.defaultBranch 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:hint: 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-12T02:42:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi063.stderr:hint: 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi063.stderr:hint: git branch -m 2024-09-12T02:42:06.931 INFO:teuthology.orchestra.run.smithi063.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-12T02:42:06.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-12T02:42:07.002 DEBUG:teuthology.orchestra.run.smithi063:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-12T02:42:07.056 DEBUG:teuthology.orchestra.run.smithi063:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-12T02:42:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-12T02:42:30.286 INFO:teuthology.orchestra.run.smithi063.stderr: * [new branch] main -> origin/main 2024-09-12T02:42:30.322 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190312 -> 20190312 2024-09-12T02:42:30.323 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190416 -> 20190416 2024-09-12T02:42:30.323 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190514 -> 20190514 2024-09-12T02:42:30.323 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190618 -> 20190618 2024-09-12T02:42:30.323 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190717 -> 20190717 2024-09-12T02:42:30.324 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190815 -> 20190815 2024-09-12T02:42:30.324 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190923 -> 20190923 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20191022 -> 20191022 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20191215 -> 20191215 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200122 -> 20200122 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200316 -> 20200316 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200421 -> 20200421 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200519 -> 20200519 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200619 -> 20200619 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200721 -> 20200721 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200817 -> 20200817 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200918 -> 20200918 2024-09-12T02:42:30.325 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20201022 -> 20201022 2024-09-12T02:42:30.327 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20201118 -> 20201118 2024-09-12T02:42:30.327 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20201218 -> 20201218 2024-09-12T02:42:30.327 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210208 -> 20210208 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210315 -> 20210315 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210511 -> 20210511 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210716 -> 20210716 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210818 -> 20210818 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210919 -> 20210919 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20211027 -> 20211027 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20211216 -> 20211216 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220209 -> 20220209 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220310 -> 20220310 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220411 -> 20220411 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220509 -> 20220509 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220610 -> 20220610 2024-09-12T02:42:30.328 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220708 -> 20220708 2024-09-12T02:42:30.329 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220815 -> 20220815 2024-09-12T02:42:30.329 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220913 -> 20220913 2024-09-12T02:42:30.329 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20221012 -> 20221012 2024-09-12T02:42:30.329 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20221109 -> 20221109 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20221214 -> 20221214 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230117 -> 20230117 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230210 -> 20230210 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230310 -> 20230310 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230404 -> 20230404 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230515 -> 20230515 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230625 -> 20230625 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230804 -> 20230804 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230919 -> 20230919 2024-09-12T02:42:30.331 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20231030 -> 20231030 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20231111 -> 20231111 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20231211 -> 20231211 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240115 -> 20240115 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240220 -> 20240220 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240312 -> 20240312 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240410 -> 20240410 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240513 -> 20240513 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240610 -> 20240610 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240709 -> 20240709 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240811 -> 20240811 2024-09-12T02:42:30.332 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240909 -> 20240909 2024-09-12T02:42:35.052 INFO:teuthology.orchestra.run.smithi063.stderr:Updating files: 29% (1022/3501) Updating files: 30% (1051/3501) Updating files: 31% (1086/3501) Updating files: 32% (1121/3501) Updating files: 33% (1156/3501) Updating files: 34% (1191/3501) Updating files: 35% (1226/3501) Updating files: 36% (1261/3501) Updating files: 37% (1296/3501) Updating files: 38% (1331/3501) Updating files: 39% (1366/3501) Updating files: 40% (1401/3501) Updating files: 41% (1436/3501) Updating files: 42% (1471/3501) Updating files: 43% (1506/3501) Updating files: 44% (1541/3501) Updating files: 45% (1576/3501) Updating files: 46% (1611/3501) Updating files: 47% (1646/3501) Updating files: 48% (1681/3501) Updating files: 49% (1716/3501) Updating files: 50% (1751/3501) Updating files: 51% (1786/3501) Updating files: 52% (1821/3501) Updating files: 53% (1856/3501) Updating files: 54% (1891/3501) Updating files: 55% (1926/3501) Updating files: 56% (1961/3501) Updating files: 57% (1996/3501) Updating files: 58% (2031/3501) Updating files: 58% (2049/3501) Updating files: 59% (2066/3501) Updating files: 60% (2101/3501) Updating files: 61% (2136/3501) Updating files: 62% (2171/3501) Updating files: 63% (2206/3501) Updating files: 64% (2241/3501) Updating files: 65% (2276/3501) Updating files: 66% (2311/3501) Updating files: 67% (2346/3501) Updating files: 68% (2381/3501) Updating files: 69% (2416/3501) Updating files: 69% (2417/3501) Updating files: 70% (2451/3501) Updating files: 71% (2486/3501) Updating files: 72% (2521/3501) Updating files: 73% (2556/3501) Updating files: 74% (2591/3501) Updating files: 75% (2626/3501) Updating files: 76% (2661/3501) Updating files: 77% (2696/3501) Updating files: 78% (2731/3501) Updating files: 79% (2766/3501) Updating files: 80% (2801/3501) Updating files: 81% (2836/3501) Updating files: 82% (2871/3501) Updating files: 82% (2878/3501) Updating files: 83% (2906/3501) Updating files: 84% (2941/3501) Updating files: 85% (2976/3501) Updating files: 86% (3011/3501) Updating files: 87% (3046/3501) Updating files: 88% (3081/3501) Updating files: 89% (3116/3501) Updating files: 90% (3151/3501) Updating files: 91% (3186/3501) Updating files: 92% (3221/3501) Updating files: 93% (3256/3501) Updating files: 94% (3291/3501) Updating files: 95% (3326/3501) Updating files: 96% (3361/3501) Updating files: 97% (3396/3501) Updating files: 98% (3431/3501) Updating files: 99% (3466/3501) Updating files: 100% (3501/3501) Updating files: 100% (3501/3501), done. 2024-09-12T02:42:35.057 INFO:teuthology.orchestra.run.smithi063.stdout:HEAD is now at 4a0367b3 Merge branch 'rtl8852b' into 'main' 2024-09-12T02:42:35.080 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T02:42:35.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T02:42:35.224 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-12T02:42:35.225 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-12T02:42:35.227 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi063.front.sepia.ceph.com to complete... 2024-09-12T02:42:36.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12 02:42:36 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-12T02:42:36.239 INFO:teuthology.orchestra.run.smithi063.stderr:FINISHED --2024-09-12 02:42:36-- 2024-09-12T02:42:36.239 INFO:teuthology.orchestra.run.smithi063.stderr:Total wall clock time: 1.0s 2024-09-12T02:42:36.240 INFO:teuthology.orchestra.run.smithi063.stderr:Downloaded: 1 files, 43M in 0.8s (51.7 MB/s) 2024-09-12T02:42:36.244 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T02:42:36.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo dpkg -i /tmp/linux-image.deb 2024-09-12T02:42:36.528 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-12T02:42:38.462 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-12T02:42:38.466 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-12T02:42:38.581 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-12T02:42:42.557 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-12T02:42:42.644 INFO:teuthology.orchestra.run.smithi063.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:04.767 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub' 2024-09-12T02:43:04.781 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T02:43:04.805 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-12T02:43:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:05.118 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:05.370 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T02:43:05.381 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T02:43:05.447 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T02:43:05.453 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T02:43:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T02:43:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T02:43:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T02:43:05.617 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-12T02:43:05.780 DEBUG:teuthology.orchestra.run.smithi063:> dpkg-deb -c /tmp/linux-image.deb 2024-09-12T02:43:05.787 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-12T02:43:05.788 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-12T02:43:05.788 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:05.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:05.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-12T02:43:05.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T02:43:05.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-12T02:43:05.826 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-12T02:43:05.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T02:43:05.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-12T02:43:05.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-12T02:43:05.827 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-12T02:43:05.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T02:43:05.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T02:43:05.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-12T02:43:05.843 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T02:43:05.844 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T02:43:05.845 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T02:43:05.846 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-12T02:43:05.847 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T02:43:05.848 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T02:43:05.849 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T02:43:05.850 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T02:43:05.851 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T02:43:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-12T02:43:05.853 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T02:43:05.854 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T02:43:05.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T02:43:05.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-12T02:43:05.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-12T02:43:05.858 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-12T02:43:05.859 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T02:43:05.905 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T02:43:05.906 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T02:43:05.907 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-12T02:43:05.908 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-12T02:43:05.909 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T02:43:05.910 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-12T02:43:05.911 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T02:43:05.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-12T02:43:05.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T02:43:05.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T02:43:05.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T02:43:05.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T02:43:05.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T02:43:05.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T02:43:05.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T02:43:05.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T02:43:05.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T02:43:05.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T02:43:05.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T02:43:05.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T02:43:05.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T02:43:05.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T02:43:05.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-12T02:43:05.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T02:43:05.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T02:43:05.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-12T02:43:05.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-12T02:43:05.932 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-12T02:43:05.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-12T02:43:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-12T02:43:05.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-12T02:43:05.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T02:43:05.937 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-12T02:43:05.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-12T02:43:05.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T02:43:05.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T02:43:05.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-12T02:43:05.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T02:43:05.943 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-12T02:43:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-12T02:43:05.945 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-12T02:43:05.946 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-12T02:43:05.947 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-12T02:43:05.948 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T02:43:05.949 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T02:43:05.950 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T02:43:05.951 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T02:43:05.952 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-12T02:43:05.953 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-12T02:43:05.954 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T02:43:05.955 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-12T02:43:05.956 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-12T02:43:05.957 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-12T02:43:05.957 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T02:43:05.957 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-12T02:43:05.957 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T02:43:05.957 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-12T02:43:05.957 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T02:43:06.022 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-12T02:43:06.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-12T02:43:06.024 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T02:43:06.025 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T02:43:06.026 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-12T02:43:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-12T02:43:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T02:43:06.029 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-12T02:43:06.030 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T02:43:06.031 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T02:43:06.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-12T02:43:06.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T02:43:06.034 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T02:43:06.035 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-12T02:43:06.036 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-12T02:43:06.037 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-12T02:43:06.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T02:43:06.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T02:43:06.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-12T02:43:06.041 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-12T02:43:06.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T02:43:06.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-12T02:43:06.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T02:43:06.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T02:43:06.046 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T02:43:06.047 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-12T02:43:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T02:43:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-12T02:43:06.050 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-12T02:43:06.051 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-12T02:43:06.052 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-12T02:43:06.053 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T02:43:06.054 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T02:43:06.055 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T02:43:06.056 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T02:43:06.057 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-12T02:43:06.058 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-12T02:43:06.059 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-12T02:43:06.060 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-12T02:43:06.061 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T02:43:06.062 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-12T02:43:06.063 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-12T02:43:06.064 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-12T02:43:06.065 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-12T02:43:06.066 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-12T02:43:06.067 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-12T02:43:06.068 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T02:43:06.069 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-12T02:43:06.070 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T02:43:06.071 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T02:43:06.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T02:43:06.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T02:43:06.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-12T02:43:06.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T02:43:06.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-12T02:43:06.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-12T02:43:06.078 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T02:43:06.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-12T02:43:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T02:43:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-12T02:43:06.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-12T02:43:06.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-12T02:43:06.084 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-12T02:43:06.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-12T02:43:06.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-12T02:43:06.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T02:43:06.088 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-12T02:43:06.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T02:43:06.134 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-12T02:43:06.134 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T02:43:06.134 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-12T02:43:06.135 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T02:43:06.136 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T02:43:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T02:43:06.138 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T02:43:06.139 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T02:43:06.140 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T02:43:06.141 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-12T02:43:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-12T02:43:06.143 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-12T02:43:06.144 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T02:43:06.145 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T02:43:06.146 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-12T02:43:06.146 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T02:43:06.146 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-12T02:43:06.146 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-12T02:43:06.146 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-12T02:43:06.148 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-12T02:43:06.148 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-12T02:43:06.148 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T02:43:06.148 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-12T02:43:06.148 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-12T02:43:06.148 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-12T02:43:06.149 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T02:43:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T02:43:06.151 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T02:43:06.152 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-12T02:43:06.153 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T02:43:06.154 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T02:43:06.155 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-12T02:43:06.156 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-12T02:43:06.157 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T02:43:06.158 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-12T02:43:06.159 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T02:43:06.160 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T02:43:06.161 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T02:43:06.162 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T02:43:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T02:43:06.164 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T02:43:06.165 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T02:43:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T02:43:06.167 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T02:43:06.168 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T02:43:06.169 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T02:43:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T02:43:06.171 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T02:43:06.172 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T02:43:06.173 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T02:43:06.174 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-12T02:43:06.175 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T02:43:06.176 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T02:43:06.177 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T02:43:06.178 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T02:43:06.179 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-12T02:43:06.180 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T02:43:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T02:43:06.182 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-12T02:43:06.183 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-12T02:43:06.188 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:06.189 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:06.189 DEBUG:teuthology.orchestra.run.smithi063:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-12T02:43:06.195 INFO:teuthology.orchestra.run.smithi063.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-12T02:43:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-12T02:43:06.195 INFO:teuthology.orchestra.run.smithi063.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-12T02:43:06.196 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-12T02:43:06.196 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:06.196 DEBUG:teuthology.orchestra.run.smithi063:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-12T02:43:06.241 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi063.front.sepia.ceph.com to complete... 2024-09-12T02:43:06.648 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub' 2024-09-12T02:43:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T02:43:06.668 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-12T02:43:06.850 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:06.855 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:43:07.077 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T02:43:07.082 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T02:43:07.122 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T02:43:07.127 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T02:43:07.229 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T02:43:07.229 INFO:teuthology.orchestra.run.smithi063.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T02:43:07.229 INFO:teuthology.orchestra.run.smithi063.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T02:43:07.238 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-12T02:43:08.367 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-09-12T02:43:38.369 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T02:43:38.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T02:43:38.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:43:56.864 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-12T02:44:05.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T02:44:05.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:44:08.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-12T02:44:21.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T02:44:21.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:44:39.613 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-12T02:44:54.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T02:44:54.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:44:54.940 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-12T02:44:56.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T02:44:56.259 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T02:44:56.259 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-12T02:44:56.309 INFO:teuthology.orchestra.run.smithi063.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:44:56.309 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T02:44:56.310 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T02:44:56.310 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T02:44:57.311 DEBUG:teuthology.parallel:result is None 2024-09-12T02:44:57.311 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T02:44:57.318 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T02:44:57.318 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:44:57.321 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T02:44:57.341 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T02:44:57.348 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T02:44:57.358 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T02:44:57.359 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:44:57.385 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T02:44:57.508 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T02:44:57.515 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T02:44:57.515 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T02:44:57.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:44:57.520 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:44:57.523 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T02:44:57.585 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:44:57.600 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:44:57.706 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:44:57.724 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T02:44:57.726 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T02:44:57.738 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T02:44:57.738 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:44:57.741 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T02:44:57.758 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T02:44:57.768 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T02:44:57.768 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:44:57.802 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T02:44:57.808 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:44:57.859 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:44:57.911 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:44:57.911 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:44:57.984 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T02:44:57.990 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T02:44:58.038 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:44:58.039 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T02:44:58.096 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-09-12T02:44:58.099 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-09-12T02:44:58.209 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T02:44:58.218 INFO:teuthology.task.internal:Starting timer... 2024-09-12T02:44:58.218 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T02:44:58.267 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T02:44:58.278 DEBUG:teuthology.task.selinux:Excluding smithi063: OS 'ubuntu' does not support SELinux 2024-09-12T02:44:58.278 DEBUG:teuthology.task.selinux:Excluding smithi119: OS 'ubuntu' does not support SELinux 2024-09-12T02:44:58.278 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T02:44:58.278 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T02:44:58.279 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T02:44:58.279 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T02:44:58.287 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T02:44:58.290 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T02:44:58.398 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T02:44:58.409 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T02:44:58.410 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:53:16.432 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2024-09-12T02:53:16.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T02:53:16.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:53:16.516 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-12T02:53:16.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-12T02:53:16.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T02:53:16.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:53:16.708 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-12T02:53:16.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-12T02:53:16.813 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:53:16.829 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:53:16.830 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:53:16.830 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:53:16.833 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:53:16.833 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:53:16.869 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T02:53:16.869 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: Command line: ntpd -gq 2024-09-12T02:53:16.869 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: ---------------------------------------------------- 2024-09-12T02:53:16.869 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T02:53:16.869 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T02:53:16.869 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: corporation. Support and training for ntp-4 are 2024-09-12T02:53:16.869 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: available at https://www.nwtime.org/support 2024-09-12T02:53:16.869 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: ---------------------------------------------------- 2024-09-12T02:53:16.870 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: proto: precision = 0.044 usec (-24) 2024-09-12T02:53:16.870 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: basedate set to 2022-02-04 2024-09-12T02:53:16.870 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: gps base set to 2022-02-06 (week 2196) 2024-09-12T02:53:16.870 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T02:53:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T02:53:16.871 INFO:teuthology.orchestra.run.smithi063.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T02:53:16.871 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T02:53:16.872 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T02:53:16.872 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T02:53:16.872 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T02:53:16.872 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: Listen normally on 3 enp3s0f1 172.21.15.63:123 2024-09-12T02:53:16.873 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: Listen normally on 4 lo [::1]:123 2024-09-12T02:53:16.873 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8d7%5]:123 2024-09-12T02:53:16.873 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:16 ntpd[18480]: Listening on routing socket on fd #22 for interface updates 2024-09-12T02:53:16.884 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T02:53:16.885 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: Command line: ntpd -gq 2024-09-12T02:53:16.885 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: ---------------------------------------------------- 2024-09-12T02:53:16.885 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T02:53:16.885 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T02:53:16.885 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: corporation. Support and training for ntp-4 are 2024-09-12T02:53:16.885 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: available at https://www.nwtime.org/support 2024-09-12T02:53:16.885 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: ---------------------------------------------------- 2024-09-12T02:53:16.886 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: proto: precision = 0.044 usec (-24) 2024-09-12T02:53:16.886 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: basedate set to 2022-02-04 2024-09-12T02:53:16.886 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: gps base set to 2022-02-06 (week 2196) 2024-09-12T02:53:16.886 INFO:teuthology.orchestra.run.smithi119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T02:53:16.887 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T02:53:16.887 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T02:53:16.887 INFO:teuthology.orchestra.run.smithi119.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T02:53:16.888 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T02:53:16.888 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T02:53:16.888 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T02:53:16.888 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: Listen normally on 3 enp3s0f1 172.21.15.119:123 2024-09-12T02:53:16.888 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: Listen normally on 4 lo [::1]:123 2024-09-12T02:53:16.888 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5ef%5]:123 2024-09-12T02:53:16.888 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:16 ntpd[18897]: Listening on routing socket on fd #22 for interface updates 2024-09-12T02:53:17.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:17.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:17 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:17.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:17 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:17.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:17 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:17.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:17 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:17.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:17 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:17.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:17 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:17.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:17 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:17.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:17 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:17.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:17 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:18.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:18 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:18.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:18 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:18.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:18 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:18.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:18 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:18.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:18 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:18.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:18 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:19.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:19.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:19.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:19.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:19.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:19.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:19.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:19.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:19.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:19.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:19.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:19.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:19 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:19.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:19.887 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:19.887 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:19 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:20 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:20 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:20 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:20 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:20 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:20 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:20 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:20 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:20.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:20 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:20.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:20 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:20.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:20 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:20.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:20 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:20.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:20 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:20.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:20 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:21.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:21.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:21.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:21.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:21.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:21.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:21.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:21.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:21.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:21.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:21.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:21.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:21 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:21.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:21.887 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:21 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:22.869 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:22 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:22 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:22 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:22 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:22 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:22.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:22 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:22.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:22 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:22.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:22 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:22.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:22 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:22.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:22 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:22.885 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:22 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:22.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:22 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:23.869 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:23.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:23.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:23.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:23.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:23.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:23.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:23.870 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:23.870 INFO:teuthology.orchestra.run.smithi063.stdout:12 Sep 02:53:23 ntpd[18480]: ntpd: time slew +0.000725 s 2024-09-12T02:53:23.870 INFO:teuthology.orchestra.run.smithi063.stdout:ntpd: time slew +0.000725s 2024-09-12T02:53:23.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T02:53:23.871 INFO:teuthology.orchestra.run.smithi063.stderr:12 Sep 02:53:23 ntpd[18480]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T02:53:23.886 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T02:53:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:12 Sep 02:53:23 ntpd[18897]: ntpd: time slew -0.004879 s 2024-09-12T02:53:23.887 INFO:teuthology.orchestra.run.smithi119.stdout:ntpd: time slew -0.004879s 2024-09-12T02:53:23.887 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T02:53:23.887 INFO:teuthology.orchestra.run.smithi119.stderr:12 Sep 02:53:23 ntpd[18897]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T02:53:23.956 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T02:53:23.956 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2024-09-12T02:53:23.956 INFO:teuthology.orchestra.run.smithi063.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T02:53:23.956 INFO:teuthology.orchestra.run.smithi063.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T02:53:23.956 INFO:teuthology.orchestra.run.smithi063.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T02:53:23.956 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T02:53:24.054 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T02:53:24.054 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-09-12T02:53:24.054 INFO:teuthology.orchestra.run.smithi119.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T02:53:24.054 INFO:teuthology.orchestra.run.smithi119.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T02:53:24.054 INFO:teuthology.orchestra.run.smithi119.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T02:53:24.054 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T02:53:24.055 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:53:24.063 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:53:24.064 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:53:24.064 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:53:24.064 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:53:24.069 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:53:24.069 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:53:24.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-key list | grep Ceph 2024-09-12T02:53:24.070 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-key list | grep Ceph 2024-09-12T02:53:24.154 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T02:53:24.178 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T02:53:24.181 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T02:53:24.181 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-12T02:53:24.181 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-12T02:53:24.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:53:24.231 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T02:53:24.231 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T02:53:24.232 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-12T02:53:24.232 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-12T02:53:24.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:53:24.335 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-12T02:53:24.336 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T02:53:24.371 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-12T02:53:24.371 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T02:53:24.449 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:53:24.449 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T02:53:24.463 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2024-09-12T02:53:24.484 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:53:24.484 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T02:53:24.504 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2024-09-12T02:53:24.685 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T02:53:24.687 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T02:53:24.693 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T02:53:24.707 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-12T02:53:24.710 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T02:53:24.730 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T02:53:24.737 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T02:53:24.758 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-12T02:53:24.759 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T02:53:24.759 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-12T02:53:24.771 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T02:53:24.781 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T02:53:24.788 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-12T02:53:24.801 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-12T02:53:24.813 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T02:53:24.831 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T02:53:24.834 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-12T02:53:24.913 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T02:53:25.132 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 29.0 kB in 0s (59.8 kB/s) 2024-09-12T02:53:25.306 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 29.0 kB in 1s (50.7 kB/s) 2024-09-12T02:53:26.161 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T02:53:26.179 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy cephfs-shell=19.1.1-298-gb53b6d3e-1jammy cephfs-top=19.1.1-298-gb53b6d3e-1jammy cephfs-mirror=19.1.1-298-gb53b6d3e-1jammy 2024-09-12T02:53:26.243 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T02:53:26.388 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-12T02:53:26.403 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy cephfs-shell=19.1.1-298-gb53b6d3e-1jammy cephfs-top=19.1.1-298-gb53b6d3e-1jammy cephfs-mirror=19.1.1-298-gb53b6d3e-1jammy 2024-09-12T02:53:26.441 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-09-12T02:53:26.441 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-09-12T02:53:26.483 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-12T02:53:26.623 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T02:53:26.623 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T02:53:26.623 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T02:53:26.623 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T02:53:26.624 INFO:teuthology.orchestra.run.smithi119.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T02:53:26.624 INFO:teuthology.orchestra.run.smithi119.stdout: python2.7-minimal 2024-09-12T02:53:26.624 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T02:53:26.624 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-09-12T02:53:26.625 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T02:53:26.625 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T02:53:26.625 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T02:53:26.625 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T02:53:26.626 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T02:53:26.626 INFO:teuthology.orchestra.run.smithi119.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T02:53:26.626 INFO:teuthology.orchestra.run.smithi119.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T02:53:26.626 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T02:53:26.626 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T02:53:26.626 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-12T02:53:26.626 INFO:teuthology.orchestra.run.smithi119.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-12T02:53:26.627 INFO:teuthology.orchestra.run.smithi119.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2024-09-12T02:53:26.628 INFO:teuthology.orchestra.run.smithi119.stdout: btrfs-tools 2024-09-12T02:53:26.677 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-09-12T02:53:26.678 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-09-12T02:53:26.734 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-09-12T02:53:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T02:53:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T02:53:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-12T02:53:26.734 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-12T02:53:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T02:53:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-12T02:53:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-12T02:53:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-12T02:53:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T02:53:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T02:53:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-12T02:53:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-12T02:53:26.736 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T02:53:26.737 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-12T02:53:26.738 INFO:teuthology.orchestra.run.smithi119.stdout: socat unzip xmlstarlet zip 2024-09-12T02:53:26.795 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-09-12T02:53:26.796 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 181 MB of archives. 2024-09-12T02:53:26.796 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-12T02:53:26.796 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-12T02:53:26.813 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T02:53:26.823 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-12T02:53:26.864 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T02:53:26.877 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T02:53:26.877 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T02:53:26.877 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T02:53:26.877 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T02:53:26.878 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T02:53:26.878 INFO:teuthology.orchestra.run.smithi063.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T02:53:26.878 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T02:53:26.878 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-12T02:53:26.879 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2024-09-12T02:53:26.879 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T02:53:26.879 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T02:53:26.879 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T02:53:26.880 INFO:teuthology.orchestra.run.smithi063.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T02:53:26.881 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T02:53:26.881 INFO:teuthology.orchestra.run.smithi063.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T02:53:26.881 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T02:53:26.881 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T02:53:26.881 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T02:53:26.881 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-12T02:53:26.881 INFO:teuthology.orchestra.run.smithi063.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-12T02:53:26.882 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-12T02:53:26.883 INFO:teuthology.orchestra.run.smithi063.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-12T02:53:26.883 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2024-09-12T02:53:26.883 INFO:teuthology.orchestra.run.smithi063.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T02:53:26.883 INFO:teuthology.orchestra.run.smithi063.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T02:53:26.883 INFO:teuthology.orchestra.run.smithi063.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T02:53:26.883 INFO:teuthology.orchestra.run.smithi063.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T02:53:26.883 INFO:teuthology.orchestra.run.smithi063.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T02:53:26.883 INFO:teuthology.orchestra.run.smithi063.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T02:53:26.884 INFO:teuthology.orchestra.run.smithi063.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T02:53:26.884 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2024-09-12T02:53:26.884 INFO:teuthology.orchestra.run.smithi063.stdout: btrfs-tools 2024-09-12T02:53:26.885 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T02:53:26.888 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T02:53:26.899 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T02:53:26.948 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T02:53:26.953 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T02:53:26.963 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T02:53:26.967 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T02:53:26.968 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T02:53:26.975 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T02:53:26.977 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T02:53:26.979 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T02:53:26.981 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T02:53:26.981 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T02:53:26.986 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T02:53:26.989 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T02:53:26.990 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T02:53:27.003 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T02:53:27.004 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T02:53:27.005 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T02:53:27.005 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T02:53:27.005 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T02:53:27.006 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T02:53:27.006 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T02:53:27.020 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T02:53:27.021 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T02:53:27.023 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T02:53:27.038 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T02:53:27.038 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T02:53:27.038 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T02:53:27.039 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T02:53:27.040 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T02:53:27.040 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T02:53:27.041 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T02:53:27.043 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2024-09-12T02:53:27.043 INFO:teuthology.orchestra.run.smithi063.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T02:53:27.044 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T02:53:27.044 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-12T02:53:27.045 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-12T02:53:27.045 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T02:53:27.045 INFO:teuthology.orchestra.run.smithi063.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T02:53:27.046 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-12T02:53:27.047 INFO:teuthology.orchestra.run.smithi063.stdout: socat unzip xmlstarlet zip 2024-09-12T02:53:27.055 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T02:53:27.055 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T02:53:27.060 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-12T02:53:27.060 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T02:53:27.071 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T02:53:27.072 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T02:53:27.073 INFO:teuthology.orchestra.run.smithi119.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T02:53:27.074 INFO:teuthology.orchestra.run.smithi119.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T02:53:27.076 INFO:teuthology.orchestra.run.smithi119.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T02:53:27.077 INFO:teuthology.orchestra.run.smithi119.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T02:53:27.078 INFO:teuthology.orchestra.run.smithi119.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T02:53:27.089 INFO:teuthology.orchestra.run.smithi119.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T02:53:27.091 INFO:teuthology.orchestra.run.smithi119.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T02:53:27.091 INFO:teuthology.orchestra.run.smithi119.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T02:53:27.105 INFO:teuthology.orchestra.run.smithi119.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-12T02:53:27.106 INFO:teuthology.orchestra.run.smithi119.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T02:53:27.108 INFO:teuthology.orchestra.run.smithi119.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T02:53:27.115 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-09-12T02:53:27.116 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 181 MB of archives. 2024-09-12T02:53:27.116 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-12T02:53:27.116 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-12T02:53:27.116 INFO:teuthology.orchestra.run.smithi119.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-12T02:53:27.122 INFO:teuthology.orchestra.run.smithi119.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-12T02:53:27.122 INFO:teuthology.orchestra.run.smithi119.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-12T02:53:27.125 INFO:teuthology.orchestra.run.smithi119.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-12T02:53:27.126 INFO:teuthology.orchestra.run.smithi119.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-12T02:53:27.132 INFO:teuthology.orchestra.run.smithi119.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-12T02:53:27.133 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T02:53:27.143 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-12T02:53:27.162 INFO:teuthology.orchestra.run.smithi119.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T02:53:27.162 INFO:teuthology.orchestra.run.smithi119.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T02:53:27.163 INFO:teuthology.orchestra.run.smithi119.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T02:53:27.163 INFO:teuthology.orchestra.run.smithi119.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T02:53:27.165 INFO:teuthology.orchestra.run.smithi119.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T02:53:27.182 INFO:teuthology.orchestra.run.smithi119.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T02:53:27.183 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T02:53:27.184 INFO:teuthology.orchestra.run.smithi119.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T02:53:27.184 INFO:teuthology.orchestra.run.smithi119.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T02:53:27.199 INFO:teuthology.orchestra.run.smithi119.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T02:53:27.199 INFO:teuthology.orchestra.run.smithi119.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T02:53:27.199 INFO:teuthology.orchestra.run.smithi119.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T02:53:27.200 INFO:teuthology.orchestra.run.smithi119.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T02:53:27.200 INFO:teuthology.orchestra.run.smithi119.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T02:53:27.200 INFO:teuthology.orchestra.run.smithi119.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T02:53:27.204 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T02:53:27.207 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T02:53:27.214 INFO:teuthology.orchestra.run.smithi119.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T02:53:27.214 INFO:teuthology.orchestra.run.smithi119.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T02:53:27.217 INFO:teuthology.orchestra.run.smithi119.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T02:53:27.218 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T02:53:27.231 INFO:teuthology.orchestra.run.smithi119.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T02:53:27.233 INFO:teuthology.orchestra.run.smithi119.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T02:53:27.234 INFO:teuthology.orchestra.run.smithi119.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T02:53:27.236 INFO:teuthology.orchestra.run.smithi119.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T02:53:27.239 INFO:teuthology.orchestra.run.smithi119.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-12T02:53:27.239 INFO:teuthology.orchestra.run.smithi119.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T02:53:27.240 INFO:teuthology.orchestra.run.smithi119.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T02:53:27.246 INFO:teuthology.orchestra.run.smithi119.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-12T02:53:27.248 INFO:teuthology.orchestra.run.smithi119.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-12T02:53:27.250 INFO:teuthology.orchestra.run.smithi119.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T02:53:27.254 INFO:teuthology.orchestra.run.smithi119.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T02:53:27.255 INFO:teuthology.orchestra.run.smithi119.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T02:53:27.255 INFO:teuthology.orchestra.run.smithi119.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-12T02:53:27.260 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T02:53:27.262 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T02:53:27.264 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-12T02:53:27.267 INFO:teuthology.orchestra.run.smithi119.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T02:53:27.267 INFO:teuthology.orchestra.run.smithi119.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T02:53:27.268 INFO:teuthology.orchestra.run.smithi119.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T02:53:27.268 INFO:teuthology.orchestra.run.smithi119.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T02:53:27.269 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T02:53:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T02:53:27.270 INFO:teuthology.orchestra.run.smithi119.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T02:53:27.272 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T02:53:27.273 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T02:53:27.276 INFO:teuthology.orchestra.run.smithi119.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T02:53:27.279 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T02:53:27.281 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T02:53:27.283 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T02:53:27.284 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T02:53:27.284 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T02:53:27.285 INFO:teuthology.orchestra.run.smithi119.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T02:53:27.285 INFO:teuthology.orchestra.run.smithi119.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T02:53:27.286 INFO:teuthology.orchestra.run.smithi119.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T02:53:27.296 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T02:53:27.298 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T02:53:27.299 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T02:53:27.300 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T02:53:27.301 INFO:teuthology.orchestra.run.smithi119.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T02:53:27.312 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T02:53:27.313 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T02:53:27.314 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T02:53:27.314 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T02:53:27.314 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T02:53:27.315 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T02:53:27.330 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T02:53:27.330 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T02:53:27.332 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T02:53:27.333 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T02:53:27.346 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T02:53:27.347 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T02:53:27.347 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T02:53:27.348 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T02:53:27.348 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T02:53:27.349 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T02:53:27.363 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T02:53:27.364 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T02:53:27.369 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T02:53:27.369 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T02:53:27.380 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T02:53:27.381 INFO:teuthology.orchestra.run.smithi063.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T02:53:27.382 INFO:teuthology.orchestra.run.smithi063.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T02:53:27.383 INFO:teuthology.orchestra.run.smithi063.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T02:53:27.384 INFO:teuthology.orchestra.run.smithi063.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T02:53:27.385 INFO:teuthology.orchestra.run.smithi063.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T02:53:27.397 INFO:teuthology.orchestra.run.smithi063.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T02:53:27.399 INFO:teuthology.orchestra.run.smithi063.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T02:53:27.399 INFO:teuthology.orchestra.run.smithi063.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T02:53:27.400 INFO:teuthology.orchestra.run.smithi063.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T02:53:27.414 INFO:teuthology.orchestra.run.smithi063.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T02:53:27.462 INFO:teuthology.orchestra.run.smithi063.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T02:53:27.463 INFO:teuthology.orchestra.run.smithi063.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T02:53:27.465 INFO:teuthology.orchestra.run.smithi063.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T02:53:27.465 INFO:teuthology.orchestra.run.smithi063.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T02:53:27.467 INFO:teuthology.orchestra.run.smithi063.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T02:53:27.488 INFO:teuthology.orchestra.run.smithi063.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T02:53:27.489 INFO:teuthology.orchestra.run.smithi063.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T02:53:27.489 INFO:teuthology.orchestra.run.smithi063.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T02:53:27.507 INFO:teuthology.orchestra.run.smithi063.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T02:53:27.507 INFO:teuthology.orchestra.run.smithi063.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T02:53:27.508 INFO:teuthology.orchestra.run.smithi063.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T02:53:27.509 INFO:teuthology.orchestra.run.smithi063.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T02:53:27.509 INFO:teuthology.orchestra.run.smithi063.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T02:53:27.510 INFO:teuthology.orchestra.run.smithi063.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T02:53:27.515 INFO:teuthology.orchestra.run.smithi063.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T02:53:27.516 INFO:teuthology.orchestra.run.smithi063.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T02:53:27.519 INFO:teuthology.orchestra.run.smithi063.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T02:53:27.532 INFO:teuthology.orchestra.run.smithi063.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T02:53:27.534 INFO:teuthology.orchestra.run.smithi063.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T02:53:27.535 INFO:teuthology.orchestra.run.smithi063.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T02:53:27.538 INFO:teuthology.orchestra.run.smithi063.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T02:53:27.541 INFO:teuthology.orchestra.run.smithi063.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-12T02:53:27.541 INFO:teuthology.orchestra.run.smithi063.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T02:53:27.542 INFO:teuthology.orchestra.run.smithi063.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T02:53:27.549 INFO:teuthology.orchestra.run.smithi063.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T02:53:27.553 INFO:teuthology.orchestra.run.smithi063.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T02:53:27.554 INFO:teuthology.orchestra.run.smithi063.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T02:53:27.566 INFO:teuthology.orchestra.run.smithi063.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T02:53:27.566 INFO:teuthology.orchestra.run.smithi063.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T02:53:27.567 INFO:teuthology.orchestra.run.smithi063.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T02:53:27.568 INFO:teuthology.orchestra.run.smithi063.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T02:53:27.569 INFO:teuthology.orchestra.run.smithi063.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T02:53:27.570 INFO:teuthology.orchestra.run.smithi063.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T02:53:27.577 INFO:teuthology.orchestra.run.smithi063.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T02:53:27.583 INFO:teuthology.orchestra.run.smithi063.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T02:53:27.583 INFO:teuthology.orchestra.run.smithi063.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T02:53:27.585 INFO:teuthology.orchestra.run.smithi063.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T02:53:27.599 INFO:teuthology.orchestra.run.smithi063.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T02:53:27.760 INFO:teuthology.orchestra.run.smithi119.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-12T02:53:27.814 INFO:teuthology.orchestra.run.smithi119.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-12T02:53:27.817 INFO:teuthology.orchestra.run.smithi119.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-12T02:53:27.818 INFO:teuthology.orchestra.run.smithi119.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-12T02:53:27.836 INFO:teuthology.orchestra.run.smithi119.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-12T02:53:27.944 INFO:teuthology.orchestra.run.smithi119.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-12T02:53:28.251 INFO:teuthology.orchestra.run.smithi063.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-12T02:53:28.431 INFO:teuthology.orchestra.run.smithi119.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-12T02:53:28.431 INFO:teuthology.orchestra.run.smithi119.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-12T02:53:28.441 INFO:teuthology.orchestra.run.smithi119.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-12T02:53:28.470 INFO:teuthology.orchestra.run.smithi119.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-12T02:53:28.479 INFO:teuthology.orchestra.run.smithi119.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-12T02:53:28.481 INFO:teuthology.orchestra.run.smithi119.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-12T02:53:28.501 INFO:teuthology.orchestra.run.smithi119.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-12T02:53:28.584 INFO:teuthology.orchestra.run.smithi063.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-12T02:53:28.646 INFO:teuthology.orchestra.run.smithi063.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-12T02:53:28.666 INFO:teuthology.orchestra.run.smithi119.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-12T02:53:28.666 INFO:teuthology.orchestra.run.smithi119.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-12T02:53:28.701 INFO:teuthology.orchestra.run.smithi063.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-12T02:53:28.702 INFO:teuthology.orchestra.run.smithi063.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-12T02:53:28.704 INFO:teuthology.orchestra.run.smithi063.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-12T02:53:28.706 INFO:teuthology.orchestra.run.smithi063.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-12T02:53:28.762 INFO:teuthology.orchestra.run.smithi063.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-12T02:53:29.381 INFO:teuthology.orchestra.run.smithi063.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-12T02:53:29.382 INFO:teuthology.orchestra.run.smithi063.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-12T02:53:29.439 INFO:teuthology.orchestra.run.smithi063.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-12T02:53:29.989 INFO:teuthology.orchestra.run.smithi119.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-12T02:53:29.992 INFO:teuthology.orchestra.run.smithi119.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-298-gb53b6d3e-1jammy [237 kB] 2024-09-12T02:53:29.996 INFO:teuthology.orchestra.run.smithi119.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-298-gb53b6d3e-1jammy [34.0 kB] 2024-09-12T02:53:29.997 INFO:teuthology.orchestra.run.smithi119.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-298-gb53b6d3e-1jammy [23.5 kB] 2024-09-12T02:53:29.998 INFO:teuthology.orchestra.run.smithi119.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-12T02:53:29.999 INFO:teuthology.orchestra.run.smithi119.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-12T02:53:30.268 INFO:teuthology.orchestra.run.smithi063.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-12T02:53:30.351 INFO:teuthology.orchestra.run.smithi119.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-12T02:53:30.386 INFO:teuthology.orchestra.run.smithi063.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-12T02:53:30.388 INFO:teuthology.orchestra.run.smithi063.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-12T02:53:30.391 INFO:teuthology.orchestra.run.smithi063.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-12T02:53:30.417 INFO:teuthology.orchestra.run.smithi063.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-12T02:53:30.519 INFO:teuthology.orchestra.run.smithi063.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-12T02:53:30.898 INFO:teuthology.orchestra.run.smithi063.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-12T02:53:30.899 INFO:teuthology.orchestra.run.smithi063.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-12T02:53:30.905 INFO:teuthology.orchestra.run.smithi063.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-12T02:53:30.947 INFO:teuthology.orchestra.run.smithi063.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-12T02:53:30.959 INFO:teuthology.orchestra.run.smithi063.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-12T02:53:30.961 INFO:teuthology.orchestra.run.smithi063.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-12T02:53:30.983 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 181 MB in 4s (50.3 MB/s) 2024-09-12T02:53:31.000 INFO:teuthology.orchestra.run.smithi063.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-12T02:53:31.125 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-12T02:53:31.143 INFO:teuthology.orchestra.run.smithi063.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-12T02:53:31.143 INFO:teuthology.orchestra.run.smithi063.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-12T02:53:31.206 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-09-12T02:53:31.210 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-12T02:53:31.249 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-12T02:53:31.551 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T02:53:31.572 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T02:53:31.610 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T02:53:31.888 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cmd2. 2024-09-12T02:53:31.908 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-12T02:53:31.946 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-12T02:53:31.999 INFO:teuthology.orchestra.run.smithi063.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-12T02:53:32.000 INFO:teuthology.orchestra.run.smithi063.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-298-gb53b6d3e-1jammy [237 kB] 2024-09-12T02:53:32.002 INFO:teuthology.orchestra.run.smithi063.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-298-gb53b6d3e-1jammy [34.0 kB] 2024-09-12T02:53:32.003 INFO:teuthology.orchestra.run.smithi063.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-298-gb53b6d3e-1jammy [23.5 kB] 2024-09-12T02:53:32.003 INFO:teuthology.orchestra.run.smithi063.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-12T02:53:32.004 INFO:teuthology.orchestra.run.smithi063.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-12T02:53:32.218 INFO:teuthology.orchestra.run.smithi063.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-12T02:53:32.266 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T02:53:32.286 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T02:53:32.349 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T02:53:32.696 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T02:53:32.715 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T02:53:32.753 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T02:53:32.897 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 181 MB in 5s (35.2 MB/s) 2024-09-12T02:53:33.027 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-12T02:53:33.081 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T02:53:33.094 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-12T02:53:33.098 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-12T02:53:33.101 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T02:53:33.134 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-12T02:53:33.139 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T02:53:33.403 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T02:53:33.417 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T02:53:33.461 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T02:53:33.518 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T02:53:33.538 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T02:53:33.575 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:53:33.781 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cmd2. 2024-09-12T02:53:33.795 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-12T02:53:33.839 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-12T02:53:33.979 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T02:53:33.999 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T02:53:34.037 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:53:34.208 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T02:53:34.223 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T02:53:34.309 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T02:53:34.374 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T02:53:34.394 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T02:53:34.432 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:53:34.595 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T02:53:34.610 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T02:53:34.645 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T02:53:34.768 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T02:53:34.788 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T02:53:34.818 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T02:53:34.973 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T02:53:34.988 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T02:53:35.031 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T02:53:35.163 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librados2. 2024-09-12T02:53:35.183 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../010-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:35.221 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:35.510 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T02:53:35.525 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T02:53:35.577 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:53:35.682 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librbd1. 2024-09-12T02:53:35.702 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../011-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:35.740 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:35.929 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T02:53:35.944 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T02:53:35.979 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:53:36.135 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T02:53:36.155 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:36.185 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:36.407 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T02:53:36.422 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T02:53:36.465 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:53:36.487 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rados. 2024-09-12T02:53:36.499 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../013-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:36.554 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:36.827 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T02:53:36.842 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T02:53:36.882 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T02:53:36.885 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T02:53:36.902 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:53:36.940 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:37.192 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T02:53:37.204 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:37.204 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librados2. 2024-09-12T02:53:37.220 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../010-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:37.242 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:37.254 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:37.571 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T02:53:37.591 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:53:37.623 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librbd1. 2024-09-12T02:53:37.629 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:37.638 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../011-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:37.681 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:37.957 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T02:53:37.977 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T02:53:38.016 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T02:53:38.118 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T02:53:38.133 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:38.176 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:38.284 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T02:53:38.296 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:38.334 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:38.453 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rados. 2024-09-12T02:53:38.469 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../013-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:38.511 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:38.629 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T02:53:38.640 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T02:53:38.670 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T02:53:38.797 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T02:53:38.813 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:53:38.847 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:38.956 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T02:53:38.968 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T02:53:39.006 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T02:53:39.066 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T02:53:39.081 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:39.116 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:39.317 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T02:53:39.329 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T02:53:39.367 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T02:53:39.450 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T02:53:39.466 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:53:39.510 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:39.696 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua5.1. 2024-09-12T02:53:39.716 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T02:53:39.754 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T02:53:40.046 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T02:53:40.062 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T02:53:40.091 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua-any. 2024-09-12T02:53:40.104 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T02:53:40.111 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-12T02:53:40.149 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T02:53:40.357 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T02:53:40.373 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:40.415 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:40.718 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package zip. 2024-09-12T02:53:40.739 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-12T02:53:40.743 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T02:53:40.759 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T02:53:40.818 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T02:53:40.893 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T02:53:41.071 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T02:53:41.087 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T02:53:41.129 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T02:53:41.272 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package unzip. 2024-09-12T02:53:41.292 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T02:53:41.330 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T02:53:41.423 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T02:53:41.439 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T02:53:41.481 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T02:53:41.717 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package luarocks. 2024-09-12T02:53:41.737 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T02:53:41.775 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T02:53:41.809 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua5.1. 2024-09-12T02:53:41.825 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T02:53:41.868 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T02:53:42.158 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librgw2. 2024-09-12T02:53:42.179 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../027-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:42.204 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-any. 2024-09-12T02:53:42.216 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:42.220 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-12T02:53:42.254 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T02:53:42.473 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package zip. 2024-09-12T02:53:42.489 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-12T02:53:42.531 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T02:53:42.769 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T02:53:42.781 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:42.819 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:42.842 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package unzip. 2024-09-12T02:53:42.858 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T02:53:42.900 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T02:53:43.164 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T02:53:43.184 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T02:53:43.230 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T02:53:43.287 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package luarocks. 2024-09-12T02:53:43.303 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T02:53:43.346 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T02:53:43.591 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T02:53:43.612 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:43.650 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:43.770 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librgw2. 2024-09-12T02:53:43.785 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../027-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:43.828 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:44.156 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-common. 2024-09-12T02:53:44.174 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../031-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:44.220 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:44.331 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T02:53:44.346 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:44.388 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:44.666 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T02:53:44.682 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T02:53:44.716 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T02:53:45.069 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T02:53:45.085 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:45.128 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:45.564 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-common. 2024-09-12T02:53:45.580 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../031-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:45.622 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:45.763 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-base. 2024-09-12T02:53:45.783 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../032-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:45.843 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:46.438 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T02:53:46.458 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T02:53:46.504 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T02:53:46.644 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-base. 2024-09-12T02:53:46.659 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../032-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:46.704 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:46.874 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T02:53:46.894 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T02:53:46.940 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T02:53:47.248 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T02:53:47.263 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T02:53:47.306 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T02:53:47.327 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T02:53:47.347 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T02:53:47.393 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T02:53:47.600 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T02:53:47.616 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T02:53:47.650 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T02:53:47.763 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T02:53:47.784 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T02:53:47.838 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T02:53:47.953 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T02:53:47.969 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T02:53:48.011 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T02:53:48.149 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T02:53:48.170 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T02:53:48.216 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T02:53:48.297 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T02:53:48.313 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T02:53:48.356 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T02:53:48.585 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T02:53:48.606 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T02:53:48.641 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T02:53:48.652 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T02:53:48.657 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T02:53:48.700 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T02:53:49.019 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T02:53:49.021 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-portend. 2024-09-12T02:53:49.035 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T02:53:49.042 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-12T02:53:49.069 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T02:53:49.088 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T02:53:49.347 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-portend. 2024-09-12T02:53:49.358 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-12T02:53:49.397 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T02:53:49.441 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T02:53:49.462 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T02:53:49.499 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T02:53:49.683 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T02:53:49.692 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T02:53:49.732 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T02:53:49.852 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T02:53:49.873 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T02:53:49.918 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T02:53:50.219 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T02:53:50.231 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T02:53:50.239 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T02:53:50.260 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T02:53:50.294 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T02:53:50.322 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T02:53:50.634 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T02:53:50.638 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T02:53:50.649 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T02:53:50.654 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T02:53:50.688 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T02:53:50.692 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T02:53:51.000 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T02:53:51.010 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T02:53:51.049 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T02:53:51.195 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T02:53:51.216 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T02:53:51.253 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T02:53:51.361 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T02:53:51.371 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T02:53:51.410 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T02:53:51.531 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-mako. 2024-09-12T02:53:51.552 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T02:53:51.589 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T02:53:51.696 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-mako. 2024-09-12T02:53:51.707 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T02:53:51.746 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T02:53:51.884 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T02:53:51.896 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T02:53:51.926 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T02:53:52.075 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T02:53:52.085 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T02:53:52.124 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T02:53:52.237 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T02:53:52.258 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T02:53:52.295 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T02:53:52.410 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T02:53:52.421 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T02:53:52.469 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T02:53:52.590 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webob. 2024-09-12T02:53:52.610 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T02:53:52.648 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T02:53:52.746 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webob. 2024-09-12T02:53:52.757 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T02:53:52.796 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T02:53:53.001 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T02:53:53.022 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T02:53:53.071 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T02:53:53.174 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T02:53:53.185 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T02:53:53.226 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T02:53:53.448 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T02:53:53.468 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T02:53:53.493 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T02:53:53.504 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T02:53:53.514 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T02:53:53.534 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T02:53:53.837 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-paste. 2024-09-12T02:53:53.848 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T02:53:53.884 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-paste. 2024-09-12T02:53:53.887 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T02:53:53.904 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T02:53:53.950 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T02:53:54.192 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T02:53:54.200 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T02:53:54.240 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T02:53:54.270 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T02:53:54.282 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T02:53:54.328 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T02:53:54.501 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T02:53:54.511 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T02:53:54.542 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T02:53:54.706 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T02:53:54.727 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T02:53:54.773 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T02:53:54.846 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T02:53:54.856 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T02:53:54.895 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T02:53:55.159 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T02:53:55.180 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T02:53:55.190 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T02:53:55.201 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T02:53:55.226 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T02:53:55.240 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T02:53:55.587 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T02:53:55.608 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T02:53:55.645 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T02:53:55.650 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T02:53:55.661 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T02:53:55.702 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T02:53:55.984 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T02:53:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-idna. 2024-09-12T02:53:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T02:53:56.004 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T02:53:56.030 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T02:53:56.042 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T02:53:56.341 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T02:53:56.352 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T02:53:56.391 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T02:53:56.545 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-idna. 2024-09-12T02:53:56.566 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T02:53:56.603 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T02:53:56.694 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests. 2024-09-12T02:53:56.704 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T02:53:56.752 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T02:53:56.906 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T02:53:56.927 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T02:53:56.964 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T02:53:57.047 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T02:53:57.060 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T02:53:57.096 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T02:53:57.284 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests. 2024-09-12T02:53:57.305 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T02:53:57.342 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T02:53:57.391 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T02:53:57.402 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:53:57.432 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:57.679 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T02:53:57.699 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T02:53:57.737 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T02:53:57.821 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T02:53:57.832 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:57.870 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:58.024 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T02:53:58.035 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:53:58.065 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:58.140 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T02:53:58.151 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T02:53:58.181 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T02:53:58.428 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T02:53:58.449 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:58.478 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:58.517 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T02:53:58.528 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T02:53:58.567 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T02:53:58.789 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T02:53:58.810 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T02:53:58.848 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T02:53:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T02:53:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:59.150 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T02:53:59.171 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T02:53:59.208 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T02:53:59.315 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T02:53:59.325 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:59.364 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:53:59.578 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T02:53:59.599 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:53:59.636 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:00.835 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T02:54:00.843 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:00.884 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:01.016 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T02:54:01.037 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:01.066 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:01.604 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph. 2024-09-12T02:54:01.612 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../068-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:01.654 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:01.736 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T02:54:01.757 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:01.794 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:01.973 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T02:54:01.981 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:02.023 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:02.367 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T02:54:02.376 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:02.409 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:02.795 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephadm. 2024-09-12T02:54:02.803 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../071-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:02.845 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:02.847 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph. 2024-09-12T02:54:02.859 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../068-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:02.897 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:03.156 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T02:54:03.164 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T02:54:03.208 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T02:54:03.234 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T02:54:03.254 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:03.292 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:03.500 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T02:54:03.511 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T02:54:03.550 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T02:54:03.670 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T02:54:03.691 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:03.728 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:04.107 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephadm. 2024-09-12T02:54:04.127 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../071-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:04.189 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:04.518 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T02:54:04.538 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T02:54:04.575 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T02:54:04.590 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-babel. 2024-09-12T02:54:04.600 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T02:54:04.640 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T02:54:04.903 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T02:54:04.924 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T02:54:04.950 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T02:54:04.960 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T02:54:04.961 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T02:54:04.992 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T02:54:05.387 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T02:54:05.396 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:05.428 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:05.773 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T02:54:05.783 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T02:54:05.815 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T02:54:05.984 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-babel. 2024-09-12T02:54:06.005 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T02:54:06.050 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T02:54:06.092 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-routes. 2024-09-12T02:54:06.102 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T02:54:06.142 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T02:54:06.386 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T02:54:06.407 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T02:54:06.444 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T02:54:06.462 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T02:54:06.472 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:06.511 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:07.081 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T02:54:07.102 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:07.139 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:07.493 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T02:54:07.514 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T02:54:07.551 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T02:54:07.608 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T02:54:07.617 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T02:54:07.658 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T02:54:07.820 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-routes. 2024-09-12T02:54:07.841 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T02:54:07.870 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T02:54:08.128 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T02:54:08.137 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T02:54:08.177 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T02:54:08.215 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T02:54:08.236 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:08.273 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:08.531 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T02:54:08.540 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T02:54:08.666 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T02:54:08.960 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T02:54:08.970 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T02:54:09.010 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T02:54:09.612 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T02:54:09.633 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T02:54:09.644 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T02:54:09.653 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:09.662 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T02:54:09.685 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:10.166 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T02:54:10.187 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T02:54:10.223 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T02:54:10.586 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T02:54:10.606 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T02:54:10.613 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T02:54:10.624 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T02:54:10.663 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T02:54:10.737 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T02:54:11.040 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T02:54:11.061 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T02:54:11.098 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T02:54:11.191 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T02:54:11.202 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T02:54:11.241 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T02:54:11.578 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T02:54:11.588 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T02:54:11.627 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T02:54:11.807 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T02:54:11.829 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:11.874 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:11.964 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T02:54:11.977 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-12T02:54:12.022 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T02:54:12.300 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T02:54:12.311 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T02:54:12.350 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T02:54:12.662 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T02:54:12.673 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T02:54:12.711 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T02:54:12.844 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T02:54:12.865 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T02:54:12.902 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T02:54:13.006 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T02:54:13.017 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T02:54:13.055 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T02:54:13.205 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T02:54:13.226 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T02:54:13.263 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T02:54:13.401 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T02:54:13.412 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T02:54:13.450 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T02:54:13.600 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T02:54:13.621 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T02:54:13.650 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T02:54:13.928 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T02:54:13.949 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-12T02:54:13.977 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T02:54:14.139 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T02:54:14.149 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:14.189 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:14.298 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T02:54:14.310 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T02:54:14.348 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T02:54:14.541 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T02:54:14.551 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T02:54:14.591 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T02:54:14.668 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T02:54:14.689 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T02:54:14.726 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T02:54:14.927 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T02:54:14.938 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T02:54:14.977 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T02:54:15.037 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T02:54:15.058 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T02:54:15.095 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T02:54:15.196 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package jq. 2024-09-12T02:54:15.207 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T02:54:15.238 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T02:54:15.382 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T02:54:15.404 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T02:54:15.432 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T02:54:15.482 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package socat. 2024-09-12T02:54:15.493 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T02:54:15.532 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T02:54:15.818 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T02:54:15.830 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T02:54:15.893 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T02:54:16.079 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T02:54:16.092 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:16.129 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:16.205 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-test. 2024-09-12T02:54:16.216 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../099-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:16.255 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:16.441 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T02:54:16.462 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T02:54:16.507 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T02:54:16.852 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T02:54:16.874 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T02:54:16.919 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T02:54:17.188 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package jq. 2024-09-12T02:54:17.200 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T02:54:17.471 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T02:54:17.699 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package socat. 2024-09-12T02:54:17.711 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T02:54:17.740 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T02:54:18.060 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T02:54:18.071 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:18.077 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T02:54:18.098 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T02:54:18.109 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:18.143 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T02:54:18.455 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-12T02:54:18.467 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:18.504 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:18.523 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-test. 2024-09-12T02:54:18.545 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../099-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:18.589 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:18.791 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-colorama. 2024-09-12T02:54:18.802 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-12T02:54:18.840 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-12T02:54:19.101 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephfs-shell. 2024-09-12T02:54:19.113 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:19.151 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:19.412 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephfs-top. 2024-09-12T02:54:19.423 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:19.461 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:19.714 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T02:54:19.725 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:19.772 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:20.075 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T02:54:20.086 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T02:54:20.116 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T02:54:20.454 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T02:54:20.465 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T02:54:20.503 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T02:54:20.825 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T02:54:20.836 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T02:54:20.844 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T02:54:20.865 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:20.866 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T02:54:20.910 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:21.391 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-12T02:54:21.412 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:21.506 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:21.662 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package pkg-config. 2024-09-12T02:54:21.677 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T02:54:21.720 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T02:54:21.818 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-colorama. 2024-09-12T02:54:21.842 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-12T02:54:21.884 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-12T02:54:21.982 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T02:54:21.994 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T02:54:22.031 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T02:54:22.103 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-shell. 2024-09-12T02:54:22.113 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:22.153 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:22.389 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-top. 2024-09-12T02:54:22.411 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T02:54:22.456 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:22.459 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T02:54:22.475 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T02:54:22.517 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T02:54:22.809 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T02:54:22.821 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:22.845 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T02:54:22.861 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T02:54:22.861 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:22.903 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T02:54:23.187 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T02:54:23.208 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T02:54:23.248 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T02:54:23.253 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T02:54:23.262 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T02:54:23.306 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T02:54:23.533 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T02:54:23.554 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T02:54:23.591 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T02:54:23.617 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T02:54:23.631 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T02:54:23.675 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T02:54:23.970 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T02:54:23.992 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T02:54:24.028 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-py. 2024-09-12T02:54:24.036 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T02:54:24.042 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-12T02:54:24.094 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T02:54:24.406 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T02:54:24.420 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T02:54:24.458 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package pkg-config. 2024-09-12T02:54:24.472 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T02:54:24.480 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T02:54:24.525 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T02:54:24.778 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T02:54:24.799 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T02:54:24.844 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T02:54:24.910 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T02:54:24.922 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T02:54:24.959 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T02:54:25.246 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-toml. 2024-09-12T02:54:25.256 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T02:54:25.258 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-12T02:54:25.277 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T02:54:25.295 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T02:54:25.322 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T02:54:25.606 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T02:54:25.620 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T02:54:25.642 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T02:54:25.664 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T02:54:25.672 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T02:54:25.708 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T02:54:26.001 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T02:54:26.015 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T02:54:26.028 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T02:54:26.050 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T02:54:26.059 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T02:54:26.095 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T02:54:26.312 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T02:54:26.325 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T02:54:26.370 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T02:54:26.398 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T02:54:26.420 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T02:54:26.465 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T02:54:26.809 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-py. 2024-09-12T02:54:26.831 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-12T02:54:26.876 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T02:54:27.057 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package radosgw. 2024-09-12T02:54:27.070 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../122-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:27.106 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:27.217 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T02:54:27.239 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T02:54:27.287 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T02:54:27.710 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T02:54:27.723 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:27.768 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:27.887 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T02:54:27.909 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T02:54:28.038 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T02:54:28.049 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T02:54:28.369 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-toml. 2024-09-12T02:54:28.372 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T02:54:28.391 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-12T02:54:28.435 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T02:54:28.507 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T02:54:28.722 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T02:54:28.743 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T02:54:28.775 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T02:54:28.788 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T02:54:29.142 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T02:54:29.163 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T02:54:29.184 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T02:54:29.208 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T02:54:29.478 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T02:54:29.499 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T02:54:29.544 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T02:54:29.782 INFO:teuthology.orchestra.run.smithi063.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T02:54:29.818 INFO:teuthology.orchestra.run.smithi063.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-12T02:54:29.867 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:30.290 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package radosgw. 2024-09-12T02:54:30.313 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../122-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:30.348 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:30.377 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user cephadm....done 2024-09-12T02:54:30.522 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T02:54:30.857 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T02:54:31.125 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T02:54:31.152 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T02:54:31.173 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T02:54:31.218 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:31.251 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T02:54:31.528 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T02:54:31.735 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T02:54:31.790 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T02:54:31.933 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T02:54:31.986 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T02:54:32.112 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T02:54:32.195 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T02:54:32.447 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T02:54:32.551 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T02:54:32.824 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T02:54:33.050 INFO:teuthology.orchestra.run.smithi119.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T02:54:33.093 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-12T02:54:33.160 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:33.360 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T02:54:33.627 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T02:54:33.725 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user cephadm....done 2024-09-12T02:54:33.866 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T02:54:33.887 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T02:54:34.138 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T02:54:34.142 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T02:54:34.393 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T02:54:34.414 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T02:54:34.520 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T02:54:34.690 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:34.770 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T02:54:34.967 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T02:54:35.030 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T02:54:35.092 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T02:54:35.158 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T02:54:35.218 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-12T02:54:35.468 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T02:54:35.486 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T02:54:35.586 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T02:54:35.828 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T02:54:35.854 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T02:54:36.079 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-12T02:54:36.331 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T02:54:36.340 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T02:54:36.402 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T02:54:36.466 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T02:54:36.592 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T02:54:36.632 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T02:54:36.925 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T02:54:36.976 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T02:54:37.094 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T02:54:37.176 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T02:54:37.353 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T02:54:37.520 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T02:54:37.629 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T02:54:37.837 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:37.955 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T02:54:38.081 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T02:54:38.096 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T02:54:38.222 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T02:54:38.348 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-12T02:54:38.599 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T02:54:38.734 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T02:54:38.800 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T02:54:38.985 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T02:54:39.092 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T02:54:39.202 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T02:54:39.302 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T02:54:39.394 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T02:54:39.415 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T02:54:39.471 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T02:54:39.597 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T02:54:39.611 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T02:54:39.948 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T02:54:40.004 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T02:54:40.083 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T02:54:40.272 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T02:54:40.351 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T02:54:40.635 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T02:54:40.682 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T02:54:40.920 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T02:54:40.991 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-12T02:54:41.071 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T02:54:41.326 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T02:54:41.686 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T02:54:41.764 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T02:54:42.007 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T02:54:42.133 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T02:54:42.178 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T02:54:42.259 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T02:54:42.280 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:42.552 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T02:54:42.588 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T02:54:42.937 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T02:54:42.965 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T02:54:43.188 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T02:54:43.730 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T02:54:44.016 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-12T02:54:44.229 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T02:54:44.325 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T02:54:44.497 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:54:44.631 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T02:54:44.668 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T02:54:44.903 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T02:54:44.907 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T02:54:45.029 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:45.033 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T02:54:45.151 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T02:54:45.330 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T02:54:45.452 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T02:54:45.656 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T02:54:45.711 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T02:54:45.954 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:54:46.071 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T02:54:46.398 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T02:54:46.674 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T02:54:46.812 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T02:54:46.983 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T02:54:47.097 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:54:47.231 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T02:54:47.251 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T02:54:47.491 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T02:54:47.502 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T02:54:47.617 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T02:54:47.743 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T02:54:47.769 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T02:54:47.895 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T02:54:48.028 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T02:54:48.188 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T02:54:48.279 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T02:54:48.347 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T02:54:48.530 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:54:48.656 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T02:54:48.657 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T02:54:48.949 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T02:54:48.966 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T02:54:49.200 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T02:54:49.242 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T02:54:49.351 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T02:54:49.452 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T02:54:49.460 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T02:54:49.541 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T02:54:49.711 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T02:54:49.779 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T02:54:49.905 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T02:54:49.962 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T02:54:50.263 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T02:54:50.317 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T02:54:50.389 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T02:54:50.584 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T02:54:50.648 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T02:54:50.685 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T02:54:50.783 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T02:54:50.936 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:54:51.062 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T02:54:51.085 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T02:54:51.388 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T02:54:51.394 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T02:54:51.645 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T02:54:51.706 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T02:54:51.787 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T02:54:51.913 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T02:54:51.991 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T02:54:52.002 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T02:54:52.194 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T02:54:52.223 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T02:54:52.350 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T02:54:52.470 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T02:54:52.735 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T02:54:52.746 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T02:54:52.994 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T02:54:53.039 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T02:54:53.120 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T02:54:53.371 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T02:54:53.441 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T02:54:53.497 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T02:54:53.751 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T02:54:53.806 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T02:54:54.087 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T02:54:54.133 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T02:54:54.205 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:54.330 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:54.409 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T02:54:54.457 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T02:54:54.620 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T02:54:54.793 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:54.896 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T02:54:54.911 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:55.028 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T02:54:55.155 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T02:54:55.347 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:55.407 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T02:54:55.473 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:55.599 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:55.785 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T02:54:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T02:54:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T02:54:56.068 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T02:54:56.420 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T02:54:56.467 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:56.546 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:56.585 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:56.673 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:56.702 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:56.799 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T02:54:56.820 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:56.929 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T02:54:57.135 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:57.244 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:57.370 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T02:54:57.639 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:57.748 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:57.874 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:58.082 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T02:54:58.082 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T02:54:58.250 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:58.376 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:58.502 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:58.619 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:58.660 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:58.720 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:58.794 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:58.838 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:59.304 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:59.425 INFO:teuthology.orchestra.run.smithi063.stdout:Adding group ceph....done 2024-09-12T02:54:59.430 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:54:59.556 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T02:54:59.792 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user ceph....done 2024-09-12T02:54:59.961 INFO:teuthology.orchestra.run.smithi063.stdout:Setting system user ceph properties....done 2024-09-12T02:54:59.977 INFO:teuthology.orchestra.run.smithi063.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T02:55:00.127 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T02:55:00.526 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T02:55:00.727 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:00.853 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:00.962 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:01.063 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:01.164 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:01.198 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:01.282 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:01.413 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:55:01.413 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:55:01.825 INFO:teuthology.orchestra.run.smithi119.stdout:Adding group ceph....done 2024-09-12T02:55:02.032 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:02.161 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:02.186 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user ceph....done 2024-09-12T02:55:02.362 INFO:teuthology.orchestra.run.smithi119.stdout:Setting system user ceph properties....done 2024-09-12T02:55:02.377 INFO:teuthology.orchestra.run.smithi119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T02:55:02.516 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T02:55:02.874 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T02:55:02.957 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:55:02.957 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:55:03.458 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:03.627 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:03.670 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:55:03.670 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:55:04.069 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T02:55:04.168 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:04.294 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:04.792 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:55:04.792 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:55:04.796 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:05.026 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T02:55:05.026 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T02:55:05.279 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:05.631 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T02:55:05.632 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T02:55:05.852 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T02:55:06.165 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:06.427 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T02:55:06.427 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T02:55:06.483 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:06.809 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T02:55:06.809 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T02:55:06.942 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:07.155 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T02:55:07.155 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T02:55:07.403 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:07.512 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:07.657 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:07.718 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:07.863 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T02:55:07.864 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T02:55:08.033 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T02:55:08.033 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T02:55:08.464 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:08.578 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:08.606 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:08.704 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:08.757 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:08.830 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:08.900 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:09.050 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T02:55:09.051 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T02:55:09.312 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T02:55:09.413 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T02:55:09.556 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T02:55:09.624 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:09.775 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:09.901 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:10.053 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T02:55:10.405 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T02:55:10.506 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T02:55:10.641 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T02:55:10.659 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T02:55:11.363 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T02:55:11.367 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-12T02:55:11.446 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-09-12T02:55:11.634 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-09-12T02:55:11.635 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-09-12T02:55:11.785 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T02:55:11.830 INFO:teuthology.orchestra.run.smithi063.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-12T02:55:11.830 INFO:teuthology.orchestra.run.smithi063.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T02:55:11.830 INFO:teuthology.orchestra.run.smithi063.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T02:55:11.830 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T02:55:11.830 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T02:55:11.830 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T02:55:11.830 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T02:55:11.830 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T02:55:11.831 INFO:teuthology.orchestra.run.smithi063.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T02:55:11.831 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T02:55:11.832 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2024-09-12T02:55:11.832 INFO:teuthology.orchestra.run.smithi063.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-12T02:55:11.832 INFO:teuthology.orchestra.run.smithi063.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-12T02:55:11.832 INFO:teuthology.orchestra.run.smithi063.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-12T02:55:11.832 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-12T02:55:11.832 INFO:teuthology.orchestra.run.smithi063.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T02:55:11.833 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2024-09-12T02:55:11.833 INFO:teuthology.orchestra.run.smithi063.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-12T02:55:11.833 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-12T02:55:11.833 INFO:teuthology.orchestra.run.smithi063.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-12T02:55:11.892 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2024-09-12T02:55:11.893 INFO:teuthology.orchestra.run.smithi063.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-12T02:55:11.893 INFO:teuthology.orchestra.run.smithi063.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-12T02:55:11.894 INFO:teuthology.orchestra.run.smithi063.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-12T02:55:11.894 INFO:teuthology.orchestra.run.smithi063.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-12T02:55:11.894 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-12T02:55:11.894 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-12T02:55:11.894 INFO:teuthology.orchestra.run.smithi063.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T02:55:11.894 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be upgraded: 2024-09-12T02:55:11.895 INFO:teuthology.orchestra.run.smithi063.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-12T02:55:11.971 INFO:teuthology.orchestra.run.smithi063.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-12T02:55:11.971 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 55.8 MB of archives. 2024-09-12T02:55:11.971 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-12T02:55:11.971 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-12T02:55:12.104 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T02:55:12.107 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T02:55:12.134 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T02:55:12.135 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T02:55:12.136 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T02:55:12.143 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-12T02:55:12.144 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-12T02:55:12.146 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-12T02:55:12.147 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T02:55:12.147 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-12T02:55:12.148 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T02:55:12.157 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T02:55:12.157 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T02:55:12.157 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-12T02:55:12.174 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-12T02:55:12.410 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-12T02:55:12.412 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-12T02:55:12.412 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-12T02:55:12.415 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-12T02:55:12.416 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-12T02:55:12.421 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-12T02:55:12.423 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-12T02:55:12.430 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-12T02:55:12.431 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T02:55:12.445 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T02:55:12.448 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-12T02:55:12.453 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-12T02:55:12.453 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-12T02:55:12.464 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-12T02:55:12.487 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-12T02:55:12.491 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-12T02:55:12.491 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-12T02:55:12.492 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-12T02:55:12.493 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-12T02:55:12.506 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-12T02:55:12.506 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2024-09-12T02:55:12.508 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-12T02:55:12.666 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-12T02:55:12.667 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-12T02:55:12.667 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-12T02:55:12.667 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-12T02:55:12.667 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-12T02:55:12.667 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-12T02:55:12.681 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-12T02:55:12.681 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-12T02:55:12.725 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2024-09-12T02:55:12.727 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2024-09-12T02:55:12.932 INFO:teuthology.orchestra.run.smithi119.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-12T02:55:12.932 INFO:teuthology.orchestra.run.smithi119.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T02:55:12.932 INFO:teuthology.orchestra.run.smithi119.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T02:55:12.932 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T02:55:12.932 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T02:55:12.933 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T02:55:12.933 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T02:55:12.933 INFO:teuthology.orchestra.run.smithi119.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T02:55:12.934 INFO:teuthology.orchestra.run.smithi119.stdout: python2.7-minimal 2024-09-12T02:55:12.934 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T02:55:12.935 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2024-09-12T02:55:12.935 INFO:teuthology.orchestra.run.smithi119.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-12T02:55:12.935 INFO:teuthology.orchestra.run.smithi119.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-12T02:55:12.935 INFO:teuthology.orchestra.run.smithi119.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-12T02:55:12.935 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-12T02:55:12.936 INFO:teuthology.orchestra.run.smithi119.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T02:55:12.938 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2024-09-12T02:55:12.938 INFO:teuthology.orchestra.run.smithi119.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-12T02:55:12.938 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-12T02:55:12.938 INFO:teuthology.orchestra.run.smithi119.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-12T02:55:12.978 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2024-09-12T02:55:12.978 INFO:teuthology.orchestra.run.smithi119.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-12T02:55:12.978 INFO:teuthology.orchestra.run.smithi119.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-12T02:55:12.979 INFO:teuthology.orchestra.run.smithi119.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-12T02:55:12.979 INFO:teuthology.orchestra.run.smithi119.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-12T02:55:12.979 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-12T02:55:12.979 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-12T02:55:12.979 INFO:teuthology.orchestra.run.smithi119.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T02:55:12.981 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2024-09-12T02:55:12.982 INFO:teuthology.orchestra.run.smithi119.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-12T02:55:13.084 INFO:teuthology.orchestra.run.smithi063.stdout:Preconfiguring packages ... 2024-09-12T02:55:13.162 INFO:teuthology.orchestra.run.smithi119.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-12T02:55:13.163 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 55.8 MB of archives. 2024-09-12T02:55:13.163 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-12T02:55:13.163 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-12T02:55:13.243 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 55.8 MB in 1s (71.7 MB/s) 2024-09-12T02:55:13.529 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-12T02:55:13.533 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T02:55:13.673 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T02:55:13.783 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T02:55:13.799 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T02:55:13.923 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T02:55:13.925 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T02:55:13.926 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T02:55:13.954 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-12T02:55:13.955 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-12T02:55:13.959 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-12T02:55:13.962 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T02:55:13.962 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-12T02:55:13.965 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T02:55:14.027 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T02:55:14.028 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T02:55:14.028 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-12T02:55:14.108 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-12T02:55:14.308 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-12T02:55:14.920 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-12T02:55:14.925 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-12T02:55:14.925 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-12T02:55:14.932 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-12T02:55:14.932 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-12T02:55:14.943 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-12T02:55:14.947 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-12T02:55:14.964 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-12T02:55:14.965 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T02:55:15.033 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-12T02:55:15.050 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-12T02:55:15.075 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-12T02:55:15.140 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-12T02:55:15.146 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-12T02:55:15.147 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-12T02:55:15.147 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-12T02:55:15.148 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-12T02:55:15.178 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-12T02:55:15.181 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-12T02:55:15.360 INFO:teuthology.orchestra.run.smithi063.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-12T02:55:15.621 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package flex. 2024-09-12T02:55:15.692 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-12T02:55:15.695 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T02:55:15.701 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-12T02:55:15.701 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-12T02:55:15.702 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-12T02:55:15.736 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T02:55:15.745 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-12T02:55:15.746 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-12T02:55:15.746 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-12T02:55:15.779 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-12T02:55:15.780 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-12T02:55:16.192 INFO:teuthology.orchestra.run.smithi119.stdout:Preconfiguring packages ... 2024-09-12T02:55:16.239 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T02:55:16.364 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 55.8 MB in 3s (20.0 MB/s) 2024-09-12T02:55:16.408 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T02:55:16.657 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138501 files and directories currently installed.) 2024-09-12T02:55:16.665 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T02:55:16.815 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T02:55:16.841 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T02:55:17.361 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-12T02:55:17.365 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T02:55:17.435 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-12T02:55:17.491 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T02:55:17.973 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T02:55:18.133 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T02:55:18.443 INFO:teuthology.orchestra.run.smithi119.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-12T02:55:18.461 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T02:55:18.746 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package flex. 2024-09-12T02:55:18.821 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138501 files and directories currently installed.) 2024-09-12T02:55:18.825 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package bison. 2024-09-12T02:55:18.826 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T02:55:18.870 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T02:55:18.904 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-12T02:55:18.908 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T02:55:18.953 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T02:55:19.336 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-12T02:55:19.351 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-12T02:55:19.405 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T02:55:19.416 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T02:55:19.584 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T02:55:19.733 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package dump. 2024-09-12T02:55:19.746 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-12T02:55:19.790 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking dump (0.4b47-3) ... 2024-09-12T02:55:20.145 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package indent. 2024-09-12T02:55:20.159 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T02:55:20.193 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T02:55:20.421 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T02:55:20.437 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T02:55:20.479 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T02:55:20.699 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138574 files and directories currently installed.) 2024-09-12T02:55:20.704 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T02:55:20.827 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T02:55:20.833 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-12T02:55:20.850 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-12T02:55:20.892 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T02:55:21.145 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T02:55:21.161 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T02:55:21.203 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T02:55:21.238 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T02:55:21.375 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T02:55:21.531 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T02:55:21.548 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T02:55:21.589 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T02:55:21.708 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T02:55:21.842 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T02:55:21.858 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T02:55:21.900 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T02:55:22.076 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package bison. 2024-09-12T02:55:22.164 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138574 files and directories currently installed.) 2024-09-12T02:55:22.169 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T02:55:22.178 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjson-perl. 2024-09-12T02:55:22.195 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-12T02:55:22.220 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T02:55:22.237 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-12T02:55:22.523 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-12T02:55:22.540 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-12T02:55:22.581 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T02:55:22.687 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-12T02:55:22.709 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-12T02:55:22.754 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T02:55:23.082 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package dump. 2024-09-12T02:55:23.103 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-12T02:55:23.148 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking dump (0.4b47-3) ... 2024-09-12T02:55:23.461 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package indent. 2024-09-12T02:55:23.473 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:23.511 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T02:55:23.738 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T02:55:24.327 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-12T02:55:24.328 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T02:55:24.328 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T02:55:24.328 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-12T02:55:24.328 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T02:55:24.328 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T02:55:24.328 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T02:55:24.328 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-12T02:55:24.328 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-12T02:55:24.328 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T02:55:24.363 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T02:55:24.528 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T02:55:24.551 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T02:55:24.595 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T02:55:24.640 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-12T02:55:24.658 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T02:55:24.690 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T02:55:24.915 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T02:55:24.937 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T02:55:24.982 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T02:55:25.068 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-12T02:55:25.085 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-12T02:55:25.135 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T02:55:25.235 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T02:55:25.256 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T02:55:25.301 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T02:55:25.463 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-12T02:55:25.480 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T02:55:25.521 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T02:55:25.596 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjson-perl. 2024-09-12T02:55:25.618 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-12T02:55:25.663 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-12T02:55:25.816 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-12T02:55:25.833 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:25.866 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:25.933 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-12T02:55:25.955 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-12T02:55:25.999 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T02:55:26.186 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-12T02:55:26.202 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:26.244 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T02:55:26.547 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-12T02:55:26.564 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:26.597 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T02:55:26.841 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T02:55:26.858 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T02:55:26.899 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T02:55:27.403 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-12T02:55:27.420 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-12T02:55:27.453 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T02:55:27.763 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-12T02:55:27.785 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T02:55:27.814 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package modemmanager. 2024-09-12T02:55:27.829 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T02:55:27.831 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T02:55:27.872 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T02:55:28.081 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-12T02:55:28.094 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T02:55:28.123 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T02:55:28.434 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-12T02:55:28.456 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T02:55:28.501 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T02:55:28.674 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package network-manager. 2024-09-12T02:55:28.690 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T02:55:28.741 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-12T02:55:28.854 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-12T02:55:28.876 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-12T02:55:28.946 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T02:55:29.290 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-12T02:55:29.312 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T02:55:29.357 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T02:55:29.389 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ppp. 2024-09-12T02:55:29.406 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-12T02:55:29.693 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-12T02:55:29.715 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:29.755 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T02:55:29.760 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:30.069 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package pptp-linux. 2024-09-12T02:55:30.085 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-12T02:55:30.113 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-12T02:55:30.119 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-12T02:55:30.135 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:30.179 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T02:55:30.339 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-12T02:55:30.354 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-12T02:55:30.430 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-12T02:55:30.666 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-12T02:55:30.689 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:30.733 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-12T02:55:30.749 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-12T02:55:30.750 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T02:55:30.792 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-client-common (238) ... 2024-09-12T02:55:31.003 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T02:55:31.015 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T02:55:31.053 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T02:55:31.104 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-12T02:55:31.121 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:31.162 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:31.581 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-12T02:55:31.603 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-12T02:55:31.648 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T02:55:31.775 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-common. 2024-09-12T02:55:31.787 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-12T02:55:31.845 INFO:teuthology.orchestra.run.smithi063.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-12T02:55:31.874 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-common (238) ... 2024-09-12T02:55:32.026 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package modemmanager. 2024-09-12T02:55:32.047 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T02:55:32.092 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T02:55:32.333 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-14. 2024-09-12T02:55:32.345 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:32.386 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:32.724 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager. 2024-09-12T02:55:32.746 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T02:55:32.816 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-12T02:55:33.440 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ppp. 2024-09-12T02:55:33.462 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-12T02:55:33.782 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T02:55:34.096 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql. 2024-09-12T02:55:34.110 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-12T02:55:34.120 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package pptp-linux. 2024-09-12T02:55:34.142 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-12T02:55:34.145 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql (14+238) ... 2024-09-12T02:55:34.195 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-12T02:55:34.364 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-client. 2024-09-12T02:55:34.376 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-12T02:55:34.414 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-client (14+238) ... 2024-09-12T02:55:34.498 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-12T02:55:34.519 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-12T02:55:34.573 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-12T02:55:34.683 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-12T02:55:34.695 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-12T02:55:34.733 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-12T02:55:34.942 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-12T02:55:34.964 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-12T02:55:35.008 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-common (238) ... 2024-09-12T02:55:35.060 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package tcl8.6. 2024-09-12T02:55:35.073 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-12T02:55:35.110 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T02:55:35.346 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-12T02:55:35.368 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:35.388 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package tcl. 2024-09-12T02:55:35.401 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-12T02:55:35.420 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:35.451 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-12T02:55:35.774 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package wpasupplicant. 2024-09-12T02:55:35.787 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-12T02:55:35.849 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T02:55:36.042 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-common. 2024-09-12T02:55:36.064 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-12T02:55:36.126 INFO:teuthology.orchestra.run.smithi119.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-12T02:55:36.156 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-common (238) ... 2024-09-12T02:55:36.194 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-12T02:55:36.207 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-12T02:55:36.244 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-12T02:55:36.631 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-12T02:55:36.641 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-14. 2024-09-12T02:55:36.644 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-12T02:55:36.663 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T02:55:36.698 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T02:55:36.710 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:36.974 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-client-common (238) ... 2024-09-12T02:55:37.203 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T02:55:37.329 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T02:55:37.455 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:37.572 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T02:55:37.673 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T02:55:37.799 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:38.043 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql. 2024-09-12T02:55:38.057 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-12T02:55:38.101 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql (14+238) ... 2024-09-12T02:55:38.329 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client. 2024-09-12T02:55:38.341 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-12T02:55:38.370 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client (14+238) ... 2024-09-12T02:55:38.606 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-12T02:55:38.619 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-12T02:55:38.656 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-12T02:55:38.767 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-12T02:55:38.871 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T02:55:38.975 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package tcl8.6. 2024-09-12T02:55:38.997 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-12T02:55:39.041 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T02:55:39.315 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T02:55:39.316 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T02:55:39.327 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package tcl. 2024-09-12T02:55:39.350 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-12T02:55:39.399 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-12T02:55:39.688 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package wpasupplicant. 2024-09-12T02:55:39.701 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-12T02:55:39.738 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T02:55:40.016 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T02:55:40.101 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-12T02:55:40.114 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-12T02:55:40.151 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-12T02:55:40.167 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T02:55:40.318 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T02:55:40.469 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-12T02:55:40.521 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-12T02:55:40.543 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-12T02:55:40.596 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T02:55:40.596 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T02:55:40.721 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T02:55:40.864 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T02:55:40.897 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-common (238) ... 2024-09-12T02:55:41.014 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T02:55:41.243 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T02:55:41.370 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T02:55:41.471 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:41.597 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T02:55:41.723 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T02:55:41.849 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:41.911 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T02:55:42.037 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up dump (0.4b47-3) ... 2024-09-12T02:55:42.132 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-12T02:55:42.206 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T02:55:42.331 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T02:55:42.365 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-12T02:55:42.432 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-12T02:55:42.445 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T02:55:42.533 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-12T02:55:42.668 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T02:55:42.757 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T02:55:42.817 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T02:55:42.818 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T02:55:42.827 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T02:55:42.953 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T02:55:43.129 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T02:55:43.264 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T02:55:43.357 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T02:55:43.390 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-12T02:55:43.499 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T02:55:43.549 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-client (14+238) ... 2024-09-12T02:55:43.625 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T02:55:43.659 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-12T02:55:43.760 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-12T02:55:43.886 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T02:55:43.995 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T02:55:44.104 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T02:55:44.231 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T02:55:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:55:44.255 INFO:teuthology.orchestra.run.smithi063.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-12T02:55:44.255 INFO:teuthology.orchestra.run.smithi063.stdout:which means they are currently configured by ifupdown: 2024-09-12T02:55:44.256 INFO:teuthology.orchestra.run.smithi063.stdout:- enp3s0f1 2024-09-12T02:55:44.256 INFO:teuthology.orchestra.run.smithi063.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-12T02:55:44.256 INFO:teuthology.orchestra.run.smithi063.stdout:remove their configuration from /etc/network/interfaces. 2024-09-12T02:55:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:55:44.398 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-12T02:55:44.797 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-12T02:55:44.878 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T02:55:44.996 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up dump (0.4b47-3) ... 2024-09-12T02:55:45.074 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-12T02:55:45.139 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T02:55:45.203 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-12T02:55:45.265 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T02:55:45.391 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-12T02:55:45.517 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-12T02:55:45.659 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T02:55:45.750 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T02:55:45.811 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T02:55:45.894 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T02:55:45.929 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T02:55:46.037 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T02:55:46.080 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T02:55:46.189 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-12T02:55:46.206 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T02:55:46.315 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-common (238) ... 2024-09-12T02:55:46.532 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-12T02:55:47.255 INFO:teuthology.orchestra.run.smithi063.stdout:Adding user postgres to group ssl-cert 2024-09-12T02:55:47.367 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client (14+238) ... 2024-09-12T02:55:47.493 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-12T02:55:47.497 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:55:47.497 INFO:teuthology.orchestra.run.smithi063.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-12T02:55:47.767 INFO:teuthology.orchestra.run.smithi063.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-12T02:55:47.768 INFO:teuthology.orchestra.run.smithi063.stdout:Removing obsolete dictionary files: 2024-09-12T02:55:47.996 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:55:47.996 INFO:teuthology.orchestra.run.smithi119.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-12T02:55:47.996 INFO:teuthology.orchestra.run.smithi119.stdout:which means they are currently configured by ifupdown: 2024-09-12T02:55:47.996 INFO:teuthology.orchestra.run.smithi119.stdout:- enp3s0f1 2024-09-12T02:55:47.996 INFO:teuthology.orchestra.run.smithi119.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-12T02:55:47.997 INFO:teuthology.orchestra.run.smithi119.stdout:remove their configuration from /etc/network/interfaces. 2024-09-12T02:55:47.997 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:55:48.107 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-12T02:55:48.456 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-12T02:55:48.507 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-12T02:55:48.821 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-12T02:55:48.998 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:49.354 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T02:55:49.471 INFO:teuthology.orchestra.run.smithi063.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-12T02:55:49.481 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T02:55:49.488 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout:This user must also own the server process. 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout:The database cluster will be initialized with locale "en_US". 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout:The default text search configuration will be set to "english". 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout:Data page checksums are disabled. 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:55:49.533 INFO:teuthology.orchestra.run.smithi063.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-12T02:55:49.534 INFO:teuthology.orchestra.run.smithi063.stdout:creating subdirectories ... ok 2024-09-12T02:55:49.534 INFO:teuthology.orchestra.run.smithi063.stdout:selecting dynamic shared memory implementation ... posix 2024-09-12T02:55:49.559 INFO:teuthology.orchestra.run.smithi063.stdout:selecting default max_connections ... 100 2024-09-12T02:55:49.593 INFO:teuthology.orchestra.run.smithi063.stdout:selecting default shared_buffers ... 128MB 2024-09-12T02:55:49.609 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-12T02:55:49.609 INFO:teuthology.orchestra.run.smithi063.stdout:selecting default time zone ... Etc/UTC 2024-09-12T02:55:49.609 INFO:teuthology.orchestra.run.smithi063.stdout:creating configuration files ... ok 2024-09-12T02:55:49.733 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-common (238) ... 2024-09-12T02:55:49.777 INFO:teuthology.orchestra.run.smithi063.stdout:running bootstrap script ... ok 2024-09-12T02:55:50.426 INFO:teuthology.orchestra.run.smithi063.stdout:performing post-bootstrap initialization ... ok 2024-09-12T02:55:50.785 INFO:teuthology.orchestra.run.smithi119.stdout:Adding user postgres to group ssl-cert 2024-09-12T02:55:50.977 INFO:teuthology.orchestra.run.smithi063.stdout:syncing data to disk ... ok 2024-09-12T02:55:50.977 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:55:50.977 INFO:teuthology.orchestra.run.smithi119.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-12T02:55:51.179 INFO:teuthology.orchestra.run.smithi119.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-12T02:55:51.180 INFO:teuthology.orchestra.run.smithi119.stdout:Removing obsolete dictionary files: 2024-09-12T02:55:51.520 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-12T02:55:51.774 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-12T02:55:52.201 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T02:55:52.544 INFO:teuthology.orchestra.run.smithi119.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-12T02:55:52.559 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-12T02:55:52.609 INFO:teuthology.orchestra.run.smithi119.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-12T02:55:52.609 INFO:teuthology.orchestra.run.smithi119.stdout:This user must also own the server process. 2024-09-12T02:55:52.609 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:55:52.609 INFO:teuthology.orchestra.run.smithi119.stdout:The database cluster will be initialized with locale "en_US". 2024-09-12T02:55:52.609 INFO:teuthology.orchestra.run.smithi119.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-12T02:55:52.609 INFO:teuthology.orchestra.run.smithi119.stdout:The default text search configuration will be set to "english". 2024-09-12T02:55:52.610 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:55:52.610 INFO:teuthology.orchestra.run.smithi119.stdout:Data page checksums are disabled. 2024-09-12T02:55:52.610 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:55:52.610 INFO:teuthology.orchestra.run.smithi119.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-12T02:55:52.610 INFO:teuthology.orchestra.run.smithi119.stdout:creating subdirectories ... ok 2024-09-12T02:55:52.610 INFO:teuthology.orchestra.run.smithi119.stdout:selecting dynamic shared memory implementation ... posix 2024-09-12T02:55:52.623 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default max_connections ... 100 2024-09-12T02:55:52.644 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default shared_buffers ... 128MB 2024-09-12T02:55:52.654 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default time zone ... Etc/UTC 2024-09-12T02:55:52.654 INFO:teuthology.orchestra.run.smithi119.stdout:creating configuration files ... ok 2024-09-12T02:55:52.771 INFO:teuthology.orchestra.run.smithi119.stdout:running bootstrap script ... ok 2024-09-12T02:55:53.434 INFO:teuthology.orchestra.run.smithi119.stdout:performing post-bootstrap initialization ... ok 2024-09-12T02:55:54.179 INFO:teuthology.orchestra.run.smithi119.stdout:syncing data to disk ... ok 2024-09-12T02:55:54.579 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-12T02:55:54.606 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T02:55:54.748 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-12T02:55:54.882 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql (14+238) ... 2024-09-12T02:55:54.983 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T02:55:55.100 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T02:55:55.369 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T02:55:55.369 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T02:55:56.111 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T02:55:56.320 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T02:55:56.672 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T02:55:56.824 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T02:55:57.401 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T02:55:57.525 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-12T02:55:57.652 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql (14+238) ... 2024-09-12T02:55:57.769 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T02:55:57.870 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T02:55:58.125 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T02:55:58.125 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T02:55:58.284 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-12T02:55:58.384 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T02:55:58.731 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T02:55:58.823 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T02:55:58.939 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T02:55:58.946 DEBUG:teuthology.parallel:result is None 2024-09-12T02:55:59.159 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T02:55:59.311 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T02:56:00.706 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-12T02:56:00.805 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T02:56:01.327 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T02:56:01.332 DEBUG:teuthology.parallel:result is None 2024-09-12T02:56:01.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:56:01.484 DEBUG:teuthology.orchestra.run.smithi063:> dpkg-query -W -f '${Version}' ceph 2024-09-12T02:56:01.508 INFO:teuthology.orchestra.run.smithi063.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-12T02:56:01.509 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T02:56:01.509 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-12T02:56:01.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:56:01.651 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-query -W -f '${Version}' ceph 2024-09-12T02:56:01.669 INFO:teuthology.orchestra.run.smithi119.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-12T02:56:01.670 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T02:56:01.670 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-12T02:56:01.672 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:56:01.672 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:01.672 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:56:01.695 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:01.695 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:56:01.723 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:56:01.724 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:01.724 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:56:01.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:56:01.824 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:01.825 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:56:01.838 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:56:01.891 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:56:01.892 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:01.892 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:56:01.913 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:56:01.976 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:01.976 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:56:01.989 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:56:02.043 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:56:02.043 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:02.043 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:56:02.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:56:02.130 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:02.130 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:56:02.143 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:56:02.198 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T02:56:02.274 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T02:56:02.274 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-09-12T02:56:02.278 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-09-12T02:56:02.296 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T02:56:02.296 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:56:02.342 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T02:56:02.360 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T02:56:02.361 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:56:02.406 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T02:56:02.431 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-12T02:56:02.432 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-12T02:56:02.432 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-12T02:56:02.432 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:02.432 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:56:02.476 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:56:02.571 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:02.571 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T02:56:02.577 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T02:56:02.657 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T02:56:02.657 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T02:56:02.658 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642', 'branch': 'squid', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901642', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA2OAyg21ZkXs20P4AxxQ9o8XDB0tyIniMNh+ebfXCmV8Gy+fMKztGF65HS0Nb/t9MmU8ombojtwRKzxImCdBLg=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJf8DopiplFazTS1kIMSwtpbBthz2EV9TYOHJOiSuEsJAMW/K3XxiWEXlGfS9XQNp3T1PuI1grsUiQ+YiRiKDlY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'thrashosds': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T02:56:02.658 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:56:02.662 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T02:56:02.700 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:56:02.714 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T02:56:02.759 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:02.759 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:56:02.784 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:56:02.784 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-09-12T02:56:02.836 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:56:02.837 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:56:02.837 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 886 Links: 1 2024-09-12T02:56:02.837 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:56:02.837 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-12 02:49:27.389602132 +0000 2024-09-12T02:56:02.837 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-12 02:49:27.385602167 +0000 2024-09-12T02:56:02.837 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-12 02:49:27.385602167 +0000 2024-09-12T02:56:02.837 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-12 02:49:27.385602167 +0000 2024-09-12T02:56:02.838 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:56:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-12T02:56:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-12T02:56:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000389192 s, 1.3 MB/s 2024-09-12T02:56:02.900 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:56:02.954 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-09-12T02:56:03.004 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:56:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:56:03.005 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 903 Links: 1 2024-09-12T02:56:03.005 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:56:03.005 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-12 02:49:28.257594378 +0000 2024-09-12T02:56:03.005 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-12 02:49:27.977596879 +0000 2024-09-12T02:56:03.005 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-12 02:49:27.977596879 +0000 2024-09-12T02:56:03.005 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-12 02:49:27.977596879 +0000 2024-09-12T02:56:03.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:56:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-12T02:56:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-12T02:56:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000370462 s, 1.4 MB/s 2024-09-12T02:56:03.068 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:56:03.122 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-09-12T02:56:03.176 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:56:03.177 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:56:03.177 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 922 Links: 1 2024-09-12T02:56:03.177 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:56:03.177 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-12 02:49:28.573591555 +0000 2024-09-12T02:56:03.177 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-12 02:49:28.569591591 +0000 2024-09-12T02:56:03.177 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-12 02:49:28.569591591 +0000 2024-09-12T02:56:03.177 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-12 02:49:28.569591591 +0000 2024-09-12T02:56:03.177 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:56:03.239 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-12T02:56:03.239 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-12T02:56:03.239 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000393179 s, 1.3 MB/s 2024-09-12T02:56:03.241 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:56:03.294 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-09-12T02:56:03.345 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:56:03.345 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:56:03.345 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 938 Links: 1 2024-09-12T02:56:03.345 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:56:03.345 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-12 02:49:29.481583445 +0000 2024-09-12T02:56:03.345 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-12 02:49:29.181586124 +0000 2024-09-12T02:56:03.345 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-12 02:49:29.181586124 +0000 2024-09-12T02:56:03.346 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-12 02:49:29.181586124 +0000 2024-09-12T02:56:03.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:56:03.410 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-12T02:56:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-12T02:56:03.411 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.00038327 s, 1.3 MB/s 2024-09-12T02:56:03.413 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:56:03.470 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:03.470 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:03.470 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:56:03.476 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:56:03.477 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-09-12T02:56:03.524 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:56:03.524 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:56:03.524 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-09-12T02:56:03.524 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:56:03.525 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 02:49:01.107113225 +0000 2024-09-12T02:56:03.525 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 02:49:00.867117188 +0000 2024-09-12T02:56:03.525 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 02:49:00.867117188 +0000 2024-09-12T02:56:03.525 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-09-12T02:56:03.525 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:56:03.578 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T02:56:03.579 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T02:56:03.579 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000505089 s, 1.0 MB/s 2024-09-12T02:56:03.580 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:56:03.629 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-09-12T02:56:03.676 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:56:03.676 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:56:03.676 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-12T02:56:03.676 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:56:03.676 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 02:49:01.351109338 +0000 2024-09-12T02:56:03.676 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 02:49:01.347109402 +0000 2024-09-12T02:56:03.676 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 02:49:01.347109402 +0000 2024-09-12T02:56:03.676 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-09-12T02:56:03.677 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:56:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T02:56:03.730 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T02:56:03.731 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000575332 s, 890 kB/s 2024-09-12T02:56:03.732 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:56:03.781 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-09-12T02:56:03.828 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:56:03.828 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:56:03.828 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-12T02:56:03.828 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:56:03.828 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 02:49:02.111097230 +0000 2024-09-12T02:56:03.828 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 02:49:01.843101499 +0000 2024-09-12T02:56:03.828 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 02:49:01.843101499 +0000 2024-09-12T02:56:03.829 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-09-12T02:56:03.829 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:56:03.882 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T02:56:03.882 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T02:56:03.882 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000497317 s, 1.0 MB/s 2024-09-12T02:56:03.883 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:56:03.933 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-09-12T02:56:03.980 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:56:03.980 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:56:03.980 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 945 Links: 1 2024-09-12T02:56:03.980 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:56:03.980 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-12 02:49:02.627089008 +0000 2024-09-12T02:56:03.981 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-12 02:49:02.359093278 +0000 2024-09-12T02:56:03.981 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-12 02:49:02.359093278 +0000 2024-09-12T02:56:03.981 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: - 2024-09-12T02:56:03.981 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:56:04.034 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-12T02:56:04.034 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-12T02:56:04.034 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000518266 s, 988 kB/s 2024-09-12T02:56:04.035 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:56:04.085 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:04.085 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:56:04.085 INFO:tasks.ceph:Generating config... 2024-09-12T02:56:04.086 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-12T02:56:04.086 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-12T02:56:04.086 INFO:tasks.ceph:[client] debug client = 20 2024-09-12T02:56:04.086 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T02:56:04.086 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-12T02:56:04.087 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-12T02:56:04.087 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-12T02:56:04.087 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-12T02:56:04.088 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-12T02:56:04.089 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T02:56:04.089 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T02:56:04.090 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T02:56:04.090 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T02:56:04.090 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-12T02:56:04.090 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T02:56:04.090 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T02:56:04.137 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T02:56:04.153 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T02:56:04.204 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:56:04.224 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '172.21.15.119'), ('mon.c', '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]')] 2024-09-12T02:56:04.224 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-12T02:56:04.225 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:04.225 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:56:04.280 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --add b 172.21.15.119 --addv c '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:04.372 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:04.372 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 20b0bc3b-ca7e-4b63-a9bc-3526f84b65da 2024-09-12T02:56:04.372 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-09-12T02:56:04.372 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2024-09-12T02:56:04.372 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 20b0bc3b-ca7e-4b63-a9bc-3526f84b65da 2024-09-12T02:56:04.373 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2024-09-12T02:56:04.371243+0000 2024-09-12T02:56:04.373 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-12T02:56:04.371243+0000 2024-09-12T02:56:04.373 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 17 (quincy) 2024-09-12T02:56:04.373 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2024-09-12T02:56:04.373 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-12T02:56:04.373 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-12T02:56:04.374 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2024-09-12T02:56:04.374 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T02:56:04.375 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T02:56:04.424 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 20b0bc3b-ca7e-4b63-a9bc-3526f84b65da... 2024-09-12T02:56:04.425 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:56:04.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T02:56:04.502 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-09-12T02:56:04.502 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-09-12T02:56:04.502 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:56:04.502 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-09-12T02:56:04.502 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.502 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-09-12T02:56:04.502 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.502 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-09-12T02:56:04.502 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-09-12T02:56:04.503 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:56:04.504 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-09-12T02:56:04.505 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.63,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on skipped message = False 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 20b0bc3b-ca7e-4b63-a9bc-3526f84b65da 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-09-12T02:56:04.506 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug trim objects = true 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-09-12T02:56:04.507 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 20 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 20 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-09-12T02:56:04.508 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 10 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: osd blocked scrub grace period = 3600 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: osd max markdown count = 1000 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-09-12T02:56:04.509 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-09-12T02:56:04.510 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-09-12T02:56:04.511 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: mon down mkfs grace = 300 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on pool no app = False 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:56:04.512 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout: client_shutdown_timeout = 120 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.e] 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-09-12T02:56:04.513 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.f] 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal fragment size max = 10000 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal merge size = 5 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal split bits = 3 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: mds bal split size = 100 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2024-09-12T02:56:04.514 INFO:teuthology.orchestra.run.smithi119.stdout: mds oft prefetch dirfrags = True 2024-09-12T02:56:04.515 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2024-09-12T02:56:04.515 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2024-09-12T02:56:04.515 INFO:teuthology.orchestra.run.smithi119.stdout: mds_dir_prefetch = True 2024-09-12T02:56:04.515 INFO:teuthology.orchestra.run.smithi119.stdout: mds_sleep_rank_change = 5000000.0 2024-09-12T02:56:04.515 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2024-09-12T02:56:04.515 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2024-09-12T02:56:04.515 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2024-09-12T02:56:04.516 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-12T02:56:04.516 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-09-12T02:56:04.516 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T02:56:04.516 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-09-12T02:56:04.516 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.516 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-09-12T02:56:04.516 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.516 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T02:56:04.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-09-12T02:56:04.518 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on skipped message = False 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 20b0bc3b-ca7e-4b63-a9bc-3526f84b65da 2024-09-12T02:56:04.519 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-09-12T02:56:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-09-12T02:56:04.521 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-09-12T02:56:04.522 INFO:teuthology.orchestra.run.smithi063.stdout: osd blocked scrub grace period = 3600 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: osd max markdown count = 1000 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:56:04.523 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-09-12T02:56:04.524 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-09-12T02:56:04.525 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-09-12T02:56:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-09-12T02:56:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: mon down mkfs grace = 300 2024-09-12T02:56:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2024-09-12T02:56:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on pool no app = False 2024-09-12T02:56:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:04.526 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-09-12T02:56:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-09-12T02:56:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: client_shutdown_timeout = 120 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: rados mon op timeout = 900 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout: rados osd op timeout = 900 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-09-12T02:56:04.527 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.e] 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.f] 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds balancer = 20 2024-09-12T02:56:04.528 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds oft prefetch dirfrags = True 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds_dir_prefetch = True 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: mds_sleep_rank_change = 5000000.0 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2024-09-12T02:56:04.529 INFO:teuthology.orchestra.run.smithi063.stdout: rados mon op timeout = 900 2024-09-12T02:56:04.530 INFO:teuthology.orchestra.run.smithi063.stdout: rados osd op timeout = 900 2024-09-12T02:56:04.531 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T02:56:04.531 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T02:56:04.633 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T02:56:04.633 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:04.633 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T02:56:04.642 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:04.642 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T02:56:04.691 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T02:56:04.692 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:04.692 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:56:04.692 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:56:04.768 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:04.768 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:04.819 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:56:04.819 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:04.820 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T02:56:04.820 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T02:56:04.843 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:04.843 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:04.892 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T02:56:04.892 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T02:56:04.892 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:56:04.947 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T02:56:04.952 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:56:04.996 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T02:56:05.006 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T02:56:05.006 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:56:05.061 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T02:56:05.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T02:56:05.085 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:56:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T02:56:05.191 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-12T02:56:05.211 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-12T02:56:05.306 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-12T02:56:05.310 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-12T02:56:05.330 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:56:05.375 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T02:56:05.378 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-12T02:56:05.431 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:56:05.515 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T02:56:05.518 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-12T02:56:05.571 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-12T02:56:05.652 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-12T02:56:05.655 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-12T02:56:05.712 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T02:56:05.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:56:05.756 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T02:56:05.773 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T02:56:05.774 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T02:56:05.774 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T02:56:05.835 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:05.835 INFO:tasks.ceph:role: osd.0 2024-09-12T02:56:05.835 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T02:56:05.835 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:56:05.904 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:56:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:56:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:56:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T02:56:05.904 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:56:05.904 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:56:05.905 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:56:05.905 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T02:56:05.905 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:56:05.905 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:56:06.320 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-12T02:56:06.323 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-12T02:56:06.323 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T02:56:06.462 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T02:56:06.479 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T02:56:06.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:56:06.480 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T02:56:06.544 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:06.544 INFO:tasks.ceph:role: osd.1 2024-09-12T02:56:06.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T02:56:06.544 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:56:06.615 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:56:06.615 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:56:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:56:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T02:56:06.616 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:56:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:56:06.616 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:56:06.616 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T02:56:06.616 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:56:06.616 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:56:06.973 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-12T02:56:06.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-12T02:56:06.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T02:56:07.055 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T02:56:07.117 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T02:56:07.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:56:07.118 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T02:56:07.180 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:07.181 INFO:tasks.ceph:role: osd.2 2024-09-12T02:56:07.181 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T02:56:07.181 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:56:07.253 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:56:07.253 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:56:07.253 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:56:07.253 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T02:56:07.253 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:56:07.253 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:56:07.253 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:56:07.253 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T02:56:07.253 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:56:07.254 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:56:07.644 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-12T02:56:07.647 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-12T02:56:07.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T02:56:07.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T02:56:07.764 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T02:56:07.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:56:07.765 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T02:56:07.830 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:07.830 INFO:tasks.ceph:role: osd.3 2024-09-12T02:56:07.830 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T02:56:07.830 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:56:07.900 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:56:07.900 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:56:07.900 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:56:07.900 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T02:56:07.900 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:56:07.901 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:56:07.901 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:56:07.901 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T02:56:07.901 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:56:07.901 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:56:08.288 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-12T02:56:08.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-12T02:56:08.291 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T02:56:08.430 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T02:56:08.447 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T02:56:08.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:56:08.448 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:08.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:08.580+0000 7fe64374a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T02:56:08.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:08.584+0000 7fe64374a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T02:56:08.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:08.584+0000 7fe64374a7c0 -1 bdev(0x5635befdf800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T02:56:08.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:08.584+0000 7fe64374a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T02:56:11.839 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T02:56:11.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:11.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:11.956+0000 7f88114487c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T02:56:11.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:11.956+0000 7f88114487c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T02:56:11.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:11.956+0000 7f88114487c0 -1 bdev(0x562acd5bb800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T02:56:11.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:11.956+0000 7f88114487c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T02:56:15.207 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T02:56:15.235 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:15.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:15.344+0000 7f58689ad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T02:56:15.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:15.348+0000 7f58689ad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T02:56:15.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:15.348+0000 7f58689ad7c0 -1 bdev(0x5620fb9b7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T02:56:15.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:15.348+0000 7f58689ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T02:56:18.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T02:56:18.649 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:18.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:18.744+0000 7f24dac677c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T02:56:18.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:18.748+0000 7f24dac677c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T02:56:18.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:18.748+0000 7f24dac677c0 -1 bdev(0x55a939ff5800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T02:56:18.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:18.748+0000 7f24dac677c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T02:56:22.018 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T02:56:22.039 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T02:56:22.053 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:22.053 INFO:tasks.ceph:role: osd.4 2024-09-12T02:56:22.053 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:56:22.054 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T02:56:22.116 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:56:22.117 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:56:22.117 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:56:22.117 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T02:56:22.117 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:56:22.117 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:56:22.117 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:56:22.117 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T02:56:22.117 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:56:22.117 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:56:22.586 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T02:56:22.589 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T02:56:22.589 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T02:56:22.719 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T02:56:22.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:56:22.731 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T02:56:22.731 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T02:56:22.792 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:22.792 INFO:tasks.ceph:role: osd.5 2024-09-12T02:56:22.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:56:22.792 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T02:56:22.855 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:56:22.856 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:56:22.856 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:56:22.856 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T02:56:22.856 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:56:22.856 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:56:22.856 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:56:22.856 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T02:56:22.856 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:56:22.856 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:56:23.338 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T02:56:23.340 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T02:56:23.340 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T02:56:23.461 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T02:56:23.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:56:23.474 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T02:56:23.474 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T02:56:23.527 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:23.527 INFO:tasks.ceph:role: osd.6 2024-09-12T02:56:23.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:56:23.527 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T02:56:23.592 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:56:23.592 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:56:23.592 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:56:23.592 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T02:56:23.592 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:56:23.592 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:56:23.592 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:56:23.592 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T02:56:23.593 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:56:23.593 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:56:24.068 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T02:56:24.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T02:56:24.071 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T02:56:24.223 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T02:56:24.234 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T02:56:24.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:56:24.235 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T02:56:24.291 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T02:56:24.291 INFO:tasks.ceph:role: osd.7 2024-09-12T02:56:24.291 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:56:24.292 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T02:56:24.354 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T02:56:24.355 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T02:56:24.355 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T02:56:24.355 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T02:56:24.355 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T02:56:24.355 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-09-12T02:56:24.355 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T02:56:24.355 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T02:56:24.355 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T02:56:24.355 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T02:56:24.782 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-09-12T02:56:24.784 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-09-12T02:56:24.784 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T02:56:24.877 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T02:56:24.887 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T02:56:24.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:56:24.889 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:24.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:24.996+0000 7f8672aae7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T02:56:25.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:25.000+0000 7f8672aae7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T02:56:25.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:25.000+0000 7f8672aae7c0 -1 bdev(0x55ded5895800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T02:56:25.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:25.000+0000 7f8672aae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T02:56:28.131 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T02:56:28.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:28.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:28.224+0000 7fa6f4ec77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T02:56:28.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:28.224+0000 7fa6f4ec77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T02:56:28.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:28.224+0000 7fa6f4ec77c0 -1 bdev(0x55c97f66f800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T02:56:28.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:28.224+0000 7fa6f4ec77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T02:56:31.355 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T02:56:31.412 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:31.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:31.496+0000 7fac67e747c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T02:56:31.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:31.496+0000 7fac67e747c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T02:56:31.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:31.496+0000 7fac67e747c0 -1 bdev(0x55b532049800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T02:56:31.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:31.496+0000 7fac67e747c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T02:56:32.660 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:56:32.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:56:34.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T02:56:34.666 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:34.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:34.748+0000 7f8e940527c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T02:56:34.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:34.748+0000 7f8e940527c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T02:56:34.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:34.748+0000 7f8e940527c0 -1 bdev(0x5595fe935800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T02:56:34.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:34.748+0000 7f8e940527c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T02:56:37.882 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T02:56:37.940 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T02:56:37.940 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:37.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T02:56:37.962 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:37.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T02:56:38.028 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:38.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-12T02:56:38.092 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:38.092 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-12T02:56:38.160 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:38.160 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T02:56:38.228 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:38.228 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T02:56:38.292 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:38.292 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T02:56:38.356 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:38.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T02:56:38.420 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:38.420 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T02:56:38.433 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:38.433 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-12T02:56:38.486 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:38.486 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-12T02:56:38.540 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:38.540 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-12T02:56:38.594 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:38.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T02:56:38.651 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:38.651 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T02:56:38.706 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:38.707 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T02:56:38.762 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:38.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T02:56:38.815 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:38.815 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T02:56:38.824 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T02:56:38.824 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:56:38.871 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T02:56:38.882 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2024-09-12T02:56:38.882 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBEWOJmKSBtOBAAeNmv4OnpLSEcQieNUVUOOQ== 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBFWOJmQHGfAxAAbFSg/fLbP7SPvVkes4WZqg== 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBFWOJm7qkaCxAAk4XE+cFoE1FLuftX+ZZkcg== 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.e] 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBFWOJmYyE4EhAAUA4PDXzjR8Esj7OTlpemAw== 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBIWOJmetfQIhAAcZIadxsL1lEMk4tD1Nhmjg== 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBLWOJmqew7ORAASySGJWge+gp7E52wwVnt/w== 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBPWOJmYNTqFBAAqeEj4hZfeiEhtRc9GbvZRQ== 2024-09-12T02:56:38.883 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBSWOJm72vJLBAAWPWW8nKmmCjkhN2l/VJHKg== 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBEWOJm7fF5OxAApwqEPnl9+/8hB1Wbt4s4Jg== 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBFWOJmDe94FhAAoDfJRDEp3Ockyb9qIxh0lA== 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBFWOJmtMnVHhAAVDoei8jnkSqy2fJH1C68jQ== 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.f] 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBFWOJmwV7+JhAAzjcOBGHgA+F1+Io1HUgQvA== 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBYWOJmsOGVOxAA1+1ap4yONqJfbufOZcU0mw== 2024-09-12T02:56:38.884 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2024-09-12T02:56:38.885 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBcWOJmUOWPDRAAUJwRjebboMTyTzO1E98Mbw== 2024-09-12T02:56:38.885 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2024-09-12T02:56:38.885 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBfWOJm/IvHHRAAWJvymn3UJrFtnYgwQ0X/Yw== 2024-09-12T02:56:38.885 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2024-09-12T02:56:38.885 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBiWOJmp+fKLBAA0SDgmFTtpinWyHxEJNEYpQ== 2024-09-12T02:56:38.885 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2024-09-12T02:56:38.885 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQBFWOJmvOAQLRAAsoujSxKpv85SxoOnIF36qA== 2024-09-12T02:56:38.886 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2024-09-12T02:56:38.886 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBEWOJmKSBtOBAAeNmv4OnpLSEcQieNUVUOOQ== 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBFWOJmQHGfAxAAbFSg/fLbP7SPvVkes4WZqg== 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBFWOJm7qkaCxAAk4XE+cFoE1FLuftX+ZZkcg== 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.e] 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBFWOJmYyE4EhAAUA4PDXzjR8Esj7OTlpemAw== 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBIWOJmetfQIhAAcZIadxsL1lEMk4tD1Nhmjg== 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-09-12T02:56:38.887 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBLWOJmqew7ORAASySGJWge+gp7E52wwVnt/w== 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBPWOJmYNTqFBAAqeEj4hZfeiEhtRc9GbvZRQ== 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBSWOJm72vJLBAAWPWW8nKmmCjkhN2l/VJHKg== 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBEWOJm7fF5OxAApwqEPnl9+/8hB1Wbt4s4Jg== 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBFWOJmDe94FhAAoDfJRDEp3Ockyb9qIxh0lA== 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBFWOJmtMnVHhAAVDoei8jnkSqy2fJH1C68jQ== 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.f] 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBFWOJmwV7+JhAAzjcOBGHgA+F1+Io1HUgQvA== 2024-09-12T02:56:38.888 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2024-09-12T02:56:38.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBYWOJmsOGVOxAA1+1ap4yONqJfbufOZcU0mw== 2024-09-12T02:56:38.889 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2024-09-12T02:56:38.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBcWOJmUOWPDRAAUJwRjebboMTyTzO1E98Mbw== 2024-09-12T02:56:38.889 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2024-09-12T02:56:38.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBfWOJm/IvHHRAAWJvymn3UJrFtnYgwQ0X/Yw== 2024-09-12T02:56:38.889 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2024-09-12T02:56:38.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBiWOJmp+fKLBAA0SDgmFTtpinWyHxEJNEYpQ== 2024-09-12T02:56:38.889 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-12T02:56:38.889 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBFWOJmvOAQLRAAsoujSxKpv85SxoOnIF36qA== 2024-09-12T02:56:38.890 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:56:38.934 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:56:38.991 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:38.995 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.051 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.054 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.109 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.113 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.167 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.170 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.246 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.330 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.415 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.418 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.504 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:56:39.507 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T02:56:39.559 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.562 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.634 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.637 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.725 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.728 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T02:56:39.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.786 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.853 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.856 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:39.941 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:40.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:40.025 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T02:56:40.107 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:56:40.110 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T02:56:40.201 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T02:56:40.201 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T02:56:40.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:56:40.332 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T02:56:40.351 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T02:56:40.365 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:56:40.457 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T02:56:40.468 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T02:56:40.524 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T02:56:40.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T02:56:40.622 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:40.626 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T02:56:40.674 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T02:56:40.675 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T02:56:40.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T02:56:40.678 INFO:tasks.ceph.mon.a:Started 2024-09-12T02:56:40.678 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T02:56:40.678 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T02:56:40.720 INFO:tasks.ceph.mon.b:Started 2024-09-12T02:56:40.720 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T02:56:40.721 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T02:56:40.723 INFO:tasks.ceph.mon.c:Started 2024-09-12T02:56:40.723 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T02:56:40.723 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T02:56:40.723 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T02:56:40.726 INFO:tasks.ceph.mgr.y:Started 2024-09-12T02:56:40.726 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T02:56:40.727 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T02:56:40.729 INFO:tasks.ceph.mgr.x:Started 2024-09-12T02:56:40.729 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T02:56:40.729 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T02:56:40.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.864+0000 7f1d1e000640 1 Processor -- start 2024-09-12T02:56:40.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.864+0000 7f1d1e000640 1 -- start start 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d1e000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d18152870 0x7f1d180cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d1e000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 0x7f1d180714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d1e000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d180ceeb0 con 0x7f1d180c4f50 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d1e000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f1d180ce1d0 con 0x7f1d18152870 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d1e000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1d180cdb50 con 0x7f1d180ce9e0 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d17400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d18152870 0x7f1d180cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d0ea00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 0x7f1d180714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d17400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d18152870 0x7f1d180cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:39162/0 (socket says 172.21.15.63:39162) 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d17400640 1 -- 172.21.15.63:0/2068000110 learned_addr learned my addr 172.21.15.63:0/2068000110 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d17400640 1 -- 172.21.15.63:0/2068000110 >> v2:172.21.15.119:3300/0 conn(0x7f1d18152870 msgr2=0x7f1d180cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d17400640 1 -- 172.21.15.63:0/2068000110 >> v2:172.21.15.119:3300/0 conn(0x7f1d18152870 msgr2=0x7f1d180cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d17400640 1 --2- 172.21.15.63:0/2068000110 >> v2:172.21.15.119:3300/0 conn(0x7f1d18152870 0x7f1d180cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:56:40.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d0ea00640 1 -- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 msgr2=0x7f1d180714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T02:56:40.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d0ea00640 1 -- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 msgr2=0x7f1d180714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T02:56:40.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d0ea00640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 0x7f1d180714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:56:40.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d0ea00640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 0x7f1d180714b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:56:40.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:40.868+0000 7f1d17400640 1 --2- 172.21.15.63:0/2068000110 >> v2:172.21.15.119:3300/0 conn(0x7f1d18152870 0x7f1d180cbf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:56:41.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.064+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528686490 0 0) 0x7f1d180ceeb0 con 0x7f1d180c4f50 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cfc003530 con 0x7f1d180c4f50 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3933356768 0 0) 0x7f1cfc003530 con 0x7f1d180c4f50 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 msgr2=0x7f1d180714b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 0x7f1d180714b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 >> v2:172.21.15.119:3300/0 conn(0x7f1d18152870 msgr2=0x7f1d180cbf00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 --2- 172.21.15.63:0/2068000110 >> v2:172.21.15.119:3300/0 conn(0x7f1d18152870 0x7f1d180cbf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d180ce420 con 0x7f1d180c4f50 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f1d10001a00 con 0x7f1d180c4f50 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 >> v1:172.21.15.63:6789/0 conn(0x7f1d180c4f50 legacy=0x7f1d180cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cfc0039c0 0x7f1cfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cfc004810 0x7f1cfc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 0x7f1cfc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1d180ce1d0 con 0x7f1cfc0039c0 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1d180cdb50 con 0x7f1cfc004810 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1cfc00bb00 con 0x7f1d180ce9e0 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d17400640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cfc0039c0 0x7f1cfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d0ea00640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cfc004810 0x7f1cfc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d17e00640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 0x7f1cfc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d17400640 1 -- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 msgr2=0x7f1cfc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d17400640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d180ce9e0 0x7f1cfc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d17400640 1 -- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cfc004810 msgr2=0x7f1cfc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d17400640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cfc004810 0x7f1cfc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.068+0000 7f1d17400640 1 -- 172.21.15.63:0/2068000110 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc003530 con 0x7f1cfc0039c0 2024-09-12T02:56:41.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d17400640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cfc0039c0 0x7f1cfc003de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009100 tx=0x7f1d0801c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0da56237934256c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:41.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d080b1070 con 0x7f1cfc0039c0 2024-09-12T02:56:41.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d080a8050 con 0x7f1cfc0039c0 2024-09-12T02:56:41.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d16a00640 1 -- 172.21.15.63:0/2068000110 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0800f040 con 0x7f1cfc0039c0 2024-09-12T02:56:41.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d1e000640 1 -- 172.21.15.63:0/2068000110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cfc0039c0 msgr2=0x7f1cfc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d1e000640 1 --2- 172.21.15.63:0/2068000110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cfc0039c0 0x7f1cfc003de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009100 tx=0x7f1d0801c5b0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d17e00640 1 -- 172.21.15.63:0/2068000110 reap_dead start 2024-09-12T02:56:41.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d1e000640 1 -- 172.21.15.63:0/2068000110 shutdown_connections 2024-09-12T02:56:41.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d1e000640 1 -- 172.21.15.63:0/2068000110 >> 172.21.15.63:0/2068000110 conn(0x7f1d1806bcc0 msgr2=0x7f1d1806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:41.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d1e000640 1 -- 172.21.15.63:0/2068000110 shutdown_connections 2024-09-12T02:56:41.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d1e000640 1 -- 172.21.15.63:0/2068000110 wait complete. 2024-09-12T02:56:41.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d1e000640 1 Processor -- start 2024-09-12T02:56:41.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.072+0000 7f1d1e000640 1 -- start start 2024-09-12T02:56:41.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d1e000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cfc0039c0 0x7f1d181e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d1e000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d181f6920 0x7f1d1814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d1e000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d180c6ca0 0x7f1d180c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d181f6920 0x7f1d1814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d1e000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1d180cd090 con 0x7f1d181f6920 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d181f6920 0x7f1d1814dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60582/0 (socket says 172.21.15.63:60582) 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0ea00640 1 -- 172.21.15.63:0/4090319650 learned_addr learned my addr 172.21.15.63:0/4090319650 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1d180ccf10 con 0x7f1d180c6ca0 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1d18162fe0 con 0x7f1cfc0039c0 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d17400640 1 --2- 172.21.15.63:0/4090319650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cfc0039c0 0x7f1d181e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d17e00640 1 --2- 172.21.15.63:0/4090319650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d180c6ca0 0x7f1d180c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0ea00640 1 -- 172.21.15.63:0/4090319650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cfc0039c0 msgr2=0x7f1d181e8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0ea00640 1 --2- 172.21.15.63:0/4090319650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cfc0039c0 0x7f1d181e8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0ea00640 1 -- 172.21.15.63:0/4090319650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d180c6ca0 msgr2=0x7f1d180c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0ea00640 1 --2- 172.21.15.63:0/4090319650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d180c6ca0 0x7f1d180c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0ea00640 1 -- 172.21.15.63:0/4090319650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d181e93b0 con 0x7f1d181f6920 2024-09-12T02:56:41.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0ea00640 1 --2- 172.21.15.63:0/4090319650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d181f6920 0x7f1d1814dfc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000bfd0 tx=0x7f1d0000f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:41.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0fe00640 1 -- 172.21.15.63:0/4090319650 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00019020 con 0x7f1d181f6920 2024-09-12T02:56:41.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0fe00640 1 -- 172.21.15.63:0/4090319650 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d00014870 con 0x7f1d181f6920 2024-09-12T02:56:41.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0fe00640 1 -- 172.21.15.63:0/4090319650 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00014c40 con 0x7f1d181f6920 2024-09-12T02:56:41.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1814f120 con 0x7f1d181f6920 2024-09-12T02:56:41.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1814f3e0 con 0x7f1d181f6920 2024-09-12T02:56:41.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0fe00640 1 -- 172.21.15.63:0/4090319650 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1d0001c020 con 0x7f1d181f6920 2024-09-12T02:56:41.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.076+0000 7f1d0fe00640 1 -- 172.21.15.63:0/4090319650 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1d0001e400 con 0x7f1d181f6920 2024-09-12T02:56:41.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.080+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d180cbee0 con 0x7f1d181f6920 2024-09-12T02:56:41.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.092+0000 7f1d0fe00640 1 -- 172.21.15.63:0/4090319650 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1d00023020 con 0x7f1d181f6920 2024-09-12T02:56:41.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.156+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1d1815ea30 con 0x7f1d181f6920 2024-09-12T02:56:41.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d0fe00640 1 -- 172.21.15.63:0/4090319650 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1d00015410 con 0x7f1d181f6920 2024-09-12T02:56:41.168 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-09-12T02:56:41.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d181f6920 msgr2=0x7f1d1814dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d1e000640 1 --2- 172.21.15.63:0/4090319650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d181f6920 0x7f1d1814dfc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000bfd0 tx=0x7f1d0000f9e0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 shutdown_connections 2024-09-12T02:56:41.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d1e000640 1 --2- 172.21.15.63:0/4090319650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d180c6ca0 0x7f1d180c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d1e000640 1 --2- 172.21.15.63:0/4090319650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d181f6920 0x7f1d1814dfc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d1e000640 1 --2- 172.21.15.63:0/4090319650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cfc0039c0 0x7f1d181e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 >> 172.21.15.63:0/4090319650 conn(0x7f1d1806bcc0 msgr2=0x7f1d18161da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:41.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 shutdown_connections 2024-09-12T02:56:41.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:41.164+0000 7f1d1e000640 1 -- 172.21.15.63:0/4090319650 wait complete. 2024-09-12T02:56:41.189 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T02:56:41.189 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T02:56:41.189 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:41.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T02:56:41.210 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:41.210 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T02:56:41.275 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:41.275 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T02:56:41.289 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:41.284+0000 7f9a8ae2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:56:41.308 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:56:41.308 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T02:56:41.322 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:41.320+0000 7f7e9ae4d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:56:41.371 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:41.371 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T02:56:41.385 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:41.385 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T02:56:41.438 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:41.438 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T02:56:41.490 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-12T02:56:41.490 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T02:56:41.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 5c33857f-3772-4c5f-9025-2157ac056da1 0 2024-09-12T02:56:41.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e10bce640 1 Processor -- start 2024-09-12T02:56:41.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e10bce640 1 -- start start 2024-09-12T02:56:41.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e10bce640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8e0c0ce3b0 0x7f8e0c0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e10bce640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c06f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e10bce640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e0c0caa40 con 0x7f8e0c0ce790 2024-09-12T02:56:41.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e10bce640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f8e0c0c9340 con 0x7f8e0c0ce3b0 2024-09-12T02:56:41.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e10bce640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0c0ca760 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e0ad9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c06f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e0a59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8e0c0ce3b0 0x7f8e0c0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e0ad9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c06f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:53828/0 (socket says 172.21.15.119:53828) 2024-09-12T02:56:41.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.704+0000 7f8e0ad9d640 1 -- 172.21.15.119:0/3605926996 learned_addr learned my addr 172.21.15.119:0/3605926996 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e0a59c640 1 -- 172.21.15.119:0/3605926996 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 msgr2=0x7f8e0c06f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e0a59c640 1 --2- 172.21.15.119:0/3605926996 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c06f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e0a59c640 1 -- 172.21.15.119:0/3605926996 >> v1:172.21.15.63:6789/0 conn(0x7f8e0c0ce790 legacy=0x7f8e0c1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e0a59c640 1 -- 172.21.15.119:0/3605926996 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0c0c95e0 con 0x7f8e0c0ce3b0 2024-09-12T02:56:41.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e0ad9d640 1 --2- 172.21.15.119:0/3605926996 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c06f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e0a59c640 1 --2- 172.21.15.119:0/3605926996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 0x7f8e0c0ca120 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0097c0 tx=0x7f8dfc01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=735720d8ed004848 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e0959a640 1 -- 172.21.15.119:0/3605926996 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0ab5f0 con 0x7f8e0c0ce3b0 2024-09-12T02:56:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e0959a640 1 -- 172.21.15.119:0/3605926996 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc0b0070 con 0x7f8e0c0ce3b0 2024-09-12T02:56:41.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e0959a640 1 -- 172.21.15.119:0/3605926996 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0ab9b0 con 0x7f8e0c0ce3b0 2024-09-12T02:56:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e10bce640 1 -- 172.21.15.119:0/3605926996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 msgr2=0x7f8e0c0ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e10bce640 1 --2- 172.21.15.119:0/3605926996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 0x7f8e0c0ca120 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0097c0 tx=0x7f8dfc01c430 comp rx=0 tx=0).stop 2024-09-12T02:56:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e10bce640 1 -- 172.21.15.119:0/3605926996 shutdown_connections 2024-09-12T02:56:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e10bce640 1 --2- 172.21.15.119:0/3605926996 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c06f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e10bce640 1 --2- 172.21.15.119:0/3605926996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 0x7f8e0c0ca120 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e10bce640 1 -- 172.21.15.119:0/3605926996 >> 172.21.15.119:0/3605926996 conn(0x7f8e0c071690 msgr2=0x7f8e0c071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e10bce640 1 -- 172.21.15.119:0/3605926996 shutdown_connections 2024-09-12T02:56:41.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.708+0000 7f8e10bce640 1 -- 172.21.15.119:0/3605926996 wait complete. 2024-09-12T02:56:41.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 Processor -- start 2024-09-12T02:56:41.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 -- start start 2024-09-12T02:56:41.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 0x7f8e0c159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0c0ce790 0x7f8e0c1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c152d40 con 0x7f8e0c0ce790 2024-09-12T02:56:41.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c152bc0 con 0x7f8e0c0ce3b0 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0c165780 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e09d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 0x7f8e0c159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0a59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0a59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c14d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:53830/0 (socket says 172.21.15.119:53830) 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0a59c640 1 -- 172.21.15.119:0/2867129122 learned_addr learned my addr 172.21.15.119:0/2867129122 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e09d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 0x7f8e0c159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50688/0 (socket says 172.21.15.119:50688) 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0ad9d640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0c0ce790 0x7f8e0c1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0a59c640 1 -- 172.21.15.119:0/2867129122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 msgr2=0x7f8e0c159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0a59c640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 0x7f8e0c159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0a59c640 1 -- 172.21.15.119:0/2867129122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0c0ce790 msgr2=0x7f8e0c1553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0a59c640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0c0ce790 0x7f8e0c1553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0a59c640 1 -- 172.21.15.119:0/2867129122 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0c150ea0 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0ad9d640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0c0ce790 0x7f8e0c1553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e09d9b640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 0x7f8e0c159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e0a59c640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c14d6f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0ad040 tx=0x7f8dfc01ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8dfaffd640 1 -- 172.21.15.119:0/2867129122 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0bf410 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8dfaffd640 1 -- 172.21.15.119:0/2867129122 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc0bf5f0 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8dfaffd640 1 -- 172.21.15.119:0/2867129122 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0bf9e0 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 -- 172.21.15.119:0/2867129122 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0c151180 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 -- 172.21.15.119:0/2867129122 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0c14cc10 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8dfaffd640 1 -- 172.21.15.119:0/2867129122 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8dfc0bd020 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8dfaffd640 1 -- 172.21.15.119:0/2867129122 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f8dfc0b5db0 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.712+0000 7f8e10bce640 1 -- 172.21.15.119:0/2867129122 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e0c06f6a0 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.728+0000 7f8dfaffd640 1 -- 172.21.15.119:0/2867129122 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8dfc0c6030 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.796+0000 7f8e10bce640 1 -- 172.21.15.119:0/2867129122 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5c33857f-3772-4c5f-9025-2157ac056da1", "id": 0} v 0) -- 0x7f8e0c0ced20 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.801 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:41.796+0000 7f9a8ae2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:56:41.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8dfaffd640 1 -- 172.21.15.119:0/2867129122 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5c33857f-3772-4c5f-9025-2157ac056da1", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8dfc016050 con 0x7f8e0c0c8bc0 2024-09-12T02:56:41.804 INFO:teuthology.orchestra.run.smithi119.stdout:0 2024-09-12T02:56:41.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8e10bce640 1 -- 172.21.15.119:0/2867129122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 msgr2=0x7f8e0c14d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8e10bce640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c14d6f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0ad040 tx=0x7f8dfc01ac70 comp rx=0 tx=0).stop 2024-09-12T02:56:41.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8e10bce640 1 -- 172.21.15.119:0/2867129122 shutdown_connections 2024-09-12T02:56:41.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8e10bce640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e0c0ce790 0x7f8e0c1553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8e10bce640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e0c0ce3b0 0x7f8e0c159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8e10bce640 1 --2- 172.21.15.119:0/2867129122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e0c0c8bc0 0x7f8e0c14d6f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8e10bce640 1 -- 172.21.15.119:0/2867129122 >> 172.21.15.119:0/2867129122 conn(0x7f8e0c071690 msgr2=0x7f8e0c156280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:41.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8e10bce640 1 -- 172.21.15.119:0/2867129122 shutdown_connections 2024-09-12T02:56:41.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f8e10bce640 1 -- 172.21.15.119:0/2867129122 wait complete. 2024-09-12T02:56:41.806 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:41.804+0000 7f7e9ae4d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:56:41.822 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 9a1b1d8b-fd3f-4b94-8135-941da7cb2797 1 2024-09-12T02:56:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f145aba2640 1 Processor -- start 2024-09-12T02:56:41.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f145aba2640 1 -- start start 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f145aba2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1454152b80 0x7f14540c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f145aba2640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14540ca660 0x7f145415c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f145aba2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1454158ad0 con 0x7f14541527a0 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f145aba2640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f14540cbb10 con 0x7f14540ca660 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f145aba2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f1454159610 con 0x7f1454152b80 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f1453fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1454152b80 0x7f14540c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f145893e640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f14541527a0 0x7f14540ce040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:45178/0 (socket says 172.21.15.119:45178) 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.940+0000 7f145893e640 1 -- 172.21.15.119:0/224861279 learned_addr learned my addr 172.21.15.119:0/224861279 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f1453fff640 1 -- 172.21.15.119:0/224861279 >> v2:172.21.15.63:3300/0 conn(0x7f14540ca660 msgr2=0x7f145415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f1453fff640 1 --2- 172.21.15.119:0/224861279 >> v2:172.21.15.63:3300/0 conn(0x7f14540ca660 0x7f145415c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f1453fff640 1 -- 172.21.15.119:0/224861279 >> v1:172.21.15.119:6789/0 conn(0x7f14541527a0 legacy=0x7f14540ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f1453fff640 1 -- 172.21.15.119:0/224861279 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1454158d70 con 0x7f1454152b80 2024-09-12T02:56:41.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f14537fe640 1 -- 172.21.15.119:0/224861279 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2473543104 0 0) 0x7f1454158ad0 con 0x7f14541527a0 2024-09-12T02:56:41.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f1453fff640 1 --2- 172.21.15.119:0/224861279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1454152b80 0x7f14540c9510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14540cedd0 tx=0x7f144401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e793121ab2ca8ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:41.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f14537fe640 1 -- 172.21.15.119:0/224861279 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14440b0070 con 0x7f1454152b80 2024-09-12T02:56:41.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f14537fe640 1 -- 172.21.15.119:0/224861279 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14440ab600 con 0x7f1454152b80 2024-09-12T02:56:41.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f14537fe640 1 -- 172.21.15.119:0/224861279 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14440ab9d0 con 0x7f1454152b80 2024-09-12T02:56:41.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f145aba2640 1 -- 172.21.15.119:0/224861279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1454152b80 msgr2=0x7f14540c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f145aba2640 1 --2- 172.21.15.119:0/224861279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1454152b80 0x7f14540c9510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14540cedd0 tx=0x7f144401c3f0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f145aba2640 1 -- 172.21.15.119:0/224861279 shutdown_connections 2024-09-12T02:56:41.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f145aba2640 1 --2- 172.21.15.119:0/224861279 >> v2:172.21.15.63:3300/0 conn(0x7f14540ca660 0x7f145415c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f145aba2640 1 --2- 172.21.15.119:0/224861279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1454152b80 0x7f14540c9510 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f145aba2640 1 -- 172.21.15.119:0/224861279 >> 172.21.15.119:0/224861279 conn(0x7f145406f7e0 msgr2=0x7f145406fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:41.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f145aba2640 1 -- 172.21.15.119:0/224861279 shutdown_connections 2024-09-12T02:56:41.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f145aba2640 1 -- 172.21.15.119:0/224861279 wait complete. 2024-09-12T02:56:41.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.944+0000 7f145aba2640 1 Processor -- start 2024-09-12T02:56:41.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 -- start start 2024-09-12T02:56:41.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14540ca660 0x7f14541f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14541527a0 0x7f1454151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1454152b80 0x7f14540ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:41.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1454158830 con 0x7f14541527a0 2024-09-12T02:56:41.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14541586b0 con 0x7f14540ca660 2024-09-12T02:56:41.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f14540ce750 con 0x7f1454152b80 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145893e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14540ca660 0x7f14541f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145913f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1454152b80 0x7f14540ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145893e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14540ca660 0x7f14541f17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50712/0 (socket says 172.21.15.119:50712) 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145893e640 1 -- 172.21.15.119:0/1362256961 learned_addr learned my addr 172.21.15.119:0/1362256961 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145893e640 1 -- 172.21.15.119:0/1362256961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1454152b80 msgr2=0x7f14540ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145893e640 1 --2- 172.21.15.119:0/1362256961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1454152b80 0x7f14540ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145893e640 1 -- 172.21.15.119:0/1362256961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14541527a0 msgr2=0x7f1454151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145893e640 1 --2- 172.21.15.119:0/1362256961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14541527a0 0x7f1454151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145893e640 1 -- 172.21.15.119:0/1362256961 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1454156470 con 0x7f14540ca660 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145913f640 1 --2- 172.21.15.119:0/1362256961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1454152b80 0x7f14540ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145893e640 1 --2- 172.21.15.119:0/1362256961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14540ca660 0x7f14541f17c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f144800cc10 tx=0x7f144800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f14517fa640 1 -- 172.21.15.119:0/1362256961 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448017070 con 0x7f14540ca660 2024-09-12T02:56:41.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f14517fa640 1 -- 172.21.15.119:0/1362256961 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f144800ce20 con 0x7f14540ca660 2024-09-12T02:56:41.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 -- 172.21.15.119:0/1362256961 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14540cda70 con 0x7f14540ca660 2024-09-12T02:56:41.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f14517fa640 1 -- 172.21.15.119:0/1362256961 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448012640 con 0x7f14540ca660 2024-09-12T02:56:41.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 -- 172.21.15.119:0/1362256961 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f145414bce0 con 0x7f14540ca660 2024-09-12T02:56:41.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f14517fa640 1 -- 172.21.15.119:0/1362256961 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f144801a070 con 0x7f14540ca660 2024-09-12T02:56:41.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f14517fa640 1 -- 172.21.15.119:0/1362256961 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f144801cd20 con 0x7f14540ca660 2024-09-12T02:56:41.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.948+0000 7f145aba2640 1 -- 172.21.15.119:0/1362256961 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f145415c240 con 0x7f14540ca660 2024-09-12T02:56:41.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:41.952+0000 7f14517fa640 1 -- 172.21.15.119:0/1362256961 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1448021070 con 0x7f14540ca660 2024-09-12T02:56:42.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.020+0000 7f145aba2640 1 -- 172.21.15.119:0/1362256961 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9a1b1d8b-fd3f-4b94-8135-941da7cb2797", "id": 1} v 0) -- 0x7f1454157a40 con 0x7f14540ca660 2024-09-12T02:56:42.021 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:42.020+0000 7f7e9ae4d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:56:42.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f14517fa640 1 -- 172.21.15.119:0/1362256961 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a1b1d8b-fd3f-4b94-8135-941da7cb2797", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f14480127e0 con 0x7f14540ca660 2024-09-12T02:56:42.028 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-09-12T02:56:42.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f145aba2640 1 -- 172.21.15.119:0/1362256961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14540ca660 msgr2=0x7f14541f17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f145aba2640 1 --2- 172.21.15.119:0/1362256961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14540ca660 0x7f14541f17c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f144800cc10 tx=0x7f144800a430 comp rx=0 tx=0).stop 2024-09-12T02:56:42.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f145aba2640 1 -- 172.21.15.119:0/1362256961 shutdown_connections 2024-09-12T02:56:42.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f145aba2640 1 --2- 172.21.15.119:0/1362256961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1454152b80 0x7f14540ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f145aba2640 1 --2- 172.21.15.119:0/1362256961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14541527a0 0x7f1454151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f145aba2640 1 --2- 172.21.15.119:0/1362256961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14540ca660 0x7f14541f17c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f145aba2640 1 -- 172.21.15.119:0/1362256961 >> 172.21.15.119:0/1362256961 conn(0x7f145406f7e0 msgr2=0x7f145406fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:42.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f145aba2640 1 -- 172.21.15.119:0/1362256961 shutdown_connections 2024-09-12T02:56:42.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.028+0000 7f145aba2640 1 -- 172.21.15.119:0/1362256961 wait complete. 2024-09-12T02:56:42.032 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:42.028+0000 7f9a8ae2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:56:42.046 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new f23c8af2-7fa2-4e43-99de-7bf2670b72ce 2 2024-09-12T02:56:42.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.160+0000 7f335290f640 1 Processor -- start 2024-09-12T02:56:42.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.160+0000 7f335290f640 1 -- start start 2024-09-12T02:56:42.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.160+0000 7f335290f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c152800 0x7f334c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.160+0000 7f335290f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f334c15c3d0 0x7f334c06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.160+0000 7f335290f640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f334c06c490 con 0x7f334c06bcc0 2024-09-12T02:56:42.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.160+0000 7f335290f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f334c06c770 con 0x7f334c15c3d0 2024-09-12T02:56:42.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.160+0000 7f335290f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f334c0c96e0 con 0x7f334c152800 2024-09-12T02:56:42.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334bfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c152800 0x7f334c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f3350eac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f334c15c3d0 0x7f334c06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334bfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c152800 0x7f334c06e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:53846/0 (socket says 172.21.15.119:53846) 2024-09-12T02:56:42.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334bfff640 1 -- 172.21.15.119:0/2483529276 learned_addr learned my addr 172.21.15.119:0/2483529276 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:42.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334bfff640 1 -- 172.21.15.119:0/2483529276 >> v2:172.21.15.119:3300/0 conn(0x7f334c15c3d0 msgr2=0x7f334c06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:42.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334bfff640 1 --2- 172.21.15.119:0/2483529276 >> v2:172.21.15.119:3300/0 conn(0x7f334c15c3d0 0x7f334c06ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334bfff640 1 -- 172.21.15.119:0/2483529276 >> v1:172.21.15.63:6789/0 conn(0x7f334c06bcc0 legacy=0x7f334c15bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334bfff640 1 -- 172.21.15.119:0/2483529276 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c0c99c0 con 0x7f334c152800 2024-09-12T02:56:42.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334bfff640 1 --2- 172.21.15.119:0/2483529276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c152800 0x7f334c06e8d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f333c009870 tx=0x7f333c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75747ad58e8882f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:42.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334affd640 1 -- 172.21.15.119:0/2483529276 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c0a7070 con 0x7f334c152800 2024-09-12T02:56:42.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334affd640 1 -- 172.21.15.119:0/2483529276 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333c0b0070 con 0x7f334c152800 2024-09-12T02:56:42.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f334affd640 1 -- 172.21.15.119:0/2483529276 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c0ab890 con 0x7f334c152800 2024-09-12T02:56:42.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f335290f640 1 -- 172.21.15.119:0/2483529276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c152800 msgr2=0x7f334c06e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f335290f640 1 --2- 172.21.15.119:0/2483529276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c152800 0x7f334c06e8d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f333c009870 tx=0x7f333c01c560 comp rx=0 tx=0).stop 2024-09-12T02:56:42.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f335290f640 1 -- 172.21.15.119:0/2483529276 shutdown_connections 2024-09-12T02:56:42.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f335290f640 1 --2- 172.21.15.119:0/2483529276 >> v2:172.21.15.119:3300/0 conn(0x7f334c15c3d0 0x7f334c06ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f335290f640 1 --2- 172.21.15.119:0/2483529276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c152800 0x7f334c06e8d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.164+0000 7f335290f640 1 -- 172.21.15.119:0/2483529276 >> 172.21.15.119:0/2483529276 conn(0x7f334c072a80 msgr2=0x7f334c072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:42.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 -- 172.21.15.119:0/2483529276 shutdown_connections 2024-09-12T02:56:42.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 -- 172.21.15.119:0/2483529276 wait complete. 2024-09-12T02:56:42.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 Processor -- start 2024-09-12T02:56:42.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 -- start start 2024-09-12T02:56:42.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c06bcc0 0x7f334c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c152800 0x7f334c0c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f334c15c3d0 0x7f334c0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f334c152d60 con 0x7f334c152800 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f334c152be0 con 0x7f334c15c3d0 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f334c165750 con 0x7f334c06bcc0 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f3350eac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f334c15c3d0 0x7f334c0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f3350eac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f334c15c3d0 0x7f334c0c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50740/0 (socket says 172.21.15.119:50740) 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f3350eac640 1 -- 172.21.15.119:0/2623642567 learned_addr learned my addr 172.21.15.119:0/2623642567 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f334bfff640 1 --2- 172.21.15.119:0/2623642567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c06bcc0 0x7f334c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f334b7fe640 1 --2- 172.21.15.119:0/2623642567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c152800 0x7f334c0c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f334bfff640 1 -- 172.21.15.119:0/2623642567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f334c15c3d0 msgr2=0x7f334c0c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f334bfff640 1 --2- 172.21.15.119:0/2623642567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f334c15c3d0 0x7f334c0c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f334bfff640 1 -- 172.21.15.119:0/2623642567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c152800 msgr2=0x7f334c0c4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f334bfff640 1 --2- 172.21.15.119:0/2623642567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c152800 0x7f334c0c4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f334bfff640 1 -- 172.21.15.119:0/2623642567 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c0c7240 con 0x7f334c06bcc0 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f334bfff640 1 --2- 172.21.15.119:0/2623642567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c06bcc0 0x7f334c0cd920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f334c06f570 tx=0x7f333c01ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:42.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f3348ff9640 1 -- 172.21.15.119:0/2623642567 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c0be640 con 0x7f334c06bcc0 2024-09-12T02:56:42.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f3348ff9640 1 -- 172.21.15.119:0/2623642567 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333c0be800 con 0x7f334c06bcc0 2024-09-12T02:56:42.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f3348ff9640 1 -- 172.21.15.119:0/2623642567 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c0bebf0 con 0x7f334c06bcc0 2024-09-12T02:56:42.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 -- 172.21.15.119:0/2623642567 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334c1f8040 con 0x7f334c06bcc0 2024-09-12T02:56:42.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f335290f640 1 -- 172.21.15.119:0/2623642567 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f334c156f70 con 0x7f334c06bcc0 2024-09-12T02:56:42.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f3348ff9640 1 -- 172.21.15.119:0/2623642567 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f333c0b4780 con 0x7f334c06bcc0 2024-09-12T02:56:42.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.168+0000 7f3348ff9640 1 -- 172.21.15.119:0/2623642567 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f333c0c7bd0 con 0x7f334c06bcc0 2024-09-12T02:56:42.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.172+0000 7f335290f640 1 -- 172.21.15.119:0/2623642567 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f334c15bcc0 con 0x7f334c06bcc0 2024-09-12T02:56:42.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.172+0000 7f3348ff9640 1 -- 172.21.15.119:0/2623642567 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f333c016150 con 0x7f334c06bcc0 2024-09-12T02:56:42.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.248+0000 7f335290f640 1 -- 172.21.15.119:0/2623642567 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f23c8af2-7fa2-4e43-99de-7bf2670b72ce", "id": 2} v 0) -- 0x7f334c0c3cf0 con 0x7f334c06bcc0 2024-09-12T02:56:42.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.252+0000 7f3348ff9640 1 -- 172.21.15.119:0/2623642567 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f23c8af2-7fa2-4e43-99de-7bf2670b72ce", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f333c0c73a0 con 0x7f334c06bcc0 2024-09-12T02:56:42.254 INFO:teuthology.orchestra.run.smithi119.stdout:2 2024-09-12T02:56:42.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.256+0000 7f335290f640 1 -- 172.21.15.119:0/2623642567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c06bcc0 msgr2=0x7f334c0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.256+0000 7f335290f640 1 --2- 172.21.15.119:0/2623642567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c06bcc0 0x7f334c0cd920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f334c06f570 tx=0x7f333c01ada0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.256+0000 7f335290f640 1 -- 172.21.15.119:0/2623642567 shutdown_connections 2024-09-12T02:56:42.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.256+0000 7f335290f640 1 --2- 172.21.15.119:0/2623642567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f334c15c3d0 0x7f334c0c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.256+0000 7f335290f640 1 --2- 172.21.15.119:0/2623642567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f334c152800 0x7f334c0c4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.256+0000 7f335290f640 1 --2- 172.21.15.119:0/2623642567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f334c06bcc0 0x7f334c0cd920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.256+0000 7f335290f640 1 -- 172.21.15.119:0/2623642567 >> 172.21.15.119:0/2623642567 conn(0x7f334c072a80 msgr2=0x7f334c06e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:42.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.256+0000 7f335290f640 1 -- 172.21.15.119:0/2623642567 shutdown_connections 2024-09-12T02:56:42.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.256+0000 7f335290f640 1 -- 172.21.15.119:0/2623642567 wait complete. 2024-09-12T02:56:42.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 0b6a2786-33e7-4286-92f4-e8d25573149a 3 2024-09-12T02:56:42.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53f76d640 1 Processor -- start 2024-09-12T02:56:42.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53f76d640 1 -- start start 2024-09-12T02:56:42.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53f76d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff5380ce3b0 0x7ff5380ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53f76d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380ce790 0x7ff5381524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53f76d640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5380caa40 con 0x7ff5380c8bc0 2024-09-12T02:56:42.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53f76d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff5380c9340 con 0x7ff5380ce3b0 2024-09-12T02:56:42.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53f76d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff5380ca760 con 0x7ff5380ce790 2024-09-12T02:56:42.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53d509640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff5380ce3b0 0x7ff5380ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53cd08640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380ce790 0x7ff5381524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53d509640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff5380ce3b0 0x7ff5380ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50750/0 (socket says 172.21.15.119:50750) 2024-09-12T02:56:42.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53d509640 1 -- 172.21.15.119:0/2551731606 learned_addr learned my addr 172.21.15.119:0/2551731606 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:42.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53cd08640 1 -- 172.21.15.119:0/2551731606 >> v2:172.21.15.119:3300/0 conn(0x7ff5380ce3b0 msgr2=0x7ff5380ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:42.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53cd08640 1 --2- 172.21.15.119:0/2551731606 >> v2:172.21.15.119:3300/0 conn(0x7ff5380ce3b0 0x7ff5380ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53cd08640 1 -- 172.21.15.119:0/2551731606 >> v1:172.21.15.63:6789/0 conn(0x7ff5380c8bc0 legacy=0x7ff53806f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.384+0000 7ff53cd08640 1 -- 172.21.15.119:0/2551731606 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5380c95e0 con 0x7ff5380ce790 2024-09-12T02:56:42.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff53cd08640 1 --2- 172.21.15.119:0/2551731606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380ce790 0x7ff5381524b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff5280097c0 tx=0x7ff52801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1846c1d039a21253 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:42.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff52ffff640 1 -- 172.21.15.119:0/2551731606 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5280a7070 con 0x7ff5380ce790 2024-09-12T02:56:42.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff52ffff640 1 -- 172.21.15.119:0/2551731606 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5280b0070 con 0x7ff5380ce790 2024-09-12T02:56:42.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff52ffff640 1 -- 172.21.15.119:0/2551731606 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5280ab890 con 0x7ff5380ce790 2024-09-12T02:56:42.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff53f76d640 1 -- 172.21.15.119:0/2551731606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380ce790 msgr2=0x7ff5381524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff53f76d640 1 --2- 172.21.15.119:0/2551731606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380ce790 0x7ff5381524b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff5280097c0 tx=0x7ff52801c470 comp rx=0 tx=0).stop 2024-09-12T02:56:42.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff53f76d640 1 -- 172.21.15.119:0/2551731606 shutdown_connections 2024-09-12T02:56:42.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff53f76d640 1 --2- 172.21.15.119:0/2551731606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380ce790 0x7ff5381524b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff53f76d640 1 --2- 172.21.15.119:0/2551731606 >> v2:172.21.15.119:3300/0 conn(0x7ff5380ce3b0 0x7ff5380ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff53f76d640 1 -- 172.21.15.119:0/2551731606 >> 172.21.15.119:0/2551731606 conn(0x7ff538071690 msgr2=0x7ff538071aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:42.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff53f76d640 1 -- 172.21.15.119:0/2551731606 shutdown_connections 2024-09-12T02:56:42.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.388+0000 7ff53f76d640 1 -- 172.21.15.119:0/2551731606 wait complete. 2024-09-12T02:56:42.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 Processor -- start 2024-09-12T02:56:42.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 -- start start 2024-09-12T02:56:42.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380c8bc0 0x7ff5380cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5380ce3b0 0x7ff5380ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5380ce790 0x7ff53814bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff538152d80 con 0x7ff5380ce3b0 2024-09-12T02:56:42.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff538152c00 con 0x7ff5380ce790 2024-09-12T02:56:42.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff538165780 con 0x7ff5380c8bc0 2024-09-12T02:56:42.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53d509640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380c8bc0 0x7ff5380cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53dd0a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5380ce790 0x7ff53814bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53d509640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380c8bc0 0x7ff5380cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:53872/0 (socket says 172.21.15.119:53872) 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53d509640 1 -- 172.21.15.119:0/1324067957 learned_addr learned my addr 172.21.15.119:0/1324067957 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53cd08640 1 --2- 172.21.15.119:0/1324067957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5380ce3b0 0x7ff5380ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53d509640 1 -- 172.21.15.119:0/1324067957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5380ce790 msgr2=0x7ff53814bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53d509640 1 --2- 172.21.15.119:0/1324067957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5380ce790 0x7ff53814bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53d509640 1 -- 172.21.15.119:0/1324067957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5380ce3b0 msgr2=0x7ff5380ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53d509640 1 --2- 172.21.15.119:0/1324067957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5380ce3b0 0x7ff5380ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53d509640 1 -- 172.21.15.119:0/1324067957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5381554e0 con 0x7ff5380c8bc0 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53d509640 1 --2- 172.21.15.119:0/1324067957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380c8bc0 0x7ff5380cd3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff53400e7f0 tx=0x7ff53400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff52dffb640 1 -- 172.21.15.119:0/1324067957 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534017070 con 0x7ff5380c8bc0 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff52dffb640 1 -- 172.21.15.119:0/1324067957 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53400c940 con 0x7ff5380c8bc0 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff52dffb640 1 -- 172.21.15.119:0/1324067957 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53400cd30 con 0x7ff5380c8bc0 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 -- 172.21.15.119:0/1324067957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff538155bd0 con 0x7ff5380c8bc0 2024-09-12T02:56:42.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 -- 172.21.15.119:0/1324067957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff538070200 con 0x7ff5380c8bc0 2024-09-12T02:56:42.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff52dffb640 1 -- 172.21.15.119:0/1324067957 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff53401a070 con 0x7ff5380c8bc0 2024-09-12T02:56:42.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff52dffb640 1 -- 172.21.15.119:0/1324067957 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ff534013470 con 0x7ff5380c8bc0 2024-09-12T02:56:42.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.392+0000 7ff53f76d640 1 -- 172.21.15.119:0/1324067957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5380ca120 con 0x7ff5380c8bc0 2024-09-12T02:56:42.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.396+0000 7ff52dffb640 1 -- 172.21.15.119:0/1324067957 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff534006020 con 0x7ff5380c8bc0 2024-09-12T02:56:42.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.464+0000 7ff53f76d640 1 -- 172.21.15.119:0/1324067957 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0b6a2786-33e7-4286-92f4-e8d25573149a", "id": 3} v 0) -- 0x7ff5380aac30 con 0x7ff5380c8bc0 2024-09-12T02:56:42.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff52dffb640 1 -- 172.21.15.119:0/1324067957 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b6a2786-33e7-4286-92f4-e8d25573149a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ff534006480 con 0x7ff5380c8bc0 2024-09-12T02:56:42.471 INFO:teuthology.orchestra.run.smithi119.stdout:3 2024-09-12T02:56:42.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff53f76d640 1 -- 172.21.15.119:0/1324067957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380c8bc0 msgr2=0x7ff5380cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff53f76d640 1 --2- 172.21.15.119:0/1324067957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380c8bc0 0x7ff5380cd3a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff53400e7f0 tx=0x7ff53400ecb0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff53f76d640 1 -- 172.21.15.119:0/1324067957 shutdown_connections 2024-09-12T02:56:42.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff53f76d640 1 --2- 172.21.15.119:0/1324067957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5380ce790 0x7ff53814bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff53f76d640 1 --2- 172.21.15.119:0/1324067957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5380ce3b0 0x7ff5380ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff53f76d640 1 --2- 172.21.15.119:0/1324067957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5380c8bc0 0x7ff5380cd3a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff53f76d640 1 -- 172.21.15.119:0/1324067957 >> 172.21.15.119:0/1324067957 conn(0x7ff538071690 msgr2=0x7ff5380cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:42.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff53f76d640 1 -- 172.21.15.119:0/1324067957 shutdown_connections 2024-09-12T02:56:42.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.472+0000 7ff53f76d640 1 -- 172.21.15.119:0/1324067957 wait complete. 2024-09-12T02:56:42.487 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new cdd5dfe1-3893-42ee-8706-50ef5c92ac9f 4 2024-09-12T02:56:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.604+0000 7f7f1ecb1640 1 Processor -- start 2024-09-12T02:56:42.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.604+0000 7f7f1ecb1640 1 -- start start 2024-09-12T02:56:42.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1ecb1640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7f18152740 0x7f7f180c6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1ecb1640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f18158bd0 con 0x7f7f18152b20 2024-09-12T02:56:42.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1ecb1640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f18158eb0 con 0x7f7f180c8bc0 2024-09-12T02:56:42.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1ecb1640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7f180c7d40 con 0x7f7f18152740 2024-09-12T02:56:42.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1d24e640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7f180c8bc0 0x7f7f180c4350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:45190/0 (socket says 172.21.15.119:45190) 2024-09-12T02:56:42.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1d24e640 1 -- 172.21.15.119:0/3830718186 learned_addr learned my addr 172.21.15.119:0/3830718186 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:56:42.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1ca4d640 1 --2- 172.21.15.119:0/3830718186 >> v2:172.21.15.63:3300/0 conn(0x7f7f18152740 0x7f7f180c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999336884 0 0) 0x7f7f18158eb0 con 0x7f7f180c8bc0 2024-09-12T02:56:42.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f04003530 con 0x7f7f180c8bc0 2024-09-12T02:56:42.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 989247748 0 0) 0x7f7f04003530 con 0x7f7f180c8bc0 2024-09-12T02:56:42.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 >> v2:172.21.15.63:3300/0 conn(0x7f7f18152740 msgr2=0x7f7f180c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:42.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 --2- 172.21.15.119:0/3830718186 >> v2:172.21.15.63:3300/0 conn(0x7f7f18152740 0x7f7f180c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 >> v1:172.21.15.63:6789/0 conn(0x7f7f18152b20 legacy=0x7f7f180c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f18159190 con 0x7f7f180c8bc0 2024-09-12T02:56:42.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f7f10001680 con 0x7f7f180c8bc0 2024-09-12T02:56:42.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 >> v1:172.21.15.119:6789/0 conn(0x7f7f180c8bc0 legacy=0x7f7f180c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f040039c0 0x7f7f04003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f04004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f040051d0 0x7f7f0400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7f180c7d40 con 0x7f7f040039c0 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0400c070 con 0x7f7f040051d0 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0400c270 con 0x7f7f04004810 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f17fff640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f04004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1d24e640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f040051d0 0x7f7f0400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1ca4d640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f040039c0 0x7f7f04003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f17fff640 1 -- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f040051d0 msgr2=0x7f7f0400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f17fff640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f040051d0 0x7f7f0400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f17fff640 1 -- 172.21.15.119:0/3830718186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f040039c0 msgr2=0x7f7f04003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f17fff640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f040039c0 0x7f7f04003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f17fff640 1 -- 172.21.15.119:0/3830718186 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f04003530 con 0x7f7f04004810 2024-09-12T02:56:42.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f1d24e640 1 -- 172.21.15.119:0/3830718186 reap_dead start 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.608+0000 7f7f17fff640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f04004c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f00001750 tx=0x7f7f0001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2b2179d2993e50d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f000013a0 con 0x7f7f04004810 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f000052f0 con 0x7f7f04004810 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f177fe640 1 -- 172.21.15.119:0/3830718186 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00003840 con 0x7f7f04004810 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 msgr2=0x7f7f04004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f1ecb1640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f04004c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f00001750 tx=0x7f7f0001c3e0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3830718186 shutdown_connections 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f1ecb1640 1 --2- 172.21.15.119:0/3830718186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f04004c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3830718186 >> 172.21.15.119:0/3830718186 conn(0x7f7f180702e0 msgr2=0x7f7f180c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3830718186 shutdown_connections 2024-09-12T02:56:42.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3830718186 wait complete. 2024-09-12T02:56:42.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f1ecb1640 1 Processor -- start 2024-09-12T02:56:42.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.612+0000 7f7f1ecb1640 1 -- start start 2024-09-12T02:56:42.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ecb1640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f18159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ecb1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f180cb140 0x7f7f181486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ecb1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f180cbda0 0x7f7f18146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ecb1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7f180c8630 con 0x7f7f180cb140 2024-09-12T02:56:42.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ecb1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f180c84b0 con 0x7f7f180cbda0 2024-09-12T02:56:42.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ecb1640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7f180c87b0 con 0x7f7f04004810 2024-09-12T02:56:42.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ca4d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f18159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ca4d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f18159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:53902/0 (socket says 172.21.15.119:53902) 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ca4d640 1 -- 172.21.15.119:0/3944548199 learned_addr learned my addr 172.21.15.119:0/3944548199 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1d24e640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f180cbda0 0x7f7f18146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f17fff640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f180cb140 0x7f7f181486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ca4d640 1 -- 172.21.15.119:0/3944548199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f180cbda0 msgr2=0x7f7f18146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ca4d640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f180cbda0 0x7f7f18146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ca4d640 1 -- 172.21.15.119:0/3944548199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f180cb140 msgr2=0x7f7f181486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ca4d640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f180cb140 0x7f7f181486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ca4d640 1 -- 172.21.15.119:0/3944548199 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f181582d0 con 0x7f7f04004810 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1d24e640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f180cbda0 0x7f7f18146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ca4d640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f18159830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009f90 tx=0x7f7f0800f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f157fa640 1 -- 172.21.15.119:0/3944548199 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800fea0 con 0x7f7f04004810 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f157fa640 1 -- 172.21.15.119:0/3944548199 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f08015630 con 0x7f7f04004810 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f157fa640 1 -- 172.21.15.119:0/3944548199 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08015a00 con 0x7f7f04004810 2024-09-12T02:56:42.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3944548199 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f180caa90 con 0x7f7f04004810 2024-09-12T02:56:42.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3944548199 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f1815b550 con 0x7f7f04004810 2024-09-12T02:56:42.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f157fa640 1 -- 172.21.15.119:0/3944548199 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f08015ba0 con 0x7f7f04004810 2024-09-12T02:56:42.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f157fa640 1 -- 172.21.15.119:0/3944548199 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f7f08026900 con 0x7f7f04004810 2024-09-12T02:56:42.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.616+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3944548199 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f1815c470 con 0x7f7f04004810 2024-09-12T02:56:42.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.620+0000 7f7f157fa640 1 -- 172.21.15.119:0/3944548199 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7f181582d0 con 0x7f7f04004810 2024-09-12T02:56:42.625 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:42.624+0000 7f7e9ae4d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:56:42.675 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:42.668+0000 7f9a8ae2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:56:42.680 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:42.680+0000 7f7e9ae4d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:56:42.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.684+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3944548199 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cdd5dfe1-3893-42ee-8706-50ef5c92ac9f", "id": 4} v 0) -- 0x7f7f180cb9c0 con 0x7f7f04004810 2024-09-12T02:56:42.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.688+0000 7f7f157fa640 1 -- 172.21.15.119:0/3944548199 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cdd5dfe1-3893-42ee-8706-50ef5c92ac9f", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f7f08019030 con 0x7f7f04004810 2024-09-12T02:56:42.689 INFO:teuthology.orchestra.run.smithi119.stdout:4 2024-09-12T02:56:42.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.688+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3944548199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 msgr2=0x7f7f18159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.688+0000 7f7f1ecb1640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f18159830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009f90 tx=0x7f7f0800f580 comp rx=0 tx=0).stop 2024-09-12T02:56:42.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.688+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3944548199 shutdown_connections 2024-09-12T02:56:42.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.688+0000 7f7f1ecb1640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f180cbda0 0x7f7f18146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.688+0000 7f7f1ecb1640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f180cb140 0x7f7f181486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.688+0000 7f7f1ecb1640 1 --2- 172.21.15.119:0/3944548199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f04004810 0x7f7f18159830 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.692+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3944548199 >> 172.21.15.119:0/3944548199 conn(0x7f7f180702e0 msgr2=0x7f7f180c4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:42.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.692+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3944548199 shutdown_connections 2024-09-12T02:56:42.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.692+0000 7f7f1ecb1640 1 -- 172.21.15.119:0/3944548199 wait complete. 2024-09-12T02:56:42.706 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 442157e7-0a20-45b7-a3b6-f4a930643516 5 2024-09-12T02:56:42.736 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:42.736+0000 7f7e9ae4d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:56:42.740 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:42.736+0000 7f9a8ae2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:56:42.805 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:42.800+0000 7f9a8ae2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:56:42.816 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:42.816+0000 7f7e9ae4d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:56:42.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.820+0000 7ffba7cad640 1 Processor -- start 2024-09-12T02:56:42.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.820+0000 7ffba7cad640 1 -- start start 2024-09-12T02:56:42.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba7cad640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffba0151810 0x7ffba006f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba7cad640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffba00c5ab0 0x7ffba00c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba7cad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 0x7ffba00c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba7cad640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ffba006edb0 con 0x7ffba00c5ab0 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba7cad640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ffba00c9b30 con 0x7ffba0151810 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba7cad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ffba00c49e0 con 0x7ffba006faa0 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba5a49640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffba0151810 0x7ffba006f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba624a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 0x7ffba00c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba5a49640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffba0151810 0x7ffba006f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50784/0 (socket says 172.21.15.119:50784) 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba5a49640 1 -- 172.21.15.119:0/990390529 learned_addr learned my addr 172.21.15.119:0/990390529 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba5248640 1 --2- 172.21.15.119:0/990390529 >> v2:172.21.15.63:3300/0 conn(0x7ffba00c5ab0 0x7ffba00c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba624a640 1 -- 172.21.15.119:0/990390529 >> v2:172.21.15.119:3300/0 conn(0x7ffba0151810 msgr2=0x7ffba006f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba624a640 1 --2- 172.21.15.119:0/990390529 >> v2:172.21.15.119:3300/0 conn(0x7ffba0151810 0x7ffba006f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba624a640 1 -- 172.21.15.119:0/990390529 >> v2:172.21.15.63:3300/0 conn(0x7ffba00c5ab0 msgr2=0x7ffba00c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba624a640 1 --2- 172.21.15.119:0/990390529 >> v2:172.21.15.63:3300/0 conn(0x7ffba00c5ab0 0x7ffba00c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba624a640 1 -- 172.21.15.119:0/990390529 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba00c9dd0 con 0x7ffba006faa0 2024-09-12T02:56:42.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba5a49640 1 --2- 172.21.15.119:0/990390529 >> v2:172.21.15.119:3300/0 conn(0x7ffba0151810 0x7ffba006f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:56:42.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba5248640 1 --2- 172.21.15.119:0/990390529 >> v2:172.21.15.63:3300/0 conn(0x7ffba00c5ab0 0x7ffba00c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:56:42.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba624a640 1 --2- 172.21.15.119:0/990390529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 0x7ffba00c94b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffba0072070 tx=0x7ffb9801eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d247a90bf43b69a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:42.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba4a47640 1 -- 172.21.15.119:0/990390529 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9800b2d0 con 0x7ffba006faa0 2024-09-12T02:56:42.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba4a47640 1 -- 172.21.15.119:0/990390529 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb980a7990 con 0x7ffba006faa0 2024-09-12T02:56:42.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.824+0000 7ffba4a47640 1 -- 172.21.15.119:0/990390529 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb980a7d60 con 0x7ffba006faa0 2024-09-12T02:56:42.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- 172.21.15.119:0/990390529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 msgr2=0x7ffba00c94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 --2- 172.21.15.119:0/990390529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 0x7ffba00c94b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffba0072070 tx=0x7ffb9801eb00 comp rx=0 tx=0).stop 2024-09-12T02:56:42.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- 172.21.15.119:0/990390529 shutdown_connections 2024-09-12T02:56:42.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 --2- 172.21.15.119:0/990390529 >> v2:172.21.15.63:3300/0 conn(0x7ffba00c5ab0 0x7ffba00c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 --2- 172.21.15.119:0/990390529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 0x7ffba00c94b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 --2- 172.21.15.119:0/990390529 >> v2:172.21.15.119:3300/0 conn(0x7ffba0151810 0x7ffba006f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- 172.21.15.119:0/990390529 >> 172.21.15.119:0/990390529 conn(0x7ffba0072d60 msgr2=0x7ffba006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:42.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- 172.21.15.119:0/990390529 shutdown_connections 2024-09-12T02:56:42.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- 172.21.15.119:0/990390529 wait complete. 2024-09-12T02:56:42.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 Processor -- start 2024-09-12T02:56:42.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- start start 2024-09-12T02:56:42.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 0x7ffba0138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffba00c5ab0 0x7ffba01f6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffba0151810 0x7ffba014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:42.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffba0151d70 con 0x7ffba00c5ab0 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffba0151bf0 con 0x7ffba0151810 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ffba00c7fd0 con 0x7ffba006faa0 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba624a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffba0151810 0x7ffba014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba624a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffba0151810 0x7ffba014cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50792/0 (socket says 172.21.15.119:50792) 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba624a640 1 -- 172.21.15.119:0/2690246742 learned_addr learned my addr 172.21.15.119:0/2690246742 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba5a49640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 0x7ffba0138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba5248640 1 --2- 172.21.15.119:0/2690246742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffba00c5ab0 0x7ffba01f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba624a640 1 -- 172.21.15.119:0/2690246742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 msgr2=0x7ffba0138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba624a640 1 --2- 172.21.15.119:0/2690246742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 0x7ffba0138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba624a640 1 -- 172.21.15.119:0/2690246742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffba00c5ab0 msgr2=0x7ffba01f6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba624a640 1 --2- 172.21.15.119:0/2690246742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffba00c5ab0 0x7ffba01f6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba624a640 1 -- 172.21.15.119:0/2690246742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba01f6dd0 con 0x7ffba0151810 2024-09-12T02:56:42.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba624a640 1 --2- 172.21.15.119:0/2690246742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffba0151810 0x7ffba014cde0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb9801f3a0 tx=0x7ffb9801b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:42.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffb967fc640 1 -- 172.21.15.119:0/2690246742 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb980be070 con 0x7ffba0151810 2024-09-12T02:56:42.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffb967fc640 1 -- 172.21.15.119:0/2690246742 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb98009740 con 0x7ffba0151810 2024-09-12T02:56:42.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- 172.21.15.119:0/2690246742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba0145230 con 0x7ffba0151810 2024-09-12T02:56:42.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffb967fc640 1 -- 172.21.15.119:0/2690246742 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98009b30 con 0x7ffba0151810 2024-09-12T02:56:42.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.828+0000 7ffba7cad640 1 -- 172.21.15.119:0/2690246742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba01406a0 con 0x7ffba0151810 2024-09-12T02:56:42.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.832+0000 7ffb967fc640 1 -- 172.21.15.119:0/2690246742 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffb980c1070 con 0x7ffba0151810 2024-09-12T02:56:42.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.832+0000 7ffb967fc640 1 -- 172.21.15.119:0/2690246742 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7ffb980b9990 con 0x7ffba0151810 2024-09-12T02:56:42.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.832+0000 7ffba7cad640 1 -- 172.21.15.119:0/2690246742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba00c45a0 con 0x7ffba0151810 2024-09-12T02:56:42.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.832+0000 7ffb967fc640 1 -- 172.21.15.119:0/2690246742 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ffb980c8080 con 0x7ffba0151810 2024-09-12T02:56:42.869 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:42.868+0000 7f7e9ae4d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:56:42.898 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:42.892+0000 7f9a8ae2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:56:42.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.900+0000 7ffba7cad640 1 -- 172.21.15.119:0/2690246742 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "442157e7-0a20-45b7-a3b6-f4a930643516", "id": 5} v 0) -- 0x7ffba0145010 con 0x7ffba0151810 2024-09-12T02:56:42.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.904+0000 7ffb967fc640 1 -- 172.21.15.119:0/2690246742 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "442157e7-0a20-45b7-a3b6-f4a930643516", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7ffb98018720 con 0x7ffba0151810 2024-09-12T02:56:42.906 INFO:teuthology.orchestra.run.smithi119.stdout:5 2024-09-12T02:56:42.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.908+0000 7ffba7cad640 1 -- 172.21.15.119:0/2690246742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffba0151810 msgr2=0x7ffba014cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:42.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.908+0000 7ffba7cad640 1 --2- 172.21.15.119:0/2690246742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffba0151810 0x7ffba014cde0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb9801f3a0 tx=0x7ffb9801b8a0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.908+0000 7ffba7cad640 1 -- 172.21.15.119:0/2690246742 shutdown_connections 2024-09-12T02:56:42.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.908+0000 7ffba7cad640 1 --2- 172.21.15.119:0/2690246742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffba0151810 0x7ffba014cde0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.908+0000 7ffba7cad640 1 --2- 172.21.15.119:0/2690246742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffba00c5ab0 0x7ffba01f6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.908+0000 7ffba7cad640 1 --2- 172.21.15.119:0/2690246742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffba006faa0 0x7ffba0138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:42.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.908+0000 7ffba7cad640 1 -- 172.21.15.119:0/2690246742 >> 172.21.15.119:0/2690246742 conn(0x7ffba0072d60 msgr2=0x7ffba0148140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:42.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.908+0000 7ffba7cad640 1 -- 172.21.15.119:0/2690246742 shutdown_connections 2024-09-12T02:56:42.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:42.908+0000 7ffba7cad640 1 -- 172.21.15.119:0/2690246742 wait complete. 2024-09-12T02:56:42.922 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 0f1cd9bc-aafa-4004-b7e5-6ea6e409d398 6 2024-09-12T02:56:42.949 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:42.948+0000 7f7e9ae4d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:56:42.965 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:42.960+0000 7f9a8ae2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:56:43.004 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:43.004+0000 7f7e9ae4d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:56:43.058 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:43.052+0000 7f9a8ae2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:56:43.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d089e5640 1 Processor -- start 2024-09-12T02:56:43.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d089e5640 1 -- start start 2024-09-12T02:56:43.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d089e5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5d0406faa0 0x7f5d04162e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d089e5640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d040c9b30 con 0x7f5d040c5ab0 2024-09-12T02:56:43.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d089e5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d040c49e0 con 0x7f5d04151810 2024-09-12T02:56:43.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d089e5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5d0406edb0 con 0x7f5d0406faa0 2024-09-12T02:56:43.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d0259c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5d04151810 0x7f5d0406f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:45198/0 (socket says 172.21.15.119:45198) 2024-09-12T02:56:43.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d02d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5d0406faa0 0x7f5d04162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d0259c640 1 -- 172.21.15.119:0/2444674561 learned_addr learned my addr 172.21.15.119:0/2444674561 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:56:43.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d02d9d640 1 -- 172.21.15.119:0/2444674561 >> v1:172.21.15.119:6789/0 conn(0x7f5d04151810 legacy=0x7f5d0406f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d02d9d640 1 -- 172.21.15.119:0/2444674561 >> v1:172.21.15.63:6789/0 conn(0x7f5d040c5ab0 legacy=0x7f5d040c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.060+0000 7f5d02d9d640 1 -- 172.21.15.119:0/2444674561 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d040c9dd0 con 0x7f5d0406faa0 2024-09-12T02:56:43.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d02d9d640 1 --2- 172.21.15.119:0/2444674561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 0x7f5d04162e90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009d90 tx=0x7f5cfc01eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a17217880d49bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d01d9b640 1 -- 172.21.15.119:0/2444674561 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0b4070 con 0x7f5d0406faa0 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d01d9b640 1 -- 172.21.15.119:0/2444674561 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cfc0a7a40 con 0x7f5d0406faa0 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d01d9b640 1 -- 172.21.15.119:0/2444674561 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0a7e10 con 0x7f5d0406faa0 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d089e5640 1 -- 172.21.15.119:0/2444674561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 msgr2=0x7f5d04162e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d089e5640 1 --2- 172.21.15.119:0/2444674561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 0x7f5d04162e90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009d90 tx=0x7f5cfc01eb80 comp rx=0 tx=0).stop 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d089e5640 1 -- 172.21.15.119:0/2444674561 shutdown_connections 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d089e5640 1 --2- 172.21.15.119:0/2444674561 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 0x7f5d04162e90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d089e5640 1 -- 172.21.15.119:0/2444674561 >> 172.21.15.119:0/2444674561 conn(0x7f5d04072d60 msgr2=0x7f5d0406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d089e5640 1 -- 172.21.15.119:0/2444674561 shutdown_connections 2024-09-12T02:56:43.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d089e5640 1 -- 172.21.15.119:0/2444674561 wait complete. 2024-09-12T02:56:43.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d089e5640 1 Processor -- start 2024-09-12T02:56:43.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.064+0000 7f5d089e5640 1 -- start start 2024-09-12T02:56:43.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d089e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 0x7f5d0415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d089e5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d040c5ab0 0x7f5d040cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d089e5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d04151810 0x7f5d0414c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d089e5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040c8150 con 0x7f5d04151810 2024-09-12T02:56:43.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d089e5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d040c7fd0 con 0x7f5d0406faa0 2024-09-12T02:56:43.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d089e5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5d040c45a0 con 0x7f5d040c5ab0 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d0259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 0x7f5d0415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5cfbfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d040c5ab0 0x7f5d040cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d0259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 0x7f5d0415dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:50806/0 (socket says 172.21.15.119:50806) 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d0259c640 1 -- 172.21.15.119:0/79820168 learned_addr learned my addr 172.21.15.119:0/79820168 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d02d9d640 1 --2- 172.21.15.119:0/79820168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d04151810 0x7f5d0414c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d0259c640 1 -- 172.21.15.119:0/79820168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d040c5ab0 msgr2=0x7f5d040cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d0259c640 1 --2- 172.21.15.119:0/79820168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d040c5ab0 0x7f5d040cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d0259c640 1 -- 172.21.15.119:0/79820168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d04151810 msgr2=0x7f5d0414c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d0259c640 1 --2- 172.21.15.119:0/79820168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d04151810 0x7f5d0414c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d0259c640 1 -- 172.21.15.119:0/79820168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0414aa00 con 0x7f5d0406faa0 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d0259c640 1 --2- 172.21.15.119:0/79820168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 0x7f5d0415dd50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400c400 tx=0x7f5cf400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5cfaffd640 1 -- 172.21.15.119:0/79820168 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4017070 con 0x7f5d0406faa0 2024-09-12T02:56:43.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5cfaffd640 1 -- 172.21.15.119:0/79820168 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4005cf0 con 0x7f5d0406faa0 2024-09-12T02:56:43.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d089e5640 1 -- 172.21.15.119:0/79820168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0414a760 con 0x7f5d0406faa0 2024-09-12T02:56:43.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5cfaffd640 1 -- 172.21.15.119:0/79820168 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40072d0 con 0x7f5d0406faa0 2024-09-12T02:56:43.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d089e5640 1 -- 172.21.15.119:0/79820168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d040ccb00 con 0x7f5d0406faa0 2024-09-12T02:56:43.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5cfaffd640 1 -- 172.21.15.119:0/79820168 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5cf401a070 con 0x7f5d0406faa0 2024-09-12T02:56:43.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5cfaffd640 1 -- 172.21.15.119:0/79820168 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5cf401cbc0 con 0x7f5d0406faa0 2024-09-12T02:56:43.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.068+0000 7f5d089e5640 1 -- 172.21.15.119:0/79820168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0406f240 con 0x7f5d0406faa0 2024-09-12T02:56:43.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.072+0000 7f5cfaffd640 1 -- 172.21.15.119:0/79820168 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5cf40074d0 con 0x7f5d0406faa0 2024-09-12T02:56:43.129 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:43.124+0000 7f9a8ae2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:56:43.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.139+0000 7f5d089e5640 1 -- 172.21.15.119:0/79820168 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0f1cd9bc-aafa-4004-b7e5-6ea6e409d398", "id": 6} v 0) -- 0x7f5d040ccd30 con 0x7f5d0406faa0 2024-09-12T02:56:43.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.143+0000 7f5cfaffd640 1 -- 172.21.15.119:0/79820168 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f1cd9bc-aafa-4004-b7e5-6ea6e409d398", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5cf401c440 con 0x7f5d0406faa0 2024-09-12T02:56:43.146 INFO:teuthology.orchestra.run.smithi119.stdout:6 2024-09-12T02:56:43.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.147+0000 7f5d089e5640 1 -- 172.21.15.119:0/79820168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 msgr2=0x7f5d0415dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.147+0000 7f5d089e5640 1 --2- 172.21.15.119:0/79820168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 0x7f5d0415dd50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400c400 tx=0x7f5cf400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.147+0000 7f5d089e5640 1 -- 172.21.15.119:0/79820168 shutdown_connections 2024-09-12T02:56:43.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.147+0000 7f5d089e5640 1 --2- 172.21.15.119:0/79820168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d04151810 0x7f5d0414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.147+0000 7f5d089e5640 1 --2- 172.21.15.119:0/79820168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d040c5ab0 0x7f5d040cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.147+0000 7f5d089e5640 1 --2- 172.21.15.119:0/79820168 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d0406faa0 0x7f5d0415dd50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.147+0000 7f5d089e5640 1 -- 172.21.15.119:0/79820168 >> 172.21.15.119:0/79820168 conn(0x7f5d04072d60 msgr2=0x7f5d040c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:43.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.147+0000 7f5d089e5640 1 -- 172.21.15.119:0/79820168 shutdown_connections 2024-09-12T02:56:43.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.147+0000 7f5d089e5640 1 -- 172.21.15.119:0/79820168 wait complete. 2024-09-12T02:56:43.163 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new ac41ac05-d082-43f8-93ec-ba27bf53fd08 7 2024-09-12T02:56:43.165 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:43.163+0000 7f7e9ae4d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:56:43.228 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:43.227+0000 7f7e9ae4d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:56:43.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76c1f2c640 1 Processor -- start 2024-09-12T02:56:43.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76c1f2c640 1 -- start start 2024-09-12T02:56:43.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76c1f2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151c10 0x7f76bc0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76c1f2c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f76bc072f40 0x7f76bc0c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76c1f2c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc0c38b0 con 0x7f76bc151830 2024-09-12T02:56:43.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76c1f2c640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f76bc0c3fb0 con 0x7f76bc072f40 2024-09-12T02:56:43.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76c1f2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc06d170 con 0x7f76bc151c10 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76bb7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f76bc151830 0x7f76bc1576c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:45302/0 (socket says 172.21.15.119:45302) 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76bb7fe640 1 -- 172.21.15.119:0/1093757470 learned_addr learned my addr 172.21.15.119:0/1093757470 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.279+0000 7f76baffd640 1 --2- 172.21.15.119:0/1093757470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151c10 0x7f76bc0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76bbfff640 1 --2- 172.21.15.119:0/1093757470 >> v2:172.21.15.63:3300/0 conn(0x7f76bc072f40 0x7f76bc0c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76ba7fc640 1 -- 172.21.15.119:0/1093757470 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3331725649 0 0) 0x7f76bc0c38b0 con 0x7f76bc151830 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76ba7fc640 1 -- 172.21.15.119:0/1093757470 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a4003530 con 0x7f76bc151830 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76baffd640 1 -- 172.21.15.119:0/1093757470 >> v2:172.21.15.63:3300/0 conn(0x7f76bc072f40 msgr2=0x7f76bc0c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76baffd640 1 --2- 172.21.15.119:0/1093757470 >> v2:172.21.15.63:3300/0 conn(0x7f76bc072f40 0x7f76bc0c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76baffd640 1 -- 172.21.15.119:0/1093757470 >> v1:172.21.15.119:6789/0 conn(0x7f76bc151830 legacy=0x7f76bc1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76baffd640 1 -- 172.21.15.119:0/1093757470 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc06d450 con 0x7f76bc151c10 2024-09-12T02:56:43.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76baffd640 1 --2- 172.21.15.119:0/1093757470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151c10 0x7f76bc0c9c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f76b00097c0 tx=0x7f76b001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d05aac24204f949d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:43.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76ba7fc640 1 -- 172.21.15.119:0/1093757470 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00b0070 con 0x7f76bc151c10 2024-09-12T02:56:43.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76ba7fc640 1 -- 172.21.15.119:0/1093757470 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b00ab600 con 0x7f76bc151c10 2024-09-12T02:56:43.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76ba7fc640 1 -- 172.21.15.119:0/1093757470 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00ab9d0 con 0x7f76bc151c10 2024-09-12T02:56:43.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76c1f2c640 1 -- 172.21.15.119:0/1093757470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151c10 msgr2=0x7f76bc0c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76c1f2c640 1 --2- 172.21.15.119:0/1093757470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151c10 0x7f76bc0c9c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f76b00097c0 tx=0x7f76b001c410 comp rx=0 tx=0).stop 2024-09-12T02:56:43.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76c1f2c640 1 -- 172.21.15.119:0/1093757470 shutdown_connections 2024-09-12T02:56:43.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76c1f2c640 1 --2- 172.21.15.119:0/1093757470 >> v2:172.21.15.63:3300/0 conn(0x7f76bc072f40 0x7f76bc0c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76c1f2c640 1 --2- 172.21.15.119:0/1093757470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151c10 0x7f76bc0c9c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76c1f2c640 1 -- 172.21.15.119:0/1093757470 >> 172.21.15.119:0/1093757470 conn(0x7f76bc0702e0 msgr2=0x7f76bc0c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:43.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76c1f2c640 1 -- 172.21.15.119:0/1093757470 shutdown_connections 2024-09-12T02:56:43.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.283+0000 7f76c1f2c640 1 -- 172.21.15.119:0/1093757470 wait complete. 2024-09-12T02:56:43.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 Processor -- start 2024-09-12T02:56:43.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 -- start start 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc072f40 0x7f76bc1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151830 0x7f76bc147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76bc151c10 0x7f76bc148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc072c70 con 0x7f76bc151c10 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc157dd0 con 0x7f76bc072f40 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc0c3bd0 con 0x7f76bc151830 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76baffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151830 0x7f76bc147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76baffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151830 0x7f76bc147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:53596/0 (socket says 172.21.15.119:53596) 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76baffd640 1 -- 172.21.15.119:0/2123737755 learned_addr learned my addr 172.21.15.119:0/2123737755 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-12T02:56:43.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76bb7fe640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc072f40 0x7f76bc1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76bbfff640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76bc151c10 0x7f76bc148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76baffd640 1 -- 172.21.15.119:0/2123737755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc072f40 msgr2=0x7f76bc1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76baffd640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc072f40 0x7f76bc1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76baffd640 1 -- 172.21.15.119:0/2123737755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76bc151c10 msgr2=0x7f76bc148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76baffd640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76bc151c10 0x7f76bc148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76baffd640 1 -- 172.21.15.119:0/2123737755 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc157830 con 0x7f76bc151830 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76bb7fe640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc072f40 0x7f76bc1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76baffd640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151830 0x7f76bc147bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f76b001a040 tx=0x7f76b00191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76a3fff640 1 -- 172.21.15.119:0/2123737755 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00b0040 con 0x7f76bc151830 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76a3fff640 1 -- 172.21.15.119:0/2123737755 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b00bc070 con 0x7f76bc151830 2024-09-12T02:56:43.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 -- 172.21.15.119:0/2123737755 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc1f4ba0 con 0x7f76bc151830 2024-09-12T02:56:43.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76a3fff640 1 -- 172.21.15.119:0/2123737755 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00b56a0 con 0x7f76bc151830 2024-09-12T02:56:43.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 -- 172.21.15.119:0/2123737755 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc1f5160 con 0x7f76bc151830 2024-09-12T02:56:43.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76a3fff640 1 -- 172.21.15.119:0/2123737755 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f76b00b3070 con 0x7f76bc151830 2024-09-12T02:56:43.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76a3fff640 1 -- 172.21.15.119:0/2123737755 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f76b00c1c00 con 0x7f76bc151830 2024-09-12T02:56:43.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.287+0000 7f76c1f2c640 1 -- 172.21.15.119:0/2123737755 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc1f5770 con 0x7f76bc151830 2024-09-12T02:56:43.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.291+0000 7f76a3fff640 1 -- 172.21.15.119:0/2123737755 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f76b0016090 con 0x7f76bc151830 2024-09-12T02:56:43.306 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:43.300+0000 7f9a8ae2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:56:43.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.359+0000 7f76c1f2c640 1 -- 172.21.15.119:0/2123737755 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ac41ac05-d082-43f8-93ec-ba27bf53fd08", "id": 7} v 0) -- 0x7f76bc0c55b0 con 0x7f76bc151830 2024-09-12T02:56:43.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.363+0000 7f76a3fff640 1 -- 172.21.15.119:0/2123737755 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac41ac05-d082-43f8-93ec-ba27bf53fd08", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f76b00c15a0 con 0x7f76bc151830 2024-09-12T02:56:43.366 INFO:teuthology.orchestra.run.smithi119.stdout:7 2024-09-12T02:56:43.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.363+0000 7f76c1f2c640 1 -- 172.21.15.119:0/2123737755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151830 msgr2=0x7f76bc147bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.363+0000 7f76c1f2c640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151830 0x7f76bc147bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f76b001a040 tx=0x7f76b00191b0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.363+0000 7f76c1f2c640 1 -- 172.21.15.119:0/2123737755 shutdown_connections 2024-09-12T02:56:43.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.363+0000 7f76c1f2c640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76bc151c10 0x7f76bc148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.367+0000 7f76c1f2c640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76bc151830 0x7f76bc147bc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.367+0000 7f76c1f2c640 1 --2- 172.21.15.119:0/2123737755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76bc072f40 0x7f76bc1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.367+0000 7f76c1f2c640 1 -- 172.21.15.119:0/2123737755 >> 172.21.15.119:0/2123737755 conn(0x7f76bc0702e0 msgr2=0x7f76bc0ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:43.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.367+0000 7f76c1f2c640 1 -- 172.21.15.119:0/2123737755 shutdown_connections 2024-09-12T02:56:43.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-12T02:56:43.367+0000 7f76c1f2c640 1 -- 172.21.15.119:0/2123737755 wait complete. 2024-09-12T02:56:43.380 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:43.376+0000 7f9a8ae2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:56:43.381 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T02:56:43.381 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T02:56:43.384 INFO:tasks.ceph.osd.0:Started 2024-09-12T02:56:43.384 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T02:56:43.385 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T02:56:43.387 INFO:tasks.ceph.osd.1:Started 2024-09-12T02:56:43.388 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T02:56:43.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T02:56:43.391 INFO:tasks.ceph.osd.2:Started 2024-09-12T02:56:43.391 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T02:56:43.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T02:56:43.395 INFO:tasks.ceph.osd.3:Started 2024-09-12T02:56:43.395 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T02:56:43.395 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T02:56:43.397 INFO:tasks.ceph.osd.4:Started 2024-09-12T02:56:43.397 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T02:56:43.398 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T02:56:43.399 INFO:tasks.ceph.osd.5:Started 2024-09-12T02:56:43.400 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T02:56:43.400 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T02:56:43.402 INFO:tasks.ceph.osd.6:Started 2024-09-12T02:56:43.402 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T02:56:43.402 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T02:56:43.404 INFO:tasks.ceph.osd.7:Started 2024-09-12T02:56:43.404 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:56:43.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a8800640 1 Processor -- start 2024-09-12T02:56:43.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a8800640 1 -- start start 2024-09-12T02:56:43.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a8800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39a015b5c0 0x7f39a00c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a8800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a0155070 con 0x7f39a0154c90 2024-09-12T02:56:43.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a8800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a00c8bf0 con 0x7f39a006ec90 2024-09-12T02:56:43.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a8800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f39a015b130 con 0x7f39a015b5c0 2024-09-12T02:56:43.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a5e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f39a0154c90 0x7f39a00ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55396/0 (socket says 172.21.15.63:55396) 2024-09-12T02:56:43.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a5e00640 1 -- 172.21.15.63:0/1372384016 learned_addr learned my addr 172.21.15.63:0/1372384016 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:56:43.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a6800640 1 --2- 172.21.15.63:0/1372384016 >> v2:172.21.15.119:3300/0 conn(0x7f39a015b5c0 0x7f39a00c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a4a00640 1 -- 172.21.15.63:0/1372384016 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 838920887 0 0) 0x7f39a0155070 con 0x7f39a0154c90 2024-09-12T02:56:43.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a4a00640 1 -- 172.21.15.63:0/1372384016 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3988003530 con 0x7f39a0154c90 2024-09-12T02:56:43.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a4a00640 1 -- 172.21.15.63:0/1372384016 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731665255 0 0) 0x7f39a00c8bf0 con 0x7f39a006ec90 2024-09-12T02:56:43.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a4a00640 1 -- 172.21.15.63:0/1372384016 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39a0155070 con 0x7f39a006ec90 2024-09-12T02:56:43.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a6800640 1 -- 172.21.15.63:0/1372384016 >> v1:172.21.15.119:6789/0 conn(0x7f39a006ec90 legacy=0x7f39a006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a6800640 1 -- 172.21.15.63:0/1372384016 >> v1:172.21.15.63:6789/0 conn(0x7f39a0154c90 legacy=0x7f39a00ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.572+0000 7f39a6800640 1 -- 172.21.15.63:0/1372384016 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a00c8ed0 con 0x7f39a015b5c0 2024-09-12T02:56:43.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a6800640 1 --2- 172.21.15.63:0/1372384016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39a015b5c0 0x7f39a00c3170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f39a015b2b0 tx=0x7f399c01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7583840444943796 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:43.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a4a00640 1 -- 172.21.15.63:0/1372384016 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c0b4070 con 0x7f39a015b5c0 2024-09-12T02:56:43.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a4a00640 1 -- 172.21.15.63:0/1372384016 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c0af600 con 0x7f39a015b5c0 2024-09-12T02:56:43.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a4a00640 1 -- 172.21.15.63:0/1372384016 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c0af9d0 con 0x7f39a015b5c0 2024-09-12T02:56:43.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a8800640 1 -- 172.21.15.63:0/1372384016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39a015b5c0 msgr2=0x7f39a00c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a8800640 1 --2- 172.21.15.63:0/1372384016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39a015b5c0 0x7f39a00c3170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f39a015b2b0 tx=0x7f399c01f130 comp rx=0 tx=0).stop 2024-09-12T02:56:43.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a8800640 1 -- 172.21.15.63:0/1372384016 shutdown_connections 2024-09-12T02:56:43.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a8800640 1 --2- 172.21.15.63:0/1372384016 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39a015b5c0 0x7f39a00c3170 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a8800640 1 -- 172.21.15.63:0/1372384016 >> 172.21.15.63:0/1372384016 conn(0x7f39a006bcc0 msgr2=0x7f39a006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:43.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a8800640 1 -- 172.21.15.63:0/1372384016 shutdown_connections 2024-09-12T02:56:43.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.576+0000 7f39a8800640 1 -- 172.21.15.63:0/1372384016 wait complete. 2024-09-12T02:56:43.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 Processor -- start 2024-09-12T02:56:43.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 -- start start 2024-09-12T02:56:43.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39a006ec90 0x7f39a0153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39a0154c90 0x7f39a0157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39a015b5c0 0x7f39a00c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:43.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f39a015aae0 con 0x7f39a0154c90 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f39a00c36b0 con 0x7f39a015b5c0 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f39a015adc0 con 0x7f39a006ec90 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39a0154c90 0x7f39a0157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39a0154c90 0x7f39a0157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47256/0 (socket says 172.21.15.63:47256) 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5400640 1 -- 172.21.15.63:0/2305931430 learned_addr learned my addr 172.21.15.63:0/2305931430 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5e00640 1 --2- 172.21.15.63:0/2305931430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39a006ec90 0x7f39a0153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a6800640 1 --2- 172.21.15.63:0/2305931430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39a015b5c0 0x7f39a00c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5400640 1 -- 172.21.15.63:0/2305931430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39a006ec90 msgr2=0x7f39a0153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5400640 1 --2- 172.21.15.63:0/2305931430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39a006ec90 0x7f39a0153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5400640 1 -- 172.21.15.63:0/2305931430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39a015b5c0 msgr2=0x7f39a00c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5400640 1 --2- 172.21.15.63:0/2305931430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39a015b5c0 0x7f39a00c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5400640 1 -- 172.21.15.63:0/2305931430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a00cb370 con 0x7f39a0154c90 2024-09-12T02:56:43.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a5400640 1 --2- 172.21.15.63:0/2305931430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39a0154c90 0x7f39a0157b00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f399000c430 tx=0x7f399000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:43.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f399a000640 1 -- 172.21.15.63:0/2305931430 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990017070 con 0x7f39a0154c90 2024-09-12T02:56:43.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f399a000640 1 -- 172.21.15.63:0/2305931430 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39900052f0 con 0x7f39a0154c90 2024-09-12T02:56:43.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f399a000640 1 -- 172.21.15.63:0/2305931430 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990003840 con 0x7f39a0154c90 2024-09-12T02:56:43.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 -- 172.21.15.63:0/2305931430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a01f0f90 con 0x7f39a0154c90 2024-09-12T02:56:43.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f39a8800640 1 -- 172.21.15.63:0/2305931430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a00cb8f0 con 0x7f39a0154c90 2024-09-12T02:56:43.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f399a000640 1 -- 172.21.15.63:0/2305931430 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f399001a070 con 0x7f39a0154c90 2024-09-12T02:56:43.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.580+0000 7f399a000640 1 -- 172.21.15.63:0/2305931430 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3990011590 con 0x7f39a0154c90 2024-09-12T02:56:43.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.584+0000 7f39a8800640 1 -- 172.21.15.63:0/2305931430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a006c6d0 con 0x7f39a0154c90 2024-09-12T02:56:43.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.584+0000 7f399a000640 1 -- 172.21.15.63:0/2305931430 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3990021020 con 0x7f39a0154c90 2024-09-12T02:56:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 -- 172.21.15.63:0/2305931430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39a0153e70 con 0x7f39a0154c90 2024-09-12T02:56:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f399a000640 1 -- 172.21.15.63:0/2305931430 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f3990011bd0 con 0x7f39a0154c90 2024-09-12T02:56:43.650 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:43.651 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:56:43.361756+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:56:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 -- 172.21.15.63:0/2305931430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39a0154c90 msgr2=0x7f39a0157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 --2- 172.21.15.63:0/2305931430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39a0154c90 0x7f39a0157b00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f399000c430 tx=0x7f399000c8f0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 -- 172.21.15.63:0/2305931430 shutdown_connections 2024-09-12T02:56:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 --2- 172.21.15.63:0/2305931430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39a015b5c0 0x7f39a00c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 --2- 172.21.15.63:0/2305931430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39a0154c90 0x7f39a0157b00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 --2- 172.21.15.63:0/2305931430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39a006ec90 0x7f39a0153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 -- 172.21.15.63:0/2305931430 >> 172.21.15.63:0/2305931430 conn(0x7f39a006bcc0 msgr2=0x7f39a0159fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 -- 172.21.15.63:0/2305931430 shutdown_connections 2024-09-12T02:56:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:43.644+0000 7f39a8800640 1 -- 172.21.15.63:0/2305931430 wait complete. 2024-09-12T02:56:43.671 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T02:56:43.671 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T02:56:43.837 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T02:56:43.837 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T02:56:43.837 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2024-09-12T02:56:43.870 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:43.867+0000 7f7e9ae4d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:56:44.032 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:44.031+0000 7f7e9ae4d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:56:44.086 INFO:tasks.ceph.mgr.y.smithi063.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T02:56:44.086 INFO:tasks.ceph.mgr.y.smithi063.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T02:56:44.086 INFO:tasks.ceph.mgr.y.smithi063.stderr: from numpy import show_config as show_numpy_config 2024-09-12T02:56:44.156 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:44.152+0000 7f9a8ae2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:56:44.194 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:44.191+0000 7f7e9ae4d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:56:44.264 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:44.263+0000 7f7e9ae4d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:56:44.313 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:44.308+0000 7f9a8ae2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:56:44.411 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:44.411+0000 7f7e9ae4d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:56:44.476 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:56:44.504 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:44.500+0000 7f9a8ae2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:56:44.582 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:44.576+0000 7f9a8ae2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:56:44.608 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb70200640 1 Processor -- start 2024-09-12T02:56:44.608 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb70200640 1 -- start start 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb70200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb68154a20 0x7fdb6815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb70200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb6815af50 0x7fdb68165390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb70200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb6815eab0 con 0x7fdb680cad00 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb70200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fdb680ca550 con 0x7fdb68154a20 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb70200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fdb680b0ea0 con 0x7fdb6815af50 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb6d800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb68154a20 0x7fdb6815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb6d800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb68154a20 0x7fdb6815aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:40386/0 (socket says 172.21.15.63:40386) 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb6d800640 1 -- 172.21.15.63:0/2598888832 learned_addr learned my addr 172.21.15.63:0/2598888832 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb6ce00640 1 --1- 172.21.15.63:0/2598888832 >> v1:172.21.15.119:6789/0 conn(0x7fdb680cad00 0x7fdb680717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:42792/0 (socket says 172.21.15.63:42792) 2024-09-12T02:56:44.610 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb6e200640 1 --2- 172.21.15.63:0/2598888832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb6815af50 0x7fdb68165390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:44.611 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb6d800640 1 -- 172.21.15.63:0/2598888832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb6815af50 msgr2=0x7fdb68165390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:44.611 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb6d800640 1 --2- 172.21.15.63:0/2598888832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb6815af50 0x7fdb68165390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:44.611 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb6d800640 1 -- 172.21.15.63:0/2598888832 >> v1:172.21.15.119:6789/0 conn(0x7fdb680cad00 legacy=0x7fdb680717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:44.611 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.604+0000 7fdb6d800640 1 -- 172.21.15.63:0/2598888832 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6815ed50 con 0x7fdb68154a20 2024-09-12T02:56:44.613 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb6d800640 1 --2- 172.21.15.63:0/2598888832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 0x7fdb6815aa10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb680ca6d0 tx=0x7fdb5c01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9902debcb2d18221 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:44.613 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb67e00640 1 -- 172.21.15.63:0/2598888832 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0b5070 con 0x7fdb68154a20 2024-09-12T02:56:44.613 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb67e00640 1 -- 172.21.15.63:0/2598888832 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb5c0a8a30 con 0x7fdb68154a20 2024-09-12T02:56:44.614 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb67e00640 1 -- 172.21.15.63:0/2598888832 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0a8e00 con 0x7fdb68154a20 2024-09-12T02:56:44.614 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb70200640 1 -- 172.21.15.63:0/2598888832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 msgr2=0x7fdb6815aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:44.615 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb70200640 1 --2- 172.21.15.63:0/2598888832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 0x7fdb6815aa10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb680ca6d0 tx=0x7fdb5c01ed30 comp rx=0 tx=0).stop 2024-09-12T02:56:44.615 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb70200640 1 -- 172.21.15.63:0/2598888832 shutdown_connections 2024-09-12T02:56:44.615 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb70200640 1 --2- 172.21.15.63:0/2598888832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb6815af50 0x7fdb68165390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:44.615 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb70200640 1 --2- 172.21.15.63:0/2598888832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 0x7fdb6815aa10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:44.615 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb70200640 1 -- 172.21.15.63:0/2598888832 >> 172.21.15.63:0/2598888832 conn(0x7fdb68070fd0 msgr2=0x7fdb68067b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:44.615 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb70200640 1 -- 172.21.15.63:0/2598888832 shutdown_connections 2024-09-12T02:56:44.615 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.608+0000 7fdb70200640 1 -- 172.21.15.63:0/2598888832 wait complete. 2024-09-12T02:56:44.616 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 Processor -- start 2024-09-12T02:56:44.616 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 -- start start 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb680cad00 0x7fdb680b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 0x7fdb680ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb6815af50 0x7fdb6814cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdb68071ec0 con 0x7fdb6815af50 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb680ca9e0 con 0x7fdb68154a20 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fdb68072040 con 0x7fdb680cad00 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6e200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb6815af50 0x7fdb6814cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6ce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 0x7fdb680ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6d800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb680cad00 0x7fdb680b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6ce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 0x7fdb680ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:40400/0 (socket says 172.21.15.63:40400) 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6ce00640 1 -- 172.21.15.63:0/4215932010 learned_addr learned my addr 172.21.15.63:0/4215932010 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:56:44.618 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6e200640 1 -- 172.21.15.63:0/4215932010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb680cad00 msgr2=0x7fdb680b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:44.619 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6e200640 1 --2- 172.21.15.63:0/4215932010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb680cad00 0x7fdb680b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:44.619 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6e200640 1 -- 172.21.15.63:0/4215932010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 msgr2=0x7fdb680ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:44.619 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6e200640 1 --2- 172.21.15.63:0/4215932010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 0x7fdb680ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:44.619 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6e200640 1 -- 172.21.15.63:0/4215932010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb681f1520 con 0x7fdb6815af50 2024-09-12T02:56:44.620 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb6e200640 1 --2- 172.21.15.63:0/4215932010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb6815af50 0x7fdb6814cd80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000ef90 tx=0x7fdb6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:44.620 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb65600640 1 -- 172.21.15.63:0/4215932010 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60018020 con 0x7fdb6815af50 2024-09-12T02:56:44.620 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb65600640 1 -- 172.21.15.63:0/4215932010 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb60014480 con 0x7fdb6815af50 2024-09-12T02:56:44.620 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb65600640 1 -- 172.21.15.63:0/4215932010 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60014870 con 0x7fdb6815af50 2024-09-12T02:56:44.620 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 -- 172.21.15.63:0/4215932010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb680b4000 con 0x7fdb6815af50 2024-09-12T02:56:44.620 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb70200640 1 -- 172.21.15.63:0/4215932010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb680b1680 con 0x7fdb6815af50 2024-09-12T02:56:44.620 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb65600640 1 -- 172.21.15.63:0/4215932010 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb6001b020 con 0x7fdb6815af50 2024-09-12T02:56:44.620 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.612+0000 7fdb65600640 1 -- 172.21.15.63:0/4215932010 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fdb6001de00 con 0x7fdb6815af50 2024-09-12T02:56:44.620 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.616+0000 7fdb70200640 1 -- 172.21.15.63:0/4215932010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb68069310 con 0x7fdb6815af50 2024-09-12T02:56:44.622 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.616+0000 7fdb65600640 1 -- 172.21.15.63:0/4215932010 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdb60022030 con 0x7fdb6815af50 2024-09-12T02:56:44.682 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.676+0000 7fdb70200640 1 -- 172.21.15.63:0/4215932010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb680c9d80 con 0x7fdb6815af50 2024-09-12T02:56:44.683 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.676+0000 7fdb65600640 1 -- 172.21.15.63:0/4215932010 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fdb60010040 con 0x7fdb6815af50 2024-09-12T02:56:44.683 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-12T02:56:44.683 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":10,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:56:43.361756+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:56:44.684 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.680+0000 7fdb70200640 1 -- 172.21.15.63:0/4215932010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb6815af50 msgr2=0x7fdb6814cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:44.684 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.680+0000 7fdb70200640 1 --2- 172.21.15.63:0/4215932010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb6815af50 0x7fdb6814cd80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000ef90 tx=0x7fdb6000c490 comp rx=0 tx=0).stop 2024-09-12T02:56:44.684 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.680+0000 7fdb70200640 1 -- 172.21.15.63:0/4215932010 shutdown_connections 2024-09-12T02:56:44.684 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.680+0000 7fdb70200640 1 --2- 172.21.15.63:0/4215932010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb6815af50 0x7fdb6814cd80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:44.684 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.680+0000 7fdb70200640 1 --2- 172.21.15.63:0/4215932010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb68154a20 0x7fdb680ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:44.684 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.680+0000 7fdb70200640 1 --2- 172.21.15.63:0/4215932010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb680cad00 0x7fdb680b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:44.684 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.680+0000 7fdb70200640 1 -- 172.21.15.63:0/4215932010 >> 172.21.15.63:0/4215932010 conn(0x7fdb68070fd0 msgr2=0x7fdb6806cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:44.685 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.680+0000 7fdb70200640 1 -- 172.21.15.63:0/4215932010 shutdown_connections 2024-09-12T02:56:44.685 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:44.680+0000 7fdb70200640 1 -- 172.21.15.63:0/4215932010 wait complete. 2024-09-12T02:56:44.701 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T02:56:44.704 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:56:44.703+0000 7f95319ec7c0 -1 Falling back to public interface 2024-09-12T02:56:44.740 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:56:44.739+0000 7f645c9757c0 -1 Falling back to public interface 2024-09-12T02:56:44.746 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:44.740+0000 7f9a8ae2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:56:44.881 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:56:44.876+0000 7eff3e6677c0 -1 Falling back to public interface 2024-09-12T02:56:45.022 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:45.019+0000 7f7e9ae4d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:56:45.029 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:56:45.027+0000 7fefc5a6d7c0 -1 Falling back to public interface 2024-09-12T02:56:45.039 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:56:45.039+0000 7f00d96807c0 -1 Falling back to public interface 2024-09-12T02:56:45.101 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:45.099+0000 7f7e9ae4d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:56:45.120 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:56:45.116+0000 7f8576d3c7c0 -1 Falling back to public interface 2024-09-12T02:56:45.164 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:56:45.160+0000 7f29e51bf7c0 -1 Falling back to public interface 2024-09-12T02:56:45.196 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:56:45.192+0000 7fd5345fd7c0 -1 Falling back to public interface 2024-09-12T02:56:45.282 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:45.279+0000 7f7e9ae4d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:56:45.355 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:45.355+0000 7f7e9ae4d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:56:45.467 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:45.460+0000 7f9a8ae2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:56:45.560 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:45.556+0000 7f9a8ae2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:56:45.648 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:45.647+0000 7f7e9ae4d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:56:45.710 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:45.707+0000 7f7e9ae4d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:56:45.775 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:45.769+0000 7f9a8ae2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:56:45.865 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:45.861+0000 7f9a8ae2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:56:46.216 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:46.213+0000 7f9a8ae2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:56:46.290 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-09-12T02:56:46.285+0000 7f9a8ae2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:56:46.755 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:46.751+0000 7f7e41980640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T02:56:46.756 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-09-12T02:56:46.755+0000 7f7e41980640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T02:56:48.821 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:56:48.819+0000 7f645c9757c0 -1 osd.4 0 log_to_monitors true 2024-09-12T02:56:48.834 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:56:48.831+0000 7f95319ec7c0 -1 osd.7 0 log_to_monitors true 2024-09-12T02:56:49.050 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:56:49.045+0000 7eff3e6677c0 -1 osd.1 0 log_to_monitors true 2024-09-12T02:56:49.109 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:56:49.107+0000 7fefc5a6d7c0 -1 osd.6 0 log_to_monitors true 2024-09-12T02:56:49.210 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:56:49.207+0000 7f00d96807c0 -1 osd.5 0 log_to_monitors true 2024-09-12T02:56:49.258 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:56:49.253+0000 7f8576d3c7c0 -1 osd.3 0 log_to_monitors true 2024-09-12T02:56:49.477 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:56:49.473+0000 7fd5345fd7c0 -1 osd.0 0 log_to_monitors true 2024-09-12T02:56:49.684 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:56:49.681+0000 7f29e51bf7c0 -1 osd.2 0 log_to_monitors true 2024-09-12T02:56:50.975 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:56:50.969+0000 7eff39600640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:56:51.008 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:56:51.005+0000 7eff2f600640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:56:51.509 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:56:51.642 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:56:51.638+0000 7f952e1a7640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:56:51.643 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:56:51.638+0000 7f645891e640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:56:51.663 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef3e600640 1 Processor -- start 2024-09-12T02:56:51.664 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef3e600640 1 -- start start 2024-09-12T02:56:51.665 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef3e600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fef380cbe30 0x7fef3815c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:51.665 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef3e600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef380c4f50 con 0x7fef38152760 2024-09-12T02:56:51.666 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef3e600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef38159350 con 0x7fef380c9040 2024-09-12T02:56:51.666 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef3e600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fef380c3d50 con 0x7fef380cbe30 2024-09-12T02:56:51.666 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef36a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fef380cbe30 0x7fef3815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:51.666 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef37400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fef38152760 0x7fef38067b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55398/0 (socket says 172.21.15.63:55398) 2024-09-12T02:56:51.666 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef37400640 1 -- 172.21.15.63:0/3259717777 learned_addr learned my addr 172.21.15.63:0/3259717777 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:56:51.666 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef36a00640 1 -- 172.21.15.63:0/3259717777 >> v1:172.21.15.119:6789/0 conn(0x7fef380c9040 legacy=0x7fef381630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:51.666 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef36a00640 1 -- 172.21.15.63:0/3259717777 >> v1:172.21.15.63:6789/0 conn(0x7fef38152760 legacy=0x7fef38067b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:51.666 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef36a00640 1 -- 172.21.15.63:0/3259717777 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef38159630 con 0x7fef380cbe30 2024-09-12T02:56:51.667 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.661+0000 7fef36000640 1 -- 172.21.15.63:0/3259717777 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1535941796 0 0) 0x7fef380c4f50 con 0x7fef38152760 2024-09-12T02:56:51.669 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef36a00640 1 --2- 172.21.15.63:0/3259717777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef380cbe30 0x7fef3815c020 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef240097c0 tx=0x7fef2401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6cc04253d36192 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:51.669 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef36000640 1 -- 172.21.15.63:0/3259717777 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240b5070 con 0x7fef380cbe30 2024-09-12T02:56:51.669 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef36000640 1 -- 172.21.15.63:0/3259717777 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef240a8990 con 0x7fef380cbe30 2024-09-12T02:56:51.670 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef36000640 1 -- 172.21.15.63:0/3259717777 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240a8d60 con 0x7fef380cbe30 2024-09-12T02:56:51.670 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef3e600640 1 -- 172.21.15.63:0/3259717777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef380cbe30 msgr2=0x7fef3815c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:51.670 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef3e600640 1 --2- 172.21.15.63:0/3259717777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef380cbe30 0x7fef3815c020 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef240097c0 tx=0x7fef2401ec90 comp rx=0 tx=0).stop 2024-09-12T02:56:51.670 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef3e600640 1 -- 172.21.15.63:0/3259717777 shutdown_connections 2024-09-12T02:56:51.671 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef3e600640 1 --2- 172.21.15.63:0/3259717777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef380cbe30 0x7fef3815c020 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:51.671 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef3e600640 1 -- 172.21.15.63:0/3259717777 >> 172.21.15.63:0/3259717777 conn(0x7fef38070500 msgr2=0x7fef38070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:51.671 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef3e600640 1 -- 172.21.15.63:0/3259717777 shutdown_connections 2024-09-12T02:56:51.671 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.665+0000 7fef3e600640 1 -- 172.21.15.63:0/3259717777 wait complete. 2024-09-12T02:56:51.673 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef3e600640 1 Processor -- start 2024-09-12T02:56:51.673 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef3e600640 1 -- start start 2024-09-12T02:56:51.674 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef3e600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef380c9040 0x7fef381fdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:51.674 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef3e600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef380cbe30 0x7fef380c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:51.674 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef3e600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef38152760 0x7fef38200730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:51.675 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef3e600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fef38152b40 con 0x7fef380c9040 2024-09-12T02:56:51.675 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef3e600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fef380c39e0 con 0x7fef380cbe30 2024-09-12T02:56:51.675 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef3e600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fef380cb900 con 0x7fef38152760 2024-09-12T02:56:51.675 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef36a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef380cbe30 0x7fef380c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:51.675 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef36a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef380cbe30 0x7fef380c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:40454/0 (socket says 172.21.15.63:40454) 2024-09-12T02:56:51.675 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef36a00640 1 -- 172.21.15.63:0/4054763758 learned_addr learned my addr 172.21.15.63:0/4054763758 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:56:51.675 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.669+0000 7fef37e00640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef38152760 0x7fef38200730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:51.676 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef37400640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef380c9040 0x7fef381fdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:51.676 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef36a00640 1 -- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef38152760 msgr2=0x7fef38200730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:51.676 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef36a00640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef38152760 0x7fef38200730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:51.676 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef36a00640 1 -- 172.21.15.63:0/4054763758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef380c9040 msgr2=0x7fef381fdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:51.676 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef36a00640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef380c9040 0x7fef381fdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:51.677 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef36a00640 1 -- 172.21.15.63:0/4054763758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef380c81b0 con 0x7fef380cbe30 2024-09-12T02:56:51.677 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef36a00640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef380cbe30 0x7fef380c6450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef240097c0 tx=0x7fef2401ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:51.677 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef2f400640 1 -- 172.21.15.63:0/4054763758 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240c0070 con 0x7fef380cbe30 2024-09-12T02:56:51.677 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef2f400640 1 -- 172.21.15.63:0/4054763758 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef24004230 con 0x7fef380cbe30 2024-09-12T02:56:51.677 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef380c8750 con 0x7fef380cbe30 2024-09-12T02:56:51.677 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef2f400640 1 -- 172.21.15.63:0/4054763758 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef240b5040 con 0x7fef380cbe30 2024-09-12T02:56:51.677 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef381fd2b0 con 0x7fef380cbe30 2024-09-12T02:56:51.678 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:56:51.674+0000 7f95257ca640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:56:51.678 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.673+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef38069310 con 0x7fef380cbe30 2024-09-12T02:56:51.679 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.677+0000 7fef2f400640 1 -- 172.21.15.63:0/4054763758 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7fef240c3070 con 0x7fef380cbe30 2024-09-12T02:56:51.680 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.677+0000 7fef2f400640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef18067830 0x7fef18069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:51.680 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.677+0000 7fef2f400640 1 -- 172.21.15.63:0/4054763758 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7fef24121790 con 0x7fef380cbe30 2024-09-12T02:56:51.680 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.677+0000 7fef37400640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef18067830 0x7fef18069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:51.681 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.677+0000 7fef37400640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef18067830 0x7fef18069cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef28007b50 tx=0x7fef28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:51.683 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:56:51.678+0000 7f6450753640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:56:51.685 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.681+0000 7fef2f400640 1 -- 172.21.15.63:0/4054763758 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fef240187f0 con 0x7fef380cbe30 2024-09-12T02:56:51.889 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.885+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef380c5370 con 0x7fef380cbe30 2024-09-12T02:56:51.890 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.885+0000 7fef2f400640 1 -- 172.21.15.63:0/4054763758 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7543 (secure 0 0 0) 0x7fef240f2950 con 0x7fef380cbe30 2024-09-12T02:56:51.891 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-12T02:56:51.891 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":13,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:56:51.082574+0000","last_up_change":"2024-09-12T02:56:51.082574+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:56:51.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef18067830 msgr2=0x7fef18069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:51.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef18067830 0x7fef18069cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef28007b50 tx=0x7fef28009040 comp rx=0 tx=0).stop 2024-09-12T02:56:51.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef380cbe30 msgr2=0x7fef380c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:51.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef380cbe30 0x7fef380c6450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef240097c0 tx=0x7fef2401ba30 comp rx=0 tx=0).stop 2024-09-12T02:56:51.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 shutdown_connections 2024-09-12T02:56:51.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef18067830 0x7fef18069cf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:51.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef38152760 0x7fef38200730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:51.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef380cbe30 0x7fef380c6450 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:51.893 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 --2- 172.21.15.63:0/4054763758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef380c9040 0x7fef381fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:51.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 >> 172.21.15.63:0/4054763758 conn(0x7fef38070500 msgr2=0x7fef38071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:51.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 shutdown_connections 2024-09-12T02:56:51.894 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:51.889+0000 7fef3e600640 1 -- 172.21.15.63:0/4054763758 wait complete. 2024-09-12T02:56:51.912 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T02:56:52.468 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:56:52.466+0000 7f00d5629640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:56:52.486 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:56:52.482+0000 7fefc1a16640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:56:52.500 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:56:52.498+0000 7f00cd45e640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:56:52.512 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:56:52.510+0000 7fefb984b640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:56:52.921 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:56:52.917+0000 7f29e0000640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:56:52.948 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:56:52.945+0000 7f29d6000640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:56:52.984 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:56:52.981+0000 7f8572600640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:56:52.994 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:56:52.989+0000 7fd52f400640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:56:53.016 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:56:53.013+0000 7f8567c00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:56:53.031 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:56:53.029+0000 7fd525400640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:56:58.719 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T02:56:58.865 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.861+0000 7f0f98c00640 1 Processor -- start 2024-09-12T02:56:58.865 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.861+0000 7f0f98c00640 1 -- start start 2024-09-12T02:56:58.867 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.861+0000 7f0f98c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0f940cac20 0x7f0f94166270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:58.867 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.861+0000 7f0f98c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f940cbf20 con 0x7f0f940cbb40 2024-09-12T02:56:58.867 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.861+0000 7f0f98c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f940c78c0 con 0x7f0f94067b50 2024-09-12T02:56:58.867 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.861+0000 7f0f98c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0f94070310 con 0x7f0f940cac20 2024-09-12T02:56:58.867 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f91e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0f940cbb40 0x7f0f9415a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:50126/0 (socket says 172.21.15.63:50126) 2024-09-12T02:56:58.867 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f91e00640 1 -- 172.21.15.63:0/2364605559 learned_addr learned my addr 172.21.15.63:0/2364605559 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f92800640 1 --2- 172.21.15.63:0/2364605559 >> v2:172.21.15.119:3300/0 conn(0x7f0f940cac20 0x7f0f94166270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816043625 0 0) 0x7f0f940cbf20 con 0x7f0f940cbb40 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f78003530 con 0x7f0f940cbb40 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3662786647 0 0) 0x7f0f78003530 con 0x7f0f940cbb40 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 >> v2:172.21.15.119:3300/0 conn(0x7f0f940cac20 msgr2=0x7f0f94166270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 --2- 172.21.15.63:0/2364605559 >> v2:172.21.15.119:3300/0 conn(0x7f0f940cac20 0x7f0f94166270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 >> v1:172.21.15.119:6789/0 conn(0x7f0f94067b50 legacy=0x7f0f940cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f940707a0 con 0x7f0f940cbb40 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f0f84001680 con 0x7f0f940cbb40 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 >> v1:172.21.15.63:6789/0 conn(0x7f0f940cbb40 legacy=0x7f0f9415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:58.869 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f780039c0 0x7f0f78003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f780051d0 0x7f0f7800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0f94070310 con 0x7f0f78004810 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7800c170 con 0x7f0f780051d0 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7800c370 con 0x7f0f780039c0 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f91400640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f91e00640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f780039c0 0x7f0f78003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f92800640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f780051d0 0x7f0f7800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f91400640 1 -- 172.21.15.63:0/2364605559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f780039c0 msgr2=0x7f0f78003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f91400640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f780039c0 0x7f0f78003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f91400640 1 -- 172.21.15.63:0/2364605559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f780051d0 msgr2=0x7f0f7800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f91400640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f780051d0 0x7f0f7800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f91400640 1 -- 172.21.15.63:0/2364605559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f78003530 con 0x7f0f78004810 2024-09-12T02:56:58.870 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.865+0000 7f0f92800640 1 -- 172.21.15.63:0/2364605559 reap_dead start 2024-09-12T02:56:58.872 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f91400640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f78004c90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0f80001780 tx=0x7f0f8001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66491480f6d9546 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:58.872 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800013a0 con 0x7f0f78004810 2024-09-12T02:56:58.872 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f800052f0 con 0x7f0f78004810 2024-09-12T02:56:58.872 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f90a00640 1 -- 172.21.15.63:0/2364605559 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80003840 con 0x7f0f78004810 2024-09-12T02:56:58.873 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f98c00640 1 -- 172.21.15.63:0/2364605559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 msgr2=0x7f0f78004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:58.873 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f98c00640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f78004c90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0f80001780 tx=0x7f0f8001c400 comp rx=0 tx=0).stop 2024-09-12T02:56:58.873 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f98c00640 1 -- 172.21.15.63:0/2364605559 shutdown_connections 2024-09-12T02:56:58.873 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f98c00640 1 --2- 172.21.15.63:0/2364605559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f78004c90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:58.873 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f98c00640 1 -- 172.21.15.63:0/2364605559 >> 172.21.15.63:0/2364605559 conn(0x7f0f940c9920 msgr2=0x7f0f940c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:58.873 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f98c00640 1 -- 172.21.15.63:0/2364605559 shutdown_connections 2024-09-12T02:56:58.874 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f98c00640 1 -- 172.21.15.63:0/2364605559 wait complete. 2024-09-12T02:56:58.874 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f98c00640 1 Processor -- start 2024-09-12T02:56:58.874 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.869+0000 7f0f98c00640 1 -- start start 2024-09-12T02:56:58.877 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f98c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f941f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:58.877 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f98c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f9414e090 0x7f0f941577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:58.877 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f98c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f9414f5c0 0x7f0f94148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:58.877 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f98c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0f940c7e10 con 0x7f0f78004810 2024-09-12T02:56:58.877 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f98c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0f940680d0 con 0x7f0f9414e090 2024-09-12T02:56:58.877 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f98c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0f940c9590 con 0x7f0f9414f5c0 2024-09-12T02:56:58.877 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f941f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:58.877 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f941f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41012/0 (socket says 172.21.15.63:41012) 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91e00640 1 -- 172.21.15.63:0/1490111289 learned_addr learned my addr 172.21.15.63:0/1490111289 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f92800640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f9414f5c0 0x7f0f94148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91400640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f9414e090 0x7f0f941577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91e00640 1 -- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f9414f5c0 msgr2=0x7f0f94148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91e00640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f9414f5c0 0x7f0f94148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91e00640 1 -- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f9414e090 msgr2=0x7f0f941577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91e00640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f9414e090 0x7f0f941577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91e00640 1 -- 172.21.15.63:0/1490111289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f94152380 con 0x7f0f78004810 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f92800640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f9414f5c0 0x7f0f94148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91400640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f9414e090 0x7f0f941577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f91e00640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f941f3770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f84004f80 tx=0x7f0f840074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:58.878 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f8a000640 1 -- 172.21.15.63:0/1490111289 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8401a070 con 0x7f0f78004810 2024-09-12T02:56:58.879 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f8a000640 1 -- 172.21.15.63:0/1490111289 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8400f750 con 0x7f0f78004810 2024-09-12T02:56:58.879 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f8a000640 1 -- 172.21.15.63:0/1490111289 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400fb40 con 0x7f0f78004810 2024-09-12T02:56:58.879 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9414ec20 con 0x7f0f78004810 2024-09-12T02:56:58.879 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9414e940 con 0x7f0f78004810 2024-09-12T02:56:58.880 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f940cc1f0 con 0x7f0f78004810 2024-09-12T02:56:58.880 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.873+0000 7f0f8a000640 1 -- 172.21.15.63:0/1490111289 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f8401d070 con 0x7f0f78004810 2024-09-12T02:56:58.880 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.877+0000 7f0f8a000640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0f740678c0 0x7f0f74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:58.880 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.877+0000 7f0f8a000640 1 -- 172.21.15.63:0/1490111289 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f0f840854a0 con 0x7f0f78004810 2024-09-12T02:56:58.880 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.877+0000 7f0f91400640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0f740678c0 0x7f0f74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:58.881 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.877+0000 7f0f91400640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0f740678c0 0x7f0f74069d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0f80001750 tx=0x7f0f800011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:58.884 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:58.881+0000 7f0f8a000640 1 -- 172.21.15.63:0/1490111289 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f84056290 con 0x7f0f78004810 2024-09-12T02:56:59.050 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.045+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f940c80e0 con 0x7f0f78004810 2024-09-12T02:56:59.051 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f8a000640 1 -- 172.21.15.63:0/1490111289 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12896 (secure 0 0 0) 0x7f0f84055b90 con 0x7f0f78004810 2024-09-12T02:56:59.051 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-12T02:56:59.052 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":18,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:56:56.735544+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:56:59.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0f740678c0 msgr2=0x7f0f74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:59.053 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0f740678c0 0x7f0f74069d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0f80001750 tx=0x7f0f800011a0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 msgr2=0x7f0f941f3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f941f3770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f84004f80 tx=0x7f0f840074f0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 shutdown_connections 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0f740678c0 0x7f0f74069d80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f9414f5c0 0x7f0f94148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f9414e090 0x7f0f941577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 --2- 172.21.15.63:0/1490111289 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f78004810 0x7f0f941f3770 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 >> 172.21.15.63:0/1490111289 conn(0x7f0f940c9920 msgr2=0x7f0f940c3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 shutdown_connections 2024-09-12T02:56:59.054 INFO:teuthology.misc.health.smithi063.stderr:2024-09-12T02:56:59.049+0000 7f0f98c00640 1 -- 172.21.15.63:0/1490111289 wait complete. 2024-09-12T02:56:59.071 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T02:56:59.071 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T02:56:59.071 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T02:56:59.071 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T02:56:59.074 INFO:tasks.ceph.mds.a:Started 2024-09-12T02:56:59.074 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T02:56:59.075 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T02:56:59.077 INFO:tasks.ceph.mds.c:Started 2024-09-12T02:56:59.078 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-12T02:56:59.078 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-12T02:56:59.081 INFO:tasks.ceph.mds.e:Started 2024-09-12T02:56:59.081 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T02:56:59.081 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T02:56:59.084 INFO:tasks.ceph.mds.b:Started 2024-09-12T02:56:59.084 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T02:56:59.084 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T02:56:59.087 INFO:tasks.ceph.mds.d:Started 2024-09-12T02:56:59.087 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-12T02:56:59.087 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-12T02:56:59.089 INFO:tasks.ceph.mds.f:Started 2024-09-12T02:56:59.089 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T02:56:59.090 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:56:59.162 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2024-09-12T02:56:59.162 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2024-09-12T02:56:59.166 INFO:tasks.ceph.mds.f.smithi119.stdout:starting mds.f at 2024-09-12T02:56:59.177 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-12T02:56:59.179 INFO:tasks.ceph.mds.e.smithi063.stdout:starting mds.e at 2024-09-12T02:56:59.179 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2024-09-12T02:56:59.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda36a00640 1 Processor -- start 2024-09-12T02:56:59.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda36a00640 1 -- start start 2024-09-12T02:56:59.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda36a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fda30154c90 0x7fda300c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:59.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda36a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda30155070 con 0x7fda3006ec90 2024-09-12T02:56:59.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda36a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda300c8bf0 con 0x7fda3015b5c0 2024-09-12T02:56:59.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda36a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fda3015b130 con 0x7fda30154c90 2024-09-12T02:56:59.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda27400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fda3006ec90 0x7fda300ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:50154/0 (socket says 172.21.15.63:50154) 2024-09-12T02:56:59.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda27400640 1 -- 172.21.15.63:0/3653143163 learned_addr learned my addr 172.21.15.63:0/3653143163 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:56:59.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda2fe00640 1 --2- 172.21.15.63:0/3653143163 >> v2:172.21.15.119:3300/0 conn(0x7fda30154c90 0x7fda300c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:59.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.237+0000 7fda2f400640 1 -- 172.21.15.63:0/3653143163 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081959227 0 0) 0x7fda30155070 con 0x7fda3006ec90 2024-09-12T02:56:59.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.241+0000 7fda2f400640 1 -- 172.21.15.63:0/3653143163 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda14003530 con 0x7fda3006ec90 2024-09-12T02:56:59.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.241+0000 7fda2fe00640 1 -- 172.21.15.63:0/3653143163 >> v1:172.21.15.119:6789/0 conn(0x7fda3015b5c0 legacy=0x7fda3006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:59.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.241+0000 7fda2fe00640 1 -- 172.21.15.63:0/3653143163 >> v1:172.21.15.63:6789/0 conn(0x7fda3006ec90 legacy=0x7fda300ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:59.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.241+0000 7fda2f400640 1 -- 172.21.15.63:0/3653143163 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3716160787 0 0) 0x7fda14003530 con 0x7fda3006ec90 2024-09-12T02:56:59.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.241+0000 7fda2fe00640 1 -- 172.21.15.63:0/3653143163 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda300c8ed0 con 0x7fda30154c90 2024-09-12T02:56:59.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.241+0000 7fda2fe00640 1 --2- 172.21.15.63:0/3653143163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda30154c90 0x7fda300c3170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda3015b2b0 tx=0x7fda2001ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2b2951789ffddd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:59.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.241+0000 7fda2f400640 1 -- 172.21.15.63:0/3653143163 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda200b5070 con 0x7fda30154c90 2024-09-12T02:56:59.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.241+0000 7fda2f400640 1 -- 172.21.15.63:0/3653143163 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda200a8630 con 0x7fda30154c90 2024-09-12T02:56:59.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.241+0000 7fda2f400640 1 -- 172.21.15.63:0/3653143163 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18001680 con 0x7fda30154c90 2024-09-12T02:56:59.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 -- 172.21.15.63:0/3653143163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda30154c90 msgr2=0x7fda300c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:59.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 --2- 172.21.15.63:0/3653143163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda30154c90 0x7fda300c3170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda3015b2b0 tx=0x7fda2001ebb0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 -- 172.21.15.63:0/3653143163 shutdown_connections 2024-09-12T02:56:59.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 --2- 172.21.15.63:0/3653143163 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda30154c90 0x7fda300c3170 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 -- 172.21.15.63:0/3653143163 >> 172.21.15.63:0/3653143163 conn(0x7fda3006bcc0 msgr2=0x7fda3006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:59.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 -- 172.21.15.63:0/3653143163 shutdown_connections 2024-09-12T02:56:59.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 -- 172.21.15.63:0/3653143163 wait complete. 2024-09-12T02:56:59.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 Processor -- start 2024-09-12T02:56:59.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 -- start start 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3006ec90 0x7fda301517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda30154c90 0x7fda3015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3015b5c0 0x7fda301f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fda3015aae0 con 0x7fda30154c90 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fda300c36b0 con 0x7fda3015b5c0 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda36a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fda3015adc0 con 0x7fda3006ec90 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda27400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda30154c90 0x7fda3015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda27400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda30154c90 0x7fda3015c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41068/0 (socket says 172.21.15.63:41068) 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda27400640 1 -- 172.21.15.63:0/3084606476 learned_addr learned my addr 172.21.15.63:0/3084606476 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda34a00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3015b5c0 0x7fda301f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:59.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda2fe00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3006ec90 0x7fda301517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda27400640 1 -- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3006ec90 msgr2=0x7fda301517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda27400640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3006ec90 0x7fda301517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda27400640 1 -- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3015b5c0 msgr2=0x7fda301f0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda27400640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3015b5c0 0x7fda301f0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda27400640 1 -- 172.21.15.63:0/3084606476 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3014fa50 con 0x7fda30154c90 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.245+0000 7fda27400640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda30154c90 0x7fda3015c890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c700 tx=0x7fda1800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda2cc00640 1 -- 172.21.15.63:0/3084606476 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18005ae0 con 0x7fda30154c90 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda2cc00640 1 -- 172.21.15.63:0/3084606476 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda18005c80 con 0x7fda30154c90 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3014f050 con 0x7fda30154c90 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda2cc00640 1 -- 172.21.15.63:0/3084606476 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18007290 con 0x7fda30154c90 2024-09-12T02:56:59.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3015be60 con 0x7fda30154c90 2024-09-12T02:56:59.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3006c6d0 con 0x7fda30154c90 2024-09-12T02:56:59.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda2cc00640 1 -- 172.21.15.63:0/3084606476 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda18007430 con 0x7fda30154c90 2024-09-12T02:56:59.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda2cc00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda0c0678c0 0x7fda0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:56:59.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda2cc00640 1 -- 172.21.15.63:0/3084606476 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fda18085580 con 0x7fda30154c90 2024-09-12T02:56:59.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.249+0000 7fda2fe00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda0c0678c0 0x7fda0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:56:59.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.253+0000 7fda2fe00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda0c0678c0 0x7fda0c069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda200b2000 tx=0x7fda200aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:56:59.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.253+0000 7fda2cc00640 1 -- 172.21.15.63:0/3084606476 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fda18007720 con 0x7fda30154c90 2024-09-12T02:56:59.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.453+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda300701b0 con 0x7fda30154c90 2024-09-12T02:56:59.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.453+0000 7fda2cc00640 1 -- 172.21.15.63:0/3084606476 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7fda18055e50 con 0x7fda30154c90 2024-09-12T02:56:59.458 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:56:59.458 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":2,"btime":"2024-09-12T02:56:59:171768+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:56:59.458 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 2 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda0c0678c0 msgr2=0x7fda0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda0c0678c0 0x7fda0c069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda200b2000 tx=0x7fda200aa070 comp rx=0 tx=0).stop 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda30154c90 msgr2=0x7fda3015c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda30154c90 0x7fda3015c890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c700 tx=0x7fda1800cbc0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 shutdown_connections 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3015b5c0 0x7fda301f0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda30154c90 0x7fda3015c890 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda0c0678c0 0x7fda0c069d80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 --2- 172.21.15.63:0/3084606476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3006ec90 0x7fda301517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 >> 172.21.15.63:0/3084606476 conn(0x7fda3006bcc0 msgr2=0x7fda30159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:56:59.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 shutdown_connections 2024-09-12T02:56:59.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:56:59.457+0000 7fda36a00640 1 -- 172.21.15.63:0/3084606476 wait complete. 2024-09-12T02:57:01.480 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:57:01.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.629+0000 7f5268200640 1 Processor -- start 2024-09-12T02:57:01.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.629+0000 7f5268200640 1 -- start start 2024-09-12T02:57:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.629+0000 7f5268200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5260154c90 0x7f52600c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5268200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5260155070 con 0x7f526006ec90 2024-09-12T02:57:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5268200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52600c8bf0 con 0x7f526015b5c0 2024-09-12T02:57:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5268200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f526015b130 con 0x7f5260154c90 2024-09-12T02:57:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5264e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f526006ec90 0x7f52600ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:50166/0 (socket says 172.21.15.63:50166) 2024-09-12T02:57:01.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5264e00640 1 -- 172.21.15.63:0/613049945 learned_addr learned my addr 172.21.15.63:0/613049945 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:01.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5265800640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5260154c90 0x7f52600c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:01.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506809075 0 0) 0x7f5260155070 con 0x7f526006ec90 2024-09-12T02:57:01.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5248003530 con 0x7f526006ec90 2024-09-12T02:57:01.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1590431896 0 0) 0x7f5248003530 con 0x7f526006ec90 2024-09-12T02:57:01.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5260154c90 msgr2=0x7f52600c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:01.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5260154c90 0x7f52600c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:01.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 >> v1:172.21.15.119:6789/0 conn(0x7f526015b5c0 legacy=0x7f526006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:01.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52600c8ed0 con 0x7f526006ec90 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f524c001680 con 0x7f526006ec90 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 >> v1:172.21.15.63:6789/0 conn(0x7f526006ec90 legacy=0x7f52600ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5260154c90 0x7f52480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5248004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5248004d50 0x7f52480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f526015b130 con 0x7f5248003f70 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f524800bb40 con 0x7f5248004d50 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f524800bd40 con 0x7f5260154c90 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5264e00640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5248004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5265800640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5260154c90 0x7f52480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5266200640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5248004d50 0x7f52480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5264e00640 1 -- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5260154c90 msgr2=0x7f52480039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5264e00640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5260154c90 0x7f52480039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:01.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5264e00640 1 -- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5248004d50 msgr2=0x7f52480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:01.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5264e00640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5248004d50 0x7f52480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:01.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.633+0000 7f5264e00640 1 -- 172.21.15.63:0/613049945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5248003530 con 0x7f5248003f70 2024-09-12T02:57:01.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5264e00640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5248004810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f526006dda0 tx=0x7f524c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c14a16dac9358d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:01.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c007d20 con 0x7f5248003f70 2024-09-12T02:57:01.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524c0a9070 con 0x7f5248003f70 2024-09-12T02:57:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f525fe00640 1 -- 172.21.15.63:0/613049945 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0a5dc0 con 0x7f5248003f70 2024-09-12T02:57:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5268200640 1 -- 172.21.15.63:0/613049945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 msgr2=0x7f5248004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5268200640 1 --2- 172.21.15.63:0/613049945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5248004810 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f526006dda0 tx=0x7f524c01cc20 comp rx=0 tx=0).stop 2024-09-12T02:57:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5266200640 1 -- 172.21.15.63:0/613049945 reap_dead start 2024-09-12T02:57:01.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5268200640 1 -- 172.21.15.63:0/613049945 shutdown_connections 2024-09-12T02:57:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5268200640 1 -- 172.21.15.63:0/613049945 >> 172.21.15.63:0/613049945 conn(0x7f526006bcc0 msgr2=0x7f526006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5268200640 1 -- 172.21.15.63:0/613049945 shutdown_connections 2024-09-12T02:57:01.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5268200640 1 -- 172.21.15.63:0/613049945 wait complete. 2024-09-12T02:57:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5268200640 1 Processor -- start 2024-09-12T02:57:01.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.637+0000 7f5268200640 1 -- start start 2024-09-12T02:57:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5268200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5260150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5268200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600c8020 0x7f52600c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5268200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f526015dd70 0x7f526015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5268200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f526015adc0 con 0x7f5248003f70 2024-09-12T02:57:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5268200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f526015aae0 con 0x7f52600c8020 2024-09-12T02:57:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5268200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f52600cea80 con 0x7f526015dd70 2024-09-12T02:57:01.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5265800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5260150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5265800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5260150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41086/0 (socket says 172.21.15.63:41086) 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5265800640 1 -- 172.21.15.63:0/3803745060 learned_addr learned my addr 172.21.15.63:0/3803745060 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5264e00640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600c8020 0x7f52600c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5266200640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f526015dd70 0x7f526015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5265800640 1 -- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f526015dd70 msgr2=0x7f526015e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5265800640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f526015dd70 0x7f526015e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5265800640 1 -- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600c8020 msgr2=0x7f52600c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5265800640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600c8020 0x7f52600c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5265800640 1 -- 172.21.15.63:0/3803745060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526015ebd0 con 0x7f5248003f70 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5266200640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f526015dd70 0x7f526015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5265800640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5260150c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5254011640 tx=0x7f5254011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f525d600640 1 -- 172.21.15.63:0/3803745060 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254015870 con 0x7f5248003f70 2024-09-12T02:57:01.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f525d600640 1 -- 172.21.15.63:0/3803745060 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5254015a10 con 0x7f5248003f70 2024-09-12T02:57:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52601f12f0 con 0x7f5248003f70 2024-09-12T02:57:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f525d600640 1 -- 172.21.15.63:0/3803745060 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254015dc0 con 0x7f5248003f70 2024-09-12T02:57:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52600c5960 con 0x7f5248003f70 2024-09-12T02:57:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f526006c6d0 con 0x7f5248003f70 2024-09-12T02:57:01.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.641+0000 7f525d600640 1 -- 172.21.15.63:0/3803745060 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f525400f450 con 0x7f5248003f70 2024-09-12T02:57:01.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.645+0000 7f525d600640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52400678c0 0x7f5240069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:01.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.645+0000 7f525d600640 1 -- 172.21.15.63:0/3803745060 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f52540863f0 con 0x7f5248003f70 2024-09-12T02:57:01.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.645+0000 7f5264e00640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52400678c0 0x7f5240069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:01.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.645+0000 7f5264e00640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52400678c0 0x7f5240069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f524c0ab000 tx=0x7f524c0b1040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:01.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.649+0000 7f525d600640 1 -- 172.21.15.63:0/3803745060 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5254019030 con 0x7f5248003f70 2024-09-12T02:57:01.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.849+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52600cd170 con 0x7f5248003f70 2024-09-12T02:57:01.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.849+0000 7f525d600640 1 -- 172.21.15.63:0/3803745060 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5563 (secure 0 0 0) 0x7f5254057150 con 0x7f5248003f70 2024-09-12T02:57:01.857 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:01.857 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"btime":"2024-09-12T02:57:00:173582+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4306,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T02:57:01.858 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2024-09-12T02:57:01.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52400678c0 msgr2=0x7f5240069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:01.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52400678c0 0x7f5240069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f524c0ab000 tx=0x7f524c0b1040 comp rx=0 tx=0).stop 2024-09-12T02:57:01.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 msgr2=0x7f5260150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:01.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5260150c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5254011640 tx=0x7f5254011b00 comp rx=0 tx=0).stop 2024-09-12T02:57:01.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 shutdown_connections 2024-09-12T02:57:01.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52400678c0 0x7f5240069d80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:01.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f526015dd70 0x7f526015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:01.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52600c8020 0x7f52600c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:01.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 --2- 172.21.15.63:0/3803745060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5248003f70 0x7f5260150c90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:01.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 >> 172.21.15.63:0/3803745060 conn(0x7f526006bcc0 msgr2=0x7f52600cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:01.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 shutdown_connections 2024-09-12T02:57:01.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:01.853+0000 7f5268200640 1 -- 172.21.15.63:0/3803745060 wait complete. 2024-09-12T02:57:01.877 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T02:57:02.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.013+0000 7ff9bba00640 1 Processor -- start 2024-09-12T02:57:02.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.013+0000 7ff9bba00640 1 -- start start 2024-09-12T02:57:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9bba00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9b4159080 0x7ff9b40ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9bba00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9b40cbf00 0x7ff9b40cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9bba00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b406d5d0 con 0x7ff9b40c6970 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9bba00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b4073d30 con 0x7ff9b4159080 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9bba00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b40c88b0 con 0x7ff9b40cbf00 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9b9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9b4159080 0x7ff9b40ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9b9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff9b4159080 0x7ff9b40ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41092/0 (socket says 172.21.15.63:41092) 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9b9000640 1 -- 172.21.15.63:0/4142008197 learned_addr learned my addr 172.21.15.63:0/4142008197 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9b9a00640 1 --2- 172.21.15.63:0/4142008197 >> v2:172.21.15.119:3300/0 conn(0x7ff9b40cbf00 0x7ff9b40cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9b9000640 1 -- 172.21.15.63:0/4142008197 >> v2:172.21.15.119:3300/0 conn(0x7ff9b40cbf00 msgr2=0x7ff9b40cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9b9000640 1 --2- 172.21.15.63:0/4142008197 >> v2:172.21.15.119:3300/0 conn(0x7ff9b40cbf00 0x7ff9b40cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9b9000640 1 -- 172.21.15.63:0/4142008197 >> v1:172.21.15.63:6789/0 conn(0x7ff9b40c6970 legacy=0x7ff9b406cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.017+0000 7ff9b9000640 1 -- 172.21.15.63:0/4142008197 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b4073f80 con 0x7ff9b4159080 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9b9000640 1 --2- 172.21.15.63:0/4142008197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 0x7ff9b40ccb20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9b406cd60 tx=0x7ff9a801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7888e58ae541e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9b3400640 1 -- 172.21.15.63:0/4142008197 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80b5070 con 0x7ff9b4159080 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9b3400640 1 -- 172.21.15.63:0/4142008197 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a80a8a10 con 0x7ff9b4159080 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9b3400640 1 -- 172.21.15.63:0/4142008197 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80a8de0 con 0x7ff9b4159080 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 -- 172.21.15.63:0/4142008197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 msgr2=0x7ff9b40ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 --2- 172.21.15.63:0/4142008197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 0x7ff9b40ccb20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9b406cd60 tx=0x7ff9a801ed10 comp rx=0 tx=0).stop 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 -- 172.21.15.63:0/4142008197 shutdown_connections 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 --2- 172.21.15.63:0/4142008197 >> v2:172.21.15.119:3300/0 conn(0x7ff9b40cbf00 0x7ff9b40cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 --2- 172.21.15.63:0/4142008197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 0x7ff9b40ccb20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 -- 172.21.15.63:0/4142008197 >> 172.21.15.63:0/4142008197 conn(0x7ff9b406f3d0 msgr2=0x7ff9b406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 -- 172.21.15.63:0/4142008197 shutdown_connections 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 -- 172.21.15.63:0/4142008197 wait complete. 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 Processor -- start 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 -- start start 2024-09-12T02:57:02.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b40c6970 0x7ff9b41f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b40cbf00 0x7ff9b4152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 0x7ff9b41511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b415ecc0 con 0x7ff9b4159080 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b40c6d90 con 0x7ff9b40c6970 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9bba00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b415efa0 con 0x7ff9b40cbf00 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9b9a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 0x7ff9b41511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9b9a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 0x7ff9b41511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41104/0 (socket says 172.21.15.63:41104) 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.021+0000 7ff9b9a00640 1 -- 172.21.15.63:0/2017381372 learned_addr learned my addr 172.21.15.63:0/2017381372 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b9000640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b40c6970 0x7ff9b41f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b3e00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b40cbf00 0x7ff9b4152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b9a00640 1 -- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b40cbf00 msgr2=0x7ff9b4152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b9a00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b40cbf00 0x7ff9b4152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b9a00640 1 -- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b40c6970 msgr2=0x7ff9b41f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b9a00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b40c6970 0x7ff9b41f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b9a00640 1 -- 172.21.15.63:0/2017381372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b4154a50 con 0x7ff9b4159080 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b9a00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 0x7ff9b41511f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac007e40 tx=0x7ff9ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b0c00640 1 -- 172.21.15.63:0/2017381372 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac014620 con 0x7ff9b4159080 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b0c00640 1 -- 172.21.15.63:0/2017381372 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ac019070 con 0x7ff9b4159080 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b4154d30 con 0x7ff9b4159080 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b0c00640 1 -- 172.21.15.63:0/2017381372 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac014a20 con 0x7ff9b4159080 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b40c3370 con 0x7ff9b4159080 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b40c3860 con 0x7ff9b4159080 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b0c00640 1 -- 172.21.15.63:0/2017381372 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9ac014bc0 con 0x7ff9b4159080 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b0c00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9940678f0 0x7ff994069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.025+0000 7ff9b0c00640 1 -- 172.21.15.63:0/2017381372 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff9ac086080 con 0x7ff9b4159080 2024-09-12T02:57:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.029+0000 7ff9b9000640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9940678f0 0x7ff994069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.029+0000 7ff9b9000640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9940678f0 0x7ff994069db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80b2000 tx=0x7ff9a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:02.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.029+0000 7ff9b0c00640 1 -- 172.21.15.63:0/2017381372 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff9ac0568b0 con 0x7ff9b4159080 2024-09-12T02:57:02.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff9b415f280 con 0x7ff9b4159080 2024-09-12T02:57:02.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9b0c00640 1 -- 172.21.15.63:0/2017381372 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7ff9ac05abb0 con 0x7ff9b4159080 2024-09-12T02:57:02.204 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:02.204 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-09-12T02:57:02.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:02.204 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-09-12T02:57:02.204 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-09-12T02:57:02.204 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:02.204 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-09-12T02:57:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9940678f0 msgr2=0x7ff994069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9940678f0 0x7ff994069db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80b2000 tx=0x7ff9a8009040 comp rx=0 tx=0).stop 2024-09-12T02:57:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 msgr2=0x7ff9b41511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 0x7ff9b41511f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac007e40 tx=0x7ff9ac00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 shutdown_connections 2024-09-12T02:57:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b4159080 0x7ff9b41511f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9940678f0 0x7ff994069db0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b40cbf00 0x7ff9b4152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 --2- 172.21.15.63:0/2017381372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b40c6970 0x7ff9b41f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 >> 172.21.15.63:0/2017381372 conn(0x7ff9b406f3d0 msgr2=0x7ff9b40c1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:02.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 shutdown_connections 2024-09-12T02:57:02.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.201+0000 7ff9bba00640 1 -- 172.21.15.63:0/2017381372 wait complete. 2024-09-12T02:57:02.225 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:57:02.225 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:57:02.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.365+0000 7fe99b000640 1 Processor -- start 2024-09-12T02:57:02.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.365+0000 7fe99b000640 1 -- start start 2024-09-12T02:57:02.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe99b000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941515d0 0x7fe9941519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe99b000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe99415b850 0x7fe9940c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe99b000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9941584d0 con 0x7fe9941576a0 2024-09-12T02:57:02.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe99b000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe9940c3bd0 con 0x7fe99415b850 2024-09-12T02:57:02.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe99b000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe9940c6d30 con 0x7fe9941515d0 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe999000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe9941576a0 0x7fe9940c8210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:50178/0 (socket says 172.21.15.63:50178) 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe999000640 1 -- 172.21.15.63:0/3071148019 learned_addr learned my addr 172.21.15.63:0/3071148019 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993e00640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941515d0 0x7fe9941519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe98be00640 1 --2- 172.21.15.63:0/3071148019 >> v2:172.21.15.119:3300/0 conn(0x7fe99415b850 0x7fe9940c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583648400 0 0) 0x7fe98c0014a0 con 0x7fe9941576a0 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe978005740 con 0x7fe9941576a0 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4185841286 0 0) 0x7fe978005740 con 0x7fe9941576a0 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941515d0 msgr2=0x7fe9941519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941515d0 0x7fe9941519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 >> v2:172.21.15.119:3300/0 conn(0x7fe99415b850 msgr2=0x7fe9940c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:02.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 --2- 172.21.15.63:0/3071148019 >> v2:172.21.15.119:3300/0 conn(0x7fe99415b850 0x7fe9940c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9940c7010 con 0x7fe9941576a0 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7fe98c001bd0 con 0x7fe9941576a0 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 >> v1:172.21.15.63:6789/0 conn(0x7fe9941576a0 legacy=0x7fe9940c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941515d0 0x7fe978005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe978006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe978006f60 0x7fe9780073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940c3bd0 con 0x7fe978006150 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940c6d30 con 0x7fe978006f60 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe97800dc10 con 0x7fe9941515d0 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe98be00640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe978006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe993e00640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941515d0 0x7fe978005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe999000640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe978006f60 0x7fe9780073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe98be00640 1 -- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941515d0 msgr2=0x7fe978005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:02.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe98be00640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941515d0 0x7fe978005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe98be00640 1 -- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe978006f60 msgr2=0x7fe9780073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe98be00640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe978006f60 0x7fe9780073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe98be00640 1 -- 172.21.15.63:0/3071148019 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe978005740 con 0x7fe978006150 2024-09-12T02:57:02.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.369+0000 7fe999000640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe978006f60 0x7fe9780073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:02.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe98be00640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe978006a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009ae0 tx=0x7fe97c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3afe8ad54ec7e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:02.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0b2070 con 0x7fe978006150 2024-09-12T02:57:02.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97c0a56a0 con 0x7fe978006150 2024-09-12T02:57:02.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe993400640 1 -- 172.21.15.63:0/3071148019 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0096b0 con 0x7fe978006150 2024-09-12T02:57:02.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe99b000640 1 -- 172.21.15.63:0/3071148019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 msgr2=0x7fe978006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe99b000640 1 --2- 172.21.15.63:0/3071148019 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe978006a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe97c009ae0 tx=0x7fe97c01cab0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe999000640 1 -- 172.21.15.63:0/3071148019 reap_dead start 2024-09-12T02:57:02.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe99b000640 1 -- 172.21.15.63:0/3071148019 shutdown_connections 2024-09-12T02:57:02.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe99b000640 1 -- 172.21.15.63:0/3071148019 >> 172.21.15.63:0/3071148019 conn(0x7fe99406bcc0 msgr2=0x7fe99406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:02.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe99b000640 1 -- 172.21.15.63:0/3071148019 shutdown_connections 2024-09-12T02:57:02.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe99b000640 1 -- 172.21.15.63:0/3071148019 wait complete. 2024-09-12T02:57:02.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.373+0000 7fe99b000640 1 Processor -- start 2024-09-12T02:57:02.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 -- start start 2024-09-12T02:57:02.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe994159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941539e0 0x7fe9940bea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9940befa0 0x7fe9941f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940c78b0 con 0x7fe978006150 2024-09-12T02:57:02.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940c75d0 con 0x7fe9940befa0 2024-09-12T02:57:02.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe9940c8920 con 0x7fe9941539e0 2024-09-12T02:57:02.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe993e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe994159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe993e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe994159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41132/0 (socket says 172.21.15.63:41132) 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe993e00640 1 -- 172.21.15.63:0/1945720218 learned_addr learned my addr 172.21.15.63:0/1945720218 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe98be00640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941539e0 0x7fe9940bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe999000640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9940befa0 0x7fe9941f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe993e00640 1 -- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941539e0 msgr2=0x7fe9940bea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe993e00640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941539e0 0x7fe9940bea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe993e00640 1 -- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9940befa0 msgr2=0x7fe9941f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe993e00640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9940befa0 0x7fe9941f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe993e00640 1 -- 172.21.15.63:0/1945720218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99415aa10 con 0x7fe978006150 2024-09-12T02:57:02.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe993e00640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe994159ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe984011a00 tx=0x7fe984011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:02.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe990c00640 1 -- 172.21.15.63:0/1945720218 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98400fb50 con 0x7fe978006150 2024-09-12T02:57:02.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe990c00640 1 -- 172.21.15.63:0/1945720218 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98400fcf0 con 0x7fe978006150 2024-09-12T02:57:02.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe990c00640 1 -- 172.21.15.63:0/1945720218 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98400fea0 con 0x7fe978006150 2024-09-12T02:57:02.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9941f0860 con 0x7fe978006150 2024-09-12T02:57:02.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9941f0e20 con 0x7fe978006150 2024-09-12T02:57:02.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.377+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9940c3690 con 0x7fe978006150 2024-09-12T02:57:02.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.381+0000 7fe990c00640 1 -- 172.21.15.63:0/1945720218 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe984012040 con 0x7fe978006150 2024-09-12T02:57:02.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.381+0000 7fe990c00640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9700678c0 0x7fe970069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.381+0000 7fe990c00640 1 -- 172.21.15.63:0/1945720218 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fe984085f60 con 0x7fe978006150 2024-09-12T02:57:02.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.381+0000 7fe98be00640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9700678c0 0x7fe970069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.381+0000 7fe98be00640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9700678c0 0x7fe970069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0af000 tx=0x7fe97c0046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:02.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.385+0000 7fe990c00640 1 -- 172.21.15.63:0/1945720218 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe984019030 con 0x7fe978006150 2024-09-12T02:57:02.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.553+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe9940701f0 con 0x7fe978006150 2024-09-12T02:57:02.731 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:57:02.735 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:57:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe990c00640 1 -- 172.21.15.63:0/1945720218 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fe984056ea0 con 0x7fe978006150 2024-09-12T02:57:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9700678c0 msgr2=0x7fe970069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9700678c0 0x7fe970069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0af000 tx=0x7fe97c0046d0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 msgr2=0x7fe994159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe994159ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe984011a00 tx=0x7fe984011ec0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 shutdown_connections 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9940befa0 0x7fe9941f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9700678c0 0x7fe970069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9941539e0 0x7fe9940bea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 --2- 172.21.15.63:0/1945720218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe978006150 0x7fe994159ab0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 >> 172.21.15.63:0/1945720218 conn(0x7fe99406bcc0 msgr2=0x7fe9940cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:02.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 shutdown_connections 2024-09-12T02:57:02.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.765+0000 7fe99b000640 1 -- 172.21.15.63:0/1945720218 wait complete. 2024-09-12T02:57:02.794 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T02:57:02.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.977+0000 7fe4ae000640 1 Processor -- start 2024-09-12T02:57:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.977+0000 7fe4ae000640 1 -- start start 2024-09-12T02:57:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4ae000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a8073620 0x7fe4a8067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4ae000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a815e370 con 0x7fe4a8073ec0 2024-09-12T02:57:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4ae000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a815e650 con 0x7fe4a8073a00 2024-09-12T02:57:02.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4ae000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a815eff0 con 0x7fe4a8073620 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a7e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe4a8073ec0 0x7fe4a815ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:50194/0 (socket says 172.21.15.63:50194) 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a7e00640 1 -- 172.21.15.63:0/3481724712 learned_addr learned my addr 172.21.15.63:0/3481724712 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a7400640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a8073620 0x7fe4a8067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964394487 0 0) 0x7fe4a815e370 con 0x7fe4a8073ec0 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe48c003530 con 0x7fe4a8073ec0 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263302886 0 0) 0x7fe4a815e650 con 0x7fe4a8073a00 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4a815e370 con 0x7fe4a8073a00 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2922323691 0 0) 0x7fe48c003530 con 0x7fe4a8073ec0 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a8073620 msgr2=0x7fe4a8067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a8073620 0x7fe4a8067a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 >> v1:172.21.15.119:6789/0 conn(0x7fe4a8073a00 legacy=0x7fe4a81549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a815e930 con 0x7fe4a8073ec0 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7fe4a0001a00 con 0x7fe4a8073ec0 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 >> v1:172.21.15.63:6789/0 conn(0x7fe4a8073ec0 legacy=0x7fe4a815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a8073620 0x7fe48c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe48c0040e0 0x7fe48c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c004d50 0x7fe48c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c00ba80 con 0x7fe48c0040e0 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c00bc30 con 0x7fe48c004d50 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe48c00be30 con 0x7fe4a8073620 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe49ea00640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe48c0040e0 0x7fe48c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a7400640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a8073620 0x7fe48c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe4a7e00640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c004d50 0x7fe48c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe49ea00640 1 -- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a8073620 msgr2=0x7fe48c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe49ea00640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a8073620 0x7fe48c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe49ea00640 1 -- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c004d50 msgr2=0x7fe48c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe49ea00640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c004d50 0x7fe48c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.981+0000 7fe49ea00640 1 -- 172.21.15.63:0/3481724712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c003530 con 0x7fe48c0040e0 2024-09-12T02:57:02.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe49ea00640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe48c0040e0 0x7fe48c004810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe4900018d0 tx=0x7fe49001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea538d5c7da4db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:02.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490001520 con 0x7fe48c0040e0 2024-09-12T02:57:02.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4900052f0 con 0x7fe48c0040e0 2024-09-12T02:57:02.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4a6a00640 1 -- 172.21.15.63:0/3481724712 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4900a8950 con 0x7fe48c0040e0 2024-09-12T02:57:02.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4ae000640 1 -- 172.21.15.63:0/3481724712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe48c0040e0 msgr2=0x7fe48c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4ae000640 1 --2- 172.21.15.63:0/3481724712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe48c0040e0 0x7fe48c004810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe4900018d0 tx=0x7fe49001ecf0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4a7e00640 1 -- 172.21.15.63:0/3481724712 reap_dead start 2024-09-12T02:57:02.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4ae000640 1 -- 172.21.15.63:0/3481724712 shutdown_connections 2024-09-12T02:57:02.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4ae000640 1 -- 172.21.15.63:0/3481724712 >> 172.21.15.63:0/3481724712 conn(0x7fe4a80cc8e0 msgr2=0x7fe4a80cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:02.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4ae000640 1 -- 172.21.15.63:0/3481724712 shutdown_connections 2024-09-12T02:57:02.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4ae000640 1 -- 172.21.15.63:0/3481724712 wait complete. 2024-09-12T02:57:02.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.985+0000 7fe4ae000640 1 Processor -- start 2024-09-12T02:57:02.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 -- start start 2024-09-12T02:57:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c0040e0 0x7fe4a81f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a814fb60 0x7fe4a80c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a814ffc0 0x7fe4a80c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80cd520 con 0x7fe4a814ffc0 2024-09-12T02:57:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a815e040 con 0x7fe48c0040e0 2024-09-12T02:57:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a80cd6a0 con 0x7fe4a814fb60 2024-09-12T02:57:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a814ffc0 0x7fe4a80c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a814ffc0 0x7fe4a80c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41154/0 (socket says 172.21.15.63:41154) 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7e00640 1 -- 172.21.15.63:0/2526269765 learned_addr learned my addr 172.21.15.63:0/2526269765 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7400640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c0040e0 0x7fe4a81f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe49ea00640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a814fb60 0x7fe4a80c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7e00640 1 -- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a814fb60 msgr2=0x7fe4a80c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7e00640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a814fb60 0x7fe4a80c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7e00640 1 -- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c0040e0 msgr2=0x7fe4a81f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7e00640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c0040e0 0x7fe4a81f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7e00640 1 -- 172.21.15.63:0/2526269765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a80c6c80 con 0x7fe4a814ffc0 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7400640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c0040e0 0x7fe4a81f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4a7e00640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a814ffc0 0x7fe4a80c5d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8072250 tx=0x7fe4a0007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe49fe00640 1 -- 172.21.15.63:0/2526269765 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000eb00 con 0x7fe4a814ffc0 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe49fe00640 1 -- 172.21.15.63:0/2526269765 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a0018070 con 0x7fe4a814ffc0 2024-09-12T02:57:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe49fe00640 1 -- 172.21.15.63:0/2526269765 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0013420 con 0x7fe4a814ffc0 2024-09-12T02:57:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a80c52e0 con 0x7fe4a814ffc0 2024-09-12T02:57:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a81f4360 con 0x7fe4a814ffc0 2024-09-12T02:57:02.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.989+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a80c54b0 con 0x7fe4a814ffc0 2024-09-12T02:57:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.993+0000 7fe49fe00640 1 -- 172.21.15.63:0/2526269765 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4a00135c0 con 0x7fe4a814ffc0 2024-09-12T02:57:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.993+0000 7fe49fe00640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe4840678c0 0x7fe484069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.993+0000 7fe49fe00640 1 -- 172.21.15.63:0/2526269765 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fe4a00867f0 con 0x7fe4a814ffc0 2024-09-12T02:57:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.993+0000 7fe4a7400640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe4840678c0 0x7fe484069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.993+0000 7fe4a7400640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe4840678c0 0x7fe484069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe498009b00 tx=0x7fe498008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:02.997+0000 7fe49fe00640 1 -- 172.21.15.63:0/2526269765 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe4a0057570 con 0x7fe4a814ffc0 2024-09-12T02:57:03.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.161+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fe4a8067a00 con 0x7fe4a814ffc0 2024-09-12T02:57:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.765+0000 7fe49fe00640 1 -- 172.21.15.63:0/2526269765 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7fe4a0056e70 con 0x7fe4a814ffc0 2024-09-12T02:57:03.771 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-09-12T02:57:03.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe4840678c0 msgr2=0x7fe484069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:03.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe4840678c0 0x7fe484069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe498009b00 tx=0x7fe498008040 comp rx=0 tx=0).stop 2024-09-12T02:57:03.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a814ffc0 msgr2=0x7fe4a80c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:03.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a814ffc0 0x7fe4a80c5d20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8072250 tx=0x7fe4a0007bd0 comp rx=0 tx=0).stop 2024-09-12T02:57:03.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 shutdown_connections 2024-09-12T02:57:03.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe4a814ffc0 0x7fe4a80c5d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:03.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe4840678c0 0x7fe484069d80 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe498009b00 tx=0x7fe498008040 comp rx=0 tx=0).stop 2024-09-12T02:57:03.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a814fb60 0x7fe4a80c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:03.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 --2- 172.21.15.63:0/2526269765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48c0040e0 0x7fe4a81f3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:03.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 >> 172.21.15.63:0/2526269765 conn(0x7fe4a80cc8e0 msgr2=0x7fe4a806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:03.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 shutdown_connections 2024-09-12T02:57:03.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.769+0000 7fe4ae000640 1 -- 172.21.15.63:0/2526269765 wait complete. 2024-09-12T02:57:03.812 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:57:03.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.957+0000 7f4113200640 1 Processor -- start 2024-09-12T02:57:03.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.957+0000 7f4113200640 1 -- start start 2024-09-12T02:57:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.957+0000 7f4113200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f410c06fb80 0x7f410c06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.957+0000 7f4113200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f410c15ed90 con 0x7f410c0cc2e0 2024-09-12T02:57:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.957+0000 7f4113200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f410c0ce270 con 0x7f410c0b2e70 2024-09-12T02:57:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.957+0000 7f4113200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f410c0ce810 con 0x7f410c06fb80 2024-09-12T02:57:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.957+0000 7f410be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f410c06fb80 0x7f410c06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.957+0000 7f410be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f410c06fb80 0x7f410c06ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39642/0 (socket says 172.21.15.63:39642) 2024-09-12T02:57:03.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.957+0000 7f410be00640 1 -- 172.21.15.63:0/1867856138 learned_addr learned my addr 172.21.15.63:0/1867856138 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f410be00640 1 -- 172.21.15.63:0/1867856138 >> v1:172.21.15.119:6789/0 conn(0x7f410c0b2e70 legacy=0x7f410c15e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f410be00640 1 -- 172.21.15.63:0/1867856138 >> v1:172.21.15.63:6789/0 conn(0x7f410c0cc2e0 legacy=0x7f410c15df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:03.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f410be00640 1 -- 172.21.15.63:0/1867856138 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410c0cef50 con 0x7f410c06fb80 2024-09-12T02:57:03.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f410be00640 1 --2- 172.21.15.63:0/1867856138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c06fb80 0x7f410c06ff60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009870 tx=0x7f40fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d88fddee3a414f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f410aa00640 1 -- 172.21.15.63:0/1867856138 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0b1070 con 0x7f410c06fb80 2024-09-12T02:57:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f410aa00640 1 -- 172.21.15.63:0/1867856138 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40fc0a8050 con 0x7f410c06fb80 2024-09-12T02:57:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f410aa00640 1 -- 172.21.15.63:0/1867856138 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc0ac860 con 0x7f410c06fb80 2024-09-12T02:57:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f4113200640 1 -- 172.21.15.63:0/1867856138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c06fb80 msgr2=0x7f410c06ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:03.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f4113200640 1 --2- 172.21.15.63:0/1867856138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c06fb80 0x7f410c06ff60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009870 tx=0x7f40fc01c4d0 comp rx=0 tx=0).stop 2024-09-12T02:57:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f4113200640 1 -- 172.21.15.63:0/1867856138 shutdown_connections 2024-09-12T02:57:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f4113200640 1 --2- 172.21.15.63:0/1867856138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c06fb80 0x7f410c06ff60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f4113200640 1 -- 172.21.15.63:0/1867856138 >> 172.21.15.63:0/1867856138 conn(0x7f410c06bcc0 msgr2=0x7f410c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f4113200640 1 -- 172.21.15.63:0/1867856138 shutdown_connections 2024-09-12T02:57:03.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.961+0000 7f4113200640 1 -- 172.21.15.63:0/1867856138 wait complete. 2024-09-12T02:57:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 Processor -- start 2024-09-12T02:57:03.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 -- start start 2024-09-12T02:57:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f410c06fb80 0x7f410c1f7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:03.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c0b2e70 0x7f410c0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f410c0cc2e0 0x7f410c14d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f410c0ccc40 con 0x7f410c0b2e70 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f410c0c5260 con 0x7f410c0cc2e0 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f410c0cea20 con 0x7f410c06fb80 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c0b2e70 0x7f410c0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c0b2e70 0x7f410c0c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39646/0 (socket says 172.21.15.63:39646) 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410b400640 1 -- 172.21.15.63:0/1360174512 learned_addr learned my addr 172.21.15.63:0/1360174512 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410be00640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f410c06fb80 0x7f410c1f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4111200640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f410c0cc2e0 0x7f410c14d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410b400640 1 -- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f410c06fb80 msgr2=0x7f410c1f7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410b400640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f410c06fb80 0x7f410c1f7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:03.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410b400640 1 -- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f410c0cc2e0 msgr2=0x7f410c14d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410b400640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f410c0cc2e0 0x7f410c14d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410b400640 1 -- 172.21.15.63:0/1360174512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410c0b2c10 con 0x7f410c0b2e70 2024-09-12T02:57:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f410b400640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c0b2e70 0x7f410c0c5df0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40f800c3c0 tx=0x7f40f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4103e00640 1 -- 172.21.15.63:0/1360174512 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f8017070 con 0x7f410c0b2e70 2024-09-12T02:57:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4103e00640 1 -- 172.21.15.63:0/1360174512 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f80052d0 con 0x7f410c0b2e70 2024-09-12T02:57:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4103e00640 1 -- 172.21.15.63:0/1360174512 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f8003840 con 0x7f410c0b2e70 2024-09-12T02:57:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410c0b2110 con 0x7f410c0b2e70 2024-09-12T02:57:03.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.965+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f410c0c7fd0 con 0x7f410c0b2e70 2024-09-12T02:57:03.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.969+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f410c06ec00 con 0x7f410c0b2e70 2024-09-12T02:57:03.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.969+0000 7f4103e00640 1 -- 172.21.15.63:0/1360174512 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40f801a070 con 0x7f410c0b2e70 2024-09-12T02:57:03.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.969+0000 7f4103e00640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f40ec0678f0 0x7f40ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:03.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.969+0000 7f4103e00640 1 -- 172.21.15.63:0/1360174512 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f40f8084fe0 con 0x7f410c0b2e70 2024-09-12T02:57:03.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.969+0000 7f410be00640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f40ec0678f0 0x7f40ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:03.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.973+0000 7f410be00640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f40ec0678f0 0x7f40ec069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0ae000 tx=0x7f40fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:03.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:03.977+0000 7f4103e00640 1 -- 172.21.15.63:0/1360174512 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f40f8005480 con 0x7f410c0b2e70 2024-09-12T02:57:04.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.177+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f410c06e420 con 0x7f410c0b2e70 2024-09-12T02:57:04.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.833+0000 7f4103e00640 1 -- 172.21.15.63:0/1360174512 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f40f8055ae0 con 0x7f410c0b2e70 2024-09-12T02:57:04.838 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:57:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.837+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f40ec0678f0 msgr2=0x7f40ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.837+0000 7f4113200640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f40ec0678f0 0x7f40ec069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0ae000 tx=0x7f40fc008040 comp rx=0 tx=0).stop 2024-09-12T02:57:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.837+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c0b2e70 msgr2=0x7f410c0c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.837+0000 7f4113200640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c0b2e70 0x7f410c0c5df0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40f800c3c0 tx=0x7f40f800c880 comp rx=0 tx=0).stop 2024-09-12T02:57:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.837+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 shutdown_connections 2024-09-12T02:57:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.837+0000 7f4113200640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f410c0cc2e0 0x7f410c14d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.841+0000 7f4113200640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f410c0b2e70 0x7f410c0c5df0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.841+0000 7f4113200640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f40ec0678f0 0x7f40ec069db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.841+0000 7f4113200640 1 --2- 172.21.15.63:0/1360174512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f410c06fb80 0x7f410c1f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.841+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 >> 172.21.15.63:0/1360174512 conn(0x7f410c06bcc0 msgr2=0x7f410c0ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.841+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 shutdown_connections 2024-09-12T02:57:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:04.841+0000 7f4113200640 1 -- 172.21.15.63:0/1360174512 wait complete. 2024-09-12T02:57:04.870 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T02:57:04.871 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T02:57:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b29200640 1 Processor -- start 2024-09-12T02:57:05.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b29200640 1 -- start start 2024-09-12T02:57:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b29200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5b240c8dc0 0x7f5b240c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b29200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b24155050 con 0x7f5b24154c70 2024-09-12T02:57:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b29200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b240c9fa0 con 0x7f5b24067d60 2024-09-12T02:57:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b29200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2415dec0 con 0x7f5b240c8dc0 2024-09-12T02:57:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b23400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5b24154c70 0x7f5b240c86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52124/0 (socket says 172.21.15.63:52124) 2024-09-12T02:57:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b23400640 1 -- 172.21.15.63:0/3564346374 learned_addr learned my addr 172.21.15.63:0/3564346374 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:05.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b1aa00640 1 --2- 172.21.15.63:0/3564346374 >> v2:172.21.15.119:3300/0 conn(0x7f5b240c8dc0 0x7f5b240c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b22a00640 1 -- 172.21.15.63:0/3564346374 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695729254 0 0) 0x7f5b24155050 con 0x7f5b24154c70 2024-09-12T02:57:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b22a00640 1 -- 172.21.15.63:0/3564346374 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b08003530 con 0x7f5b24154c70 2024-09-12T02:57:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b22a00640 1 -- 172.21.15.63:0/3564346374 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1204114894 0 0) 0x7f5b08003530 con 0x7f5b24154c70 2024-09-12T02:57:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b1aa00640 1 -- 172.21.15.63:0/3564346374 >> v1:172.21.15.119:6789/0 conn(0x7f5b24067d60 legacy=0x7f5b241651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b1aa00640 1 -- 172.21.15.63:0/3564346374 >> v1:172.21.15.63:6789/0 conn(0x7f5b24154c70 legacy=0x7f5b240c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:05.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.017+0000 7f5b1aa00640 1 -- 172.21.15.63:0/3564346374 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2415e1a0 con 0x7f5b240c8dc0 2024-09-12T02:57:05.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b1aa00640 1 --2- 172.21.15.63:0/3564346374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b240c8dc0 0x7f5b240c72e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0097c0 tx=0x7f5b0c01ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0b64bbfbd789c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b22a00640 1 -- 172.21.15.63:0/3564346374 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0b5070 con 0x7f5b240c8dc0 2024-09-12T02:57:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b22a00640 1 -- 172.21.15.63:0/3564346374 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0a8630 con 0x7f5b240c8dc0 2024-09-12T02:57:05.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b22a00640 1 -- 172.21.15.63:0/3564346374 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14001680 con 0x7f5b240c8dc0 2024-09-12T02:57:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b29200640 1 -- 172.21.15.63:0/3564346374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b240c8dc0 msgr2=0x7f5b240c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b29200640 1 --2- 172.21.15.63:0/3564346374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b240c8dc0 0x7f5b240c72e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0097c0 tx=0x7f5b0c01ebb0 comp rx=0 tx=0).stop 2024-09-12T02:57:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b29200640 1 -- 172.21.15.63:0/3564346374 shutdown_connections 2024-09-12T02:57:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b29200640 1 --2- 172.21.15.63:0/3564346374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b240c8dc0 0x7f5b240c72e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b29200640 1 -- 172.21.15.63:0/3564346374 >> 172.21.15.63:0/3564346374 conn(0x7f5b240c93e0 msgr2=0x7f5b240c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b29200640 1 -- 172.21.15.63:0/3564346374 shutdown_connections 2024-09-12T02:57:05.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.021+0000 7f5b29200640 1 -- 172.21.15.63:0/3564346374 wait complete. 2024-09-12T02:57:05.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 Processor -- start 2024-09-12T02:57:05.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 -- start start 2024-09-12T02:57:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b24067d60 0x7f5b241504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:05.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b24154c70 0x7f5b24157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b240cbff0 0x7f5b241f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2406d980 con 0x7f5b240cbff0 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2406d690 con 0x7f5b24067d60 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5b240ca210 con 0x7f5b24154c70 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b240cbff0 0x7f5b241f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b240cbff0 0x7f5b241f3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39648/0 (socket says 172.21.15.63:39648) 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23e00640 1 -- 172.21.15.63:0/2701020741 learned_addr learned my addr 172.21.15.63:0/2701020741 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b1aa00640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b24154c70 0x7f5b24157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23400640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b24067d60 0x7f5b241504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:05.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23e00640 1 -- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b24154c70 msgr2=0x7f5b24157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23e00640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b24154c70 0x7f5b24157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23e00640 1 -- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b24067d60 msgr2=0x7f5b241504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23e00640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b24067d60 0x7f5b241504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23e00640 1 -- 172.21.15.63:0/2701020741 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b240c9d30 con 0x7f5b240cbff0 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b23e00640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b240cbff0 0x7f5b241f3970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c770 tx=0x7f5b1c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b1be00640 1 -- 172.21.15.63:0/2701020741 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c003b80 con 0x7f5b240cbff0 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b1be00640 1 -- 172.21.15.63:0/2701020741 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1c003d20 con 0x7f5b240cbff0 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b1be00640 1 -- 172.21.15.63:0/2701020741 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00aa90 con 0x7f5b240cbff0 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b241f1370 con 0x7f5b240cbff0 2024-09-12T02:57:05.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.025+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b240cbb90 con 0x7f5b240cbff0 2024-09-12T02:57:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.029+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2406f8a0 con 0x7f5b240cbff0 2024-09-12T02:57:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.029+0000 7f5b1be00640 1 -- 172.21.15.63:0/2701020741 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b1c00ac30 con 0x7f5b240cbff0 2024-09-12T02:57:05.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.029+0000 7f5b1be00640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b000678c0 0x7f5b00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.029+0000 7f5b1be00640 1 -- 172.21.15.63:0/2701020741 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b1c085c60 con 0x7f5b240cbff0 2024-09-12T02:57:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.029+0000 7f5b23400640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b000678c0 0x7f5b00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:05.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.029+0000 7f5b23400640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b000678c0 0x7f5b00069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5b14005890 tx=0x7f5b14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:05.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.033+0000 7f5b1be00640 1 -- 172.21.15.63:0/2701020741 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5b1c056700 con 0x7f5b240cbff0 2024-09-12T02:57:05.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.209+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f5b2406f390 con 0x7f5b240cbff0 2024-09-12T02:57:05.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.813+0000 7f5b1be00640 1 -- 172.21.15.63:0/2701020741 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7f5b1c056000 con 0x7f5b240cbff0 2024-09-12T02:57:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b000678c0 msgr2=0x7f5b00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b000678c0 0x7f5b00069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5b14005890 tx=0x7f5b14009040 comp rx=0 tx=0).stop 2024-09-12T02:57:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b240cbff0 msgr2=0x7f5b241f3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b240cbff0 0x7f5b241f3970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c770 tx=0x7f5b1c00cc30 comp rx=0 tx=0).stop 2024-09-12T02:57:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 shutdown_connections 2024-09-12T02:57:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b240cbff0 0x7f5b241f3970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:05.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b000678c0 0x7f5b00069d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b24154c70 0x7f5b24157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 --2- 172.21.15.63:0/2701020741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b24067d60 0x7f5b241504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 >> 172.21.15.63:0/2701020741 conn(0x7f5b240c93e0 msgr2=0x7f5b241524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 shutdown_connections 2024-09-12T02:57:05.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.817+0000 7f5b29200640 1 -- 172.21.15.63:0/2701020741 wait complete. 2024-09-12T02:57:05.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:57:05.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b43c00640 1 Processor -- start 2024-09-12T02:57:06.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b43c00640 1 -- start start 2024-09-12T02:57:06.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b43c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1b3c152790 0x7f1b3c15c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b43c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3c0c3520 con 0x7f1b3c152b70 2024-09-12T02:57:06.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b43c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3c0c3800 con 0x7f1b3c070500 2024-09-12T02:57:06.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b43c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f1b3c0c55e0 con 0x7f1b3c152790 2024-09-12T02:57:06.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b41200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1b3c152790 0x7f1b3c15c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b41200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1b3c152790 0x7f1b3c15c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39652/0 (socket says 172.21.15.63:39652) 2024-09-12T02:57:06.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b41200640 1 -- 172.21.15.63:0/1968663837 learned_addr learned my addr 172.21.15.63:0/1968663837 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:06.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b41c00640 1 --1- 172.21.15.63:0/1968663837 >> v1:172.21.15.63:6789/0 conn(0x7f1b3c152b70 0x7f1b3c162f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52140/0 (socket says 172.21.15.63:52140) 2024-09-12T02:57:06.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b41200640 1 -- 172.21.15.63:0/1968663837 >> v1:172.21.15.119:6789/0 conn(0x7f1b3c070500 legacy=0x7f1b3c070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b41200640 1 -- 172.21.15.63:0/1968663837 >> v1:172.21.15.63:6789/0 conn(0x7f1b3c152b70 legacy=0x7f1b3c162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:05.997+0000 7f1b41200640 1 -- 172.21.15.63:0/1968663837 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c15bcf0 con 0x7f1b3c152790 2024-09-12T02:57:06.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b41200640 1 --2- 172.21.15.63:0/1968663837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 0x7f1b3c15c7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009870 tx=0x7f1b2c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4936228de00c69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:06.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b3be00640 1 -- 172.21.15.63:0/1968663837 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0b5070 con 0x7f1b3c152790 2024-09-12T02:57:06.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b3be00640 1 -- 172.21.15.63:0/1968663837 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c0a8a50 con 0x7f1b3c152790 2024-09-12T02:57:06.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b3be00640 1 -- 172.21.15.63:0/1968663837 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0a8e20 con 0x7f1b3c152790 2024-09-12T02:57:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b43c00640 1 -- 172.21.15.63:0/1968663837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 msgr2=0x7f1b3c15c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b43c00640 1 --2- 172.21.15.63:0/1968663837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 0x7f1b3c15c7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009870 tx=0x7f1b2c01ed50 comp rx=0 tx=0).stop 2024-09-12T02:57:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b43c00640 1 -- 172.21.15.63:0/1968663837 shutdown_connections 2024-09-12T02:57:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b43c00640 1 --2- 172.21.15.63:0/1968663837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 0x7f1b3c15c7d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b43c00640 1 -- 172.21.15.63:0/1968663837 >> 172.21.15.63:0/1968663837 conn(0x7f1b3c067a00 msgr2=0x7f1b3c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b43c00640 1 -- 172.21.15.63:0/1968663837 shutdown_connections 2024-09-12T02:57:06.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.001+0000 7f1b43c00640 1 -- 172.21.15.63:0/1968663837 wait complete. 2024-09-12T02:57:06.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 Processor -- start 2024-09-12T02:57:06.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 -- start start 2024-09-12T02:57:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b3c070500 0x7f1b3c0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 0x7f1b3c0c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b3c152b70 0x7f1b3c0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c0c3ae0 con 0x7f1b3c152790 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c15c2b0 con 0x7f1b3c070500 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3c071060 con 0x7f1b3c152b70 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b33e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 0x7f1b3c0c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b33e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 0x7f1b3c0c5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39664/0 (socket says 172.21.15.63:39664) 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b33e00640 1 -- 172.21.15.63:0/3951847627 learned_addr learned my addr 172.21.15.63:0/3951847627 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b41200640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b3c070500 0x7f1b3c0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b41c00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b3c152b70 0x7f1b3c0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b33e00640 1 -- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b3c152b70 msgr2=0x7f1b3c0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b33e00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b3c152b70 0x7f1b3c0c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b33e00640 1 -- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b3c070500 msgr2=0x7f1b3c0cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b33e00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b3c070500 0x7f1b3c0cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b33e00640 1 -- 172.21.15.63:0/3951847627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c06d950 con 0x7f1b3c152790 2024-09-12T02:57:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b33e00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 0x7f1b3c0c5980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400c3f0 tx=0x7f1b2400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b39600640 1 -- 172.21.15.63:0/3951847627 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24017070 con 0x7f1b3c152790 2024-09-12T02:57:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b39600640 1 -- 172.21.15.63:0/3951847627 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b240052d0 con 0x7f1b3c152790 2024-09-12T02:57:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3c158d80 con 0x7f1b3c152790 2024-09-12T02:57:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b39600640 1 -- 172.21.15.63:0/3951847627 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24003840 con 0x7f1b3c152790 2024-09-12T02:57:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3c0c7230 con 0x7f1b3c152790 2024-09-12T02:57:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.005+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3c0c50b0 con 0x7f1b3c152790 2024-09-12T02:57:06.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.009+0000 7f1b39600640 1 -- 172.21.15.63:0/3951847627 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b2401a070 con 0x7f1b3c152790 2024-09-12T02:57:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.009+0000 7f1b39600640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1b180678c0 0x7f1b18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.009+0000 7f1b39600640 1 -- 172.21.15.63:0/3951847627 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f1b240850f0 con 0x7f1b3c152790 2024-09-12T02:57:06.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.009+0000 7f1b41200640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1b180678c0 0x7f1b18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:06.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.009+0000 7f1b41200640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1b180678c0 0x7f1b18069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0b2000 tx=0x7f1b2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:06.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.013+0000 7f1b39600640 1 -- 172.21.15.63:0/3951847627 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1b3c06d950 con 0x7f1b3c152790 2024-09-12T02:57:06.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:06.185+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1b3c0680a0 con 0x7f1b3c152790 2024-09-12T02:57:07.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.837+0000 7f1b39600640 1 -- 172.21.15.63:0/3951847627 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f1b24005480 con 0x7f1b3c152790 2024-09-12T02:57:07.842 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data_ec' created 2024-09-12T02:57:07.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1b180678c0 msgr2=0x7f1b18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:07.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1b180678c0 0x7f1b18069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0b2000 tx=0x7f1b2c009040 comp rx=0 tx=0).stop 2024-09-12T02:57:07.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 msgr2=0x7f1b3c0c5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:07.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 0x7f1b3c0c5980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400c3f0 tx=0x7f1b2400c8b0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 shutdown_connections 2024-09-12T02:57:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1b180678c0 0x7f1b18069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1b3c152b70 0x7f1b3c0c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b3c152790 0x7f1b3c0c5980 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 --2- 172.21.15.63:0/3951847627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1b3c070500 0x7f1b3c0cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 >> 172.21.15.63:0/3951847627 conn(0x7f1b3c067a00 msgr2=0x7f1b3c0c9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 shutdown_connections 2024-09-12T02:57:07.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:07.841+0000 7f1b43c00640 1 -- 172.21.15.63:0/3951847627 wait complete. 2024-09-12T02:57:07.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T02:57:08.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff256800640 1 Processor -- start 2024-09-12T02:57:08.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff256800640 1 -- start start 2024-09-12T02:57:08.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff256800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25006d710 0x7ff2500c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:08.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff256800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff250073130 0x7ff25006cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:08.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff256800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff250154cd0 con 0x7ff2501548f0 2024-09-12T02:57:08.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff256800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff25006bea0 con 0x7ff250073130 2024-09-12T02:57:08.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff256800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff25006c140 con 0x7ff25006d710 2024-09-12T02:57:08.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff255400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff2501548f0 0x7ff25015a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52142/0 (socket says 172.21.15.63:52142) 2024-09-12T02:57:08.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff255400640 1 -- 172.21.15.63:0/2002678952 learned_addr learned my addr 172.21.15.63:0/2002678952 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:08.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff255e00640 1 --2- 172.21.15.63:0/2002678952 >> v2:172.21.15.119:3300/0 conn(0x7ff250073130 0x7ff25006cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff254a00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25006d710 0x7ff2500c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782224629 0 0) 0x7ff250154cd0 con 0x7ff2501548f0 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff238003530 con 0x7ff2501548f0 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2577870944 0 0) 0x7ff238003530 con 0x7ff2501548f0 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25006d710 msgr2=0x7ff2500c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25006d710 0x7ff2500c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 >> v2:172.21.15.119:3300/0 conn(0x7ff250073130 msgr2=0x7ff25006cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 --2- 172.21.15.63:0/2002678952 >> v2:172.21.15.119:3300/0 conn(0x7ff250073130 0x7ff25006cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25006c420 con 0x7ff2501548f0 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7ff244001680 con 0x7ff2501548f0 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 >> v1:172.21.15.63:6789/0 conn(0x7ff2501548f0 legacy=0x7ff25015a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25006d710 0x7ff2380039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:08.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff238003f40 0x7ff238004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238004d50 0x7ff2380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff25006bea0 con 0x7ff238003f40 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff25006c140 con 0x7ff238004d50 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff23800b9d0 con 0x7ff25006d710 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff254a00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff238003f40 0x7ff238004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff255400640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25006d710 0x7ff2380039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff255e00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238004d50 0x7ff2380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff254a00640 1 -- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25006d710 msgr2=0x7ff2380039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff254a00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25006d710 0x7ff2380039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff254a00640 1 -- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238004d50 msgr2=0x7ff2380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff254a00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238004d50 0x7ff2380051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff254a00640 1 -- 172.21.15.63:0/2002678952 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff238003530 con 0x7ff238003f40 2024-09-12T02:57:08.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.025+0000 7ff255e00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238004d50 0x7ff2380051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:08.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff254a00640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff238003f40 0x7ff238004810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009ae0 tx=0x7ff23c01c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ada9e74a24a1735 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:08.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c0b1070 con 0x7ff238003f40 2024-09-12T02:57:08.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff23c0a4990 con 0x7ff238003f40 2024-09-12T02:57:08.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff24fe00640 1 -- 172.21.15.63:0/2002678952 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c0096b0 con 0x7ff238003f40 2024-09-12T02:57:08.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff256800640 1 -- 172.21.15.63:0/2002678952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff238003f40 msgr2=0x7ff238004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:08.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff256800640 1 --2- 172.21.15.63:0/2002678952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff238003f40 0x7ff238004810 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009ae0 tx=0x7ff23c01c6f0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff255e00640 1 -- 172.21.15.63:0/2002678952 reap_dead start 2024-09-12T02:57:08.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff256800640 1 -- 172.21.15.63:0/2002678952 shutdown_connections 2024-09-12T02:57:08.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff256800640 1 -- 172.21.15.63:0/2002678952 >> 172.21.15.63:0/2002678952 conn(0x7ff2500cc6d0 msgr2=0x7ff2500ccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:08.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff256800640 1 -- 172.21.15.63:0/2002678952 shutdown_connections 2024-09-12T02:57:08.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.029+0000 7ff256800640 1 -- 172.21.15.63:0/2002678952 wait complete. 2024-09-12T02:57:08.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 Processor -- start 2024-09-12T02:57:08.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 -- start start 2024-09-12T02:57:08.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238003f40 0x7ff2501e4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:08.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25015c1f0 0x7ff2501f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:08.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25015a5c0 0x7ff250156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:08.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff25015b0d0 con 0x7ff25015a5c0 2024-09-12T02:57:08.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff250073540 con 0x7ff238003f40 2024-09-12T02:57:08.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff25015b250 con 0x7ff25015c1f0 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25015a5c0 0x7ff250156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25015a5c0 0x7ff250156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39686/0 (socket says 172.21.15.63:39686) 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255e00640 1 -- 172.21.15.63:0/176601622 learned_addr learned my addr 172.21.15.63:0/176601622 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff254a00640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25015c1f0 0x7ff2501f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255400640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238003f40 0x7ff2501e4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255e00640 1 -- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25015c1f0 msgr2=0x7ff2501f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255e00640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25015c1f0 0x7ff2501f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255e00640 1 -- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238003f40 msgr2=0x7ff2501e4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255e00640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238003f40 0x7ff2501e4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255e00640 1 -- 172.21.15.63:0/176601622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff250156980 con 0x7ff25015a5c0 2024-09-12T02:57:08.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff255e00640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25015a5c0 0x7ff250156e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff25006f2d0 tx=0x7ff248010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:08.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff24d600640 1 -- 172.21.15.63:0/176601622 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248010d20 con 0x7ff25015a5c0 2024-09-12T02:57:08.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff24d600640 1 -- 172.21.15.63:0/176601622 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2480039a0 con 0x7ff25015a5c0 2024-09-12T02:57:08.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff24d600640 1 -- 172.21.15.63:0/176601622 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248003dd0 con 0x7ff25015a5c0 2024-09-12T02:57:08.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2501f4f90 con 0x7ff25015a5c0 2024-09-12T02:57:08.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.033+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25015b770 con 0x7ff25015a5c0 2024-09-12T02:57:08.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.037+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25006cf00 con 0x7ff25015a5c0 2024-09-12T02:57:08.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.037+0000 7ff24d600640 1 -- 172.21.15.63:0/176601622 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff24801e020 con 0x7ff25015a5c0 2024-09-12T02:57:08.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.037+0000 7ff24d600640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff2300678c0 0x7ff230069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:08.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.037+0000 7ff24d600640 1 -- 172.21.15.63:0/176601622 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7ff248086650 con 0x7ff25015a5c0 2024-09-12T02:57:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.037+0000 7ff255400640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff2300678c0 0x7ff230069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.041+0000 7ff255400640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff2300678c0 0x7ff230069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff244005180 tx=0x7ff244007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:08.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.045+0000 7ff24d600640 1 -- 172.21.15.63:0/176601622 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff248025020 con 0x7ff25015a5c0 2024-09-12T02:57:08.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.209+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff2501523c0 con 0x7ff25015a5c0 2024-09-12T02:57:08.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.841+0000 7ff24d600640 1 -- 172.21.15.63:0/176601622 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7ff248056780 con 0x7ff25015a5c0 2024-09-12T02:57:08.844 INFO:teuthology.orchestra.run.smithi063.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T02:57:08.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff2300678c0 msgr2=0x7ff230069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:08.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff2300678c0 0x7ff230069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff244005180 tx=0x7ff244007900 comp rx=0 tx=0).stop 2024-09-12T02:57:08.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25015a5c0 msgr2=0x7ff250156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:08.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25015a5c0 0x7ff250156e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff25006f2d0 tx=0x7ff248010590 comp rx=0 tx=0).stop 2024-09-12T02:57:08.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 shutdown_connections 2024-09-12T02:57:08.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff25015a5c0 0x7ff250156e30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff2300678c0 0x7ff230069d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff25015c1f0 0x7ff2501f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 --2- 172.21.15.63:0/176601622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff238003f40 0x7ff2501e4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:08.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 >> 172.21.15.63:0/176601622 conn(0x7ff2500cc6d0 msgr2=0x7ff2500c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:08.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 shutdown_connections 2024-09-12T02:57:08.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:08.845+0000 7ff256800640 1 -- 172.21.15.63:0/176601622 wait complete. 2024-09-12T02:57:08.893 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T02:57:09.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef91400640 1 Processor -- start 2024-09-12T02:57:09.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef91400640 1 -- start start 2024-09-12T02:57:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef91400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fef8c0cc2e0 0x7fef8c06ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef91400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fef8c0b2e70 0x7fef8c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef91400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef8c0ce270 con 0x7fef8c06fb80 2024-09-12T02:57:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef91400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fef8c0ce810 con 0x7fef8c0b2e70 2024-09-12T02:57:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef91400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fef8c0ccd70 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef8a800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fef8c06fb80 0x7fef8c15df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52148/0 (socket says 172.21.15.63:52148) 2024-09-12T02:57:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef8a800640 1 -- 172.21.15.63:0/1438733451 learned_addr learned my addr 172.21.15.63:0/1438733451 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef8b200640 1 --2- 172.21.15.63:0/1438733451 >> v2:172.21.15.63:3300/0 conn(0x7fef8c0b2e70 0x7fef8c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:09.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef83e00640 1 --2- 172.21.15.63:0/1438733451 >> v2:172.21.15.119:3300/0 conn(0x7fef8c0cc2e0 0x7fef8c06ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef8b200640 1 -- 172.21.15.63:0/1438733451 >> v2:172.21.15.119:3300/0 conn(0x7fef8c0cc2e0 msgr2=0x7fef8c06ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef8b200640 1 --2- 172.21.15.63:0/1438733451 >> v2:172.21.15.119:3300/0 conn(0x7fef8c0cc2e0 0x7fef8c06ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef8b200640 1 -- 172.21.15.63:0/1438733451 >> v1:172.21.15.63:6789/0 conn(0x7fef8c06fb80 legacy=0x7fef8c15df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef8b200640 1 -- 172.21.15.63:0/1438733451 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c0cef50 con 0x7fef8c0b2e70 2024-09-12T02:57:09.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.041+0000 7fef89e00640 1 -- 172.21.15.63:0/1438733451 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3979684053 0 0) 0x7fef8c0ce270 con 0x7fef8c06fb80 2024-09-12T02:57:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef8b200640 1 --2- 172.21.15.63:0/1438733451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0b2e70 0x7fef8c0cc830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0725c0 tx=0x7fef8401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe07553c2ec06fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef89e00640 1 -- 172.21.15.63:0/1438733451 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef840b2070 con 0x7fef8c0b2e70 2024-09-12T02:57:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef89e00640 1 -- 172.21.15.63:0/1438733451 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef840a5790 con 0x7fef8c0b2e70 2024-09-12T02:57:09.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef89e00640 1 -- 172.21.15.63:0/1438733451 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef840a5b60 con 0x7fef8c0b2e70 2024-09-12T02:57:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef91400640 1 -- 172.21.15.63:0/1438733451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0b2e70 msgr2=0x7fef8c0cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef91400640 1 --2- 172.21.15.63:0/1438733451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0b2e70 0x7fef8c0cc830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0725c0 tx=0x7fef8401c8a0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef91400640 1 -- 172.21.15.63:0/1438733451 shutdown_connections 2024-09-12T02:57:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef91400640 1 --2- 172.21.15.63:0/1438733451 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0b2e70 0x7fef8c0cc830 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef91400640 1 --2- 172.21.15.63:0/1438733451 >> v2:172.21.15.119:3300/0 conn(0x7fef8c0cc2e0 0x7fef8c06ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef91400640 1 -- 172.21.15.63:0/1438733451 >> 172.21.15.63:0/1438733451 conn(0x7fef8c06bcc0 msgr2=0x7fef8c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:09.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef91400640 1 -- 172.21.15.63:0/1438733451 shutdown_connections 2024-09-12T02:57:09.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.045+0000 7fef91400640 1 -- 172.21.15.63:0/1438733451 wait complete. 2024-09-12T02:57:09.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 Processor -- start 2024-09-12T02:57:09.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 -- start start 2024-09-12T02:57:09.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef8c06fb80 0x7fef8c0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:09.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef8c0b2e70 0x7fef8c14de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cc2e0 0x7fef8c144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c0cea20 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c0c5260 con 0x7fef8c0b2e70 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fef8c06ec00 con 0x7fef8c06fb80 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cc2e0 0x7fef8c144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cc2e0 0x7fef8c144b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39710/0 (socket says 172.21.15.63:39710) 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8b200640 1 -- 172.21.15.63:0/37796669 learned_addr learned my addr 172.21.15.63:0/37796669 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8a800640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef8c06fb80 0x7fef8c0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef83e00640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef8c0b2e70 0x7fef8c14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8b200640 1 -- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef8c06fb80 msgr2=0x7fef8c0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8b200640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef8c06fb80 0x7fef8c0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8b200640 1 -- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef8c0b2e70 msgr2=0x7fef8c14de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:09.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8b200640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef8c0b2e70 0x7fef8c14de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8b200640 1 -- 172.21.15.63:0/37796669 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c0ca620 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef8b200640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cc2e0 0x7fef8c144b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef840b0040 tx=0x7fef84019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:09.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef82a00640 1 -- 172.21.15.63:0/37796669 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef840b2050 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef82a00640 1 -- 172.21.15.63:0/37796669 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef840b3040 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef82a00640 1 -- 172.21.15.63:0/37796669 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef840ad650 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8c0c9830 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8c0c8af0 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.049+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef8c1582e0 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.053+0000 7fef82a00640 1 -- 172.21.15.63:0/37796669 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef840c0020 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.053+0000 7fef82a00640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef680678c0 0x7fef68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:09.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.053+0000 7fef82a00640 1 -- 172.21.15.63:0/37796669 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fef84120690 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.053+0000 7fef8a800640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef680678c0 0x7fef68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:09.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.053+0000 7fef8a800640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef680678c0 0x7fef68069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007fd0 tx=0x7fef7c007d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:09.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.057+0000 7fef82a00640 1 -- 172.21.15.63:0/37796669 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fef84016520 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.257+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fef8c06e420 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef82a00640 1 -- 172.21.15.63:0/37796669 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fef840f0e20 con 0x7fef8c0cc2e0 2024-09-12T02:57:09.879 INFO:teuthology.orchestra.run.smithi063.stderr:added data pool 4 to fsmap 2024-09-12T02:57:09.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef680678c0 msgr2=0x7fef68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef680678c0 0x7fef68069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fef7c007fd0 tx=0x7fef7c007d60 comp rx=0 tx=0).stop 2024-09-12T02:57:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cc2e0 msgr2=0x7fef8c144b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cc2e0 0x7fef8c144b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef840b0040 tx=0x7fef84019640 comp rx=0 tx=0).stop 2024-09-12T02:57:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 shutdown_connections 2024-09-12T02:57:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cc2e0 0x7fef8c144b90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef8c0b2e70 0x7fef8c14de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fef680678c0 0x7fef68069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 --2- 172.21.15.63:0/37796669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef8c06fb80 0x7fef8c0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:09.882 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 >> 172.21.15.63:0/37796669 conn(0x7fef8c06bcc0 msgr2=0x7fef8c14eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:09.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 shutdown_connections 2024-09-12T02:57:09.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:09.877+0000 7fef91400640 1 -- 172.21.15.63:0/37796669 wait complete. 2024-09-12T02:57:09.905 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:57:10.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcc5000640 1 Processor -- start 2024-09-12T02:57:10.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcc5000640 1 -- start start 2024-09-12T02:57:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcc5000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 0x7fbcc0072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcc5000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbcc0074070 0x7fbcc0073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcc5000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc01580c0 con 0x7fbcc00c2380 2024-09-12T02:57:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcc5000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc00c8500 con 0x7fbcc0074070 2024-09-12T02:57:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcc5000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc01583a0 con 0x7fbcc0151a80 2024-09-12T02:57:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcbe800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbcc00c2380 0x7fbcc015aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52158/0 (socket says 172.21.15.63:52158) 2024-09-12T02:57:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcbe800640 1 -- 172.21.15.63:0/495887092 learned_addr learned my addr 172.21.15.63:0/495887092 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcbde00640 1 --2- 172.21.15.63:0/495887092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 0x7fbcc0072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.045+0000 7fbcb5400640 1 --2- 172.21.15.63:0/495887092 >> v2:172.21.15.119:3300/0 conn(0x7fbcc0074070 0x7fbcc0073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbd400640 1 -- 172.21.15.63:0/495887092 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170309267 0 0) 0x7fbcc01580c0 con 0x7fbcc00c2380 2024-09-12T02:57:10.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbd400640 1 -- 172.21.15.63:0/495887092 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbca4003530 con 0x7fbcc00c2380 2024-09-12T02:57:10.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbde00640 1 -- 172.21.15.63:0/495887092 >> v2:172.21.15.119:3300/0 conn(0x7fbcc0074070 msgr2=0x7fbcc0073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:10.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbde00640 1 --2- 172.21.15.63:0/495887092 >> v2:172.21.15.119:3300/0 conn(0x7fbcc0074070 0x7fbcc0073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbde00640 1 -- 172.21.15.63:0/495887092 >> v1:172.21.15.63:6789/0 conn(0x7fbcc00c2380 legacy=0x7fbcc015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbde00640 1 -- 172.21.15.63:0/495887092 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc00cbf00 con 0x7fbcc0151a80 2024-09-12T02:57:10.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcb5400640 1 --2- 172.21.15.63:0/495887092 >> v2:172.21.15.119:3300/0 conn(0x7fbcc0074070 0x7fbcc0073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:10.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbde00640 1 --2- 172.21.15.63:0/495887092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 0x7fbcc0072e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00097f0 tx=0x7fbcb001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc6af611d2d9b960 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbd400640 1 -- 172.21.15.63:0/495887092 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00b5070 con 0x7fbcc0151a80 2024-09-12T02:57:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbd400640 1 -- 172.21.15.63:0/495887092 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb00a8990 con 0x7fbcc0151a80 2024-09-12T02:57:10.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.049+0000 7fbcbd400640 1 -- 172.21.15.63:0/495887092 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00a8d40 con 0x7fbcc0151a80 2024-09-12T02:57:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 -- 172.21.15.63:0/495887092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 msgr2=0x7fbcc0072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 --2- 172.21.15.63:0/495887092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 0x7fbcc0072e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00097f0 tx=0x7fbcb001ec90 comp rx=0 tx=0).stop 2024-09-12T02:57:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 -- 172.21.15.63:0/495887092 shutdown_connections 2024-09-12T02:57:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 --2- 172.21.15.63:0/495887092 >> v2:172.21.15.119:3300/0 conn(0x7fbcc0074070 0x7fbcc0073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 --2- 172.21.15.63:0/495887092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 0x7fbcc0072e50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 -- 172.21.15.63:0/495887092 >> 172.21.15.63:0/495887092 conn(0x7fbcc006f3d0 msgr2=0x7fbcc006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 -- 172.21.15.63:0/495887092 shutdown_connections 2024-09-12T02:57:10.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 -- 172.21.15.63:0/495887092 wait complete. 2024-09-12T02:57:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 Processor -- start 2024-09-12T02:57:10.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 -- start start 2024-09-12T02:57:10.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc0074070 0x7fbcc014e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc00c2380 0x7fbcc0153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 0x7fbcc01538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc00c81f0 con 0x7fbcc0074070 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc00cc4c0 con 0x7fbcc00c2380 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcc5000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc00c7cf0 con 0x7fbcc0151a80 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc0074070 0x7fbcc014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc0074070 0x7fbcc014e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39726/0 (socket says 172.21.15.63:39726) 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbde00640 1 -- 172.21.15.63:0/311366827 learned_addr learned my addr 172.21.15.63:0/311366827 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcb5400640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc00c2380 0x7fbcc0153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbe800640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 0x7fbcc01538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbde00640 1 -- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 msgr2=0x7fbcc01538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbde00640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 0x7fbcc01538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbde00640 1 -- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc00c2380 msgr2=0x7fbcc0153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbde00640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc00c2380 0x7fbcc0153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbde00640 1 -- 172.21.15.63:0/311366827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc014ecb0 con 0x7fbcc0074070 2024-09-12T02:57:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.053+0000 7fbcbde00640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc0074070 0x7fbcc014e160 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00b3040 tx=0x7fbcb001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcb6a00640 1 -- 172.21.15.63:0/311366827 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00c1070 con 0x7fbcc0074070 2024-09-12T02:57:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcb6a00640 1 -- 172.21.15.63:0/311366827 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcb0004240 con 0x7fbcc0074070 2024-09-12T02:57:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcb6a00640 1 -- 172.21.15.63:0/311366827 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00b5040 con 0x7fbcc0074070 2024-09-12T02:57:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc0149040 con 0x7fbcc0074070 2024-09-12T02:57:10.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc01495e0 con 0x7fbcc0074070 2024-09-12T02:57:10.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc006fef0 con 0x7fbcc0074070 2024-09-12T02:57:10.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcb6a00640 1 -- 172.21.15.63:0/311366827 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbcb00c4070 con 0x7fbcc0074070 2024-09-12T02:57:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcb6a00640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbc9c0678c0 0x7fbc9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcb6a00640 1 -- 172.21.15.63:0/311366827 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbcb0122fd0 con 0x7fbcc0074070 2024-09-12T02:57:10.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.057+0000 7fbcb5400640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbc9c0678c0 0x7fbc9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.061+0000 7fbcb5400640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbc9c0678c0 0x7fbc9c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009580 tx=0x7fbca8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:10.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.061+0000 7fbcb6a00640 1 -- 172.21.15.63:0/311366827 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbcb00187f0 con 0x7fbcc0074070 2024-09-12T02:57:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.261+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcc00b14b0 con 0x7fbcc0074070 2024-09-12T02:57:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcb6a00640 1 -- 172.21.15.63:0/311366827 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6871 (secure 0 0 0) 0x7fbcb00f37c0 con 0x7fbcc0074070 2024-09-12T02:57:10.267 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:10.267 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"btime":"2024-09-12T02:57:09:867812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:09.262860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T02:57:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 5 2024-09-12T02:57:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbc9c0678c0 msgr2=0x7fbc9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbc9c0678c0 0x7fbc9c069d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009580 tx=0x7fbca8008040 comp rx=0 tx=0).stop 2024-09-12T02:57:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc0074070 msgr2=0x7fbcc014e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc0074070 0x7fbcc014e160 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00b3040 tx=0x7fbcb001ba30 comp rx=0 tx=0).stop 2024-09-12T02:57:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 shutdown_connections 2024-09-12T02:57:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbc9c0678c0 0x7fbc9c069d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcc0151a80 0x7fbcc01538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcc00c2380 0x7fbcc0153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 --2- 172.21.15.63:0/311366827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbcc0074070 0x7fbcc014e160 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 >> 172.21.15.63:0/311366827 conn(0x7fbcc006f3d0 msgr2=0x7fbcc006d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 shutdown_connections 2024-09-12T02:57:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.265+0000 7fbcc5000640 1 -- 172.21.15.63:0/311366827 wait complete. 2024-09-12T02:57:10.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:57:10.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7c9c00640 1 Processor -- start 2024-09-12T02:57:10.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7c9c00640 1 -- start start 2024-09-12T02:57:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7c9c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb7c4073e80 0x7fb7c40c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7c9c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb7c40c7ec0 0x7fb7c40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7c9c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7c4159330 con 0x7fb7c4152620 2024-09-12T02:57:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7c9c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fb7c415c390 con 0x7fb7c4073e80 2024-09-12T02:57:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7c9c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb7c40742a0 con 0x7fb7c40c7ec0 2024-09-12T02:57:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7bb400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb7c4073e80 0x7fb7c40c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7bb400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb7c4073e80 0x7fb7c40c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39732/0 (socket says 172.21.15.63:39732) 2024-09-12T02:57:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7bb400640 1 -- 172.21.15.63:0/2898086525 learned_addr learned my addr 172.21.15.63:0/2898086525 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:10.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7c9200640 1 --2- 172.21.15.63:0/2898086525 >> v2:172.21.15.119:3300/0 conn(0x7fb7c40c7ec0 0x7fb7c40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7bb400640 1 -- 172.21.15.63:0/2898086525 >> v2:172.21.15.119:3300/0 conn(0x7fb7c40c7ec0 msgr2=0x7fb7c40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:10.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7bb400640 1 --2- 172.21.15.63:0/2898086525 >> v2:172.21.15.119:3300/0 conn(0x7fb7c40c7ec0 0x7fb7c40c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7bb400640 1 -- 172.21.15.63:0/2898086525 >> v1:172.21.15.119:6789/0 conn(0x7fb7c4152620 legacy=0x7fb7c406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.429+0000 7fb7bb400640 1 -- 172.21.15.63:0/2898086525 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c406c3d0 con 0x7fb7c4073e80 2024-09-12T02:57:10.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7bb400640 1 --2- 172.21.15.63:0/2898086525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4073e80 0x7fb7c40c7980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40b2b50 tx=0x7fb7ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e263b1a474d0c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c3400640 1 -- 172.21.15.63:0/2898086525 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0b0070 con 0x7fb7c4073e80 2024-09-12T02:57:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c3400640 1 -- 172.21.15.63:0/2898086525 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0ab600 con 0x7fb7c4073e80 2024-09-12T02:57:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c3400640 1 -- 172.21.15.63:0/2898086525 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0ab9d0 con 0x7fb7c4073e80 2024-09-12T02:57:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c9c00640 1 -- 172.21.15.63:0/2898086525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4073e80 msgr2=0x7fb7c40c7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c9c00640 1 --2- 172.21.15.63:0/2898086525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4073e80 0x7fb7c40c7980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb7c40b2b50 tx=0x7fb7ac01c520 comp rx=0 tx=0).stop 2024-09-12T02:57:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c9c00640 1 -- 172.21.15.63:0/2898086525 shutdown_connections 2024-09-12T02:57:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c9c00640 1 --2- 172.21.15.63:0/2898086525 >> v2:172.21.15.119:3300/0 conn(0x7fb7c40c7ec0 0x7fb7c40c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c9c00640 1 --2- 172.21.15.63:0/2898086525 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4073e80 0x7fb7c40c7980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c9c00640 1 -- 172.21.15.63:0/2898086525 >> 172.21.15.63:0/2898086525 conn(0x7fb7c4070260 msgr2=0x7fb7c4070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:10.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c9c00640 1 -- 172.21.15.63:0/2898086525 shutdown_connections 2024-09-12T02:57:10.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.433+0000 7fb7c9c00640 1 -- 172.21.15.63:0/2898086525 wait complete. 2024-09-12T02:57:10.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 Processor -- start 2024-09-12T02:57:10.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 -- start start 2024-09-12T02:57:10.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7c4073e80 0x7fb7c40cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7c40c7ec0 0x7fb7c40c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4152620 0x7fb7c40caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c415c800 con 0x7fb7c4152620 2024-09-12T02:57:10.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c415baa0 con 0x7fb7c4073e80 2024-09-12T02:57:10.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c4152a00 con 0x7fb7c40c7ec0 2024-09-12T02:57:10.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4152620 0x7fb7c40caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7c4073e80 0x7fb7c40cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7c4073e80 0x7fb7c40cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:51926/0 (socket says 172.21.15.63:51926) 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c3e00640 1 -- 172.21.15.63:0/820390429 learned_addr learned my addr 172.21.15.63:0/820390429 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7bb400640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7c40c7ec0 0x7fb7c40c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9200640 1 -- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7c40c7ec0 msgr2=0x7fb7c40c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9200640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7c40c7ec0 0x7fb7c40c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9200640 1 -- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7c4073e80 msgr2=0x7fb7c40cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9200640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7c4073e80 0x7fb7c40cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9200640 1 -- 172.21.15.63:0/820390429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c41f5630 con 0x7fb7c4152620 2024-09-12T02:57:10.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9200640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4152620 0x7fb7c40caf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00eba0 tx=0x7fb7bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:10.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c0c00640 1 -- 172.21.15.63:0/820390429 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc018020 con 0x7fb7c4152620 2024-09-12T02:57:10.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c0c00640 1 -- 172.21.15.63:0/820390429 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7bc00cd20 con 0x7fb7c4152620 2024-09-12T02:57:10.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c0c00640 1 -- 172.21.15.63:0/820390429 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc0146c0 con 0x7fb7c4152620 2024-09-12T02:57:10.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c40cd9a0 con 0x7fb7c4152620 2024-09-12T02:57:10.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c40cdc40 con 0x7fb7c4152620 2024-09-12T02:57:10.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.437+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c40b2ed0 con 0x7fb7c4152620 2024-09-12T02:57:10.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.441+0000 7fb7c0c00640 1 -- 172.21.15.63:0/820390429 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7bc01b020 con 0x7fb7c4152620 2024-09-12T02:57:10.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.441+0000 7fb7c0c00640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7a00678c0 0x7fb7a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.441+0000 7fb7c0c00640 1 -- 172.21.15.63:0/820390429 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb7bc086ac0 con 0x7fb7c4152620 2024-09-12T02:57:10.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.441+0000 7fb7c3e00640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7a00678c0 0x7fb7a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.441+0000 7fb7c3e00640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7a00678c0 0x7fb7a0069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4007fd0 tx=0x7fb7b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:10.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.445+0000 7fb7c0c00640 1 -- 172.21.15.63:0/820390429 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7bc022030 con 0x7fb7c4152620 2024-09-12T02:57:10.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.613+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7c40c6c90 con 0x7fb7c4152620 2024-09-12T02:57:10.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.613+0000 7fb7c0c00640 1 -- 172.21.15.63:0/820390429 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18598 (secure 0 0 0) 0x7fb7bc010040 con 0x7fb7c4152620 2024-09-12T02:57:10.618 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:10.619 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:57:09.262695+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:57:10.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7a00678c0 msgr2=0x7fb7a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7a00678c0 0x7fb7a0069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4007fd0 tx=0x7fb7b4009040 comp rx=0 tx=0).stop 2024-09-12T02:57:10.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4152620 msgr2=0x7fb7c40caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4152620 0x7fb7c40caf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00eba0 tx=0x7fb7bc00c490 comp rx=0 tx=0).stop 2024-09-12T02:57:10.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 shutdown_connections 2024-09-12T02:57:10.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7c4152620 0x7fb7c40caf30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7a00678c0 0x7fb7a0069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7c40c7ec0 0x7fb7c40c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 --2- 172.21.15.63:0/820390429 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7c4073e80 0x7fb7c40cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 >> 172.21.15.63:0/820390429 conn(0x7fb7c4070260 msgr2=0x7fb7c406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:10.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 shutdown_connections 2024-09-12T02:57:10.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.617+0000 7fb7c9c00640 1 -- 172.21.15.63:0/820390429 wait complete. 2024-09-12T02:57:10.640 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:57:10.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bfc200640 1 Processor -- start 2024-09-12T02:57:10.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bfc200640 1 -- start start 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bfc200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9bf4152a70 0x7f9bf4158820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bfc200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9bf40c9380 0x7f9bf40c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bfc200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf4071590 con 0x7f9bf40ced50 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bfc200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf4158d60 con 0x7f9bf4152a70 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bfc200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9bf4071830 con 0x7f9bf40c9380 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bf9800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9bf4152a70 0x7f9bf4158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bfa200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9bf40ced50 0x7f9bf415bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52168/0 (socket says 172.21.15.63:52168) 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bf9800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9bf4152a70 0x7f9bf4158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39750/0 (socket says 172.21.15.63:39750) 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bfa200640 1 -- 172.21.15.63:0/1809845979 learned_addr learned my addr 172.21.15.63:0/1809845979 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:10.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bf8e00640 1 --2- 172.21.15.63:0/1809845979 >> v2:172.21.15.119:3300/0 conn(0x7f9bf40c9380 0x7f9bf40c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bf9800640 1 -- 172.21.15.63:0/1809845979 >> v2:172.21.15.119:3300/0 conn(0x7f9bf40c9380 msgr2=0x7f9bf40c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:10.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bf9800640 1 --2- 172.21.15.63:0/1809845979 >> v2:172.21.15.119:3300/0 conn(0x7f9bf40c9380 0x7f9bf40c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bf9800640 1 -- 172.21.15.63:0/1809845979 >> v1:172.21.15.63:6789/0 conn(0x7f9bf40ced50 legacy=0x7f9bf415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.777+0000 7f9bf9800640 1 -- 172.21.15.63:0/1809845979 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf4071b10 con 0x7f9bf4152a70 2024-09-12T02:57:10.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bf9800640 1 --2- 172.21.15.63:0/1809845979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf4152a70 0x7f9bf4158820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40ce1e0 tx=0x7f9be801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b76d011dcd311ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:10.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bf3e00640 1 -- 172.21.15.63:0/1809845979 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be80b5070 con 0x7f9bf4152a70 2024-09-12T02:57:10.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bf3e00640 1 -- 172.21.15.63:0/1809845979 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be80a8970 con 0x7f9bf4152a70 2024-09-12T02:57:10.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bf3e00640 1 -- 172.21.15.63:0/1809845979 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be80a8d40 con 0x7f9bf4152a70 2024-09-12T02:57:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bfc200640 1 -- 172.21.15.63:0/1809845979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf4152a70 msgr2=0x7f9bf4158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bfc200640 1 --2- 172.21.15.63:0/1809845979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf4152a70 0x7f9bf4158820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40ce1e0 tx=0x7f9be801ec70 comp rx=0 tx=0).stop 2024-09-12T02:57:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bfc200640 1 -- 172.21.15.63:0/1809845979 shutdown_connections 2024-09-12T02:57:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bfc200640 1 --2- 172.21.15.63:0/1809845979 >> v2:172.21.15.119:3300/0 conn(0x7f9bf40c9380 0x7f9bf40c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bfc200640 1 --2- 172.21.15.63:0/1809845979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf4152a70 0x7f9bf4158820 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bfc200640 1 -- 172.21.15.63:0/1809845979 >> 172.21.15.63:0/1809845979 conn(0x7f9bf406bcc0 msgr2=0x7f9bf406fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:10.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bfc200640 1 -- 172.21.15.63:0/1809845979 shutdown_connections 2024-09-12T02:57:10.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.781+0000 7f9bfc200640 1 -- 172.21.15.63:0/1809845979 wait complete. 2024-09-12T02:57:10.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 Processor -- start 2024-09-12T02:57:10.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 -- start start 2024-09-12T02:57:10.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bf40c9380 0x7f9bf41f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf40ced50 0x7f9bf41e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4152a70 0x7f9bf406d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40ce550 con 0x7f9bf40ced50 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40ce270 con 0x7f9bf40c9380 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf40ce830 con 0x7f9bf4152a70 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf8e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf40ced50 0x7f9bf41e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf8e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf40ced50 0x7f9bf41e2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39754/0 (socket says 172.21.15.63:39754) 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf8e00640 1 -- 172.21.15.63:0/3332998576 learned_addr learned my addr 172.21.15.63:0/3332998576 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf9800640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bf40c9380 0x7f9bf41f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfa200640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4152a70 0x7f9bf406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf8e00640 1 -- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4152a70 msgr2=0x7f9bf406d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf8e00640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4152a70 0x7f9bf406d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf8e00640 1 -- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bf40c9380 msgr2=0x7f9bf41f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf8e00640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bf40c9380 0x7f9bf41f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf8e00640 1 -- 172.21.15.63:0/3332998576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf40ab140 con 0x7f9bf40ced50 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfa200640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4152a70 0x7f9bf406d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:10.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf8e00640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf40ced50 0x7f9bf41e2f10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9be000e870 tx=0x7f9be000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf1600640 1 -- 172.21.15.63:0/3332998576 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0017070 con 0x7f9bf40ced50 2024-09-12T02:57:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf1600640 1 -- 172.21.15.63:0/3332998576 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be000c940 con 0x7f9bf40ced50 2024-09-12T02:57:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bf1600640 1 -- 172.21.15.63:0/3332998576 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be000ccf0 con 0x7f9bf40ced50 2024-09-12T02:57:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf41f18f0 con 0x7f9bf40ced50 2024-09-12T02:57:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.785+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf406e850 con 0x7f9bf40ced50 2024-09-12T02:57:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.789+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf406c6d0 con 0x7f9bf40ced50 2024-09-12T02:57:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.789+0000 7f9bf1600640 1 -- 172.21.15.63:0/3332998576 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9be001a070 con 0x7f9bf40ced50 2024-09-12T02:57:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.789+0000 7f9bf1600640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9bd40678c0 0x7f9bd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.789+0000 7f9bf1600640 1 -- 172.21.15.63:0/3332998576 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9be0085ea0 con 0x7f9bf40ced50 2024-09-12T02:57:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.789+0000 7f9bf9800640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9bd40678c0 0x7f9bd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.789+0000 7f9bf9800640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9bd40678c0 0x7f9bd4069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9be80b2000 tx=0x7f9be8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.793+0000 7f9bf1600640 1 -- 172.21.15.63:0/3332998576 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9be0055fb0 con 0x7f9bf40ced50 2024-09-12T02:57:10.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9bf40cc4a0 con 0x7f9bf40ced50 2024-09-12T02:57:10.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bf1600640 1 -- 172.21.15.63:0/3332998576 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18598 (secure 0 0 0) 0x7f9be005a2b0 con 0x7f9bf40ced50 2024-09-12T02:57:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:10.969 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:57:09.262695+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:57:10.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9bd40678c0 msgr2=0x7f9bd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9bd40678c0 0x7f9bd4069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9be80b2000 tx=0x7f9be8008040 comp rx=0 tx=0).stop 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf40ced50 msgr2=0x7f9bf41e2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf40ced50 0x7f9bf41e2f10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9be000e870 tx=0x7f9be000ec70 comp rx=0 tx=0).stop 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 shutdown_connections 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9bd40678c0 0x7f9bd4069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bf4152a70 0x7f9bf406d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bf40ced50 0x7f9bf41e2f10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 --2- 172.21.15.63:0/3332998576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bf40c9380 0x7f9bf41f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 >> 172.21.15.63:0/3332998576 conn(0x7f9bf406bcc0 msgr2=0x7f9bf40cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 shutdown_connections 2024-09-12T02:57:10.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:10.965+0000 7f9bfc200640 1 -- 172.21.15.63:0/3332998576 wait complete. 2024-09-12T02:57:11.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:57:11.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.141+0000 7f0b65e00640 1 Processor -- start 2024-09-12T02:57:11.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.141+0000 7f0b65e00640 1 -- start start 2024-09-12T02:57:11.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b65e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0b60074070 0x7f0b600c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b65e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0b600c28c0 0x7f0b60161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b65e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b600c2d50 con 0x7f0b60151a80 2024-09-12T02:57:11.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b65e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f0b600c8500 con 0x7f0b600c28c0 2024-09-12T02:57:11.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b65e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0b601580c0 con 0x7f0b60074070 2024-09-12T02:57:11.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b5f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0b600c28c0 0x7f0b60161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b5f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0b600c28c0 0x7f0b60161e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39756/0 (socket says 172.21.15.63:39756) 2024-09-12T02:57:11.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b5f400640 1 -- 172.21.15.63:0/3229552238 learned_addr learned my addr 172.21.15.63:0/3229552238 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:11.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b56000640 1 --2- 172.21.15.63:0/3229552238 >> v2:172.21.15.119:3300/0 conn(0x7f0b60074070 0x7f0b600c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b5f400640 1 -- 172.21.15.63:0/3229552238 >> v2:172.21.15.119:3300/0 conn(0x7f0b60074070 msgr2=0x7f0b600c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:11.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b5f400640 1 --2- 172.21.15.63:0/3229552238 >> v2:172.21.15.119:3300/0 conn(0x7f0b60074070 0x7f0b600c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b5f400640 1 -- 172.21.15.63:0/3229552238 >> v1:172.21.15.119:6789/0 conn(0x7f0b60151a80 legacy=0x7f0b60072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b5f400640 1 -- 172.21.15.63:0/3229552238 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b601583a0 con 0x7f0b600c28c0 2024-09-12T02:57:11.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b5f400640 1 --2- 172.21.15.63:0/3229552238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b600c28c0 0x7f0b60161e30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b60155160 tx=0x7f0b5801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270de9bce8a1f2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:11.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.145+0000 7f0b5e000640 1 -- 172.21.15.63:0/3229552238 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b580b4070 con 0x7f0b600c28c0 2024-09-12T02:57:11.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5e000640 1 -- 172.21.15.63:0/3229552238 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b580af400 con 0x7f0b600c28c0 2024-09-12T02:57:11.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5e000640 1 -- 172.21.15.63:0/3229552238 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b580af7d0 con 0x7f0b600c28c0 2024-09-12T02:57:11.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 -- 172.21.15.63:0/3229552238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b600c28c0 msgr2=0x7f0b60161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 --2- 172.21.15.63:0/3229552238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b600c28c0 0x7f0b60161e30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b60155160 tx=0x7f0b5801f1e0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 -- 172.21.15.63:0/3229552238 shutdown_connections 2024-09-12T02:57:11.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 --2- 172.21.15.63:0/3229552238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b600c28c0 0x7f0b60161e30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 --2- 172.21.15.63:0/3229552238 >> v2:172.21.15.119:3300/0 conn(0x7f0b60074070 0x7f0b600c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 -- 172.21.15.63:0/3229552238 >> 172.21.15.63:0/3229552238 conn(0x7f0b6006f3d0 msgr2=0x7f0b6006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:11.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 -- 172.21.15.63:0/3229552238 shutdown_connections 2024-09-12T02:57:11.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 -- 172.21.15.63:0/3229552238 wait complete. 2024-09-12T02:57:11.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 Processor -- start 2024-09-12T02:57:11.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 -- start start 2024-09-12T02:57:11.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b60074070 0x7f0b600ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b600c28c0 0x7f0b60147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b60151a80 0x7f0b6014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0b600cc4c0 con 0x7f0b60151a80 2024-09-12T02:57:11.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0b600cc1e0 con 0x7f0b60074070 2024-09-12T02:57:11.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b65e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0b600c81f0 con 0x7f0b600c28c0 2024-09-12T02:57:11.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b60151a80 0x7f0b6014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b60151a80 0x7f0b6014d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39758/0 (socket says 172.21.15.63:39758) 2024-09-12T02:57:11.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5f400640 1 -- 172.21.15.63:0/3830310705 learned_addr learned my addr 172.21.15.63:0/3830310705 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:11.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b56000640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b600c28c0 0x7f0b60147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5ea00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b60074070 0x7f0b600ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5f400640 1 -- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b600c28c0 msgr2=0x7f0b60147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5f400640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b600c28c0 0x7f0b60147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5f400640 1 -- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b60074070 msgr2=0x7f0b600ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5f400640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b60074070 0x7f0b600ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.149+0000 7f0b5f400640 1 -- 172.21.15.63:0/3830310705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b600cbc40 con 0x7f0b60151a80 2024-09-12T02:57:11.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b5f400640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b60151a80 0x7f0b6014d6c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b580b2040 tx=0x7f0b5801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:11.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b57e00640 1 -- 172.21.15.63:0/3830310705 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b580c0070 con 0x7f0b60151a80 2024-09-12T02:57:11.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b57e00640 1 -- 172.21.15.63:0/3830310705 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b580afcc0 con 0x7f0b60151a80 2024-09-12T02:57:11.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b57e00640 1 -- 172.21.15.63:0/3830310705 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b580b4040 con 0x7f0b60151a80 2024-09-12T02:57:11.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b600b0720 con 0x7f0b60151a80 2024-09-12T02:57:11.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b601f0810 con 0x7f0b60151a80 2024-09-12T02:57:11.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b600c7cf0 con 0x7f0b60151a80 2024-09-12T02:57:11.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b57e00640 1 -- 172.21.15.63:0/3830310705 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0b580b8670 con 0x7f0b60151a80 2024-09-12T02:57:11.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b57e00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0b3c0678c0 0x7f0b3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b57e00640 1 -- 172.21.15.63:0/3830310705 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0b58123760 con 0x7f0b60151a80 2024-09-12T02:57:11.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.153+0000 7f0b5ea00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0b3c0678c0 0x7f0b3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.157+0000 7f0b5ea00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0b3c0678c0 0x7f0b3c069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b500015b0 tx=0x7f0b50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:11.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.157+0000 7f0b57e00640 1 -- 172.21.15.63:0/3830310705 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0b58018d40 con 0x7f0b60151a80 2024-09-12T02:57:11.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.357+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b600c7fd0 con 0x7f0b60151a80 2024-09-12T02:57:11.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.357+0000 7f0b57e00640 1 -- 172.21.15.63:0/3830310705 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6871 (secure 0 0 0) 0x7f0b580f3ed0 con 0x7f0b60151a80 2024-09-12T02:57:11.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:11.362 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"btime":"2024-09-12T02:57:09:867812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:09.262860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T02:57:11.363 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 5 2024-09-12T02:57:11.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0b3c0678c0 msgr2=0x7f0b3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0b3c0678c0 0x7f0b3c069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0b500015b0 tx=0x7f0b50009040 comp rx=0 tx=0).stop 2024-09-12T02:57:11.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b60151a80 msgr2=0x7f0b6014d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b60151a80 0x7f0b6014d6c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b580b2040 tx=0x7f0b5801bf80 comp rx=0 tx=0).stop 2024-09-12T02:57:11.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 shutdown_connections 2024-09-12T02:57:11.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b60151a80 0x7f0b6014d6c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0b3c0678c0 0x7f0b3c069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b600c28c0 0x7f0b60147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 --2- 172.21.15.63:0/3830310705 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b60074070 0x7f0b600ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 >> 172.21.15.63:0/3830310705 conn(0x7f0b6006f3d0 msgr2=0x7f0b600c71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:11.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 shutdown_connections 2024-09-12T02:57:11.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.361+0000 7f0b65e00640 1 -- 172.21.15.63:0/3830310705 wait complete. 2024-09-12T02:57:11.383 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:57:11.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e5b200640 1 Processor -- start 2024-09-12T02:57:11.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e5b200640 1 -- start start 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e5b200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e54152a70 0x7f0e54158820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e5b200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e540ced50 0x7f0e541630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e5b200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e54071590 con 0x7f0e540c9380 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e5b200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0e54158d60 con 0x7f0e54152a70 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e5b200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0e54071830 con 0x7f0e540ced50 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e4b400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0e540c9380 0x7f0e540c3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52174/0 (socket says 172.21.15.63:52174) 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e4b400640 1 -- 172.21.15.63:0/3892010454 learned_addr learned my addr 172.21.15.63:0/3892010454 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e59200640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e540ced50 0x7f0e541630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53e00640 1 --2- 172.21.15.63:0/3892010454 >> v2:172.21.15.119:3300/0 conn(0x7f0e54152a70 0x7f0e54158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118411471 0 0) 0x7f0e54071590 con 0x7f0e540c9380 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e38003530 con 0x7f0e540c9380 2024-09-12T02:57:11.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 300926627 0 0) 0x7f0e38003530 con 0x7f0e540c9380 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e540ced50 msgr2=0x7f0e541630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e540ced50 0x7f0e541630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 >> v2:172.21.15.119:3300/0 conn(0x7f0e54152a70 msgr2=0x7f0e54158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 --2- 172.21.15.63:0/3892010454 >> v2:172.21.15.119:3300/0 conn(0x7f0e54152a70 0x7f0e54158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e54071b10 con 0x7f0e540c9380 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f0e3c001680 con 0x7f0e540c9380 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 >> v1:172.21.15.63:6789/0 conn(0x7f0e540c9380 legacy=0x7f0e540c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e540ced50 0x7f0e380039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 0x7f0e38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e38004d50 0x7f0e380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e54158d60 con 0x7f0e38004d50 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e54071830 con 0x7f0e38003f40 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.521+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3800ba00 con 0x7f0e540ced50 2024-09-12T02:57:11.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e4b400640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 0x7f0e38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e53e00640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e540ced50 0x7f0e380039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e59200640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e38004d50 0x7f0e380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e4b400640 1 -- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e540ced50 msgr2=0x7f0e380039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e4b400640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e540ced50 0x7f0e380039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e4b400640 1 -- 172.21.15.63:0/3892010454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e38004d50 msgr2=0x7f0e380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:11.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e4b400640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e38004d50 0x7f0e380051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e4b400640 1 -- 172.21.15.63:0/3892010454 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e38003530 con 0x7f0e38003f40 2024-09-12T02:57:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e59200640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e38004d50 0x7f0e380051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e4b400640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 0x7f0e38004810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00c240 tx=0x7f0e3c01ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c17defeae02fb03f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c007d60 con 0x7f0e38003f40 2024-09-12T02:57:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0a9020 con 0x7f0e38003f40 2024-09-12T02:57:11.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.525+0000 7f0e53400640 1 -- 172.21.15.63:0/3892010454 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0a5bc0 con 0x7f0e38003f40 2024-09-12T02:57:11.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 -- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 msgr2=0x7f0e38004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 --2- 172.21.15.63:0/3892010454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 0x7f0e38004810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00c240 tx=0x7f0e3c01ccc0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e59200640 1 -- 172.21.15.63:0/3892010454 reap_dead start 2024-09-12T02:57:11.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 -- 172.21.15.63:0/3892010454 shutdown_connections 2024-09-12T02:57:11.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 -- 172.21.15.63:0/3892010454 >> 172.21.15.63:0/3892010454 conn(0x7f0e5406bcc0 msgr2=0x7f0e5406fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:11.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 -- 172.21.15.63:0/3892010454 shutdown_connections 2024-09-12T02:57:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 -- 172.21.15.63:0/3892010454 wait complete. 2024-09-12T02:57:11.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 Processor -- start 2024-09-12T02:57:11.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 -- start start 2024-09-12T02:57:11.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 0x7f0e541eef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5414dfb0 0x7f0e5414bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e5414e410 0x7f0e5414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e540ce550 con 0x7f0e5414e410 2024-09-12T02:57:11.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e540ce270 con 0x7f0e38003f40 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e5b200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0e540ce830 con 0x7f0e5414dfb0 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e59200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e5414e410 0x7f0e5414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e59200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e5414e410 0x7f0e5414c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39766/0 (socket says 172.21.15.63:39766) 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e59200640 1 -- 172.21.15.63:0/2129063389 learned_addr learned my addr 172.21.15.63:0/2129063389 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e53e00640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 0x7f0e541eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e4b400640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5414dfb0 0x7f0e5414bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e59200640 1 -- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5414dfb0 msgr2=0x7f0e5414bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e59200640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5414dfb0 0x7f0e5414bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e59200640 1 -- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 msgr2=0x7f0e541eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e59200640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 0x7f0e541eef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.529+0000 7f0e59200640 1 -- 172.21.15.63:0/2129063389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e540c6f60 con 0x7f0e5414e410 2024-09-12T02:57:11.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e59200640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e5414e410 0x7f0e5414c250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0e5406c580 tx=0x7f0e4c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:11.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e50c00640 1 -- 172.21.15.63:0/2129063389 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c009c10 con 0x7f0e5414e410 2024-09-12T02:57:11.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e50c00640 1 -- 172.21.15.63:0/2129063389 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c0039a0 con 0x7f0e5414e410 2024-09-12T02:57:11.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e50c00640 1 -- 172.21.15.63:0/2129063389 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c003d90 con 0x7f0e5414e410 2024-09-12T02:57:11.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e541e54c0 con 0x7f0e5414e410 2024-09-12T02:57:11.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e540c50f0 con 0x7f0e5414e410 2024-09-12T02:57:11.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5406c6d0 con 0x7f0e5414e410 2024-09-12T02:57:11.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e50c00640 1 -- 172.21.15.63:0/2129063389 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e4c003f30 con 0x7f0e5414e410 2024-09-12T02:57:11.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e50c00640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e300678c0 0x7f0e30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:11.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e50c00640 1 -- 172.21.15.63:0/2129063389 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0e4c086910 con 0x7f0e5414e410 2024-09-12T02:57:11.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.533+0000 7f0e53e00640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e300678c0 0x7f0e30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:11.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.537+0000 7f0e53e00640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e300678c0 0x7f0e30069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009be0 tx=0x7f0e44009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:11.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.537+0000 7f0e50c00640 1 -- 172.21.15.63:0/2129063389 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e4c019030 con 0x7f0e5414e410 2024-09-12T02:57:11.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.705+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e54152e50 con 0x7f0e5414e410 2024-09-12T02:57:11.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.705+0000 7f0e50c00640 1 -- 172.21.15.63:0/2129063389 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18598 (secure 0 0 0) 0x7f0e4c010040 con 0x7f0e5414e410 2024-09-12T02:57:11.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:11.709 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:57:09.262695+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:57:11.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e300678c0 msgr2=0x7f0e30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e300678c0 0x7f0e30069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009be0 tx=0x7f0e44009190 comp rx=0 tx=0).stop 2024-09-12T02:57:11.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e5414e410 msgr2=0x7f0e5414c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:11.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e5414e410 0x7f0e5414c250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0e5406c580 tx=0x7f0e4c00f580 comp rx=0 tx=0).stop 2024-09-12T02:57:11.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 shutdown_connections 2024-09-12T02:57:11.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e5414e410 0x7f0e5414c250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e300678c0 0x7f0e30069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e5414dfb0 0x7f0e5414bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 --2- 172.21.15.63:0/2129063389 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e38003f40 0x7f0e541eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:11.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 >> 172.21.15.63:0/2129063389 conn(0x7f0e5406bcc0 msgr2=0x7f0e54156480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:11.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 shutdown_connections 2024-09-12T02:57:11.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:11.709+0000 7f0e5b200640 1 -- 172.21.15.63:0/2129063389 wait complete. 2024-09-12T02:57:12.334 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:57:04.183250+0000', 'modified': '2024-09-12T02:57:09.262860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.63:6836/2556723891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6833', 'nonce': 2556723891}, {'type': 'v1', 'addr': '172.21.15.63:6836', 'nonce': 2556723891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:57:12.335 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4306:up:creating 2024-09-12T02:57:13.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:57:13.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.485+0000 7f0c89400640 1 Processor -- start 2024-09-12T02:57:13.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c89400640 1 -- start start 2024-09-12T02:57:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c89400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c840c7f10 0x7f0c84166380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c89400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8415eb90 con 0x7f0c84154c00 2024-09-12T02:57:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c89400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8415ee50 con 0x7f0c84154fe0 2024-09-12T02:57:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c89400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f0c840c7370 con 0x7f0c840c7f10 2024-09-12T02:57:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c83200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c840c7f10 0x7f0c84166380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c83200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0c840c7f10 0x7f0c84166380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60012/0 (socket says 172.21.15.63:60012) 2024-09-12T02:57:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c83200640 1 -- 172.21.15.63:0/65629970 learned_addr learned my addr 172.21.15.63:0/65629970 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c83200640 1 -- 172.21.15.63:0/65629970 >> v1:172.21.15.119:6789/0 conn(0x7f0c84154fe0 legacy=0x7f0c840c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c83200640 1 -- 172.21.15.63:0/65629970 >> v1:172.21.15.63:6789/0 conn(0x7f0c84154c00 legacy=0x7f0c8406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c83200640 1 -- 172.21.15.63:0/65629970 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c840c8b40 con 0x7f0c840c7f10 2024-09-12T02:57:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.489+0000 7f0c81e00640 1 -- 172.21.15.63:0/65629970 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848128225 0 0) 0x7f0c8415eb90 con 0x7f0c84154c00 2024-09-12T02:57:13.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c83200640 1 --2- 172.21.15.63:0/65629970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c840c7f10 0x7f0c84166380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009e50 tx=0x7f0c7c01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d5054427490e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:13.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c81e00640 1 -- 172.21.15.63:0/65629970 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0b4070 con 0x7f0c840c7f10 2024-09-12T02:57:13.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c81e00640 1 -- 172.21.15.63:0/65629970 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c0af400 con 0x7f0c840c7f10 2024-09-12T02:57:13.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c81e00640 1 -- 172.21.15.63:0/65629970 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0af7d0 con 0x7f0c840c7f10 2024-09-12T02:57:13.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c89400640 1 -- 172.21.15.63:0/65629970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c840c7f10 msgr2=0x7f0c84166380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:13.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c89400640 1 --2- 172.21.15.63:0/65629970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c840c7f10 0x7f0c84166380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009e50 tx=0x7f0c7c01f210 comp rx=0 tx=0).stop 2024-09-12T02:57:13.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c89400640 1 -- 172.21.15.63:0/65629970 shutdown_connections 2024-09-12T02:57:13.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c89400640 1 --2- 172.21.15.63:0/65629970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c840c7f10 0x7f0c84166380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:13.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c89400640 1 -- 172.21.15.63:0/65629970 >> 172.21.15.63:0/65629970 conn(0x7f0c840c93e0 msgr2=0x7f0c840c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:13.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c89400640 1 -- 172.21.15.63:0/65629970 shutdown_connections 2024-09-12T02:57:13.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c89400640 1 -- 172.21.15.63:0/65629970 wait complete. 2024-09-12T02:57:13.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c89400640 1 Processor -- start 2024-09-12T02:57:13.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.493+0000 7f0c89400640 1 -- start start 2024-09-12T02:57:13.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c89400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c840c7f10 0x7f0c84152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:13.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c89400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c84154c00 0x7f0c8414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:13.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c89400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84154fe0 0x7f0c841f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:13.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c89400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8406dda0 con 0x7f0c84154fe0 2024-09-12T02:57:13.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c89400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840c9100 con 0x7f0c84154c00 2024-09-12T02:57:13.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c89400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0c840c3a10 con 0x7f0c840c7f10 2024-09-12T02:57:13.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c83200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84154fe0 0x7f0c841f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:13.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c83200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84154fe0 0x7f0c841f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60022/0 (socket says 172.21.15.63:60022) 2024-09-12T02:57:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c83200640 1 -- 172.21.15.63:0/2777599456 learned_addr learned my addr 172.21.15.63:0/2777599456 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c82800640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c840c7f10 0x7f0c84152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c79e00640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c84154c00 0x7f0c8414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c83200640 1 -- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c840c7f10 msgr2=0x7f0c84152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c83200640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c840c7f10 0x7f0c84152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c83200640 1 -- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c84154c00 msgr2=0x7f0c8414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c83200640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c84154c00 0x7f0c8414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c83200640 1 -- 172.21.15.63:0/2777599456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c84149480 con 0x7f0c84154fe0 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c82800640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c840c7f10 0x7f0c84152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c83200640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84154fe0 0x7f0c841f3be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009e50 tx=0x7f0c7c01bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c7b400640 1 -- 172.21.15.63:0/2777599456 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0b4040 con 0x7f0c84154fe0 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c7b400640 1 -- 172.21.15.63:0/2777599456 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c0c0070 con 0x7f0c84154fe0 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c7b400640 1 -- 172.21.15.63:0/2777599456 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c009510 con 0x7f0c84154fe0 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8415bfd0 con 0x7f0c84154fe0 2024-09-12T02:57:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c84149740 con 0x7f0c84154fe0 2024-09-12T02:57:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.497+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c84067a00 con 0x7f0c84154fe0 2024-09-12T02:57:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.501+0000 7f0c7b400640 1 -- 172.21.15.63:0/2777599456 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c7c0a8d10 con 0x7f0c84154fe0 2024-09-12T02:57:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.501+0000 7f0c7b400640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c600678c0 0x7f0c60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.501+0000 7f0c7b400640 1 -- 172.21.15.63:0/2777599456 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0c7c123fe0 con 0x7f0c84154fe0 2024-09-12T02:57:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.501+0000 7f0c82800640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c600678c0 0x7f0c60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.501+0000 7f0c82800640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c600678c0 0x7f0c60069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c74007fd0 tx=0x7f0c74009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:13.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.505+0000 7f0c7b400640 1 -- 172.21.15.63:0/2777599456 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0c7c018d70 con 0x7f0c84154fe0 2024-09-12T02:57:13.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.705+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c841506b0 con 0x7f0c84154fe0 2024-09-12T02:57:13.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.705+0000 7f0c7b400640 1 -- 172.21.15.63:0/2777599456 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6871 (secure 0 0 0) 0x7f0c7c0f47a0 con 0x7f0c84154fe0 2024-09-12T02:57:13.710 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:13.710 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"btime":"2024-09-12T02:57:09:867812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:09.262860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T02:57:13.710 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 5 2024-09-12T02:57:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c600678c0 msgr2=0x7f0c60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c600678c0 0x7f0c60069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c74007fd0 tx=0x7f0c74009040 comp rx=0 tx=0).stop 2024-09-12T02:57:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84154fe0 msgr2=0x7f0c841f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84154fe0 0x7f0c841f3be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009e50 tx=0x7f0c7c01bfb0 comp rx=0 tx=0).stop 2024-09-12T02:57:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 shutdown_connections 2024-09-12T02:57:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c84154fe0 0x7f0c841f3be0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c84154c00 0x7f0c8414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c600678c0 0x7f0c60069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 --2- 172.21.15.63:0/2777599456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c840c7f10 0x7f0c84152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:13.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 >> 172.21.15.63:0/2777599456 conn(0x7f0c840c93e0 msgr2=0x7f0c8406c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:13.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 shutdown_connections 2024-09-12T02:57:13.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:13.709+0000 7f0c89400640 1 -- 172.21.15.63:0/2777599456 wait complete. 2024-09-12T02:57:14.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:57:04.183250+0000', 'modified': '2024-09-12T02:57:09.262860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.63:6836/2556723891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6833', 'nonce': 2556723891}, {'type': 'v1', 'addr': '172.21.15.63:6836', 'nonce': 2556723891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-12T02:57:14.335 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4306:up:creating 2024-09-12T02:57:15.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:57:15.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c9000640 1 Processor -- start 2024-09-12T02:57:15.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c9000640 1 -- start start 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c9000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 0x7f21c40c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f21c40c7a00 0x7f21c40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c9000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c4159520 con 0x7f21c40c61e0 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c9000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f21c41589a0 con 0x7f21c40c7a00 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c9000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f21c4158c80 con 0x7f21c41527e0 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f21c40c7a00 0x7f21c40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f21c40c7a00 0x7f21c40c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60024/0 (socket says 172.21.15.63:60024) 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.485+0000 7f21c1400640 1 -- 172.21.15.63:0/3710305755 learned_addr learned my addr 172.21.15.63:0/3710305755 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c1e00640 1 --2- 172.21.15.63:0/3710305755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 0x7f21c40c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:15.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c1400640 1 -- 172.21.15.63:0/3710305755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 msgr2=0x7f21c40c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:15.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c1400640 1 --2- 172.21.15.63:0/3710305755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 0x7f21c40c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:15.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c1400640 1 -- 172.21.15.63:0/3710305755 >> v1:172.21.15.119:6789/0 conn(0x7f21c40c61e0 legacy=0x7f21c40cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:15.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c1400640 1 -- 172.21.15.63:0/3710305755 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c4158f60 con 0x7f21c40c7a00 2024-09-12T02:57:15.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c1e00640 1 --2- 172.21.15.63:0/3710305755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 0x7f21c40c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:15.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c1400640 1 --2- 172.21.15.63:0/3710305755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 0x7f21c40c6eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009870 tx=0x7f21b001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f0065874a48c0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:15.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c0a00640 1 -- 172.21.15.63:0/3710305755 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00a95f0 con 0x7f21c40c7a00 2024-09-12T02:57:15.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c0a00640 1 -- 172.21.15.63:0/3710305755 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b00a9790 con 0x7f21c40c7a00 2024-09-12T02:57:15.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c0a00640 1 -- 172.21.15.63:0/3710305755 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00a9b60 con 0x7f21c40c7a00 2024-09-12T02:57:15.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c9000640 1 -- 172.21.15.63:0/3710305755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 msgr2=0x7f21c40c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:15.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.489+0000 7f21c9000640 1 --2- 172.21.15.63:0/3710305755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 0x7f21c40c6eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009870 tx=0x7f21b001c530 comp rx=0 tx=0).stop 2024-09-12T02:57:15.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 -- 172.21.15.63:0/3710305755 shutdown_connections 2024-09-12T02:57:15.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 --2- 172.21.15.63:0/3710305755 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 0x7f21c40c6eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:15.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 --2- 172.21.15.63:0/3710305755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 0x7f21c40c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:15.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 -- 172.21.15.63:0/3710305755 >> 172.21.15.63:0/3710305755 conn(0x7f21c406f3d0 msgr2=0x7f21c406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:15.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 -- 172.21.15.63:0/3710305755 shutdown_connections 2024-09-12T02:57:15.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 -- 172.21.15.63:0/3710305755 wait complete. 2024-09-12T02:57:15.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 Processor -- start 2024-09-12T02:57:15.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 -- start start 2024-09-12T02:57:15.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c40c61e0 0x7f21c40cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 0x7f21c41546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 0x7f21c4154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f21c41586e0 con 0x7f21c40c7a00 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21c4158560 con 0x7f21c40c61e0 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f21c4165700 con 0x7f21c41527e0 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 0x7f21c41546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 0x7f21c41546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60040/0 (socket says 172.21.15.63:60040) 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1400640 1 -- 172.21.15.63:0/915772344 learned_addr learned my addr 172.21.15.63:0/915772344 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c2800640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 0x7f21c4154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1e00640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c40c61e0 0x7f21c40cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1400640 1 -- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 msgr2=0x7f21c4154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1400640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 0x7f21c4154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1400640 1 -- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c40c61e0 msgr2=0x7f21c40cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:15.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1400640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c40c61e0 0x7f21c40cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:15.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1400640 1 -- 172.21.15.63:0/915772344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c41f52c0 con 0x7f21c40c7a00 2024-09-12T02:57:15.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c1400640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 0x7f21c41546e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21b001abe0 tx=0x7f21b001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:15.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21ba000640 1 -- 172.21.15.63:0/915772344 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00b1800 con 0x7f21c40c7a00 2024-09-12T02:57:15.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21ba000640 1 -- 172.21.15.63:0/915772344 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b00b19c0 con 0x7f21c40c7a00 2024-09-12T02:57:15.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21ba000640 1 -- 172.21.15.63:0/915772344 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00b1db0 con 0x7f21c40c7a00 2024-09-12T02:57:15.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.493+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c41f55a0 con 0x7f21c40c7a00 2024-09-12T02:57:15.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.497+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c4159bc0 con 0x7f21c40c7a00 2024-09-12T02:57:15.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.497+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c40cc550 con 0x7f21c40c7a00 2024-09-12T02:57:15.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.497+0000 7f21ba000640 1 -- 172.21.15.63:0/915772344 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f21b00c53f0 con 0x7f21c40c7a00 2024-09-12T02:57:15.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.497+0000 7f21ba000640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f21a40678f0 0x7f21a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:15.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.497+0000 7f21ba000640 1 -- 172.21.15.63:0/915772344 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f21b0120b10 con 0x7f21c40c7a00 2024-09-12T02:57:15.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.497+0000 7f21c1e00640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f21a40678f0 0x7f21a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:15.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.501+0000 7f21c1e00640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f21a40678f0 0x7f21a4069db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21b4006fd0 tx=0x7f21b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:15.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.501+0000 7f21ba000640 1 -- 172.21.15.63:0/915772344 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f21b00ad020 con 0x7f21c40c7a00 2024-09-12T02:57:15.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21c4150d00 con 0x7f21c40c7a00 2024-09-12T02:57:15.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21ba000640 1 -- 172.21.15.63:0/915772344 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6876 (secure 0 0 0) 0x7f21b0016150 con 0x7f21c40c7a00 2024-09-12T02:57:15.704 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:15.705 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"btime":"2024-09-12T02:57:13:884267+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:13.875182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-12T02:57:15.705 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f21a40678f0 msgr2=0x7f21a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f21a40678f0 0x7f21a4069db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21b4006fd0 tx=0x7f21b4008040 comp rx=0 tx=0).stop 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 msgr2=0x7f21c41546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 0x7f21c41546e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21b001abe0 tx=0x7f21b001ad70 comp rx=0 tx=0).stop 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 shutdown_connections 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f21a40678f0 0x7f21a4069db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21c41527e0 0x7f21c4154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21c40c7a00 0x7f21c41546e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 --2- 172.21.15.63:0/915772344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21c40c61e0 0x7f21c40cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 >> 172.21.15.63:0/915772344 conn(0x7f21c406f3d0 msgr2=0x7f21c4071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 shutdown_connections 2024-09-12T02:57:15.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:15.701+0000 7f21c9000640 1 -- 172.21.15.63:0/915772344 wait complete. 2024-09-12T02:57:16.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:57:04.183250+0000', 'modified': '2024-09-12T02:57:13.875182+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.63:6836/2556723891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6833', 'nonce': 2556723891}, {'type': 'v1', 'addr': '172.21.15.63:6836', 'nonce': 2556723891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4306, 'qdb_cluster': [4306]} 2024-09-12T02:57:16.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:57:16.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-12T02:57:16.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.469+0000 7f38c1e00640 1 Processor -- start 2024-09-12T02:57:16.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.469+0000 7f38c1e00640 1 -- start start 2024-09-12T02:57:16.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38c1e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38bc157db0 0x7f38bc162e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38c1e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38bc0c6a10 con 0x7f38bc151ad0 2024-09-12T02:57:16.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38c1e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38bc0c6cf0 con 0x7f38bc0c9700 2024-09-12T02:57:16.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38c1e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f38bc0c7a10 con 0x7f38bc157db0 2024-09-12T02:57:16.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38baa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f38bc151ad0 0x7f38bc072f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58616/0 (socket says 172.21.15.63:58616) 2024-09-12T02:57:16.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38baa00640 1 -- 172.21.15.63:0/3502625890 learned_addr learned my addr 172.21.15.63:0/3502625890 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:16.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38bb400640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38bc157db0 0x7f38bc162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583245919 0 0) 0x7f38bc0c6a10 con 0x7f38bc151ad0 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38a0003530 con 0x7f38bc151ad0 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 563605686 0 0) 0x7f38a0003530 con 0x7f38bc151ad0 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38bc157db0 msgr2=0x7f38bc162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38bc157db0 0x7f38bc162e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 >> v1:172.21.15.119:6789/0 conn(0x7f38bc0c9700 legacy=0x7f38bc1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38bc0c6fd0 con 0x7f38bc151ad0 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f38ac001680 con 0x7f38bc151ad0 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 >> v1:172.21.15.63:6789/0 conn(0x7f38bc151ad0 legacy=0x7f38bc072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38bc157db0 0x7f38a00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a0003f30 0x7f38a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a0004d50 0x7f38a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc0c7a10 con 0x7f38a0003f30 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38a000ba30 con 0x7f38a0004d50 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f38a000bc30 con 0x7f38bc157db0 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38b2000640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a0003f30 0x7f38a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38baa00640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38bc157db0 0x7f38a00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38bb400640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a0004d50 0x7f38a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38b2000640 1 -- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38bc157db0 msgr2=0x7f38a00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38b2000640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38bc157db0 0x7f38a00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38b2000640 1 -- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a0004d50 msgr2=0x7f38a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38b2000640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a0004d50 0x7f38a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.473+0000 7f38b2000640 1 -- 172.21.15.63:0/3502625890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a0003530 con 0x7f38a0003f30 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38b2000640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a0003f30 0x7f38a0004810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38a4001910 tx=0x7f38a4020e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7549eb3abae7337 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a40b7070 con 0x7f38a0003f30 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a40aaa60 con 0x7f38a0003f30 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38ba000640 1 -- 172.21.15.63:0/3502625890 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4001510 con 0x7f38a0003f30 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38c1e00640 1 -- 172.21.15.63:0/3502625890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a0003f30 msgr2=0x7f38a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38c1e00640 1 --2- 172.21.15.63:0/3502625890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a0003f30 0x7f38a0004810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f38a4001910 tx=0x7f38a4020e20 comp rx=0 tx=0).stop 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38bb400640 1 -- 172.21.15.63:0/3502625890 reap_dead start 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38c1e00640 1 -- 172.21.15.63:0/3502625890 shutdown_connections 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38c1e00640 1 -- 172.21.15.63:0/3502625890 >> 172.21.15.63:0/3502625890 conn(0x7f38bc06f3d0 msgr2=0x7f38bc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38c1e00640 1 -- 172.21.15.63:0/3502625890 shutdown_connections 2024-09-12T02:57:16.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38c1e00640 1 -- 172.21.15.63:0/3502625890 wait complete. 2024-09-12T02:57:16.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38c1e00640 1 Processor -- start 2024-09-12T02:57:16.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.477+0000 7f38c1e00640 1 -- start start 2024-09-12T02:57:16.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38c1e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a0003f30 0x7f38bc1f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38c1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38bc1f0b40 0x7f38bc0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38c1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38bc0ccaa0 0x7f38bc1477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38c1e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc0c7c60 con 0x7f38bc0ccaa0 2024-09-12T02:57:16.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38c1e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc071850 con 0x7f38bc1f0b40 2024-09-12T02:57:16.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38c1e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f38bc074130 con 0x7f38a0003f30 2024-09-12T02:57:16.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38bb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38bc0ccaa0 0x7f38bc1477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38b2000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38bc1f0b40 0x7f38bc0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38baa00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a0003f30 0x7f38bc1f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38bb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38bc0ccaa0 0x7f38bc1477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60064/0 (socket says 172.21.15.63:60064) 2024-09-12T02:57:16.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38bb400640 1 -- 172.21.15.63:0/1831541048 learned_addr learned my addr 172.21.15.63:0/1831541048 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:16.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38bb400640 1 -- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a0003f30 msgr2=0x7f38bc1f0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:16.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38bb400640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a0003f30 0x7f38bc1f0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38bb400640 1 -- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38bc1f0b40 msgr2=0x7f38bc0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:16.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38bb400640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38bc1f0b40 0x7f38bc0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38bb400640 1 -- 172.21.15.63:0/1831541048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38bc1e6cc0 con 0x7f38bc0ccaa0 2024-09-12T02:57:16.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38bb400640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38bc0ccaa0 0x7f38bc1477f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0c8830 tx=0x7f38b40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:16.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38b3e00640 1 -- 172.21.15.63:0/1831541048 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4007e70 con 0x7f38bc0ccaa0 2024-09-12T02:57:16.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38b3e00640 1 -- 172.21.15.63:0/1831541048 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b401b070 con 0x7f38bc0ccaa0 2024-09-12T02:57:16.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38b3e00640 1 -- 172.21.15.63:0/1831541048 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4011de0 con 0x7f38bc0ccaa0 2024-09-12T02:57:16.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38c1e00640 1 -- 172.21.15.63:0/1831541048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38bc1e69e0 con 0x7f38bc0ccaa0 2024-09-12T02:57:16.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.481+0000 7f38c1e00640 1 -- 172.21.15.63:0/1831541048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38bc1e2aa0 con 0x7f38bc0ccaa0 2024-09-12T02:57:16.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38b3e00640 1 -- 172.21.15.63:0/1831541048 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38b40039a0 con 0x7f38bc0ccaa0 2024-09-12T02:57:16.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38b3e00640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f38980678c0 0x7f3898069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38b3e00640 1 -- 172.21.15.63:0/1831541048 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f38b4086540 con 0x7f38bc0ccaa0 2024-09-12T02:57:16.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38baa00640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f38980678c0 0x7f3898069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38c51dc000 1 Processor -- start 2024-09-12T02:57:16.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38c51dc000 1 -- start start 2024-09-12T02:57:16.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38baa00640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f38980678c0 0x7f3898069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38ac001c80 tx=0x7f38ac007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:16.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5a000 0x564646a236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a23bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a5f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38c51dc000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x564646905b60 con 0x564646a5eca0 2024-09-12T02:57:16.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38c51dc000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x56464686cc70 con 0x564646a5a000 2024-09-12T02:57:16.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38c51dc000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x564646812ed0 con 0x564646a5a3e0 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38bb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a5f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38bb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a5f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60080/0 (socket says 172.21.15.63:60080) 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38bb400640 1 -- 172.21.15.63:0/1434231860 learned_addr learned my addr 172.21.15.63:0/1434231860 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38baa00640 1 --2- 172.21.15.63:0/1434231860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5a000 0x564646a236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38b2000640 1 --2- 172.21.15.63:0/1434231860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a23bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38bb400640 1 -- 172.21.15.63:0/1434231860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 msgr2=0x564646a23bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38bb400640 1 --2- 172.21.15.63:0/1434231860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a23bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38bb400640 1 -- 172.21.15.63:0/1434231860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5a000 msgr2=0x564646a236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38bb400640 1 --2- 172.21.15.63:0/1434231860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5a000 0x564646a236b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38bb400640 1 -- 172.21.15.63:0/1434231860 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564646824e50 con 0x564646a5eca0 2024-09-12T02:57:16.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38bb400640 1 --2- 172.21.15.63:0/1434231860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a5f080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f38b405ec50 tx=0x7f38b4056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934c0ea77f7e558d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:16.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.485+0000 7f38abe00640 1 -- 172.21.15.63:0/1434231860 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b405f180 con 0x564646a5eca0 2024-09-12T02:57:16.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38abe00640 1 -- 172.21.15.63:0/1434231860 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b40548a0 con 0x564646a5eca0 2024-09-12T02:57:16.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38abe00640 1 -- 172.21.15.63:0/1434231860 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4003c90 con 0x564646a5eca0 2024-09-12T02:57:16.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- 172.21.15.63:0/1434231860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 msgr2=0x564646a5f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:16.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 --2- 172.21.15.63:0/1434231860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a5f080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f38b405ec50 tx=0x7f38b4056000 comp rx=0 tx=0).stop 2024-09-12T02:57:16.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- 172.21.15.63:0/1434231860 shutdown_connections 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 --2- 172.21.15.63:0/1434231860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a5f080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 --2- 172.21.15.63:0/1434231860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a23bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 --2- 172.21.15.63:0/1434231860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5a000 0x564646a236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- 172.21.15.63:0/1434231860 >> 172.21.15.63:0/1434231860 conn(0x564646a24350 msgr2=0x564646a5ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- 172.21.15.63:0/1434231860 shutdown_connections 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- 172.21.15.63:0/1434231860 wait complete. 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- start start 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 Processor -- start 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5a000 0x564646a6a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a6af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 0x564646a6b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5646468ceb00 con 0x564646a5a000 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564646847360 con 0x564646a5eca0 2024-09-12T02:57:16.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x5646468442d0 con 0x564646a5a3e0 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 10 client.0 _ll_register_callbacks cb 0x564646a09820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38baa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5a000 0x564646a6a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38baa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5a000 0x564646a6a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60086/0 (socket says 172.21.15.63:60086) 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38baa00640 1 -- 172.21.15.63:0/357494065 learned_addr learned my addr 172.21.15.63:0/357494065 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38bb400640 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 0x564646a6b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38b2000640 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a6af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38baa00640 1 -- 172.21.15.63:0/357494065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 msgr2=0x564646a6af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38baa00640 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a6af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38baa00640 1 -- 172.21.15.63:0/357494065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 msgr2=0x564646a6b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38baa00640 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 0x564646a6b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38baa00640 1 -- 172.21.15.63:0/357494065 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564646813120 con 0x564646a5a000 2024-09-12T02:57:16.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38baa00640 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5a000 0x564646a6a9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38ac015a20 tx=0x7f38ac001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f555ea57e1c4933a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:16.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-12T02:57:16.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38a8c00640 1 -- 172.21.15.63:0/357494065 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac029060 con 0x564646a5a000 2024-09-12T02:57:16.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38c51dc000 1 -- 172.21.15.63:0/357494065 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b40548a0 con 0x564646a5a000 2024-09-12T02:57:16.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.489+0000 7f38a8c00640 1 -- 172.21.15.63:0/357494065 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f38ac010040 con 0x564646a5a000 2024-09-12T02:57:16.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38a8c00640 1 -- 172.21.15.63:0/357494065 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f38ac02f050 con 0x564646a5a000 2024-09-12T02:57:16.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38c51dc000 10 client.4389 fetch_fsmap learned FSMap version 7 2024-09-12T02:57:16.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38c51dc000 1 -- 172.21.15.63:0/357494065 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x56464680c450 con 0x564646a5a000 2024-09-12T02:57:16.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38a8c00640 1 -- 172.21.15.63:0/357494065 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b40548a0 con 0x564646a5a000 2024-09-12T02:57:16.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38a8c00640 1 -- 172.21.15.63:0/357494065 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 7) ==== 4720+0+0 (secure 0 0 0) 0x7f38ac032020 con 0x564646a5a000 2024-09-12T02:57:16.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38c51dc000 10 client.4389 fetch_fsmap finished waiting for FSMap version 7 2024-09-12T02:57:16.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38c51dc000 10 client.4389 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T02:57:16.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38c51dc000 20 client.4389 populate_metadata read hostname 'smithi063' 2024-09-12T02:57:16.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38c51dc000 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x564646a72da0 0x564646a75190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:16.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38c51dc000 4 client.4389 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:57:16.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38c51dc000 1 -- 172.21.15.63:0/357494065 --> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564646806c00 con 0x564646a72da0 2024-09-12T02:57:16.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38b2000640 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x564646a72da0 0x564646a75190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:16.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38b2000640 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x564646a72da0 0x564646a75190 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53227d962e3d6b3b server_cookie=5d94a6aa1e42d360 in_seq=0 out_seq=0 2024-09-12T02:57:16.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:16.493+0000 7f38a8c00640 10 client.4389 ms_handle_connect on v2:172.21.15.63:6833/2556723891 2024-09-12T02:57:18.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38a8c00640 1 -- 172.21.15.63:0/357494065 <== mds.0 v2:172.21.15.63:6833/2556723891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564646806c00 con 0x564646a72da0 2024-09-12T02:57:18.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38a8c00640 10 client.4389 handle_command_reply: tid=0 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 client.4389 shutdown 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 -- 172.21.15.63:0/357494065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5a000 msgr2=0x564646a6a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5a000 0x564646a6a9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38ac015a20 tx=0x7f38ac001c10 comp rx=0 tx=0).stop 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 -- 172.21.15.63:0/357494065 shutdown_connections 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x564646a72da0 0x564646a75190 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 0x564646a6b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a6af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 --2- 172.21.15.63:0/357494065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5a000 0x564646a6a9d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38a8c00640 0 client.4389 ms_handle_reset on v2:172.21.15.63:6833/2556723891 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 -- 172.21.15.63:0/357494065 >> 172.21.15.63:0/357494065 conn(0x564646a24350 msgr2=0x564646a5ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 -- 172.21.15.63:0/357494065 shutdown_connections 2024-09-12T02:57:18.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.881+0000 7f38c51dc000 1 -- 172.21.15.63:0/357494065 wait complete. 2024-09-12T02:57:18.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.885+0000 7f38c51dc000 20 client.4389 trim_cache size 0 max 16384 2024-09-12T02:57:18.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38c51dc000 1 Processor -- start 2024-09-12T02:57:18.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38c51dc000 1 -- start start 2024-09-12T02:57:18.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a785e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:18.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a228e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:18.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a78b20 0x564646a22e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:18.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38c51dc000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f38bc1fd650 con 0x564646a5eca0 2024-09-12T02:57:18.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38c51dc000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x564646824ca0 con 0x564646a78b20 2024-09-12T02:57:18.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38c51dc000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x56464686bf80 con 0x564646a5a3e0 2024-09-12T02:57:18.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38b2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:18.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38b2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60090/0 (socket says 172.21.15.63:60090) 2024-09-12T02:57:18.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38b2000640 1 -- 172.21.15.63:0/1360442110 learned_addr learned my addr 172.21.15.63:0/1360442110 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:18.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38baa00640 1 --2- 172.21.15.63:0/1360442110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a785e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:18.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38bb400640 1 --2- 172.21.15.63:0/1360442110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a78b20 0x564646a22e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:18.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38b2000640 1 -- 172.21.15.63:0/1360442110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 msgr2=0x564646a785e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:18.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38b2000640 1 --2- 172.21.15.63:0/1360442110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a785e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38b2000640 1 -- 172.21.15.63:0/1360442110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a78b20 msgr2=0x564646a22e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:18.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38b2000640 1 --2- 172.21.15.63:0/1360442110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a78b20 0x564646a22e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38b2000640 1 -- 172.21.15.63:0/1360442110 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646467f3fd0 con 0x564646a5eca0 2024-09-12T02:57:18.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38b2000640 1 --2- 172.21.15.63:0/1360442110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a228e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38a4020c50 tx=0x7f38a40012c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540ae361dd823d22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:18.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38ab400640 1 -- 172.21.15.63:0/1360442110 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a40c5070 con 0x564646a5eca0 2024-09-12T02:57:18.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38ab400640 1 -- 172.21.15.63:0/1360442110 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a40b8040 con 0x564646a5eca0 2024-09-12T02:57:18.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.905+0000 7f38ab400640 1 -- 172.21.15.63:0/1360442110 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a40b7040 con 0x564646a5eca0 2024-09-12T02:57:18.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 -- 172.21.15.63:0/1360442110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 msgr2=0x564646a228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:18.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 --2- 172.21.15.63:0/1360442110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a228e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38a4020c50 tx=0x7f38a40012c0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 -- 172.21.15.63:0/1360442110 shutdown_connections 2024-09-12T02:57:18.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 --2- 172.21.15.63:0/1360442110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a78b20 0x564646a22e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 --2- 172.21.15.63:0/1360442110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a5eca0 0x564646a228e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 --2- 172.21.15.63:0/1360442110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a785e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 -- 172.21.15.63:0/1360442110 >> 172.21.15.63:0/1360442110 conn(0x564646a24350 msgr2=0x564646a221d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:18.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 -- 172.21.15.63:0/1360442110 shutdown_connections 2024-09-12T02:57:18.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 -- 172.21.15.63:0/1360442110 wait complete. 2024-09-12T02:57:18.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 -- start start 2024-09-12T02:57:18.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 Processor -- start 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a984f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 0x564646a98a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a78b20 0x564646a98f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x56464682b0f0 con 0x564646a78b20 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5646468712a0 con 0x564646a5eca0 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x564646a23d00 con 0x564646a5a3e0 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38c51dc000 10 client.0 _ll_register_callbacks cb 0x7f38ac011a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38bb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a78b20 0x564646a98f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38bb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a78b20 0x564646a98f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60096/0 (socket says 172.21.15.63:60096) 2024-09-12T02:57:18.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38bb400640 1 -- 172.21.15.63:0/311688162 learned_addr learned my addr 172.21.15.63:0/311688162 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38baa00640 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38b2000640 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 0x564646a98a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38bb400640 1 -- 172.21.15.63:0/311688162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 msgr2=0x564646a984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38bb400640 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38bb400640 1 -- 172.21.15.63:0/311688162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 msgr2=0x564646a98a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38bb400640 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 0x564646a98a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38bb400640 1 -- 172.21.15.63:0/311688162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646468ef750 con 0x564646a78b20 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38b2000640 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 0x564646a98a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38bb400640 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a78b20 0x564646a98f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38b4056760 tx=0x7f38b4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40d5bcb21d8d3ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:18.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.909+0000 7f38a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-12T02:57:18.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38a8c00640 1 -- 172.21.15.63:0/311688162 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b405f180 con 0x564646a78b20 2024-09-12T02:57:18.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38a8c00640 1 -- 172.21.15.63:0/311688162 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f38b4003c90 con 0x564646a78b20 2024-09-12T02:57:18.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 -- 172.21.15.63:0/311688162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38a40b8040 con 0x564646a78b20 2024-09-12T02:57:18.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38a8c00640 1 -- 172.21.15.63:0/311688162 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f38b4086030 con 0x564646a78b20 2024-09-12T02:57:18.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 10 client.4395 fetch_fsmap learned FSMap version 7 2024-09-12T02:57:18.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 -- 172.21.15.63:0/311688162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5646467faa30 con 0x564646a78b20 2024-09-12T02:57:18.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38a8c00640 1 -- 172.21.15.63:0/311688162 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a40b8040 con 0x564646a78b20 2024-09-12T02:57:18.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38a8c00640 1 -- 172.21.15.63:0/311688162 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 7) ==== 4720+0+0 (secure 0 0 0) 0x7f38b40559f0 con 0x564646a78b20 2024-09-12T02:57:18.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 10 client.4395 fetch_fsmap finished waiting for FSMap version 7 2024-09-12T02:57:18.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 10 client.4395 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T02:57:18.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 20 client.4395 populate_metadata read hostname 'smithi063' 2024-09-12T02:57:18.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x564646a99930 0x564646ae03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:18.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 4 client.4395 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:57:18.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 -- 172.21.15.63:0/311688162 --> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] -- command(tid 0: {"prefix": "status"}) -- 0x56464687a3a0 con 0x564646a99930 2024-09-12T02:57:18.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38baa00640 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x564646a99930 0x564646ae03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:18.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38baa00640 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x564646a99930 0x564646ae03b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0cb06a89f1b7c74 server_cookie=cf02741898217d69 in_seq=0 out_seq=0 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38a8c00640 10 client.4395 ms_handle_connect on v2:172.21.15.63:6833/2556723891 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38a8c00640 1 -- 172.21.15.63:0/311688162 <== mds.0 v2:172.21.15.63:6833/2556723891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x56464687a3a0 con 0x564646a99930 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38a8c00640 10 client.4395 handle_command_reply: tid=0 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 client.4395 shutdown 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 -- 172.21.15.63:0/311688162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a78b20 msgr2=0x564646a98f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a78b20 0x564646a98f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38b4056760 tx=0x7f38b4000f50 comp rx=0 tx=0).stop 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 -- 172.21.15.63:0/311688162 shutdown_connections 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x564646a99930 0x564646ae03b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x564646a78b20 0x564646a98f70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564646a5eca0 0x564646a98a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 --2- 172.21.15.63:0/311688162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564646a5a3e0 0x564646a984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38a8c00640 0 client.4395 ms_handle_reset on v2:172.21.15.63:6833/2556723891 2024-09-12T02:57:18.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 -- 172.21.15.63:0/311688162 >> 172.21.15.63:0/311688162 conn(0x564646a24350 msgr2=0x564646a221d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 -- 172.21.15.63:0/311688162 shutdown_connections 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 1 -- 172.21.15.63:0/311688162 wait complete. 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c51dc000 20 client.4395 trim_cache size 0 max 16384 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "20b0bc3b-ca7e-4b63-a9bc-3526f84b65da", 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4306, 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-12T02:57:18.921 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-12T02:57:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 14.072483969, 2024-09-12T02:57:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 6, 2024-09-12T02:57:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 26, 2024-09-12T02:57:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 26, 2024-09-12T02:57:18.922 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 19.733815256 2024-09-12T02:57:18.922 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 -- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f38980678c0 msgr2=0x7f3898069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f38980678c0 0x7f3898069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38ac001c80 tx=0x7f38ac007040 comp rx=0 tx=0).stop 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 -- 172.21.15.63:0/1831541048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38bc0ccaa0 msgr2=0x7f38bc1477f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38bc0ccaa0 0x7f38bc1477f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0c8830 tx=0x7f38b40115a0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 -- 172.21.15.63:0/1831541048 shutdown_connections 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38bc0ccaa0 0x7f38bc1477f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38bc1f0b40 0x7f38bc0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f38980678c0 0x7f3898069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 --2- 172.21.15.63:0/1831541048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a0003f30 0x7f38bc1f0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 -- 172.21.15.63:0/1831541048 >> 172.21.15.63:0/1831541048 conn(0x7f38bc06f3d0 msgr2=0x7f38bc06d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:18.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 -- 172.21.15.63:0/1831541048 shutdown_connections 2024-09-12T02:57:18.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:18.913+0000 7f38c1e00640 1 -- 172.21.15.63:0/1831541048 wait complete. 2024-09-12T02:57:18.941 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:57:18.941 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:57:18.942 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:57:19.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3782a00640 1 Processor -- start 2024-09-12T02:57:19.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3782a00640 1 -- start start 2024-09-12T02:57:19.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3782a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cc910 0x7f377c0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:19.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3782a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f377c0cccf0 0x7f377c1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:19.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3782a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f377c0c7be0 con 0x7f377c0c76e0 2024-09-12T02:57:19.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3782a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f377c071d70 con 0x7f377c0cccf0 2024-09-12T02:57:19.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3782a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f377c15ad60 con 0x7f377c0cc910 2024-09-12T02:57:19.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3780a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f377c0c76e0 0x7f377c06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58626/0 (socket says 172.21.15.63:58626) 2024-09-12T02:57:19.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3780a00640 1 -- 172.21.15.63:0/678733928 learned_addr learned my addr 172.21.15.63:0/678733928 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:19.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f377be00640 1 --2- 172.21.15.63:0/678733928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cc910 0x7f377c0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:19.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.085+0000 7f3773400640 1 --2- 172.21.15.63:0/678733928 >> v2:172.21.15.119:3300/0 conn(0x7f377c0cccf0 0x7f377c1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:19.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377b400640 1 -- 172.21.15.63:0/678733928 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876675888 0 0) 0x7f377c0c7be0 con 0x7f377c0c76e0 2024-09-12T02:57:19.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377b400640 1 -- 172.21.15.63:0/678733928 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3760003530 con 0x7f377c0c76e0 2024-09-12T02:57:19.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377b400640 1 -- 172.21.15.63:0/678733928 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2084003272 0 0) 0x7f3760003530 con 0x7f377c0c76e0 2024-09-12T02:57:19.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377be00640 1 -- 172.21.15.63:0/678733928 >> v2:172.21.15.119:3300/0 conn(0x7f377c0cccf0 msgr2=0x7f377c1548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:19.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377be00640 1 --2- 172.21.15.63:0/678733928 >> v2:172.21.15.119:3300/0 conn(0x7f377c0cccf0 0x7f377c1548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377be00640 1 -- 172.21.15.63:0/678733928 >> v1:172.21.15.63:6789/0 conn(0x7f377c0c76e0 legacy=0x7f377c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:19.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377be00640 1 -- 172.21.15.63:0/678733928 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c15b040 con 0x7f377c0cc910 2024-09-12T02:57:19.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f3773400640 1 --2- 172.21.15.63:0/678733928 >> v2:172.21.15.119:3300/0 conn(0x7f377c0cccf0 0x7f377c1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:19.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377be00640 1 --2- 172.21.15.63:0/678733928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cc910 0x7f377c0c71a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f376c0097c0 tx=0x7f376c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a66ed73ad7d821 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377b400640 1 -- 172.21.15.63:0/678733928 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c0b0070 con 0x7f377c0cc910 2024-09-12T02:57:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377b400640 1 -- 172.21.15.63:0/678733928 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376c0ab400 con 0x7f377c0cc910 2024-09-12T02:57:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.089+0000 7f377b400640 1 -- 172.21.15.63:0/678733928 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774001a00 con 0x7f377c0cc910 2024-09-12T02:57:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 -- 172.21.15.63:0/678733928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cc910 msgr2=0x7f377c0c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 --2- 172.21.15.63:0/678733928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cc910 0x7f377c0c71a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f376c0097c0 tx=0x7f376c01c3c0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 -- 172.21.15.63:0/678733928 shutdown_connections 2024-09-12T02:57:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 --2- 172.21.15.63:0/678733928 >> v2:172.21.15.119:3300/0 conn(0x7f377c0cccf0 0x7f377c1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 --2- 172.21.15.63:0/678733928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cc910 0x7f377c0c71a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 -- 172.21.15.63:0/678733928 >> 172.21.15.63:0/678733928 conn(0x7f377c06be90 msgr2=0x7f377c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:19.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 -- 172.21.15.63:0/678733928 shutdown_connections 2024-09-12T02:57:19.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 -- 172.21.15.63:0/678733928 wait complete. 2024-09-12T02:57:19.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 Processor -- start 2024-09-12T02:57:19.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 -- start start 2024-09-12T02:57:19.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c0c76e0 0x7f377c14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0cc910 0x7f377c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cccf0 0x7f377c1411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f377c154f70 con 0x7f377c0c76e0 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f377c154df0 con 0x7f377c0cc910 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3782a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f377c1550f0 con 0x7f377c0cccf0 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f377be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c0c76e0 0x7f377c14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f377be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c0c76e0 0x7f377c14f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60102/0 (socket says 172.21.15.63:60102) 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f377be00640 1 -- 172.21.15.63:0/1707436909 learned_addr learned my addr 172.21.15.63:0/1707436909 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3780a00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cccf0 0x7f377c1411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.093+0000 7f3773400640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0cc910 0x7f377c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:19.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f377be00640 1 -- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cccf0 msgr2=0x7f377c1411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:19.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f377be00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cccf0 0x7f377c1411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f377be00640 1 -- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0cc910 msgr2=0x7f377c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:19.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f377be00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0cc910 0x7f377c0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f377be00640 1 -- 172.21.15.63:0/1707436909 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c1536d0 con 0x7f377c0c76e0 2024-09-12T02:57:19.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3773400640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0cc910 0x7f377c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:19.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f377be00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c0c76e0 0x7f377c14f300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f376c0ae040 tx=0x7f376c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:19.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3778c00640 1 -- 172.21.15.63:0/1707436909 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c0b0040 con 0x7f377c0c76e0 2024-09-12T02:57:19.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3778c00640 1 -- 172.21.15.63:0/1707436909 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376c0b4430 con 0x7f377c0c76e0 2024-09-12T02:57:19.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377c1539b0 con 0x7f377c0c76e0 2024-09-12T02:57:19.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3778c00640 1 -- 172.21.15.63:0/1707436909 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c0b47e0 con 0x7f377c0c76e0 2024-09-12T02:57:19.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f377c13f3d0 con 0x7f377c0c76e0 2024-09-12T02:57:19.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f377c1540d0 con 0x7f377c0c76e0 2024-09-12T02:57:19.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3778c00640 1 -- 172.21.15.63:0/1707436909 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f376c0bb020 con 0x7f377c0c76e0 2024-09-12T02:57:19.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3778c00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f37580678c0 0x7f3758069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:19.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.097+0000 7f3778c00640 1 -- 172.21.15.63:0/1707436909 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f376c11f910 con 0x7f377c0c76e0 2024-09-12T02:57:19.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.101+0000 7f3773400640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f37580678c0 0x7f3758069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:19.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.101+0000 7f3773400640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f37580678c0 0x7f3758069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f377c14eb40 tx=0x7f3764008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:19.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.105+0000 7f3778c00640 1 -- 172.21.15.63:0/1707436909 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f376c015fb0 con 0x7f377c0c76e0 2024-09-12T02:57:19.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f377c0c34b0 con 0x7f377c0c76e0 2024-09-12T02:57:19.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3778c00640 1 -- 172.21.15.63:0/1707436909 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f376c0f0070 con 0x7f377c0c76e0 2024-09-12T02:57:19.308 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:57:19.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f37580678c0 msgr2=0x7f3758069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:19.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f37580678c0 0x7f3758069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f377c14eb40 tx=0x7f3764008040 comp rx=0 tx=0).stop 2024-09-12T02:57:19.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c0c76e0 msgr2=0x7f377c14f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:19.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c0c76e0 0x7f377c14f300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f376c0ae040 tx=0x7f376c019160 comp rx=0 tx=0).stop 2024-09-12T02:57:19.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 shutdown_connections 2024-09-12T02:57:19.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f37580678c0 0x7f3758069d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0cccf0 0x7f377c1411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0cc910 0x7f377c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 --2- 172.21.15.63:0/1707436909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f377c0c76e0 0x7f377c14f300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:19.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 >> 172.21.15.63:0/1707436909 conn(0x7f377c06be90 msgr2=0x7f377c06eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:19.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 shutdown_connections 2024-09-12T02:57:19.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19.305+0000 7f3782a00640 1 -- 172.21.15.63:0/1707436909 wait complete. 2024-09-12T02:57:19.332 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:57:19.332 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:57:19.332 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-12T02:57:19.332 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T02:57:19.332 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:57:19.333 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:57:19.333 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:57:19.333 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:57:19.333 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:57:19.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:19.333 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-12T02:57:19.342 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:57:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:57:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:57:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:57:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-12T02:57:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42450sec preferred_lft 42450sec 2024-09-12T02:57:19.343 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2024-09-12T02:57:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:57:19.344 INFO:teuthology.orchestra.run.smithi063.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T02:57:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 02:42:32:db:8c:43 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T02:57:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:57:19.345 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:57:19.345 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:19.345 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:19.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:57:19.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-09-12T02:57:19.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-09-12T02:57:19.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:57:19.346 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:19.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:19.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:19.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:19.504 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:57:19.522 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-12T02:57:19.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:19.525 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-12T02:57:19.595 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T02:57:19.596 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:57:19.597 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:19.597 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:19.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:57:19.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:57:19.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:57:19.597 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:19.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:19.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:19.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:19.736 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-12T02:57:19.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:19.788 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-09-12T02:57:19.839 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:19.839 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:19.839 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:57:19.839 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T02:57:19.839 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:19.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:19.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:19.967 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T02:57:19.968 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:19.968 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:19.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T02:57:19.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:57:19.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T02:57:19.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T02:57:19.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T02:57:19.968 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:20.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:20.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:20.140 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:20.140 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:20.140 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-09-12T02:57:20.140 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:57:20.141 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:20.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:20.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:20.227 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T02:57:20.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:57:20.228 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:57:20.236 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:57:20.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:57:20.237 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:57:20.285 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-09-12T02:57:20.346 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:57:20.403 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/run/lock 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-09-12T02:57:20.404 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/fs/nfsd 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/run/rpc_pipefs 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:57:20.405 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:57:20.406 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:57:20.406 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:57:20.406 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-09-12T02:57:20.406 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:57:20.406 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:57:20.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:20.407 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-09-12T02:57:20.462 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:57:20.462 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T02:57:20.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-09-12T02:57:20.529 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:57:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/run/lock 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-09-12T02:57:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/fs/nfsd 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/run/rpc_pipefs 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-09-12T02:57:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:57:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:57:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:57:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:57:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-09-12T02:57:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:57:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:57:20.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:20.583 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-09-12T02:57:20.607 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:2024-09-12T02:57:20.605+0000 7f3e85793580 -1 init, newargv = 0x55dbde688390 newargc=15 2024-09-12T02:57:20.607 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[34815]: starting ceph client 2024-09-12T02:57:20.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[34815]: starting fuse 2024-09-12T02:57:21.190 INFO:tasks.ceph.mds.e.smithi063.stderr:2024-09-12T02:57:21.189+0000 7f1827400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:57:21.717 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-09-12T02:57:21.741 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:57:21.792 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-09-12T02:57:21.792 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/run/lock 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-09-12T02:57:21.793 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/fs/nfsd 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/run/rpc_pipefs 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T02:57:21.794 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-09-12T02:57:21.795 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:57:21.795 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:57:21.795 INFO:teuthology.orchestra.run.smithi063.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-12T02:57:21.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:21.796 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-09-12T02:57:21.851 INFO:teuthology.orchestra.run.smithi063.stdout:44 2024-09-12T02:57:21.852 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-12T02:57:21.852 DEBUG:teuthology.orchestra.run.smithi063:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:57:21.852 DEBUG:teuthology.orchestra.run.smithi063:> import glob 2024-09-12T02:57:21.852 DEBUG:teuthology.orchestra.run.smithi063:> import re 2024-09-12T02:57:21.852 DEBUG:teuthology.orchestra.run.smithi063:> import os 2024-09-12T02:57:21.852 DEBUG:teuthology.orchestra.run.smithi063:> import subprocess 2024-09-12T02:57:21.852 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-12T02:57:21.852 DEBUG:teuthology.orchestra.run.smithi063:> def _find_admin_socket(client_name): 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> return files[0] 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> for f in files: 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:57:21.853 DEBUG:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:57:21.854 DEBUG:teuthology.orchestra.run.smithi063:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:57:21.854 DEBUG:teuthology.orchestra.run.smithi063:> contents = proc_f.read() 2024-09-12T02:57:21.854 DEBUG:teuthology.orchestra.run.smithi063:> if mountpoint in contents: 2024-09-12T02:57:21.854 DEBUG:teuthology.orchestra.run.smithi063:> return f 2024-09-12T02:57:21.854 DEBUG:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:57:21.854 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-12T02:57:21.854 DEBUG:teuthology.orchestra.run.smithi063:> print(_find_admin_socket("client.admin")) 2024-09-12T02:57:21.854 DEBUG:teuthology.orchestra.run.smithi063:> ' 2024-09-12T02:57:21.986 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.admin.34815.asok 2024-09-12T02:57:21.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:21.998 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34815.asok 2024-09-12T02:57:21.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:21.999 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34815.asok status 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "admin", 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "34815", 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2024-09-12T02:57:22.181 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4410, 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 4410 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2281374232 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:57:22.182 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2281374232 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.4410 192.168.0.1:0/2281374232", 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/2281374232", 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 6, 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 26, 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklisted": false, 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs" 2024-09-12T02:57:22.183 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:22.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:22.196 DEBUG:teuthology.orchestra.run.smithi063:> stat --file-system '--printf=%T 2024-09-12T02:57:22.196 DEBUG:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:57:22.205 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2024-09-12T02:57:22.205 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:57:22.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:22.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:57:22.266 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T02:57:22.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:57:22.385 INFO:teuthology.orchestra.run.smithi063.stdout:# file: . 2024-09-12T02:57:22.385 INFO:teuthology.orchestra.run.smithi063.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T02:57:22.385 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:22.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:22.392 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:57:22.392 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:57:22.401 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:57:22.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb48400640 1 Processor -- start 2024-09-12T02:57:22.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb48400640 1 -- start start 2024-09-12T02:57:22.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb48400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcb40157db0 0x7fcb40162e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:22.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb48400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb400c6a10 con 0x7fcb40151ad0 2024-09-12T02:57:22.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb48400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb400c6cf0 con 0x7fcb400c9700 2024-09-12T02:57:22.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb48400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fcb400c7a10 con 0x7fcb40157db0 2024-09-12T02:57:22.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb45a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcb40151ad0 0x7fcb40072f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58638/0 (socket says 172.21.15.63:58638) 2024-09-12T02:57:22.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb45a00640 1 -- 172.21.15.63:0/2459036075 learned_addr learned my addr 172.21.15.63:0/2459036075 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:22.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb46400640 1 --2- 172.21.15.63:0/2459036075 >> v2:172.21.15.63:3300/0 conn(0x7fcb40157db0 0x7fcb40162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:22.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb46400640 1 -- 172.21.15.63:0/2459036075 >> v1:172.21.15.119:6789/0 conn(0x7fcb400c9700 legacy=0x7fcb401576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:22.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb46400640 1 -- 172.21.15.63:0/2459036075 >> v1:172.21.15.63:6789/0 conn(0x7fcb40151ad0 legacy=0x7fcb40072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:22.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb46400640 1 -- 172.21.15.63:0/2459036075 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb400c6fd0 con 0x7fcb40157db0 2024-09-12T02:57:22.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.581+0000 7fcb3fe00640 1 -- 172.21.15.63:0/2459036075 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539659161 0 0) 0x7fcb400c6a10 con 0x7fcb40151ad0 2024-09-12T02:57:22.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb46400640 1 --2- 172.21.15.63:0/2459036075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb40157db0 0x7fcb40162e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009d90 tx=0x7fcb3801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e61bd68cc582c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:22.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb3fe00640 1 -- 172.21.15.63:0/2459036075 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380b2070 con 0x7fcb40157db0 2024-09-12T02:57:22.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb3fe00640 1 -- 172.21.15.63:0/2459036075 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380a58e0 con 0x7fcb40157db0 2024-09-12T02:57:22.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb3fe00640 1 -- 172.21.15.63:0/2459036075 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380a5cb0 con 0x7fcb40157db0 2024-09-12T02:57:22.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb48400640 1 -- 172.21.15.63:0/2459036075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb40157db0 msgr2=0x7fcb40162e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:22.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb48400640 1 --2- 172.21.15.63:0/2459036075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb40157db0 0x7fcb40162e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009d90 tx=0x7fcb3801c970 comp rx=0 tx=0).stop 2024-09-12T02:57:22.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb48400640 1 -- 172.21.15.63:0/2459036075 shutdown_connections 2024-09-12T02:57:22.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb48400640 1 --2- 172.21.15.63:0/2459036075 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb40157db0 0x7fcb40162e90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:22.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb48400640 1 -- 172.21.15.63:0/2459036075 >> 172.21.15.63:0/2459036075 conn(0x7fcb4006f3d0 msgr2=0x7fcb4006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:22.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb48400640 1 -- 172.21.15.63:0/2459036075 shutdown_connections 2024-09-12T02:57:22.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb48400640 1 -- 172.21.15.63:0/2459036075 wait complete. 2024-09-12T02:57:22.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb48400640 1 Processor -- start 2024-09-12T02:57:22.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.585+0000 7fcb48400640 1 -- start start 2024-09-12T02:57:22.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb48400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb400c9700 0x7fcb40143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:22.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb48400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb40151ad0 0x7fcb40146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:22.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb48400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb40157db0 0x7fcb40146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:22.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb48400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb400742b0 con 0x7fcb400c9700 2024-09-12T02:57:22.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb48400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb40074130 con 0x7fcb40151ad0 2024-09-12T02:57:22.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb48400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fcb40073620 con 0x7fcb40157db0 2024-09-12T02:57:22.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb400c9700 0x7fcb40143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:22.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb400c9700 0x7fcb40143ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60134/0 (socket says 172.21.15.63:60134) 2024-09-12T02:57:22.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45a00640 1 -- 172.21.15.63:0/870815487 learned_addr learned my addr 172.21.15.63:0/870815487 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:22.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb46400640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb40157db0 0x7fcb40146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:22.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45000640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb40151ad0 0x7fcb40146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:22.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45a00640 1 -- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb40157db0 msgr2=0x7fcb40146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:22.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45a00640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb40157db0 0x7fcb40146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:22.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45a00640 1 -- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb40151ad0 msgr2=0x7fcb40146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:22.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45a00640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb40151ad0 0x7fcb40146010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:22.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45a00640 1 -- 172.21.15.63:0/870815487 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4014d6c0 con 0x7fcb400c9700 2024-09-12T02:57:22.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45000640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb40151ad0 0x7fcb40146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:22.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb45a00640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb400c9700 0x7fcb40143ae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c410 tx=0x7fcb3400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:22.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb3d600640 1 -- 172.21.15.63:0/870815487 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb340074e0 con 0x7fcb400c9700 2024-09-12T02:57:22.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb3d600640 1 -- 172.21.15.63:0/870815487 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb340047f0 con 0x7fcb400c9700 2024-09-12T02:57:22.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb401f4930 con 0x7fcb400c9700 2024-09-12T02:57:22.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb3d600640 1 -- 172.21.15.63:0/870815487 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34007680 con 0x7fcb400c9700 2024-09-12T02:57:22.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4014dc40 con 0x7fcb400c9700 2024-09-12T02:57:22.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb401576a0 con 0x7fcb400c9700 2024-09-12T02:57:22.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.589+0000 7fcb3d600640 1 -- 172.21.15.63:0/870815487 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcb34011070 con 0x7fcb400c9700 2024-09-12T02:57:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.593+0000 7fcb3d600640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb200678f0 0x7fcb20069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.593+0000 7fcb3d600640 1 -- 172.21.15.63:0/870815487 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcb34085c80 con 0x7fcb400c9700 2024-09-12T02:57:22.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.593+0000 7fcb45000640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb200678f0 0x7fcb20069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:22.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.593+0000 7fcb45000640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb200678f0 0x7fcb20069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb40145a40 tx=0x7fcb2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:22.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.597+0000 7fcb3d600640 1 -- 172.21.15.63:0/870815487 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcb340563e0 con 0x7fcb400c9700 2024-09-12T02:57:22.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb401631b0 con 0x7fcb400c9700 2024-09-12T02:57:22.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb3d600640 1 -- 172.21.15.63:0/870815487 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fcb34055ce0 con 0x7fcb400c9700 2024-09-12T02:57:22.775 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-12T02:57:22.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb200678f0 msgr2=0x7fcb20069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:22.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb200678f0 0x7fcb20069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb40145a40 tx=0x7fcb2c009040 comp rx=0 tx=0).stop 2024-09-12T02:57:22.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb400c9700 msgr2=0x7fcb40143ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb400c9700 0x7fcb40143ae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c410 tx=0x7fcb3400c8d0 comp rx=0 tx=0).stop 2024-09-12T02:57:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 shutdown_connections 2024-09-12T02:57:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb200678f0 0x7fcb20069db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb40157db0 0x7fcb40146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb40151ad0 0x7fcb40146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 --2- 172.21.15.63:0/870815487 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb400c9700 0x7fcb40143ae0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 >> 172.21.15.63:0/870815487 conn(0x7fcb4006f3d0 msgr2=0x7fcb401506f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 shutdown_connections 2024-09-12T02:57:22.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.773+0000 7fcb48400640 1 -- 172.21.15.63:0/870815487 wait complete. 2024-09-12T02:57:22.796 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:57:22.797 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:57:22.806 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:57:23.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc091600640 1 Processor -- start 2024-09-12T02:57:23.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc091600640 1 -- start start 2024-09-12T02:57:23.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc091600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc08c151ad0 0x7fc08c072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc091600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 0x7fc08c073450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc091600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08c0c6a10 con 0x7fc08c06fef0 2024-09-12T02:57:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc091600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fc08c0c7a10 con 0x7fc08c151ad0 2024-09-12T02:57:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc091600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc08c0c6cf0 con 0x7fc08c0c9700 2024-09-12T02:57:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc08aa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc08c151ad0 0x7fc08c072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc08b400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc08c06fef0 0x7fc08c1576a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58648/0 (socket says 172.21.15.63:58648) 2024-09-12T02:57:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc08aa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc08c151ad0 0x7fc08c072f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60148/0 (socket says 172.21.15.63:60148) 2024-09-12T02:57:23.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc08b400640 1 -- 172.21.15.63:0/1048911241 learned_addr learned my addr 172.21.15.63:0/1048911241 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:22.997+0000 7fc082000640 1 --2- 172.21.15.63:0/1048911241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 0x7fc08c073450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc08aa00640 1 -- 172.21.15.63:0/1048911241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 msgr2=0x7fc08c073450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc08aa00640 1 --2- 172.21.15.63:0/1048911241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 0x7fc08c073450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc08aa00640 1 -- 172.21.15.63:0/1048911241 >> v1:172.21.15.63:6789/0 conn(0x7fc08c06fef0 legacy=0x7fc08c1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc08aa00640 1 -- 172.21.15.63:0/1048911241 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c0c6fd0 con 0x7fc08c151ad0 2024-09-12T02:57:23.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc08a000640 1 -- 172.21.15.63:0/1048911241 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998715697 0 0) 0x7fc08c0c6a10 con 0x7fc08c06fef0 2024-09-12T02:57:23.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc08aa00640 1 --2- 172.21.15.63:0/1048911241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 0x7fc08c072f10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0097c0 tx=0x7fc07c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ec07a16c249bda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:23.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc08a000640 1 -- 172.21.15.63:0/1048911241 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0b0070 con 0x7fc08c151ad0 2024-09-12T02:57:23.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc08a000640 1 -- 172.21.15.63:0/1048911241 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c004230 con 0x7fc08c151ad0 2024-09-12T02:57:23.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc08a000640 1 -- 172.21.15.63:0/1048911241 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c003620 con 0x7fc08c151ad0 2024-09-12T02:57:23.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc091600640 1 -- 172.21.15.63:0/1048911241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 msgr2=0x7fc08c072f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:23.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc091600640 1 --2- 172.21.15.63:0/1048911241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 0x7fc08c072f10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0097c0 tx=0x7fc07c01c4a0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc091600640 1 -- 172.21.15.63:0/1048911241 shutdown_connections 2024-09-12T02:57:23.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc091600640 1 --2- 172.21.15.63:0/1048911241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 0x7fc08c073450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc091600640 1 --2- 172.21.15.63:0/1048911241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 0x7fc08c072f10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc091600640 1 -- 172.21.15.63:0/1048911241 >> 172.21.15.63:0/1048911241 conn(0x7fc08c06f3d0 msgr2=0x7fc08c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:23.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc091600640 1 -- 172.21.15.63:0/1048911241 shutdown_connections 2024-09-12T02:57:23.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.001+0000 7fc091600640 1 -- 172.21.15.63:0/1048911241 wait complete. 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 Processor -- start 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 -- start start 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc08c06fef0 0x7fc08c1f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 0x7fc08c0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 0x7fc08c14d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c0742b0 con 0x7fc08c151ad0 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c074130 con 0x7fc08c06fef0 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc08c1646a0 con 0x7fc08c0c9700 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 0x7fc08c14d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 0x7fc08c14d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:60158/0 (socket says 172.21.15.63:60158) 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08b400640 1 -- 172.21.15.63:0/4076221611 learned_addr learned my addr 172.21.15.63:0/4076221611 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:23.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08aa00640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc08c06fef0 0x7fc08c1f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc082000640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 0x7fc08c0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08b400640 1 -- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 msgr2=0x7fc08c0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08b400640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 0x7fc08c0b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08b400640 1 -- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc08c06fef0 msgr2=0x7fc08c1f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08b400640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc08c06fef0 0x7fc08c1f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08b400640 1 -- 172.21.15.63:0/4076221611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c0b0c90 con 0x7fc08c151ad0 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc08b400640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 0x7fc08c14d030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc08400c700 tx=0x7fc08400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc083400640 1 -- 172.21.15.63:0/4076221611 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc084018070 con 0x7fc08c151ad0 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc083400640 1 -- 172.21.15.63:0/4076221611 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08400ce10 con 0x7fc08c151ad0 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc083400640 1 -- 172.21.15.63:0/4076221611 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08400a820 con 0x7fc08c151ad0 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c153ff0 con 0x7fc08c151ad0 2024-09-12T02:57:23.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.005+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c0afc70 con 0x7fc08c151ad0 2024-09-12T02:57:23.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.009+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c0c6a10 con 0x7fc08c151ad0 2024-09-12T02:57:23.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.009+0000 7fc083400640 1 -- 172.21.15.63:0/4076221611 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc08401b070 con 0x7fc08c151ad0 2024-09-12T02:57:23.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.009+0000 7fc083400640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0680678f0 0x7fc068069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:23.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.009+0000 7fc083400640 1 -- 172.21.15.63:0/4076221611 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc084085460 con 0x7fc08c151ad0 2024-09-12T02:57:23.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.009+0000 7fc08aa00640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0680678f0 0x7fc068069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:23.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.013+0000 7fc08aa00640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0680678f0 0x7fc068069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0ad000 tx=0x7fc07c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:23.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.013+0000 7fc083400640 1 -- 172.21.15.63:0/4076221611 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc084055600 con 0x7fc08c151ad0 2024-09-12T02:57:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc08c145fc0 con 0x7fc08c151ad0 2024-09-12T02:57:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc083400640 1 -- 172.21.15.63:0/4076221611 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fc084059900 con 0x7fc08c151ad0 2024-09-12T02:57:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-12T02:57:23.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0680678f0 msgr2=0x7fc068069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0680678f0 0x7fc068069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0ad000 tx=0x7fc07c008040 comp rx=0 tx=0).stop 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 msgr2=0x7fc08c14d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 0x7fc08c14d030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc08400c700 tx=0x7fc08400cbc0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 shutdown_connections 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc08c151ad0 0x7fc08c14d030 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0680678f0 0x7fc068069db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc08c0c9700 0x7fc08c0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 --2- 172.21.15.63:0/4076221611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc08c06fef0 0x7fc08c1f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 >> 172.21.15.63:0/4076221611 conn(0x7fc08c06f3d0 msgr2=0x7fc08c156800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 shutdown_connections 2024-09-12T02:57:23.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:23.193+0000 7fc091600640 1 -- 172.21.15.63:0/4076221611 wait complete. 2024-09-12T02:57:23.217 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2024-09-12T02:57:23.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:23.218 DEBUG:teuthology.orchestra.run.smithi063:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:57:23.250 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[34815]: fuse finished with error 0 and tester_r 0 2024-09-12T02:57:23.253 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:57:29.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T02:57:29.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:29.355 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T02:57:29.377 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:57:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.565+0000 7f8420a00640 1 Processor -- start 2024-09-12T02:57:29.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8420a00640 1 -- start start 2024-09-12T02:57:29.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8420a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f841c154ca0 0x7f841c15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8420a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841c0cd0e0 con 0x7f841c0cd6a0 2024-09-12T02:57:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8420a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841c0cdc50 con 0x7f841c15af70 2024-09-12T02:57:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8420a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f841c15e8d0 con 0x7f841c154ca0 2024-09-12T02:57:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8419e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f841c154ca0 0x7f841c15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8419e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f841c154ca0 0x7f841c15aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34956/0 (socket says 172.21.15.63:34956) 2024-09-12T02:57:29.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8419e00640 1 -- 172.21.15.63:0/3939849617 learned_addr learned my addr 172.21.15.63:0/3939849617 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:29.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8419e00640 1 -- 172.21.15.63:0/3939849617 >> v1:172.21.15.119:6789/0 conn(0x7f841c15af70 legacy=0x7f841c06eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8419e00640 1 -- 172.21.15.63:0/3939849617 >> v1:172.21.15.63:6789/0 conn(0x7f841c0cd6a0 legacy=0x7f841c165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.569+0000 7f8419e00640 1 -- 172.21.15.63:0/3939849617 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c0cdf30 con 0x7f841c154ca0 2024-09-12T02:57:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8419e00640 1 --2- 172.21.15.63:0/3939849617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 0x7f841c15aa30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f840c009e50 tx=0x7f840c01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db29b165afe2b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8419400640 1 -- 172.21.15.63:0/3939849617 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0b4070 con 0x7f841c154ca0 2024-09-12T02:57:29.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8419400640 1 -- 172.21.15.63:0/3939849617 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0af400 con 0x7f841c154ca0 2024-09-12T02:57:29.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8419400640 1 -- 172.21.15.63:0/3939849617 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0af7d0 con 0x7f841c154ca0 2024-09-12T02:57:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8420a00640 1 -- 172.21.15.63:0/3939849617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 msgr2=0x7f841c15aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8420a00640 1 --2- 172.21.15.63:0/3939849617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 0x7f841c15aa30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f840c009e50 tx=0x7f840c01f210 comp rx=0 tx=0).stop 2024-09-12T02:57:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8420a00640 1 -- 172.21.15.63:0/3939849617 shutdown_connections 2024-09-12T02:57:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8420a00640 1 --2- 172.21.15.63:0/3939849617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 0x7f841c15aa30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8420a00640 1 -- 172.21.15.63:0/3939849617 >> 172.21.15.63:0/3939849617 conn(0x7f841c072960 msgr2=0x7f841c072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8420a00640 1 -- 172.21.15.63:0/3939849617 shutdown_connections 2024-09-12T02:57:29.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8420a00640 1 -- 172.21.15.63:0/3939849617 wait complete. 2024-09-12T02:57:29.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8420a00640 1 Processor -- start 2024-09-12T02:57:29.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.573+0000 7f8420a00640 1 -- start start 2024-09-12T02:57:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8420a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f841c0cd6a0 0x7f841c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8420a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 0x7f841c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8420a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841c15af70 0x7f841c0c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8420a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f841c15e560 con 0x7f841c154ca0 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8420a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f841c15e280 con 0x7f841c0cd6a0 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8420a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f841c0c8100 con 0x7f841c15af70 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8411400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 0x7f841c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8411400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 0x7f841c0cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34964/0 (socket says 172.21.15.63:34964) 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8411400640 1 -- 172.21.15.63:0/4121415028 learned_addr learned my addr 172.21.15.63:0/4121415028 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f841a800640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841c15af70 0x7f841c0c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8419e00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f841c0cd6a0 0x7f841c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8411400640 1 -- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841c15af70 msgr2=0x7f841c0c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8411400640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841c15af70 0x7f841c0c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8411400640 1 -- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f841c0cd6a0 msgr2=0x7f841c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8411400640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f841c0cd6a0 0x7f841c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8411400640 1 -- 172.21.15.63:0/4121415028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c0c6e50 con 0x7f841c154ca0 2024-09-12T02:57:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f841a800640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841c15af70 0x7f841c0c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8419e00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f841c0cd6a0 0x7f841c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8411400640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 0x7f841c0cc270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f840400c370 tx=0x7f840400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8412a00640 1 -- 172.21.15.63:0/4121415028 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84040052d0 con 0x7f841c154ca0 2024-09-12T02:57:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8412a00640 1 -- 172.21.15.63:0/4121415028 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8404005470 con 0x7f841c154ca0 2024-09-12T02:57:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c1f4410 con 0x7f841c154ca0 2024-09-12T02:57:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8412a00640 1 -- 172.21.15.63:0/4121415028 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404007260 con 0x7f841c154ca0 2024-09-12T02:57:29.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c15c940 con 0x7f841c154ca0 2024-09-12T02:57:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c0c74a0 con 0x7f841c154ca0 2024-09-12T02:57:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.577+0000 7f8412a00640 1 -- 172.21.15.63:0/4121415028 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8404007400 con 0x7f841c154ca0 2024-09-12T02:57:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.581+0000 7f8412a00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f80678c0 0x7f83f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.581+0000 7f8412a00640 1 -- 172.21.15.63:0/4121415028 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8404085420 con 0x7f841c154ca0 2024-09-12T02:57:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.581+0000 7f8419e00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f80678c0 0x7f83f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.581+0000 7f8419e00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f80678c0 0x7f83f8069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f840c0b1000 tx=0x7f840c0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:29.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.585+0000 7f8412a00640 1 -- 172.21.15.63:0/4121415028 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8404055c10 con 0x7f841c154ca0 2024-09-12T02:57:29.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f841c076300 con 0x7f841c154ca0 2024-09-12T02:57:29.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8412a00640 1 -- 172.21.15.63:0/4121415028 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18598 (secure 0 0 0) 0x7f8404055510 con 0x7f841c154ca0 2024-09-12T02:57:29.761 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:29.761 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:57:09.262695+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:57:29.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f80678c0 msgr2=0x7f83f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f80678c0 0x7f83f8069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f840c0b1000 tx=0x7f840c0aa000 comp rx=0 tx=0).stop 2024-09-12T02:57:29.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 msgr2=0x7f841c0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 0x7f841c0cc270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f840400c370 tx=0x7f840400c830 comp rx=0 tx=0).stop 2024-09-12T02:57:29.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 shutdown_connections 2024-09-12T02:57:29.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f80678c0 0x7f83f8069d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841c15af70 0x7f841c0c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f841c154ca0 0x7f841c0cc270 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.757+0000 7f8420a00640 1 --2- 172.21.15.63:0/4121415028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f841c0cd6a0 0x7f841c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.761+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 >> 172.21.15.63:0/4121415028 conn(0x7f841c072960 msgr2=0x7f841c06eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:29.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.761+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 shutdown_connections 2024-09-12T02:57:29.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.761+0000 7f8420a00640 1 -- 172.21.15.63:0/4121415028 wait complete. 2024-09-12T02:57:29.783 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:57:29.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbf200640 1 Processor -- start 2024-09-12T02:57:29.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbf200640 1 -- start start 2024-09-12T02:57:29.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbf200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cc0154b00 0x7f1cc00c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbf200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00cb670 0x7f1cc015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbf200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc015dec0 con 0x7f1cc00c8eb0 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbf200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc015ead0 con 0x7f1cc0154b00 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbf200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc015e1a0 con 0x7f1cc00cb670 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbde00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1cc0154b00 0x7f1cc00c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cb5400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1cc00c8eb0 0x7f1cc0071450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35228/0 (socket says 172.21.15.63:35228) 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cb5400640 1 -- 172.21.15.63:0/3075119176 learned_addr learned my addr 172.21.15.63:0/3075119176 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbe800640 1 --2- 172.21.15.63:0/3075119176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00cb670 0x7f1cc015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbde00640 1 -- 172.21.15.63:0/3075119176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00cb670 msgr2=0x7f1cc015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbde00640 1 --2- 172.21.15.63:0/3075119176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00cb670 0x7f1cc015a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbde00640 1 -- 172.21.15.63:0/3075119176 >> v1:172.21.15.63:6789/0 conn(0x7f1cc00c8eb0 legacy=0x7f1cc0071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbde00640 1 -- 172.21.15.63:0/3075119176 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc015e480 con 0x7f1cc0154b00 2024-09-12T02:57:29.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.921+0000 7f1cbd400640 1 -- 172.21.15.63:0/3075119176 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2752848735 0 0) 0x7f1cc015dec0 con 0x7f1cc00c8eb0 2024-09-12T02:57:29.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbde00640 1 --2- 172.21.15.63:0/3075119176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 0x7f1cc00c97c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1cc015ec50 tx=0x7f1cb001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cd53f1ff52d7cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:29.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbd400640 1 -- 172.21.15.63:0/3075119176 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00b5070 con 0x7f1cc0154b00 2024-09-12T02:57:29.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbd400640 1 -- 172.21.15.63:0/3075119176 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb00a8990 con 0x7f1cc0154b00 2024-09-12T02:57:29.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbd400640 1 -- 172.21.15.63:0/3075119176 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00a8d60 con 0x7f1cc0154b00 2024-09-12T02:57:29.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbf200640 1 -- 172.21.15.63:0/3075119176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 msgr2=0x7f1cc00c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbf200640 1 --2- 172.21.15.63:0/3075119176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 0x7f1cc00c97c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1cc015ec50 tx=0x7f1cb001ec90 comp rx=0 tx=0).stop 2024-09-12T02:57:29.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbf200640 1 -- 172.21.15.63:0/3075119176 shutdown_connections 2024-09-12T02:57:29.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbf200640 1 --2- 172.21.15.63:0/3075119176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00cb670 0x7f1cc015a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbf200640 1 --2- 172.21.15.63:0/3075119176 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 0x7f1cc00c97c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbf200640 1 -- 172.21.15.63:0/3075119176 >> 172.21.15.63:0/3075119176 conn(0x7f1cc006f6e0 msgr2=0x7f1cc006faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:29.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbf200640 1 -- 172.21.15.63:0/3075119176 shutdown_connections 2024-09-12T02:57:29.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.925+0000 7f1cbf200640 1 -- 172.21.15.63:0/3075119176 wait complete. 2024-09-12T02:57:29.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbf200640 1 Processor -- start 2024-09-12T02:57:29.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbf200640 1 -- start start 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbf200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00c8eb0 0x7f1cc015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbf200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cc00cb670 0x7f1cc00af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbf200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 0x7f1cc014a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbf200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc0071b60 con 0x7f1cc0154b00 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbf200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc00c8b70 con 0x7f1cc00cb670 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbf200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc0071ce0 con 0x7f1cc00c8eb0 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbe800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 0x7f1cc014a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbde00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00c8eb0 0x7f1cc015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbe800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 0x7f1cc014a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34992/0 (socket says 172.21.15.63:34992) 2024-09-12T02:57:29.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbe800640 1 -- 172.21.15.63:0/935283371 learned_addr learned my addr 172.21.15.63:0/935283371 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cb5400640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cc00cb670 0x7f1cc00af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbe800640 1 -- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00c8eb0 msgr2=0x7f1cc015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbe800640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00c8eb0 0x7f1cc015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbe800640 1 -- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cc00cb670 msgr2=0x7f1cc00af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbe800640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cc00cb670 0x7f1cc00af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbe800640 1 -- 172.21.15.63:0/935283371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc01e4100 con 0x7f1cc0154b00 2024-09-12T02:57:29.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cbe800640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 0x7f1cc014a8e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8007de0 tx=0x7f1cb800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cb6a00640 1 -- 172.21.15.63:0/935283371 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8014620 con 0x7f1cc0154b00 2024-09-12T02:57:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cb6a00640 1 -- 172.21.15.63:0/935283371 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb8019070 con 0x7f1cc0154b00 2024-09-12T02:57:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.929+0000 7f1cb6a00640 1 -- 172.21.15.63:0/935283371 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8014a20 con 0x7f1cc0154b00 2024-09-12T02:57:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.933+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc01e3b80 con 0x7f1cc0154b00 2024-09-12T02:57:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.933+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc0150bc0 con 0x7f1cc0154b00 2024-09-12T02:57:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.933+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc00c97c0 con 0x7f1cc0154b00 2024-09-12T02:57:29.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.933+0000 7f1cb6a00640 1 -- 172.21.15.63:0/935283371 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1cb8014bc0 con 0x7f1cc0154b00 2024-09-12T02:57:29.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.933+0000 7f1cb6a00640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c9c0678c0 0x7f1c9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:29.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.933+0000 7f1cb6a00640 1 -- 172.21.15.63:0/935283371 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1cb8086800 con 0x7f1cc0154b00 2024-09-12T02:57:29.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.933+0000 7f1cbde00640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c9c0678c0 0x7f1c9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:29.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.937+0000 7f1cbde00640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c9c0678c0 0x7f1c9c069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00b2000 tx=0x7f1cb0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:29.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:29.937+0000 7f1cb6a00640 1 -- 172.21.15.63:0/935283371 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1cb80569a0 con 0x7f1cc0154b00 2024-09-12T02:57:30.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.109+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cc006e290 con 0x7f1cc0154b00 2024-09-12T02:57:30.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.109+0000 7f1cb6a00640 1 -- 172.21.15.63:0/935283371 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18598 (secure 0 0 0) 0x7f1cb805aca0 con 0x7f1cc0154b00 2024-09-12T02:57:30.114 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:30.114 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:57:09.262695+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:57:30.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c9c0678c0 msgr2=0x7f1c9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c9c0678c0 0x7f1c9c069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00b2000 tx=0x7f1cb0008040 comp rx=0 tx=0).stop 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 msgr2=0x7f1cc014a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 0x7f1cc014a8e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8007de0 tx=0x7f1cb800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 shutdown_connections 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1cc0154b00 0x7f1cc014a8e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1cc00cb670 0x7f1cc00af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c9c0678c0 0x7f1c9c069d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 --2- 172.21.15.63:0/935283371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1cc00c8eb0 0x7f1cc015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 >> 172.21.15.63:0/935283371 conn(0x7f1cc006f6e0 msgr2=0x7f1cc015a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 shutdown_connections 2024-09-12T02:57:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.113+0000 7f1cbf200640 1 -- 172.21.15.63:0/935283371 wait complete. 2024-09-12T02:57:30.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:57:30.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ed7200640 1 Processor -- start 2024-09-12T02:57:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ed7200640 1 -- start start 2024-09-12T02:57:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ed7200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed0151a20 0x7f1ed0073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ed7200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ed00c9250 0x7f1ed00c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ed7200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed0073eb0 con 0x7f1ed00c8130 2024-09-12T02:57:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ed7200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed0074190 con 0x7f1ed00c9250 2024-09-12T02:57:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ed7200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed00717e0 con 0x7f1ed0151a20 2024-09-12T02:57:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ec7400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ed00c9250 0x7f1ed00c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ed5200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1ed00c8130 0x7f1ed00c2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35230/0 (socket says 172.21.15.63:35230) 2024-09-12T02:57:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ed5200640 1 -- 172.21.15.63:0/4218298458 learned_addr learned my addr 172.21.15.63:0/4218298458 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.277+0000 7f1ecfe00640 1 --2- 172.21.15.63:0/4218298458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed0151a20 0x7f1ed0073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:30.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ec7400640 1 -- 172.21.15.63:0/4218298458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed0151a20 msgr2=0x7f1ed0073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:30.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ec7400640 1 --2- 172.21.15.63:0/4218298458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed0151a20 0x7f1ed0073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ec7400640 1 -- 172.21.15.63:0/4218298458 >> v1:172.21.15.63:6789/0 conn(0x7f1ed00c8130 legacy=0x7f1ed00c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:30.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ec7400640 1 -- 172.21.15.63:0/4218298458 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed0071ac0 con 0x7f1ed00c9250 2024-09-12T02:57:30.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ecf400640 1 -- 172.21.15.63:0/4218298458 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476858426 0 0) 0x7f1ed0073eb0 con 0x7f1ed00c8130 2024-09-12T02:57:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ec7400640 1 --2- 172.21.15.63:0/4218298458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed00c9250 0x7f1ed00c7bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80097b0 tx=0x7f1eb801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f9f84d3c53e098 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ecf400640 1 -- 172.21.15.63:0/4218298458 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80b1070 con 0x7f1ed00c9250 2024-09-12T02:57:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ecf400640 1 -- 172.21.15.63:0/4218298458 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb80ac410 con 0x7f1ed00c9250 2024-09-12T02:57:30.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ecf400640 1 -- 172.21.15.63:0/4218298458 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb80ac7e0 con 0x7f1ed00c9250 2024-09-12T02:57:30.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ed7200640 1 -- 172.21.15.63:0/4218298458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed00c9250 msgr2=0x7f1ed00c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:30.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ed7200640 1 --2- 172.21.15.63:0/4218298458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed00c9250 0x7f1ed00c7bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80097b0 tx=0x7f1eb801c4a0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ed7200640 1 -- 172.21.15.63:0/4218298458 shutdown_connections 2024-09-12T02:57:30.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ed7200640 1 --2- 172.21.15.63:0/4218298458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed00c9250 0x7f1ed00c7bf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ed7200640 1 --2- 172.21.15.63:0/4218298458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed0151a20 0x7f1ed0073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ed7200640 1 -- 172.21.15.63:0/4218298458 >> 172.21.15.63:0/4218298458 conn(0x7f1ed006bcc0 msgr2=0x7f1ed006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:30.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.281+0000 7f1ed7200640 1 -- 172.21.15.63:0/4218298458 shutdown_connections 2024-09-12T02:57:30.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 -- 172.21.15.63:0/4218298458 wait complete. 2024-09-12T02:57:30.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 Processor -- start 2024-09-12T02:57:30.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 -- start start 2024-09-12T02:57:30.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00c8130 0x7f1ed00afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00c9250 0x7f1ed0147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed0151a20 0x7f1ed00b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed00c97f0 con 0x7f1ed0151a20 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed00c9670 con 0x7f1ed00c9250 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed0164860 con 0x7f1ed00c8130 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed5200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed0151a20 0x7f1ed00b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed5200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed0151a20 0x7f1ed00b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35014/0 (socket says 172.21.15.63:35014) 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed5200640 1 -- 172.21.15.63:0/3112735790 learned_addr learned my addr 172.21.15.63:0/3112735790 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ec7400640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00c9250 0x7f1ed0147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ecfe00640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00c8130 0x7f1ed00afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed5200640 1 -- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00c8130 msgr2=0x7f1ed00afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed5200640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00c8130 0x7f1ed00afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed5200640 1 -- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00c9250 msgr2=0x7f1ed0147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed5200640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00c9250 0x7f1ed0147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed5200640 1 -- 172.21.15.63:0/3112735790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed00b0320 con 0x7f1ed0151a20 2024-09-12T02:57:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ec7400640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00c9250 0x7f1ed0147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed5200640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed0151a20 0x7f1ed00b1300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c700 tx=0x7f1ec800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:30.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1eccc00640 1 -- 172.21.15.63:0/3112735790 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8018070 con 0x7f1ed0151a20 2024-09-12T02:57:30.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1eccc00640 1 -- 172.21.15.63:0/3112735790 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec800ce10 con 0x7f1ed0151a20 2024-09-12T02:57:30.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1eccc00640 1 -- 172.21.15.63:0/3112735790 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800a860 con 0x7f1ed0151a20 2024-09-12T02:57:30.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.285+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed00b0b40 con 0x7f1ed0151a20 2024-09-12T02:57:30.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.289+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed00af120 con 0x7f1ed0151a20 2024-09-12T02:57:30.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.289+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed00c7bf0 con 0x7f1ed0151a20 2024-09-12T02:57:30.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.289+0000 7f1eccc00640 1 -- 172.21.15.63:0/3112735790 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ec800aa00 con 0x7f1ed0151a20 2024-09-12T02:57:30.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.289+0000 7f1eccc00640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1eac0678f0 0x7f1eac069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:30.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.289+0000 7f1eccc00640 1 -- 172.21.15.63:0/3112735790 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1ec80853f0 con 0x7f1ed0151a20 2024-09-12T02:57:30.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.289+0000 7f1ecfe00640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1eac0678f0 0x7f1eac069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:30.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.293+0000 7f1ecfe00640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1eac0678f0 0x7f1eac069db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b9d0 tx=0x7f1ec0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:30.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.293+0000 7f1eccc00640 1 -- 172.21.15.63:0/3112735790 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1ec8055c80 con 0x7f1ed0151a20 2024-09-12T02:57:30.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.497+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f1ed00c1240 con 0x7f1ed0151a20 2024-09-12T02:57:30.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1eccc00640 1 -- 172.21.15.63:0/3112735790 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f1ec8055580 con 0x7f1ed0151a20 2024-09-12T02:57:30.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1eac0678f0 msgr2=0x7f1eac069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1eac0678f0 0x7f1eac069db0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b9d0 tx=0x7f1ec0008040 comp rx=0 tx=0).stop 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed0151a20 msgr2=0x7f1ed00b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed0151a20 0x7f1ed00b1300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800c700 tx=0x7f1ec800cbc0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 shutdown_connections 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ed0151a20 0x7f1ed00b1300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ed00c9250 0x7f1ed0147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1eac0678f0 0x7f1eac069db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 --2- 172.21.15.63:0/3112735790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ed00c8130 0x7f1ed00afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 >> 172.21.15.63:0/3112735790 conn(0x7f1ed006bcc0 msgr2=0x7f1ed0155980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 shutdown_connections 2024-09-12T02:57:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:30.949+0000 7f1ed7200640 1 -- 172.21.15.63:0/3112735790 wait complete. 2024-09-12T02:57:30.975 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-09-12T02:57:30.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T02:57:31.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d5bc00640 1 Processor -- start 2024-09-12T02:57:31.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d5bc00640 1 -- start start 2024-09-12T02:57:31.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d5bc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3d541621a0 0x7f3d54164590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:31.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d5bc00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d540c7460 con 0x7f3d5406df60 2024-09-12T02:57:31.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d5bc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d540c7d20 con 0x7f3d54152760 2024-09-12T02:57:31.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d5bc00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f3d54159340 con 0x7f3d541621a0 2024-09-12T02:57:31.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d53e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3d5406df60 0x7f3d5406bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35236/0 (socket says 172.21.15.63:35236) 2024-09-12T02:57:31.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d53e00640 1 -- 172.21.15.63:0/1327191149 learned_addr learned my addr 172.21.15.63:0/1327191149 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:31.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d59c00640 1 --2- 172.21.15.63:0/1327191149 >> v2:172.21.15.119:3300/0 conn(0x7f3d541621a0 0x7f3d54164590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:31.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d53400640 1 -- 172.21.15.63:0/1327191149 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092957017 0 0) 0x7f3d540c7460 con 0x7f3d5406df60 2024-09-12T02:57:31.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d53400640 1 -- 172.21.15.63:0/1327191149 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d38003530 con 0x7f3d5406df60 2024-09-12T02:57:31.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d53400640 1 -- 172.21.15.63:0/1327191149 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1269277278 0 0) 0x7f3d540c7d20 con 0x7f3d54152760 2024-09-12T02:57:31.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d53400640 1 -- 172.21.15.63:0/1327191149 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d540c7460 con 0x7f3d54152760 2024-09-12T02:57:31.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d59c00640 1 -- 172.21.15.63:0/1327191149 >> v1:172.21.15.119:6789/0 conn(0x7f3d54152760 legacy=0x7f3d540c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:31.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d53400640 1 -- 172.21.15.63:0/1327191149 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1515036438 0 0) 0x7f3d38003530 con 0x7f3d5406df60 2024-09-12T02:57:31.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d59c00640 1 -- 172.21.15.63:0/1327191149 >> v1:172.21.15.63:6789/0 conn(0x7f3d5406df60 legacy=0x7f3d5406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:31.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.117+0000 7f3d59c00640 1 -- 172.21.15.63:0/1327191149 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d54158a10 con 0x7f3d541621a0 2024-09-12T02:57:31.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d59c00640 1 --2- 172.21.15.63:0/1327191149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d541621a0 0x7f3d54164590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009d90 tx=0x7f3d4c01f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccc63cbe22662b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:31.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d53400640 1 -- 172.21.15.63:0/1327191149 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0b5070 con 0x7f3d541621a0 2024-09-12T02:57:31.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d53400640 1 -- 172.21.15.63:0/1327191149 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c0a8c10 con 0x7f3d541621a0 2024-09-12T02:57:31.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d53400640 1 -- 172.21.15.63:0/1327191149 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400016a0 con 0x7f3d541621a0 2024-09-12T02:57:31.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d5bc00640 1 -- 172.21.15.63:0/1327191149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d541621a0 msgr2=0x7f3d54164590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:31.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d5bc00640 1 --2- 172.21.15.63:0/1327191149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d541621a0 0x7f3d54164590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009d90 tx=0x7f3d4c01f080 comp rx=0 tx=0).stop 2024-09-12T02:57:31.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d5bc00640 1 -- 172.21.15.63:0/1327191149 shutdown_connections 2024-09-12T02:57:31.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d5bc00640 1 --2- 172.21.15.63:0/1327191149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d541621a0 0x7f3d54164590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:31.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d5bc00640 1 -- 172.21.15.63:0/1327191149 >> 172.21.15.63:0/1327191149 conn(0x7f3d54070470 msgr2=0x7f3d54070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:31.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d5bc00640 1 -- 172.21.15.63:0/1327191149 shutdown_connections 2024-09-12T02:57:31.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.121+0000 7f3d5bc00640 1 -- 172.21.15.63:0/1327191149 wait complete. 2024-09-12T02:57:31.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 Processor -- start 2024-09-12T02:57:31.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 -- start start 2024-09-12T02:57:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406df60 0x7f3d541f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d54152760 0x7f3d541514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:31.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d541621a0 0x7f3d540cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d54158fd0 con 0x7f3d541621a0 2024-09-12T02:57:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d540c8000 con 0x7f3d5406df60 2024-09-12T02:57:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f3d540c79e0 con 0x7f3d54152760 2024-09-12T02:57:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d541621a0 0x7f3d540cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d541621a0 0x7f3d540cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35028/0 (socket says 172.21.15.63:35028) 2024-09-12T02:57:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59c00640 1 -- 172.21.15.63:0/902934236 learned_addr learned my addr 172.21.15.63:0/902934236 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59200640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406df60 0x7f3d541f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d53e00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d54152760 0x7f3d541514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59c00640 1 -- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d54152760 msgr2=0x7f3d541514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59c00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d54152760 0x7f3d541514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59c00640 1 -- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406df60 msgr2=0x7f3d541f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59c00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406df60 0x7f3d541f1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59c00640 1 -- 172.21.15.63:0/902934236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5415c8c0 con 0x7f3d541621a0 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d59c00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d541621a0 0x7f3d540cd610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c0b3040 tx=0x7f3d4c01be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d50c00640 1 -- 172.21.15.63:0/902934236 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0b5040 con 0x7f3d541621a0 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d50c00640 1 -- 172.21.15.63:0/902934236 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c0b0aa0 con 0x7f3d541621a0 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d50c00640 1 -- 172.21.15.63:0/902934236 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c009450 con 0x7f3d541621a0 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d541f05a0 con 0x7f3d541621a0 2024-09-12T02:57:31.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d540c5c40 con 0x7f3d541621a0 2024-09-12T02:57:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.125+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d54152b40 con 0x7f3d541621a0 2024-09-12T02:57:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.129+0000 7f3d50c00640 1 -- 172.21.15.63:0/902934236 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d4c0c4020 con 0x7f3d541621a0 2024-09-12T02:57:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.129+0000 7f3d50c00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:31.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.129+0000 7f3d50c00640 1 -- 172.21.15.63:0/902934236 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3d4c123d80 con 0x7f3d541621a0 2024-09-12T02:57:31.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.129+0000 7f3d59200640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:31.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.129+0000 7f3d59200640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d440017c0 tx=0x7f3d44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:31.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.133+0000 7f3d50c00640 1 -- 172.21.15.63:0/902934236 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d4c0cb020 con 0x7f3d541621a0 2024-09-12T02:57:31.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.333+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3d5406c5a0 con 0x7f3d541621a0 2024-09-12T02:57:31.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.953+0000 7f3d50c00640 1 -- 172.21.15.63:0/902934236 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f3d541f05a0 con 0x7f3d541621a0 2024-09-12T02:57:31.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 msgr2=0x7f3d34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:31.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d440017c0 tx=0x7f3d44009040 comp rx=0 tx=0).stop 2024-09-12T02:57:31.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d541621a0 msgr2=0x7f3d540cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:31.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d541621a0 0x7f3d540cd610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c0b3040 tx=0x7f3d4c01be20 comp rx=0 tx=0).stop 2024-09-12T02:57:31.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 shutdown_connections 2024-09-12T02:57:31.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d541621a0 0x7f3d540cd610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:31.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:31.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d54152760 0x7f3d541514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:31.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 --2- 172.21.15.63:0/902934236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406df60 0x7f3d541f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:31.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.957+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 >> 172.21.15.63:0/902934236 conn(0x7f3d54070470 msgr2=0x7f3d540c94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:31.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.961+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 shutdown_connections 2024-09-12T02:57:31.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:31.961+0000 7f3d5bc00640 1 -- 172.21.15.63:0/902934236 wait complete. 2024-09-12T02:57:31.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-12T02:57:32.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.129+0000 7f7bd9800640 1 Processor -- start 2024-09-12T02:57:32.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd9800640 1 -- start start 2024-09-12T02:57:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd9800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7bd4151a20 0x7f7bd4073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd9800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7bd40c2080 0x7f7bd40c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd9800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd4073eb0 con 0x7f7bd40c9250 2024-09-12T02:57:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd9800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd4074190 con 0x7f7bd40c2080 2024-09-12T02:57:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd9800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd40717e0 con 0x7f7bd4151a20 2024-09-12T02:57:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bca000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7bd40c9250 0x7f7bd40c7bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35238/0 (socket says 172.21.15.63:35238) 2024-09-12T02:57:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bca000640 1 -- 172.21.15.63:0/1578067893 learned_addr learned my addr 172.21.15.63:0/1578067893 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd3400640 1 --2- 172.21.15.63:0/1578067893 >> v2:172.21.15.63:3300/0 conn(0x7f7bd40c2080 0x7f7bd40c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd2a00640 1 --2- 172.21.15.63:0/1578067893 >> v2:172.21.15.119:3300/0 conn(0x7f7bd4151a20 0x7f7bd4073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd2000640 1 -- 172.21.15.63:0/1578067893 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829800826 0 0) 0x7f7bd4073eb0 con 0x7f7bd40c9250 2024-09-12T02:57:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd2000640 1 -- 172.21.15.63:0/1578067893 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bb8003530 con 0x7f7bd40c9250 2024-09-12T02:57:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd3400640 1 -- 172.21.15.63:0/1578067893 >> v2:172.21.15.119:3300/0 conn(0x7f7bd4151a20 msgr2=0x7f7bd4073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd3400640 1 --2- 172.21.15.63:0/1578067893 >> v2:172.21.15.119:3300/0 conn(0x7f7bd4151a20 0x7f7bd4073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd3400640 1 -- 172.21.15.63:0/1578067893 >> v1:172.21.15.63:6789/0 conn(0x7f7bd40c9250 legacy=0x7f7bd40c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.133+0000 7f7bd3400640 1 -- 172.21.15.63:0/1578067893 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd4071ac0 con 0x7f7bd40c2080 2024-09-12T02:57:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd3400640 1 --2- 172.21.15.63:0/1578067893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd40c2080 0x7f7bd40c2460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40c87e0 tx=0x7f7bcc01d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea445a2d31eada71 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd2000640 1 -- 172.21.15.63:0/1578067893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0b2070 con 0x7f7bd40c2080 2024-09-12T02:57:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd2000640 1 -- 172.21.15.63:0/1578067893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bcc0a5a10 con 0x7f7bd40c2080 2024-09-12T02:57:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd2000640 1 -- 172.21.15.63:0/1578067893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0a5de0 con 0x7f7bd40c2080 2024-09-12T02:57:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 -- 172.21.15.63:0/1578067893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd40c2080 msgr2=0x7f7bd40c2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 --2- 172.21.15.63:0/1578067893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd40c2080 0x7f7bd40c2460 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40c87e0 tx=0x7f7bcc01d390 comp rx=0 tx=0).stop 2024-09-12T02:57:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 -- 172.21.15.63:0/1578067893 shutdown_connections 2024-09-12T02:57:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 --2- 172.21.15.63:0/1578067893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd40c2080 0x7f7bd40c2460 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 --2- 172.21.15.63:0/1578067893 >> v2:172.21.15.119:3300/0 conn(0x7f7bd4151a20 0x7f7bd4073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 -- 172.21.15.63:0/1578067893 >> 172.21.15.63:0/1578067893 conn(0x7f7bd406bcc0 msgr2=0x7f7bd406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 -- 172.21.15.63:0/1578067893 shutdown_connections 2024-09-12T02:57:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 -- 172.21.15.63:0/1578067893 wait complete. 2024-09-12T02:57:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 Processor -- start 2024-09-12T02:57:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.137+0000 7f7bd9800640 1 -- start start 2024-09-12T02:57:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd9800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd40c2080 0x7f7bd41f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd9800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd40c9250 0x7f7bd41f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd9800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd4151a20 0x7f7bd40b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd9800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd40c31c0 con 0x7f7bd4151a20 2024-09-12T02:57:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd9800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd40c3040 con 0x7f7bd40c9250 2024-09-12T02:57:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd9800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd40c8300 con 0x7f7bd40c2080 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd4151a20 0x7f7bd40b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd4151a20 0x7f7bd40b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35050/0 (socket says 172.21.15.63:35050) 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd3400640 1 -- 172.21.15.63:0/4252655212 learned_addr learned my addr 172.21.15.63:0/4252655212 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd2a00640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd40c2080 0x7f7bd41f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bca000640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd40c9250 0x7f7bd41f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd3400640 1 -- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd40c2080 msgr2=0x7f7bd41f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd3400640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd40c2080 0x7f7bd41f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd3400640 1 -- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd40c9250 msgr2=0x7f7bd41f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd3400640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd40c9250 0x7f7bd41f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd3400640 1 -- 172.21.15.63:0/4252655212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd40ccf50 con 0x7f7bd4151a20 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bca000640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd40c9250 0x7f7bd41f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd3400640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd4151a20 0x7f7bd40b0df0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0b0040 tx=0x7f7bcc0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bcb400640 1 -- 172.21.15.63:0/4252655212 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0bc030 con 0x7f7bd4151a20 2024-09-12T02:57:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bcb400640 1 -- 172.21.15.63:0/4252655212 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bcc0ad440 con 0x7f7bd4151a20 2024-09-12T02:57:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bcb400640 1 -- 172.21.15.63:0/4252655212 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0b2040 con 0x7f7bd4151a20 2024-09-12T02:57:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd40c6450 con 0x7f7bd4151a20 2024-09-12T02:57:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd40ccc70 con 0x7f7bd4151a20 2024-09-12T02:57:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.141+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd40c9660 con 0x7f7bd4151a20 2024-09-12T02:57:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.145+0000 7f7bcb400640 1 -- 172.21.15.63:0/4252655212 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7bcc0bf070 con 0x7f7bd4151a20 2024-09-12T02:57:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.145+0000 7f7bcb400640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7bb00678f0 0x7f7bb0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.145+0000 7f7bcb400640 1 -- 172.21.15.63:0/4252655212 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7bcc11fff0 con 0x7f7bd4151a20 2024-09-12T02:57:32.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.145+0000 7f7bd2a00640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7bb00678f0 0x7f7bb0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:32.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.145+0000 7f7bd2a00640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7bb00678f0 0x7f7bb0069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009b60 tx=0x7f7bc4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:32.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.149+0000 7f7bcb400640 1 -- 172.21.15.63:0/4252655212 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7bcc016520 con 0x7f7bd4151a20 2024-09-12T02:57:32.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.349+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7bd4156f60 con 0x7f7bd4151a20 2024-09-12T02:57:32.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:57:32.785 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:57:32.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.957+0000 7f7bcb400640 1 -- 172.21.15.63:0/4252655212 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f7bcc0f0820 con 0x7f7bd4151a20 2024-09-12T02:57:33.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7bb00678f0 msgr2=0x7f7bb0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7bb00678f0 0x7f7bb0069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009b60 tx=0x7f7bc4009190 comp rx=0 tx=0).stop 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd4151a20 msgr2=0x7f7bd40b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd4151a20 0x7f7bd40b0df0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0b0040 tx=0x7f7bcc0196d0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 shutdown_connections 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bd4151a20 0x7f7bd40b0df0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bd40c9250 0x7f7bd41f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7bb00678f0 0x7f7bb0069db0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 --2- 172.21.15.63:0/4252655212 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bd40c2080 0x7f7bd41f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 >> 172.21.15.63:0/4252655212 conn(0x7f7bd406bcc0 msgr2=0x7f7bd40c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 shutdown_connections 2024-09-12T02:57:33.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:32.961+0000 7f7bd9800640 1 -- 172.21.15.63:0/4252655212 wait complete. 2024-09-12T02:57:33.102 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T02:57:33.102 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:57:33.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff394200640 1 Processor -- start 2024-09-12T02:57:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff394200640 1 -- start start 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff394200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff38c154c90 0x7ff38c0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff394200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff38c15b5c0 0x7ff38c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff394200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff38c155070 con 0x7ff38c06ec90 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff394200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff38c15b130 con 0x7ff38c154c90 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff394200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff38c0c36b0 con 0x7ff38c15b5c0 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff391800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff38c154c90 0x7ff38c0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff391800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff38c154c90 0x7ff38c0c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38958/0 (socket says 172.21.15.63:38958) 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff391800640 1 -- 172.21.15.63:0/2899367741 learned_addr learned my addr 172.21.15.63:0/2899367741 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff392200640 1 --2- 172.21.15.63:0/2899367741 >> v2:172.21.15.119:3300/0 conn(0x7ff38c15b5c0 0x7ff38c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff391800640 1 -- 172.21.15.63:0/2899367741 >> v2:172.21.15.119:3300/0 conn(0x7ff38c15b5c0 msgr2=0x7ff38c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff391800640 1 --2- 172.21.15.63:0/2899367741 >> v2:172.21.15.119:3300/0 conn(0x7ff38c15b5c0 0x7ff38c06cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff391800640 1 -- 172.21.15.63:0/2899367741 >> v1:172.21.15.63:6789/0 conn(0x7ff38c06ec90 legacy=0x7ff38c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.249+0000 7ff391800640 1 -- 172.21.15.63:0/2899367741 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38c0c8bf0 con 0x7ff38c154c90 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff391800640 1 --2- 172.21.15.63:0/2899367741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c154c90 0x7ff38c0c3170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0c54b0 tx=0x7ff38001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dcac6a7c06ae37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff38be00640 1 -- 172.21.15.63:0/2899367741 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3800b5070 con 0x7ff38c154c90 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff38be00640 1 -- 172.21.15.63:0/2899367741 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3800a8a10 con 0x7ff38c154c90 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff38be00640 1 -- 172.21.15.63:0/2899367741 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3800a8de0 con 0x7ff38c154c90 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff394200640 1 -- 172.21.15.63:0/2899367741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c154c90 msgr2=0x7ff38c0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff394200640 1 --2- 172.21.15.63:0/2899367741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c154c90 0x7ff38c0c3170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0c54b0 tx=0x7ff38001ed10 comp rx=0 tx=0).stop 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff394200640 1 -- 172.21.15.63:0/2899367741 shutdown_connections 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff394200640 1 --2- 172.21.15.63:0/2899367741 >> v2:172.21.15.119:3300/0 conn(0x7ff38c15b5c0 0x7ff38c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff394200640 1 --2- 172.21.15.63:0/2899367741 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c154c90 0x7ff38c0c3170 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff394200640 1 -- 172.21.15.63:0/2899367741 >> 172.21.15.63:0/2899367741 conn(0x7ff38c06bcc0 msgr2=0x7ff38c06fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff394200640 1 -- 172.21.15.63:0/2899367741 shutdown_connections 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff394200640 1 -- 172.21.15.63:0/2899367741 wait complete. 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.253+0000 7ff394200640 1 Processor -- start 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 -- start start 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff38c06ec90 0x7ff38c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff38c154c90 0x7ff38c1e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c15b5c0 0x7ff38c0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff38c15aae0 con 0x7ff38c15b5c0 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff38c0c91b0 con 0x7ff38c154c90 2024-09-12T02:57:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff38c15adc0 con 0x7ff38c06ec90 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff392200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c15b5c0 0x7ff38c0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff392200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c15b5c0 0x7ff38c0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38968/0 (socket says 172.21.15.63:38968) 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff392200640 1 -- 172.21.15.63:0/3792694113 learned_addr learned my addr 172.21.15.63:0/3792694113 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff391800640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff38c06ec90 0x7ff38c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff390e00640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff38c154c90 0x7ff38c1e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff392200640 1 -- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff38c06ec90 msgr2=0x7ff38c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff392200640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff38c06ec90 0x7ff38c0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff392200640 1 -- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff38c154c90 msgr2=0x7ff38c1e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff392200640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff38c154c90 0x7ff38c1e7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff392200640 1 -- 172.21.15.63:0/3792694113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38c1f3ea0 con 0x7ff38c15b5c0 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff390e00640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff38c154c90 0x7ff38c1e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff392200640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c15b5c0 0x7ff38c0c9bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff384007e90 tx=0x7ff38400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff389600640 1 -- 172.21.15.63:0/3792694113 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384014420 con 0x7ff38c15b5c0 2024-09-12T02:57:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff389600640 1 -- 172.21.15.63:0/3792694113 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff384019070 con 0x7ff38c15b5c0 2024-09-12T02:57:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38c1f0a10 con 0x7ff38c15b5c0 2024-09-12T02:57:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff389600640 1 -- 172.21.15.63:0/3792694113 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384014800 con 0x7ff38c15b5c0 2024-09-12T02:57:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38c1f0fd0 con 0x7ff38c15b5c0 2024-09-12T02:57:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.257+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38c1f1300 con 0x7ff38c15b5c0 2024-09-12T02:57:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.261+0000 7ff389600640 1 -- 172.21.15.63:0/3792694113 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3840149a0 con 0x7ff38c15b5c0 2024-09-12T02:57:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.261+0000 7ff389600640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff36c0678c0 0x7ff36c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.261+0000 7ff389600640 1 -- 172.21.15.63:0/3792694113 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff384086800 con 0x7ff38c15b5c0 2024-09-12T02:57:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.261+0000 7ff391800640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff36c0678c0 0x7ff36c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.261+0000 7ff391800640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff36c0678c0 0x7ff36c069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3800b2000 tx=0x7ff380009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.265+0000 7ff389600640 1 -- 172.21.15.63:0/3792694113 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff384056f60 con 0x7ff38c15b5c0 2024-09-12T02:57:33.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.465+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff38c06c6d0 con 0x7ff38c15b5c0 2024-09-12T02:57:33.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff389600640 1 -- 172.21.15.63:0/3792694113 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6879 (secure 0 0 0) 0x7ff384056860 con 0x7ff38c15b5c0 2024-09-12T02:57:33.471 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:33.471 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"btime":"2024-09-12T02:57:32:959110+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:32.355543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-12T02:57:33.472 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 10 2024-09-12T02:57:33.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff36c0678c0 msgr2=0x7ff36c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff36c0678c0 0x7ff36c069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3800b2000 tx=0x7ff380009040 comp rx=0 tx=0).stop 2024-09-12T02:57:33.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c15b5c0 msgr2=0x7ff38c0c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c15b5c0 0x7ff38c0c9bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff384007e90 tx=0x7ff38400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 shutdown_connections 2024-09-12T02:57:33.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff38c15b5c0 0x7ff38c0c9bf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff38c154c90 0x7ff38c1e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff36c0678c0 0x7ff36c069d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 --2- 172.21.15.63:0/3792694113 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff38c06ec90 0x7ff38c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 >> 172.21.15.63:0/3792694113 conn(0x7ff38c06bcc0 msgr2=0x7ff38c14fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 shutdown_connections 2024-09-12T02:57:33.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.469+0000 7ff394200640 1 -- 172.21.15.63:0/3792694113 wait complete. 2024-09-12T02:57:33.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:57:33.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.629+0000 7f5cb6a00640 1 Processor -- start 2024-09-12T02:57:33.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.629+0000 7f5cb6a00640 1 -- start start 2024-09-12T02:57:33.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.629+0000 7f5cb6a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5cb00c9380 0x7f5cb00c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.629+0000 7f5cb6a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb0071590 con 0x7f5cb0152a70 2024-09-12T02:57:33.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.629+0000 7f5cb6a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cb0071830 con 0x7f5cb00ced50 2024-09-12T02:57:33.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.629+0000 7f5cb6a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f5cb0071b10 con 0x7f5cb00c9380 2024-09-12T02:57:33.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.629+0000 7f5cafe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5cb0152a70 0x7f5cb0158820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56328/0 (socket says 172.21.15.63:56328) 2024-09-12T02:57:33.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.629+0000 7f5cafe00640 1 -- 172.21.15.63:0/3151154843 learned_addr learned my addr 172.21.15.63:0/3151154843 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:33.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.629+0000 7f5ca7400640 1 --2- 172.21.15.63:0/3151154843 >> v2:172.21.15.63:3300/0 conn(0x7f5cb00c9380 0x7f5cb00c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5ca7400640 1 -- 172.21.15.63:0/3151154843 >> v1:172.21.15.119:6789/0 conn(0x7f5cb00ced50 legacy=0x7f5cb01630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5ca7400640 1 -- 172.21.15.63:0/3151154843 >> v1:172.21.15.63:6789/0 conn(0x7f5cb0152a70 legacy=0x7f5cb0158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5caf400640 1 -- 172.21.15.63:0/3151154843 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683412854 0 0) 0x7f5cb0071590 con 0x7f5cb0152a70 2024-09-12T02:57:33.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5ca7400640 1 -- 172.21.15.63:0/3151154843 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb0071df0 con 0x7f5cb00c9380 2024-09-12T02:57:33.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5ca7400640 1 --2- 172.21.15.63:0/3151154843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb00c9380 0x7f5cb00c3170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c980097c0 tx=0x7f5c9801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3632b7581e7bc254 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5caf400640 1 -- 172.21.15.63:0/3151154843 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c980b5070 con 0x7f5cb00c9380 2024-09-12T02:57:33.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5caf400640 1 -- 172.21.15.63:0/3151154843 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c980a8990 con 0x7f5cb00c9380 2024-09-12T02:57:33.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5caf400640 1 -- 172.21.15.63:0/3151154843 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c980a8d60 con 0x7f5cb00c9380 2024-09-12T02:57:33.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5cb6a00640 1 -- 172.21.15.63:0/3151154843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb00c9380 msgr2=0x7f5cb00c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.633+0000 7f5cb6a00640 1 --2- 172.21.15.63:0/3151154843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb00c9380 0x7f5cb00c3170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c980097c0 tx=0x7f5c9801ec90 comp rx=0 tx=0).stop 2024-09-12T02:57:33.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 -- 172.21.15.63:0/3151154843 shutdown_connections 2024-09-12T02:57:33.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 --2- 172.21.15.63:0/3151154843 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb00c9380 0x7f5cb00c3170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 -- 172.21.15.63:0/3151154843 >> 172.21.15.63:0/3151154843 conn(0x7f5cb006bcc0 msgr2=0x7f5cb006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 -- 172.21.15.63:0/3151154843 shutdown_connections 2024-09-12T02:57:33.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 -- 172.21.15.63:0/3151154843 wait complete. 2024-09-12T02:57:33.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 Processor -- start 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 -- start start 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cb00c9380 0x7f5cb00c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cb00ced50 0x7f5cb01f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb0152a70 0x7f5cb014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb00ce830 con 0x7f5cb0152a70 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb00ce550 con 0x7f5cb00c9380 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb6a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb0152e50 con 0x7f5cb00ced50 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb0152a70 0x7f5cb014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb0152a70 0x7f5cb014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38978/0 (socket says 172.21.15.63:38978) 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb4a00640 1 -- 172.21.15.63:0/2404743183 learned_addr learned my addr 172.21.15.63:0/2404743183 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:33.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cafe00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cb00c9380 0x7f5cb00c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5ca7400640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cb00ced50 0x7f5cb01f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb4a00640 1 -- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cb00ced50 msgr2=0x7f5cb01f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb4a00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cb00ced50 0x7f5cb01f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb4a00640 1 -- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cb00c9380 msgr2=0x7f5cb00c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb4a00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cb00c9380 0x7f5cb00c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb4a00640 1 -- 172.21.15.63:0/2404743183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb0157f60 con 0x7f5cb0152a70 2024-09-12T02:57:33.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cb4a00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb0152a70 0x7f5cb014d210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800c760 tx=0x7f5ca800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.637+0000 7f5cacc00640 1 -- 172.21.15.63:0/2404743183 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8003b80 con 0x7f5cb0152a70 2024-09-12T02:57:33.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.641+0000 7f5cacc00640 1 -- 172.21.15.63:0/2404743183 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca8003d20 con 0x7f5cb0152a70 2024-09-12T02:57:33.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.641+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cb0158240 con 0x7f5cb0152a70 2024-09-12T02:57:33.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.641+0000 7f5cacc00640 1 -- 172.21.15.63:0/2404743183 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca800aa30 con 0x7f5cb0152a70 2024-09-12T02:57:33.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.641+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cb01f3c90 con 0x7f5cb0152a70 2024-09-12T02:57:33.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.641+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cb006c6d0 con 0x7f5cb0152a70 2024-09-12T02:57:33.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.641+0000 7f5cacc00640 1 -- 172.21.15.63:0/2404743183 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5ca800abd0 con 0x7f5cb0152a70 2024-09-12T02:57:33.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.641+0000 7f5cacc00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c8c0678c0 0x7f5c8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.641+0000 7f5cacc00640 1 -- 172.21.15.63:0/2404743183 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5ca8085da0 con 0x7f5cb0152a70 2024-09-12T02:57:33.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.641+0000 7f5cafe00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c8c0678c0 0x7f5c8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.645+0000 7f5cafe00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c8c0678c0 0x7f5c8c069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0000f70 tx=0x7f5ca0007240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.645+0000 7f5cacc00640 1 -- 172.21.15.63:0/2404743183 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5ca8055eb0 con 0x7f5cb0152a70 2024-09-12T02:57:33.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.813+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5cb00c8b50 con 0x7f5cb0152a70 2024-09-12T02:57:33.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cacc00640 1 -- 172.21.15.63:0/2404743183 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18598 (secure 0 0 0) 0x7f5ca805a1b0 con 0x7f5cb0152a70 2024-09-12T02:57:33.819 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:33.819 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:57:09.262695+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:57:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c8c0678c0 msgr2=0x7f5c8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c8c0678c0 0x7f5c8c069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0000f70 tx=0x7f5ca0007240 comp rx=0 tx=0).stop 2024-09-12T02:57:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb0152a70 msgr2=0x7f5cb014d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb0152a70 0x7f5cb014d210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800c760 tx=0x7f5ca800cc20 comp rx=0 tx=0).stop 2024-09-12T02:57:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 shutdown_connections 2024-09-12T02:57:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5cb0152a70 0x7f5cb014d210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c8c0678c0 0x7f5c8c069d80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cb00ced50 0x7f5cb01f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 --2- 172.21.15.63:0/2404743183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cb00c9380 0x7f5cb00c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 >> 172.21.15.63:0/2404743183 conn(0x7f5cb006bcc0 msgr2=0x7f5cb006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 shutdown_connections 2024-09-12T02:57:33.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.817+0000 7f5cb6a00640 1 -- 172.21.15.63:0/2404743183 wait complete. 2024-09-12T02:57:33.840 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:57:33.840 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:57:33.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.977+0000 7f9e59000640 1 Processor -- start 2024-09-12T02:57:33.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.977+0000 7f9e59000640 1 -- start start 2024-09-12T02:57:33.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e59000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9e54154c90 0x7f9e540c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e59000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e5406ec90 0x7f9e540ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e59000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e54155070 con 0x7f9e5415b5c0 2024-09-12T02:57:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e59000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f9e5415b130 con 0x7f9e5406ec90 2024-09-12T02:57:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e59000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9e540c36b0 con 0x7f9e54154c90 2024-09-12T02:57:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e49400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e5406ec90 0x7f9e540ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e49400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9e5406ec90 0x7f9e540ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38990/0 (socket says 172.21.15.63:38990) 2024-09-12T02:57:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e49400640 1 -- 172.21.15.63:0/4126841217 learned_addr learned my addr 172.21.15.63:0/4126841217 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:33.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e51e00640 1 --2- 172.21.15.63:0/4126841217 >> v2:172.21.15.119:3300/0 conn(0x7f9e54154c90 0x7f9e540c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e49400640 1 -- 172.21.15.63:0/4126841217 >> v2:172.21.15.119:3300/0 conn(0x7f9e54154c90 msgr2=0x7f9e540c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:33.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e49400640 1 --2- 172.21.15.63:0/4126841217 >> v2:172.21.15.119:3300/0 conn(0x7f9e54154c90 0x7f9e540c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e49400640 1 -- 172.21.15.63:0/4126841217 >> v1:172.21.15.119:6789/0 conn(0x7f9e5415b5c0 legacy=0x7f9e5406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.981+0000 7f9e49400640 1 -- 172.21.15.63:0/4126841217 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e540c8bf0 con 0x7f9e5406ec90 2024-09-12T02:57:33.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e49400640 1 --2- 172.21.15.63:0/4126841217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5406ec90 0x7f9e540ce270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e540cbcf0 tx=0x7f9e3c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831491516a50c669 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e51400640 1 -- 172.21.15.63:0/4126841217 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0b5070 con 0x7f9e5406ec90 2024-09-12T02:57:33.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e51400640 1 -- 172.21.15.63:0/4126841217 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3c0a8a10 con 0x7f9e5406ec90 2024-09-12T02:57:33.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e51400640 1 -- 172.21.15.63:0/4126841217 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0a8de0 con 0x7f9e5406ec90 2024-09-12T02:57:33.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 -- 172.21.15.63:0/4126841217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5406ec90 msgr2=0x7f9e540ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 --2- 172.21.15.63:0/4126841217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5406ec90 0x7f9e540ce270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e540cbcf0 tx=0x7f9e3c01ed10 comp rx=0 tx=0).stop 2024-09-12T02:57:33.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 -- 172.21.15.63:0/4126841217 shutdown_connections 2024-09-12T02:57:33.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 --2- 172.21.15.63:0/4126841217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5406ec90 0x7f9e540ce270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 --2- 172.21.15.63:0/4126841217 >> v2:172.21.15.119:3300/0 conn(0x7f9e54154c90 0x7f9e540c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 -- 172.21.15.63:0/4126841217 >> 172.21.15.63:0/4126841217 conn(0x7f9e5406bcc0 msgr2=0x7f9e5406fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:33.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 -- 172.21.15.63:0/4126841217 shutdown_connections 2024-09-12T02:57:33.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 -- 172.21.15.63:0/4126841217 wait complete. 2024-09-12T02:57:33.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 Processor -- start 2024-09-12T02:57:33.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.985+0000 7f9e59000640 1 -- start start 2024-09-12T02:57:33.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e59000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e5406ec90 0x7f9e541554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e59000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e54154c90 0x7f9e540c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e59000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5415b5c0 0x7f9e540c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e59000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5415aae0 con 0x7f9e5415b5c0 2024-09-12T02:57:33.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e59000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9e540c91b0 con 0x7f9e54154c90 2024-09-12T02:57:33.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e59000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5415adc0 con 0x7f9e5406ec90 2024-09-12T02:57:33.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e52800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5415b5c0 0x7f9e540c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e52800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5415b5c0 0x7f9e540c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38994/0 (socket says 172.21.15.63:38994) 2024-09-12T02:57:33.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e52800640 1 -- 172.21.15.63:0/2902891453 learned_addr learned my addr 172.21.15.63:0/2902891453 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:33.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e51e00640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e5406ec90 0x7f9e541554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e49400640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e54154c90 0x7f9e540c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e52800640 1 -- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e5406ec90 msgr2=0x7f9e541554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e52800640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e5406ec90 0x7f9e541554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e52800640 1 -- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e54154c90 msgr2=0x7f9e540c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:33.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e52800640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e54154c90 0x7f9e540c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:33.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e52800640 1 -- 172.21.15.63:0/2902891453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5414f260 con 0x7f9e5415b5c0 2024-09-12T02:57:33.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e52800640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5415b5c0 0x7f9e540c9990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c760 tx=0x7f9e4c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e4aa00640 1 -- 172.21.15.63:0/2902891453 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c003b80 con 0x7f9e5415b5c0 2024-09-12T02:57:33.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e4aa00640 1 -- 172.21.15.63:0/2902891453 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e4c003d20 con 0x7f9e5415b5c0 2024-09-12T02:57:33.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e4aa00640 1 -- 172.21.15.63:0/2902891453 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c00aa30 con 0x7f9e5415b5c0 2024-09-12T02:57:33.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e541f0910 con 0x7f9e5415b5c0 2024-09-12T02:57:33.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e541f0ed0 con 0x7f9e5415b5c0 2024-09-12T02:57:33.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5406c6d0 con 0x7f9e5415b5c0 2024-09-12T02:57:33.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.989+0000 7f9e4aa00640 1 -- 172.21.15.63:0/2902891453 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e4c00abd0 con 0x7f9e5415b5c0 2024-09-12T02:57:33.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.993+0000 7f9e4aa00640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e300678c0 0x7f9e30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:33.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.993+0000 7f9e4aa00640 1 -- 172.21.15.63:0/2902891453 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9e4c085e30 con 0x7f9e5415b5c0 2024-09-12T02:57:33.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.993+0000 7f9e51e00640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e300678c0 0x7f9e30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:33.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.993+0000 7f9e51e00640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e300678c0 0x7f9e30069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009b60 tx=0x7f9e44009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:33.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:33.997+0000 7f9e4aa00640 1 -- 172.21.15.63:0/2902891453 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e4c055eb0 con 0x7f9e5415b5c0 2024-09-12T02:57:34.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.161+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e54072410 con 0x7f9e300678c0 2024-09-12T02:57:34.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.185+0000 7f9e4aa00640 1 -- 172.21.15.63:0/2902891453 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f9e54072410 con 0x7f9e300678c0 2024-09-12T02:57:34.191 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:34.195 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:57:34.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e300678c0 msgr2=0x7f9e30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e300678c0 0x7f9e30069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009b60 tx=0x7f9e44009190 comp rx=0 tx=0).stop 2024-09-12T02:57:34.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5415b5c0 msgr2=0x7f9e540c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5415b5c0 0x7f9e540c9990 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c760 tx=0x7f9e4c00cc20 comp rx=0 tx=0).stop 2024-09-12T02:57:34.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 shutdown_connections 2024-09-12T02:57:34.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e5415b5c0 0x7f9e540c9990 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e54154c90 0x7f9e540c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e300678c0 0x7f9e30069d80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 --2- 172.21.15.63:0/2902891453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e5406ec90 0x7f9e541554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 >> 172.21.15.63:0/2902891453 conn(0x7f9e5406bcc0 msgr2=0x7f9e54153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:34.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 shutdown_connections 2024-09-12T02:57:34.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.189+0000 7f9e59000640 1 -- 172.21.15.63:0/2902891453 wait complete. 2024-09-12T02:57:34.212 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-12T02:57:33.756749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2049012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004852"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886709+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:57:09.886709+0000","last_peered":"2024-09-12T02:57:09.886709+0000","last_clean":"2024-09-12T02:57:09.886709+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:57:09.886709+0000","last_undegraded":"2024-09-12T02:57:09.886709+0000","last_fullsized":"2024-09-12T02:57:09.886709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872098+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:57:09.872098+0000","last_peered":"2024-09-12T02:57:09.872098+0000","last_clean":"2024-09-12T02:57:09.872098+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:57:09.872098+0000","last_undegraded":"2024-09-12T02:57:09.872098+0000","last_fullsized":"2024-09-12T02:57:09.872098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871428+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:57:09.871428+0000","last_peered":"2024-09-12T02:57:09.871428+0000","last_clean":"2024-09-12T02:57:09.871428+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:57:09.871428+0000","last_undegraded":"2024-09-12T02:57:09.871428+0000","last_fullsized":"2024-09-12T02:57:09.871428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872215+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:57:09.872215+0000","last_peered":"2024-09-12T02:57:09.872215+0000","last_clean":"2024-09-12T02:57:09.872215+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:57:09.872215+0000","last_undegraded":"2024-09-12T02:57:09.872215+0000","last_fullsized":"2024-09-12T02:57:09.872215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886576+0000","last_change":"2024-09-12T02:57:04.882473+0000","last_active":"2024-09-12T02:57:09.886576+0000","last_peered":"2024-09-12T02:57:09.886576+0000","last_clean":"2024-09-12T02:57:09.886576+0000","last_became_active":"2024-09-12T02:57:04.882182+0000","last_became_peered":"2024-09-12T02:57:04.882182+0000","last_unstale":"2024-09-12T02:57:09.886576+0000","last_undegraded":"2024-09-12T02:57:09.886576+0000","last_fullsized":"2024-09-12T02:57:09.886576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367426+0000","last_change":"2024-09-12T02:57:08.878799+0000","last_active":"2024-09-12T02:57:10.367426+0000","last_peered":"2024-09-12T02:57:10.367426+0000","last_clean":"2024-09-12T02:57:10.367426+0000","last_became_active":"2024-09-12T02:57:08.877274+0000","last_became_peered":"2024-09-12T02:57:08.877274+0000","last_unstale":"2024-09-12T02:57:10.367426+0000","last_undegraded":"2024-09-12T02:57:10.367426+0000","last_fullsized":"2024-09-12T02:57:10.367426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:27.611325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346487+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:57:10.346487+0000","last_peered":"2024-09-12T02:57:10.346487+0000","last_clean":"2024-09-12T02:57:10.346487+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:57:10.346487+0000","last_undegraded":"2024-09-12T02:57:10.346487+0000","last_fullsized":"2024-09-12T02:57:10.346487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875248+0000","last_change":"2024-09-12T02:57:04.875312+0000","last_active":"2024-09-12T02:57:09.875248+0000","last_peered":"2024-09-12T02:57:09.875248+0000","last_clean":"2024-09-12T02:57:09.875248+0000","last_became_active":"2024-09-12T02:57:04.863748+0000","last_became_peered":"2024-09-12T02:57:04.863748+0000","last_unstale":"2024-09-12T02:57:09.875248+0000","last_undegraded":"2024-09-12T02:57:09.875248+0000","last_fullsized":"2024-09-12T02:57:09.875248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:39.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368200+0000","last_change":"2024-09-12T02:57:08.888677+0000","last_active":"2024-09-12T02:57:10.368200+0000","last_peered":"2024-09-12T02:57:10.368200+0000","last_clean":"2024-09-12T02:57:10.368200+0000","last_became_active":"2024-09-12T02:57:08.875948+0000","last_became_peered":"2024-09-12T02:57:08.875948+0000","last_unstale":"2024-09-12T02:57:10.368200+0000","last_undegraded":"2024-09-12T02:57:10.368200+0000","last_fullsized":"2024-09-12T02:57:10.368200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.194444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345910+0000","last_change":"2024-09-12T02:57:03.832933+0000","last_active":"2024-09-12T02:57:10.345910+0000","last_peered":"2024-09-12T02:57:10.345910+0000","last_clean":"2024-09-12T02:57:10.345910+0000","last_became_active":"2024-09-12T02:57:03.832253+0000","last_became_peered":"2024-09-12T02:57:03.832253+0000","last_unstale":"2024-09-12T02:57:10.345910+0000","last_undegraded":"2024-09-12T02:57:10.345910+0000","last_fullsized":"2024-09-12T02:57:10.345910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877844+0000","last_change":"2024-09-12T02:57:04.880036+0000","last_active":"2024-09-12T02:57:09.877844+0000","last_peered":"2024-09-12T02:57:09.877844+0000","last_clean":"2024-09-12T02:57:09.877844+0000","last_became_active":"2024-09-12T02:57:04.879490+0000","last_became_peered":"2024-09-12T02:57:04.879490+0000","last_unstale":"2024-09-12T02:57:09.877844+0000","last_undegraded":"2024-09-12T02:57:09.877844+0000","last_fullsized":"2024-09-12T02:57:09.877844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.579939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367568+0000","last_change":"2024-09-12T02:57:08.890508+0000","last_active":"2024-09-12T02:57:10.367568+0000","last_peered":"2024-09-12T02:57:10.367568+0000","last_clean":"2024-09-12T02:57:10.367568+0000","last_became_active":"2024-09-12T02:57:08.886515+0000","last_became_peered":"2024-09-12T02:57:08.886515+0000","last_unstale":"2024-09-12T02:57:10.367568+0000","last_undegraded":"2024-09-12T02:57:10.367568+0000","last_fullsized":"2024-09-12T02:57:10.367568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:28.963220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875670+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:57:09.875670+0000","last_peered":"2024-09-12T02:57:09.875670+0000","last_clean":"2024-09-12T02:57:09.875670+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:57:09.875670+0000","last_undegraded":"2024-09-12T02:57:09.875670+0000","last_fullsized":"2024-09-12T02:57:09.875670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346531+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:57:10.346531+0000","last_peered":"2024-09-12T02:57:10.346531+0000","last_clean":"2024-09-12T02:57:10.346531+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:57:10.346531+0000","last_undegraded":"2024-09-12T02:57:10.346531+0000","last_fullsized":"2024-09-12T02:57:10.346531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368605+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:57:10.368605+0000","last_peered":"2024-09-12T02:57:10.368605+0000","last_clean":"2024-09-12T02:57:10.368605+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:57:10.368605+0000","last_undegraded":"2024-09-12T02:57:10.368605+0000","last_fullsized":"2024-09-12T02:57:10.368605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871686+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:57:09.871686+0000","last_peered":"2024-09-12T02:57:09.871686+0000","last_clean":"2024-09-12T02:57:09.871686+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:57:09.871686+0000","last_undegraded":"2024-09-12T02:57:09.871686+0000","last_fullsized":"2024-09-12T02:57:09.871686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366516+0000","last_change":"2024-09-12T02:57:03.790544+0000","last_active":"2024-09-12T02:57:10.366516+0000","last_peered":"2024-09-12T02:57:10.366516+0000","last_clean":"2024-09-12T02:57:10.366516+0000","last_became_active":"2024-09-12T02:57:03.790195+0000","last_became_peered":"2024-09-12T02:57:03.790195+0000","last_unstale":"2024-09-12T02:57:10.366516+0000","last_undegraded":"2024-09-12T02:57:10.366516+0000","last_fullsized":"2024-09-12T02:57:10.366516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368276+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:57:10.368276+0000","last_peered":"2024-09-12T02:57:10.368276+0000","last_clean":"2024-09-12T02:57:10.368276+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:57:10.368276+0000","last_undegraded":"2024-09-12T02:57:10.368276+0000","last_fullsized":"2024-09-12T02:57:10.368276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871830+0000","last_change":"2024-09-12T02:57:04.835949+0000","last_active":"2024-09-12T02:57:09.871830+0000","last_peered":"2024-09-12T02:57:09.871830+0000","last_clean":"2024-09-12T02:57:09.871830+0000","last_became_active":"2024-09-12T02:57:04.835628+0000","last_became_peered":"2024-09-12T02:57:04.835628+0000","last_unstale":"2024-09-12T02:57:09.871830+0000","last_undegraded":"2024-09-12T02:57:09.871830+0000","last_fullsized":"2024-09-12T02:57:09.871830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366134+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:57:10.366134+0000","last_peered":"2024-09-12T02:57:10.366134+0000","last_clean":"2024-09-12T02:57:10.366134+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:57:10.366134+0000","last_undegraded":"2024-09-12T02:57:10.366134+0000","last_fullsized":"2024-09-12T02:57:10.366134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367370+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:57:10.367370+0000","last_peered":"2024-09-12T02:57:10.367370+0000","last_clean":"2024-09-12T02:57:10.367370+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:57:10.367370+0000","last_undegraded":"2024-09-12T02:57:10.367370+0000","last_fullsized":"2024-09-12T02:57:10.367370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367963+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:57:10.367963+0000","last_peered":"2024-09-12T02:57:10.367963+0000","last_clean":"2024-09-12T02:57:10.367963+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:57:10.367963+0000","last_undegraded":"2024-09-12T02:57:10.367963+0000","last_fullsized":"2024-09-12T02:57:10.367963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345073+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:57:10.345073+0000","last_peered":"2024-09-12T02:57:10.345073+0000","last_clean":"2024-09-12T02:57:10.345073+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:57:10.345073+0000","last_undegraded":"2024-09-12T02:57:10.345073+0000","last_fullsized":"2024-09-12T02:57:10.345073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368760+0000","last_change":"2024-09-12T02:57:08.881925+0000","last_active":"2024-09-12T02:57:10.368760+0000","last_peered":"2024-09-12T02:57:10.368760+0000","last_clean":"2024-09-12T02:57:10.368760+0000","last_became_active":"2024-09-12T02:57:08.880913+0000","last_became_peered":"2024-09-12T02:57:08.880913+0000","last_unstale":"2024-09-12T02:57:10.368760+0000","last_undegraded":"2024-09-12T02:57:10.368760+0000","last_fullsized":"2024-09-12T02:57:10.368760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:48.637854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885883+0000","last_change":"2024-09-12T02:57:04.837566+0000","last_active":"2024-09-12T02:57:09.885883+0000","last_peered":"2024-09-12T02:57:09.885883+0000","last_clean":"2024-09-12T02:57:09.885883+0000","last_became_active":"2024-09-12T02:57:04.837281+0000","last_became_peered":"2024-09-12T02:57:04.837281+0000","last_unstale":"2024-09-12T02:57:09.885883+0000","last_undegraded":"2024-09-12T02:57:09.885883+0000","last_fullsized":"2024-09-12T02:57:09.885883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:23.664487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.878159+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:57:09.878159+0000","last_peered":"2024-09-12T02:57:09.878159+0000","last_clean":"2024-09-12T02:57:09.878159+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:57:09.878159+0000","last_undegraded":"2024-09-12T02:57:09.878159+0000","last_fullsized":"2024-09-12T02:57:09.878159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367595+0000","last_change":"2024-09-12T02:57:09.038564+0000","last_active":"2024-09-12T02:57:10.367595+0000","last_peered":"2024-09-12T02:57:10.367595+0000","last_clean":"2024-09-12T02:57:10.367595+0000","last_became_active":"2024-09-12T02:57:09.036310+0000","last_became_peered":"2024-09-12T02:57:09.036310+0000","last_unstale":"2024-09-12T02:57:10.367595+0000","last_undegraded":"2024-09-12T02:57:10.367595+0000","last_fullsized":"2024-09-12T02:57:10.367595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.627698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872469+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:57:09.872469+0000","last_peered":"2024-09-12T02:57:09.872469+0000","last_clean":"2024-09-12T02:57:09.872469+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:57:09.872469+0000","last_undegraded":"2024-09-12T02:57:09.872469+0000","last_fullsized":"2024-09-12T02:57:09.872469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367376+0000","last_change":"2024-09-12T02:57:03.809884+0000","last_active":"2024-09-12T02:57:10.367376+0000","last_peered":"2024-09-12T02:57:10.367376+0000","last_clean":"2024-09-12T02:57:10.367376+0000","last_became_active":"2024-09-12T02:57:03.809610+0000","last_became_peered":"2024-09-12T02:57:03.809610+0000","last_unstale":"2024-09-12T02:57:10.367376+0000","last_undegraded":"2024-09-12T02:57:10.367376+0000","last_fullsized":"2024-09-12T02:57:10.367376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871306+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:57:09.871306+0000","last_peered":"2024-09-12T02:57:09.871306+0000","last_clean":"2024-09-12T02:57:09.871306+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:57:09.871306+0000","last_undegraded":"2024-09-12T02:57:09.871306+0000","last_fullsized":"2024-09-12T02:57:09.871306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366942+0000","last_change":"2024-09-12T02:57:04.837330+0000","last_active":"2024-09-12T02:57:10.366942+0000","last_peered":"2024-09-12T02:57:10.366942+0000","last_clean":"2024-09-12T02:57:10.366942+0000","last_became_active":"2024-09-12T02:57:04.836984+0000","last_became_peered":"2024-09-12T02:57:04.836984+0000","last_unstale":"2024-09-12T02:57:10.366942+0000","last_undegraded":"2024-09-12T02:57:10.366942+0000","last_fullsized":"2024-09-12T02:57:10.366942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346664+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:57:10.346664+0000","last_peered":"2024-09-12T02:57:10.346664+0000","last_clean":"2024-09-12T02:57:10.346664+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:57:10.346664+0000","last_undegraded":"2024-09-12T02:57:10.346664+0000","last_fullsized":"2024-09-12T02:57:10.346664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885339+0000","last_change":"2024-09-12T02:57:09.025446+0000","last_active":"2024-09-12T02:57:09.885339+0000","last_peered":"2024-09-12T02:57:09.885339+0000","last_clean":"2024-09-12T02:57:09.885339+0000","last_became_active":"2024-09-12T02:57:09.025008+0000","last_became_peered":"2024-09-12T02:57:09.025008+0000","last_unstale":"2024-09-12T02:57:09.885339+0000","last_undegraded":"2024-09-12T02:57:09.885339+0000","last_fullsized":"2024-09-12T02:57:09.885339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877996+0000","last_change":"2024-09-12T02:57:04.861898+0000","last_active":"2024-09-12T02:57:09.877996+0000","last_peered":"2024-09-12T02:57:09.877996+0000","last_clean":"2024-09-12T02:57:09.877996+0000","last_became_active":"2024-09-12T02:57:04.858339+0000","last_became_peered":"2024-09-12T02:57:04.858339+0000","last_unstale":"2024-09-12T02:57:09.877996+0000","last_undegraded":"2024-09-12T02:57:09.877996+0000","last_fullsized":"2024-09-12T02:57:09.877996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367038+0000","last_change":"2024-09-12T02:57:03.796368+0000","last_active":"2024-09-12T02:57:10.367038+0000","last_peered":"2024-09-12T02:57:10.367038+0000","last_clean":"2024-09-12T02:57:10.367038+0000","last_became_active":"2024-09-12T02:57:03.796016+0000","last_became_peered":"2024-09-12T02:57:03.796016+0000","last_unstale":"2024-09-12T02:57:10.367038+0000","last_undegraded":"2024-09-12T02:57:10.367038+0000","last_fullsized":"2024-09-12T02:57:10.367038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:27.840978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366160+0000","last_change":"2024-09-12T02:57:08.877519+0000","last_active":"2024-09-12T02:57:10.366160+0000","last_peered":"2024-09-12T02:57:10.366160+0000","last_clean":"2024-09-12T02:57:10.366160+0000","last_became_active":"2024-09-12T02:57:08.872329+0000","last_became_peered":"2024-09-12T02:57:08.872329+0000","last_unstale":"2024-09-12T02:57:10.366160+0000","last_undegraded":"2024-09-12T02:57:10.366160+0000","last_fullsized":"2024-09-12T02:57:10.366160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.661785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368703+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:57:10.368703+0000","last_peered":"2024-09-12T02:57:10.368703+0000","last_clean":"2024-09-12T02:57:10.368703+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:57:10.368703+0000","last_undegraded":"2024-09-12T02:57:10.368703+0000","last_fullsized":"2024-09-12T02:57:10.368703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875332+0000","last_change":"2024-09-12T02:57:03.802797+0000","last_active":"2024-09-12T02:57:09.875332+0000","last_peered":"2024-09-12T02:57:09.875332+0000","last_clean":"2024-09-12T02:57:09.875332+0000","last_became_active":"2024-09-12T02:57:03.798969+0000","last_became_peered":"2024-09-12T02:57:03.798969+0000","last_unstale":"2024-09-12T02:57:09.875332+0000","last_undegraded":"2024-09-12T02:57:09.875332+0000","last_fullsized":"2024-09-12T02:57:09.875332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.025589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367036+0000","last_change":"2024-09-12T02:57:08.883289+0000","last_active":"2024-09-12T02:57:10.367036+0000","last_peered":"2024-09-12T02:57:10.367036+0000","last_clean":"2024-09-12T02:57:10.367036+0000","last_became_active":"2024-09-12T02:57:08.880476+0000","last_became_peered":"2024-09-12T02:57:08.880476+0000","last_unstale":"2024-09-12T02:57:10.367036+0000","last_undegraded":"2024-09-12T02:57:10.367036+0000","last_fullsized":"2024-09-12T02:57:10.367036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:04.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366058+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:57:10.366058+0000","last_peered":"2024-09-12T02:57:10.366058+0000","last_clean":"2024-09-12T02:57:10.366058+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:57:10.366058+0000","last_undegraded":"2024-09-12T02:57:10.366058+0000","last_fullsized":"2024-09-12T02:57:10.366058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366630+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:57:10.366630+0000","last_peered":"2024-09-12T02:57:10.366630+0000","last_clean":"2024-09-12T02:57:10.366630+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:57:10.366630+0000","last_undegraded":"2024-09-12T02:57:10.366630+0000","last_fullsized":"2024-09-12T02:57:10.366630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367404+0000","last_change":"2024-09-12T02:57:08.872506+0000","last_active":"2024-09-12T02:57:10.367404+0000","last_peered":"2024-09-12T02:57:10.367404+0000","last_clean":"2024-09-12T02:57:10.367404+0000","last_became_active":"2024-09-12T02:57:08.872127+0000","last_became_peered":"2024-09-12T02:57:08.872127+0000","last_unstale":"2024-09-12T02:57:10.367404+0000","last_undegraded":"2024-09-12T02:57:10.367404+0000","last_fullsized":"2024-09-12T02:57:10.367404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:19.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885022+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:57:09.885022+0000","last_peered":"2024-09-12T02:57:09.885022+0000","last_clean":"2024-09-12T02:57:09.885022+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:57:09.885022+0000","last_undegraded":"2024-09-12T02:57:09.885022+0000","last_fullsized":"2024-09-12T02:57:09.885022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345274+0000","last_change":"2024-09-12T02:57:03.827694+0000","last_active":"2024-09-12T02:57:10.345274+0000","last_peered":"2024-09-12T02:57:10.345274+0000","last_clean":"2024-09-12T02:57:10.345274+0000","last_became_active":"2024-09-12T02:57:03.827099+0000","last_became_peered":"2024-09-12T02:57:03.827099+0000","last_unstale":"2024-09-12T02:57:10.345274+0000","last_undegraded":"2024-09-12T02:57:10.345274+0000","last_fullsized":"2024-09-12T02:57:10.345274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885728+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:57:09.885728+0000","last_peered":"2024-09-12T02:57:09.885728+0000","last_clean":"2024-09-12T02:57:09.885728+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:57:09.885728+0000","last_undegraded":"2024-09-12T02:57:09.885728+0000","last_fullsized":"2024-09-12T02:57:09.885728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871567+0000","last_change":"2024-09-12T02:57:04.882517+0000","last_active":"2024-09-12T02:57:09.871567+0000","last_peered":"2024-09-12T02:57:09.871567+0000","last_clean":"2024-09-12T02:57:09.871567+0000","last_became_active":"2024-09-12T02:57:04.882159+0000","last_became_peered":"2024-09-12T02:57:04.882159+0000","last_unstale":"2024-09-12T02:57:09.871567+0000","last_undegraded":"2024-09-12T02:57:09.871567+0000","last_fullsized":"2024-09-12T02:57:09.871567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876576+0000","last_change":"2024-09-12T02:57:03.798773+0000","last_active":"2024-09-12T02:57:09.876576+0000","last_peered":"2024-09-12T02:57:09.876576+0000","last_clean":"2024-09-12T02:57:09.876576+0000","last_became_active":"2024-09-12T02:57:03.797799+0000","last_became_peered":"2024-09-12T02:57:03.797799+0000","last_unstale":"2024-09-12T02:57:09.876576+0000","last_undegraded":"2024-09-12T02:57:09.876576+0000","last_fullsized":"2024-09-12T02:57:09.876576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345357+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:57:10.345357+0000","last_peered":"2024-09-12T02:57:10.345357+0000","last_clean":"2024-09-12T02:57:10.345357+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:57:10.345357+0000","last_undegraded":"2024-09-12T02:57:10.345357+0000","last_fullsized":"2024-09-12T02:57:10.345357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876527+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:57:09.876527+0000","last_peered":"2024-09-12T02:57:09.876527+0000","last_clean":"2024-09-12T02:57:09.876527+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:57:09.876527+0000","last_undegraded":"2024-09-12T02:57:09.876527+0000","last_fullsized":"2024-09-12T02:57:09.876527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346026+0000","last_change":"2024-09-12T02:57:04.879076+0000","last_active":"2024-09-12T02:57:10.346026+0000","last_peered":"2024-09-12T02:57:10.346026+0000","last_clean":"2024-09-12T02:57:10.346026+0000","last_became_active":"2024-09-12T02:57:04.878160+0000","last_became_peered":"2024-09-12T02:57:04.878160+0000","last_unstale":"2024-09-12T02:57:10.346026+0000","last_undegraded":"2024-09-12T02:57:10.346026+0000","last_fullsized":"2024-09-12T02:57:10.346026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.589537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366400+0000","last_change":"2024-09-12T02:57:03.798239+0000","last_active":"2024-09-12T02:57:10.366400+0000","last_peered":"2024-09-12T02:57:10.366400+0000","last_clean":"2024-09-12T02:57:10.366400+0000","last_became_active":"2024-09-12T02:57:03.797935+0000","last_became_peered":"2024-09-12T02:57:03.797935+0000","last_unstale":"2024-09-12T02:57:10.366400+0000","last_undegraded":"2024-09-12T02:57:10.366400+0000","last_fullsized":"2024-09-12T02:57:10.366400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875409+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:57:09.875409+0000","last_peered":"2024-09-12T02:57:09.875409+0000","last_clean":"2024-09-12T02:57:09.875409+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:57:09.875409+0000","last_undegraded":"2024-09-12T02:57:09.875409+0000","last_fullsized":"2024-09-12T02:57:09.875409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875411+0000","last_change":"2024-09-12T02:57:04.858809+0000","last_active":"2024-09-12T02:57:09.875411+0000","last_peered":"2024-09-12T02:57:09.875411+0000","last_clean":"2024-09-12T02:57:09.875411+0000","last_became_active":"2024-09-12T02:57:04.858048+0000","last_became_peered":"2024-09-12T02:57:04.858048+0000","last_unstale":"2024-09-12T02:57:09.875411+0000","last_undegraded":"2024-09-12T02:57:09.875411+0000","last_fullsized":"2024-09-12T02:57:09.875411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:59.698440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367203+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:57:10.367203+0000","last_peered":"2024-09-12T02:57:10.367203+0000","last_clean":"2024-09-12T02:57:10.367203+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:57:10.367203+0000","last_undegraded":"2024-09-12T02:57:10.367203+0000","last_fullsized":"2024-09-12T02:57:10.367203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885593+0000","last_change":"2024-09-12T02:57:08.874656+0000","last_active":"2024-09-12T02:57:09.885593+0000","last_peered":"2024-09-12T02:57:09.885593+0000","last_clean":"2024-09-12T02:57:09.885593+0000","last_became_active":"2024-09-12T02:57:08.874202+0000","last_became_peered":"2024-09-12T02:57:08.874202+0000","last_unstale":"2024-09-12T02:57:09.885593+0000","last_undegraded":"2024-09-12T02:57:09.885593+0000","last_fullsized":"2024-09-12T02:57:09.885593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.794828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346615+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:57:10.346615+0000","last_peered":"2024-09-12T02:57:10.346615+0000","last_clean":"2024-09-12T02:57:10.346615+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:57:10.346615+0000","last_undegraded":"2024-09-12T02:57:10.346615+0000","last_fullsized":"2024-09-12T02:57:10.346615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366863+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:57:10.366863+0000","last_peered":"2024-09-12T02:57:10.366863+0000","last_clean":"2024-09-12T02:57:10.366863+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:57:10.366863+0000","last_undegraded":"2024-09-12T02:57:10.366863+0000","last_fullsized":"2024-09-12T02:57:10.366863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874320+0000","last_change":"2024-09-12T02:57:09.030839+0000","last_active":"2024-09-12T02:57:09.874320+0000","last_peered":"2024-09-12T02:57:09.874320+0000","last_clean":"2024-09-12T02:57:09.874320+0000","last_became_active":"2024-09-12T02:57:09.029808+0000","last_became_peered":"2024-09-12T02:57:09.029808+0000","last_unstale":"2024-09-12T02:57:09.874320+0000","last_undegraded":"2024-09-12T02:57:09.874320+0000","last_fullsized":"2024-09-12T02:57:09.874320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346464+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:57:10.346464+0000","last_peered":"2024-09-12T02:57:10.346464+0000","last_clean":"2024-09-12T02:57:10.346464+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:57:10.346464+0000","last_undegraded":"2024-09-12T02:57:10.346464+0000","last_fullsized":"2024-09-12T02:57:10.346464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368984+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:57:10.368984+0000","last_peered":"2024-09-12T02:57:10.368984+0000","last_clean":"2024-09-12T02:57:10.368984+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:57:10.368984+0000","last_undegraded":"2024-09-12T02:57:10.368984+0000","last_fullsized":"2024-09-12T02:57:10.368984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367280+0000","last_change":"2024-09-12T02:57:08.896161+0000","last_active":"2024-09-12T02:57:10.367280+0000","last_peered":"2024-09-12T02:57:10.367280+0000","last_clean":"2024-09-12T02:57:10.367280+0000","last_became_active":"2024-09-12T02:57:08.895379+0000","last_became_peered":"2024-09-12T02:57:08.895379+0000","last_unstale":"2024-09-12T02:57:10.367280+0000","last_undegraded":"2024-09-12T02:57:10.367280+0000","last_fullsized":"2024-09-12T02:57:10.367280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:34.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345587+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:57:10.345587+0000","last_peered":"2024-09-12T02:57:10.345587+0000","last_clean":"2024-09-12T02:57:10.345587+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:57:10.345587+0000","last_undegraded":"2024-09-12T02:57:10.345587+0000","last_fullsized":"2024-09-12T02:57:10.345587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366369+0000","last_change":"2024-09-12T02:57:03.788301+0000","last_active":"2024-09-12T02:57:10.366369+0000","last_peered":"2024-09-12T02:57:10.366369+0000","last_clean":"2024-09-12T02:57:10.366369+0000","last_became_active":"2024-09-12T02:57:03.788002+0000","last_became_peered":"2024-09-12T02:57:03.788002+0000","last_unstale":"2024-09-12T02:57:10.366369+0000","last_undegraded":"2024-09-12T02:57:10.366369+0000","last_fullsized":"2024-09-12T02:57:10.366369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885578+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:57:09.885578+0000","last_peered":"2024-09-12T02:57:09.885578+0000","last_clean":"2024-09-12T02:57:09.885578+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:57:09.885578+0000","last_undegraded":"2024-09-12T02:57:09.885578+0000","last_fullsized":"2024-09-12T02:57:09.885578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875635+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:57:09.875635+0000","last_peered":"2024-09-12T02:57:09.875635+0000","last_clean":"2024-09-12T02:57:09.875635+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:57:09.875635+0000","last_undegraded":"2024-09-12T02:57:09.875635+0000","last_fullsized":"2024-09-12T02:57:09.875635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876542+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:57:09.876542+0000","last_peered":"2024-09-12T02:57:09.876542+0000","last_clean":"2024-09-12T02:57:09.876542+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:57:09.876542+0000","last_undegraded":"2024-09-12T02:57:09.876542+0000","last_fullsized":"2024-09-12T02:57:09.876542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872348+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:57:09.872348+0000","last_peered":"2024-09-12T02:57:09.872348+0000","last_clean":"2024-09-12T02:57:09.872348+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:57:09.872348+0000","last_undegraded":"2024-09-12T02:57:09.872348+0000","last_fullsized":"2024-09-12T02:57:09.872348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346216+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:57:10.346216+0000","last_peered":"2024-09-12T02:57:10.346216+0000","last_clean":"2024-09-12T02:57:10.346216+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:57:10.346216+0000","last_undegraded":"2024-09-12T02:57:10.346216+0000","last_fullsized":"2024-09-12T02:57:10.346216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875168+0000","last_change":"2024-09-12T02:57:03.802047+0000","last_active":"2024-09-12T02:57:09.875168+0000","last_peered":"2024-09-12T02:57:09.875168+0000","last_clean":"2024-09-12T02:57:09.875168+0000","last_became_active":"2024-09-12T02:57:03.797936+0000","last_became_peered":"2024-09-12T02:57:03.797936+0000","last_unstale":"2024-09-12T02:57:09.875168+0000","last_undegraded":"2024-09-12T02:57:09.875168+0000","last_fullsized":"2024-09-12T02:57:09.875168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:10.176640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872067+0000","last_change":"2024-09-12T02:57:09.030826+0000","last_active":"2024-09-12T02:57:09.872067+0000","last_peered":"2024-09-12T02:57:09.872067+0000","last_clean":"2024-09-12T02:57:09.872067+0000","last_became_active":"2024-09-12T02:57:09.029437+0000","last_became_peered":"2024-09-12T02:57:09.029437+0000","last_unstale":"2024-09-12T02:57:09.872067+0000","last_undegraded":"2024-09-12T02:57:09.872067+0000","last_fullsized":"2024-09-12T02:57:09.872067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:15.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886359+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:57:09.886359+0000","last_peered":"2024-09-12T02:57:09.886359+0000","last_clean":"2024-09-12T02:57:09.886359+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:57:09.886359+0000","last_undegraded":"2024-09-12T02:57:09.886359+0000","last_fullsized":"2024-09-12T02:57:09.886359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885915+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:57:09.885915+0000","last_peered":"2024-09-12T02:57:09.885915+0000","last_clean":"2024-09-12T02:57:09.885915+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:57:09.885915+0000","last_undegraded":"2024-09-12T02:57:09.885915+0000","last_fullsized":"2024-09-12T02:57:09.885915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877662+0000","last_change":"2024-09-12T02:57:09.031080+0000","last_active":"2024-09-12T02:57:09.877662+0000","last_peered":"2024-09-12T02:57:09.877662+0000","last_clean":"2024-09-12T02:57:09.877662+0000","last_became_active":"2024-09-12T02:57:09.029892+0000","last_became_peered":"2024-09-12T02:57:09.029892+0000","last_unstale":"2024-09-12T02:57:09.877662+0000","last_undegraded":"2024-09-12T02:57:09.877662+0000","last_fullsized":"2024-09-12T02:57:09.877662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345803+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:57:10.345803+0000","last_peered":"2024-09-12T02:57:10.345803+0000","last_clean":"2024-09-12T02:57:10.345803+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:57:10.345803+0000","last_undegraded":"2024-09-12T02:57:10.345803+0000","last_fullsized":"2024-09-12T02:57:10.345803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:22.371934+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:57:22.371934+0000","last_peered":"2024-09-12T02:57:22.371934+0000","last_clean":"2024-09-12T02:57:22.371934+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:57:22.371934+0000","last_undegraded":"2024-09-12T02:57:22.371934+0000","last_fullsized":"2024-09-12T02:57:22.371934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366364+0000","last_change":"2024-09-12T02:57:08.884030+0000","last_active":"2024-09-12T02:57:10.366364+0000","last_peered":"2024-09-12T02:57:10.366364+0000","last_clean":"2024-09-12T02:57:10.366364+0000","last_became_active":"2024-09-12T02:57:08.880332+0000","last_became_peered":"2024-09-12T02:57:08.880332+0000","last_unstale":"2024-09-12T02:57:10.366364+0000","last_undegraded":"2024-09-12T02:57:10.366364+0000","last_fullsized":"2024-09-12T02:57:10.366364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:25.232846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368553+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:57:10.368553+0000","last_peered":"2024-09-12T02:57:10.368553+0000","last_clean":"2024-09-12T02:57:10.368553+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:57:10.368553+0000","last_undegraded":"2024-09-12T02:57:10.368553+0000","last_fullsized":"2024-09-12T02:57:10.368553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367151+0000","last_change":"2024-09-12T02:57:03.798009+0000","last_active":"2024-09-12T02:57:10.367151+0000","last_peered":"2024-09-12T02:57:10.367151+0000","last_clean":"2024-09-12T02:57:10.367151+0000","last_became_active":"2024-09-12T02:57:03.797749+0000","last_became_peered":"2024-09-12T02:57:03.797749+0000","last_unstale":"2024-09-12T02:57:10.367151+0000","last_undegraded":"2024-09-12T02:57:10.367151+0000","last_fullsized":"2024-09-12T02:57:10.367151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.058712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367936+0000","last_change":"2024-09-12T02:57:08.885401+0000","last_active":"2024-09-12T02:57:10.367936+0000","last_peered":"2024-09-12T02:57:10.367936+0000","last_clean":"2024-09-12T02:57:10.367936+0000","last_became_active":"2024-09-12T02:57:08.883296+0000","last_became_peered":"2024-09-12T02:57:08.883296+0000","last_unstale":"2024-09-12T02:57:10.367936+0000","last_undegraded":"2024-09-12T02:57:10.367936+0000","last_fullsized":"2024-09-12T02:57:10.367936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:24.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886680+0000","last_change":"2024-09-12T02:57:04.882349+0000","last_active":"2024-09-12T02:57:09.886680+0000","last_peered":"2024-09-12T02:57:09.886680+0000","last_clean":"2024-09-12T02:57:09.886680+0000","last_became_active":"2024-09-12T02:57:04.882060+0000","last_became_peered":"2024-09-12T02:57:04.882060+0000","last_unstale":"2024-09-12T02:57:09.886680+0000","last_undegraded":"2024-09-12T02:57:09.886680+0000","last_fullsized":"2024-09-12T02:57:09.886680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876076+0000","last_change":"2024-09-12T02:57:03.811429+0000","last_active":"2024-09-12T02:57:09.876076+0000","last_peered":"2024-09-12T02:57:09.876076+0000","last_clean":"2024-09-12T02:57:09.876076+0000","last_became_active":"2024-09-12T02:57:03.810672+0000","last_became_peered":"2024-09-12T02:57:03.810672+0000","last_unstale":"2024-09-12T02:57:09.876076+0000","last_undegraded":"2024-09-12T02:57:09.876076+0000","last_fullsized":"2024-09-12T02:57:09.876076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871687+0000","last_change":"2024-09-12T02:57:08.875903+0000","last_active":"2024-09-12T02:57:09.871687+0000","last_peered":"2024-09-12T02:57:09.871687+0000","last_clean":"2024-09-12T02:57:09.871687+0000","last_became_active":"2024-09-12T02:57:08.875270+0000","last_became_peered":"2024-09-12T02:57:08.875270+0000","last_unstale":"2024-09-12T02:57:09.871687+0000","last_undegraded":"2024-09-12T02:57:09.871687+0000","last_fullsized":"2024-09-12T02:57:09.871687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875836+0000","last_change":"2024-09-12T02:57:04.864904+0000","last_active":"2024-09-12T02:57:09.875836+0000","last_peered":"2024-09-12T02:57:09.875836+0000","last_clean":"2024-09-12T02:57:09.875836+0000","last_became_active":"2024-09-12T02:57:04.861650+0000","last_became_peered":"2024-09-12T02:57:04.861650+0000","last_unstale":"2024-09-12T02:57:09.875836+0000","last_undegraded":"2024-09-12T02:57:09.875836+0000","last_fullsized":"2024-09-12T02:57:09.875836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:31.529412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877718+0000","last_change":"2024-09-12T02:57:03.812106+0000","last_active":"2024-09-12T02:57:09.877718+0000","last_peered":"2024-09-12T02:57:09.877718+0000","last_clean":"2024-09-12T02:57:09.877718+0000","last_became_active":"2024-09-12T02:57:03.810041+0000","last_became_peered":"2024-09-12T02:57:03.810041+0000","last_unstale":"2024-09-12T02:57:09.877718+0000","last_undegraded":"2024-09-12T02:57:09.877718+0000","last_fullsized":"2024-09-12T02:57:09.877718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871655+0000","last_change":"2024-09-12T02:57:09.030507+0000","last_active":"2024-09-12T02:57:09.871655+0000","last_peered":"2024-09-12T02:57:09.871655+0000","last_clean":"2024-09-12T02:57:09.871655+0000","last_became_active":"2024-09-12T02:57:09.029459+0000","last_became_peered":"2024-09-12T02:57:09.029459+0000","last_unstale":"2024-09-12T02:57:09.871655+0000","last_undegraded":"2024-09-12T02:57:09.871655+0000","last_fullsized":"2024-09-12T02:57:09.871655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:26.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885411+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:57:09.885411+0000","last_peered":"2024-09-12T02:57:09.885411+0000","last_clean":"2024-09-12T02:57:09.885411+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:57:09.885411+0000","last_undegraded":"2024-09-12T02:57:09.885411+0000","last_fullsized":"2024-09-12T02:57:09.885411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.365943+0000","last_change":"2024-09-12T02:57:04.834192+0000","last_active":"2024-09-12T02:57:10.365943+0000","last_peered":"2024-09-12T02:57:10.365943+0000","last_clean":"2024-09-12T02:57:10.365943+0000","last_became_active":"2024-09-12T02:57:04.833901+0000","last_became_peered":"2024-09-12T02:57:04.833901+0000","last_unstale":"2024-09-12T02:57:10.365943+0000","last_undegraded":"2024-09-12T02:57:10.365943+0000","last_fullsized":"2024-09-12T02:57:10.365943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:51:30.019270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874853+0000","last_change":"2024-09-12T02:57:03.807210+0000","last_active":"2024-09-12T02:57:09.874853+0000","last_peered":"2024-09-12T02:57:09.874853+0000","last_clean":"2024-09-12T02:57:09.874853+0000","last_became_active":"2024-09-12T02:57:03.805335+0000","last_became_peered":"2024-09-12T02:57:03.805335+0000","last_unstale":"2024-09-12T02:57:09.874853+0000","last_undegraded":"2024-09-12T02:57:09.874853+0000","last_fullsized":"2024-09-12T02:57:09.874853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876801+0000","last_change":"2024-09-12T02:57:08.895753+0000","last_active":"2024-09-12T02:57:09.876801+0000","last_peered":"2024-09-12T02:57:09.876801+0000","last_clean":"2024-09-12T02:57:09.876801+0000","last_became_active":"2024-09-12T02:57:08.894542+0000","last_became_peered":"2024-09-12T02:57:08.894542+0000","last_unstale":"2024-09-12T02:57:09.876801+0000","last_undegraded":"2024-09-12T02:57:09.876801+0000","last_fullsized":"2024-09-12T02:57:09.876801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871791+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:57:09.871791+0000","last_peered":"2024-09-12T02:57:09.871791+0000","last_clean":"2024-09-12T02:57:09.871791+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:57:09.871791+0000","last_undegraded":"2024-09-12T02:57:09.871791+0000","last_fullsized":"2024-09-12T02:57:09.871791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871652+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:57:09.871652+0000","last_peered":"2024-09-12T02:57:09.871652+0000","last_clean":"2024-09-12T02:57:09.871652+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:57:09.871652+0000","last_undegraded":"2024-09-12T02:57:09.871652+0000","last_fullsized":"2024-09-12T02:57:09.871652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875973+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:57:09.875973+0000","last_peered":"2024-09-12T02:57:09.875973+0000","last_clean":"2024-09-12T02:57:09.875973+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:57:09.875973+0000","last_undegraded":"2024-09-12T02:57:09.875973+0000","last_fullsized":"2024-09-12T02:57:09.875973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885802+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:57:09.885802+0000","last_peered":"2024-09-12T02:57:09.885802+0000","last_clean":"2024-09-12T02:57:09.885802+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:57:09.885802+0000","last_undegraded":"2024-09-12T02:57:09.885802+0000","last_fullsized":"2024-09-12T02:57:09.885802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366287+0000","last_change":"2024-09-12T02:57:08.873190+0000","last_active":"2024-09-12T02:57:10.366287+0000","last_peered":"2024-09-12T02:57:10.366287+0000","last_clean":"2024-09-12T02:57:10.366287+0000","last_became_active":"2024-09-12T02:57:08.872526+0000","last_became_peered":"2024-09-12T02:57:08.872526+0000","last_unstale":"2024-09-12T02:57:10.366287+0000","last_undegraded":"2024-09-12T02:57:10.366287+0000","last_fullsized":"2024-09-12T02:57:10.366287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:15.257391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871819+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:57:09.871819+0000","last_peered":"2024-09-12T02:57:09.871819+0000","last_clean":"2024-09-12T02:57:09.871819+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:57:09.871819+0000","last_undegraded":"2024-09-12T02:57:09.871819+0000","last_fullsized":"2024-09-12T02:57:09.871819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367905+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:57:10.367905+0000","last_peered":"2024-09-12T02:57:10.367905+0000","last_clean":"2024-09-12T02:57:10.367905+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:57:10.367905+0000","last_undegraded":"2024-09-12T02:57:10.367905+0000","last_fullsized":"2024-09-12T02:57:10.367905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872056+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:57:09.872056+0000","last_peered":"2024-09-12T02:57:09.872056+0000","last_clean":"2024-09-12T02:57:09.872056+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:57:09.872056+0000","last_undegraded":"2024-09-12T02:57:09.872056+0000","last_fullsized":"2024-09-12T02:57:09.872056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875137+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:57:09.875137+0000","last_peered":"2024-09-12T02:57:09.875137+0000","last_clean":"2024-09-12T02:57:09.875137+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:57:09.875137+0000","last_undegraded":"2024-09-12T02:57:09.875137+0000","last_fullsized":"2024-09-12T02:57:09.875137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366549+0000","last_change":"2024-09-12T02:57:04.841244+0000","last_active":"2024-09-12T02:57:10.366549+0000","last_peered":"2024-09-12T02:57:10.366549+0000","last_clean":"2024-09-12T02:57:10.366549+0000","last_became_active":"2024-09-12T02:57:04.837935+0000","last_became_peered":"2024-09-12T02:57:04.837935+0000","last_unstale":"2024-09-12T02:57:10.366549+0000","last_undegraded":"2024-09-12T02:57:10.366549+0000","last_fullsized":"2024-09-12T02:57:10.366549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:50.023694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875090+0000","last_change":"2024-09-12T02:57:04.874054+0000","last_active":"2024-09-12T02:57:09.875090+0000","last_peered":"2024-09-12T02:57:09.875090+0000","last_clean":"2024-09-12T02:57:09.875090+0000","last_became_active":"2024-09-12T02:57:04.867372+0000","last_became_peered":"2024-09-12T02:57:04.867372+0000","last_unstale":"2024-09-12T02:57:09.875090+0000","last_undegraded":"2024-09-12T02:57:09.875090+0000","last_fullsized":"2024-09-12T02:57:09.875090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:06.010582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885676+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:57:09.885676+0000","last_peered":"2024-09-12T02:57:09.885676+0000","last_clean":"2024-09-12T02:57:09.885676+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:57:09.885676+0000","last_undegraded":"2024-09-12T02:57:09.885676+0000","last_fullsized":"2024-09-12T02:57:09.885676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872206+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:57:09.872206+0000","last_peered":"2024-09-12T02:57:09.872206+0000","last_clean":"2024-09-12T02:57:09.872206+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:57:09.872206+0000","last_undegraded":"2024-09-12T02:57:09.872206+0000","last_fullsized":"2024-09-12T02:57:09.872206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367050+0000","last_change":"2024-09-12T02:57:04.836873+0000","last_active":"2024-09-12T02:57:10.367050+0000","last_peered":"2024-09-12T02:57:10.367050+0000","last_clean":"2024-09-12T02:57:10.367050+0000","last_became_active":"2024-09-12T02:57:04.836564+0000","last_became_peered":"2024-09-12T02:57:04.836564+0000","last_unstale":"2024-09-12T02:57:10.367050+0000","last_undegraded":"2024-09-12T02:57:10.367050+0000","last_fullsized":"2024-09-12T02:57:10.367050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.539077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877094+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:57:09.877094+0000","last_peered":"2024-09-12T02:57:09.877094+0000","last_clean":"2024-09-12T02:57:09.877094+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:57:09.877094+0000","last_undegraded":"2024-09-12T02:57:09.877094+0000","last_fullsized":"2024-09-12T02:57:09.877094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872473+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:57:09.872473+0000","last_peered":"2024-09-12T02:57:09.872473+0000","last_clean":"2024-09-12T02:57:09.872473+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:57:09.872473+0000","last_undegraded":"2024-09-12T02:57:09.872473+0000","last_fullsized":"2024-09-12T02:57:09.872473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874601+0000","last_change":"2024-09-12T02:57:04.874760+0000","last_active":"2024-09-12T02:57:09.874601+0000","last_peered":"2024-09-12T02:57:09.874601+0000","last_clean":"2024-09-12T02:57:09.874601+0000","last_became_active":"2024-09-12T02:57:04.861196+0000","last_became_peered":"2024-09-12T02:57:04.861196+0000","last_unstale":"2024-09-12T02:57:09.874601+0000","last_undegraded":"2024-09-12T02:57:09.874601+0000","last_fullsized":"2024-09-12T02:57:09.874601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871359+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:57:09.871359+0000","last_peered":"2024-09-12T02:57:09.871359+0000","last_clean":"2024-09-12T02:57:09.871359+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:57:09.871359+0000","last_undegraded":"2024-09-12T02:57:09.871359+0000","last_fullsized":"2024-09-12T02:57:09.871359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874921+0000","last_change":"2024-09-12T02:57:04.879052+0000","last_active":"2024-09-12T02:57:09.874921+0000","last_peered":"2024-09-12T02:57:09.874921+0000","last_clean":"2024-09-12T02:57:09.874921+0000","last_became_active":"2024-09-12T02:57:04.877672+0000","last_became_peered":"2024-09-12T02:57:04.877672+0000","last_unstale":"2024-09-12T02:57:09.874921+0000","last_undegraded":"2024-09-12T02:57:09.874921+0000","last_fullsized":"2024-09-12T02:57:09.874921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885442+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:57:09.885442+0000","last_peered":"2024-09-12T02:57:09.885442+0000","last_clean":"2024-09-12T02:57:09.885442+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:57:09.885442+0000","last_undegraded":"2024-09-12T02:57:09.885442+0000","last_fullsized":"2024-09-12T02:57:09.885442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876589+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:57:09.876589+0000","last_peered":"2024-09-12T02:57:09.876589+0000","last_clean":"2024-09-12T02:57:09.876589+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:57:09.876589+0000","last_undegraded":"2024-09-12T02:57:09.876589+0000","last_fullsized":"2024-09-12T02:57:09.876589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346360+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:57:10.346360+0000","last_peered":"2024-09-12T02:57:10.346360+0000","last_clean":"2024-09-12T02:57:10.346360+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:57:10.346360+0000","last_undegraded":"2024-09-12T02:57:10.346360+0000","last_fullsized":"2024-09-12T02:57:10.346360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366832+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:57:10.366832+0000","last_peered":"2024-09-12T02:57:10.366832+0000","last_clean":"2024-09-12T02:57:10.366832+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:57:10.366832+0000","last_undegraded":"2024-09-12T02:57:10.366832+0000","last_fullsized":"2024-09-12T02:57:10.366832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877276+0000","last_change":"2024-09-12T02:57:04.867799+0000","last_active":"2024-09-12T02:57:09.877276+0000","last_peered":"2024-09-12T02:57:09.877276+0000","last_clean":"2024-09-12T02:57:09.877276+0000","last_became_active":"2024-09-12T02:57:04.863800+0000","last_became_peered":"2024-09-12T02:57:04.863800+0000","last_unstale":"2024-09-12T02:57:09.877276+0000","last_undegraded":"2024-09-12T02:57:09.877276+0000","last_fullsized":"2024-09-12T02:57:09.877276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874304+0000","last_change":"2024-09-12T02:57:04.864906+0000","last_active":"2024-09-12T02:57:09.874304+0000","last_peered":"2024-09-12T02:57:09.874304+0000","last_clean":"2024-09-12T02:57:09.874304+0000","last_became_active":"2024-09-12T02:57:04.863556+0000","last_became_peered":"2024-09-12T02:57:04.863556+0000","last_unstale":"2024-09-12T02:57:09.874304+0000","last_undegraded":"2024-09-12T02:57:09.874304+0000","last_fullsized":"2024-09-12T02:57:09.874304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366044+0000","last_change":"2024-09-12T02:57:04.826304+0000","last_active":"2024-09-12T02:57:10.366044+0000","last_peered":"2024-09-12T02:57:10.366044+0000","last_clean":"2024-09-12T02:57:10.366044+0000","last_became_active":"2024-09-12T02:57:04.825998+0000","last_became_peered":"2024-09-12T02:57:04.825998+0000","last_unstale":"2024-09-12T02:57:10.366044+0000","last_undegraded":"2024-09-12T02:57:10.366044+0000","last_fullsized":"2024-09-12T02:57:10.366044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:35.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886270+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:57:09.886270+0000","last_peered":"2024-09-12T02:57:09.886270+0000","last_clean":"2024-09-12T02:57:09.886270+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:57:09.886270+0000","last_undegraded":"2024-09-12T02:57:09.886270+0000","last_fullsized":"2024-09-12T02:57:09.886270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871588+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:57:09.871588+0000","last_peered":"2024-09-12T02:57:09.871588+0000","last_clean":"2024-09-12T02:57:09.871588+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:57:09.871588+0000","last_undegraded":"2024-09-12T02:57:09.871588+0000","last_fullsized":"2024-09-12T02:57:09.871588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368395+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:57:10.368395+0000","last_peered":"2024-09-12T02:57:10.368395+0000","last_clean":"2024-09-12T02:57:10.368395+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:57:10.368395+0000","last_undegraded":"2024-09-12T02:57:10.368395+0000","last_fullsized":"2024-09-12T02:57:10.368395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877007+0000","last_change":"2024-09-12T02:57:04.864295+0000","last_active":"2024-09-12T02:57:09.877007+0000","last_peered":"2024-09-12T02:57:09.877007+0000","last_clean":"2024-09-12T02:57:09.877007+0000","last_became_active":"2024-09-12T02:57:04.863563+0000","last_became_peered":"2024-09-12T02:57:04.863563+0000","last_unstale":"2024-09-12T02:57:09.877007+0000","last_undegraded":"2024-09-12T02:57:09.877007+0000","last_fullsized":"2024-09-12T02:57:09.877007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877026+0000","last_change":"2024-09-12T02:57:04.860987+0000","last_active":"2024-09-12T02:57:09.877026+0000","last_peered":"2024-09-12T02:57:09.877026+0000","last_clean":"2024-09-12T02:57:09.877026+0000","last_became_active":"2024-09-12T02:57:04.859032+0000","last_became_peered":"2024-09-12T02:57:04.859032+0000","last_unstale":"2024-09-12T02:57:09.877026+0000","last_undegraded":"2024-09-12T02:57:09.877026+0000","last_fullsized":"2024-09-12T02:57:09.877026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346559+0000","last_change":"2024-09-12T02:57:04.881172+0000","last_active":"2024-09-12T02:57:10.346559+0000","last_peered":"2024-09-12T02:57:10.346559+0000","last_clean":"2024-09-12T02:57:10.346559+0000","last_became_active":"2024-09-12T02:57:04.880660+0000","last_became_peered":"2024-09-12T02:57:04.880660+0000","last_unstale":"2024-09-12T02:57:10.346559+0000","last_undegraded":"2024-09-12T02:57:10.346559+0000","last_fullsized":"2024-09-12T02:57:10.346559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:15.389185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871386+0000","last_change":"2024-09-12T02:57:04.876735+0000","last_active":"2024-09-12T02:57:09.871386+0000","last_peered":"2024-09-12T02:57:09.871386+0000","last_clean":"2024-09-12T02:57:09.871386+0000","last_became_active":"2024-09-12T02:57:04.876321+0000","last_became_peered":"2024-09-12T02:57:04.876321+0000","last_unstale":"2024-09-12T02:57:09.871386+0000","last_undegraded":"2024-09-12T02:57:09.871386+0000","last_fullsized":"2024-09-12T02:57:09.871386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345483+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:57:10.345483+0000","last_peered":"2024-09-12T02:57:10.345483+0000","last_clean":"2024-09-12T02:57:10.345483+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:57:10.345483+0000","last_undegraded":"2024-09-12T02:57:10.345483+0000","last_fullsized":"2024-09-12T02:57:10.345483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874829+0000","last_change":"2024-09-12T02:57:04.878277+0000","last_active":"2024-09-12T02:57:09.874829+0000","last_peered":"2024-09-12T02:57:09.874829+0000","last_clean":"2024-09-12T02:57:09.874829+0000","last_became_active":"2024-09-12T02:57:04.876816+0000","last_became_peered":"2024-09-12T02:57:04.876816+0000","last_unstale":"2024-09-12T02:57:09.874829+0000","last_undegraded":"2024-09-12T02:57:09.874829+0000","last_fullsized":"2024-09-12T02:57:09.874829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345685+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:57:10.345685+0000","last_peered":"2024-09-12T02:57:10.345685+0000","last_clean":"2024-09-12T02:57:10.345685+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:57:10.345685+0000","last_undegraded":"2024-09-12T02:57:10.345685+0000","last_fullsized":"2024-09-12T02:57:10.345685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875150+0000","last_change":"2024-09-12T02:57:04.876472+0000","last_active":"2024-09-12T02:57:09.875150+0000","last_peered":"2024-09-12T02:57:09.875150+0000","last_clean":"2024-09-12T02:57:09.875150+0000","last_became_active":"2024-09-12T02:57:04.867264+0000","last_became_peered":"2024-09-12T02:57:04.867264+0000","last_unstale":"2024-09-12T02:57:09.875150+0000","last_undegraded":"2024-09-12T02:57:09.875150+0000","last_fullsized":"2024-09-12T02:57:09.875150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885265+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:57:09.885265+0000","last_peered":"2024-09-12T02:57:09.885265+0000","last_clean":"2024-09-12T02:57:09.885265+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:57:09.885265+0000","last_undegraded":"2024-09-12T02:57:09.885265+0000","last_fullsized":"2024-09-12T02:57:09.885265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367313+0000","last_change":"2024-09-12T02:57:04.841638+0000","last_active":"2024-09-12T02:57:10.367313+0000","last_peered":"2024-09-12T02:57:10.367313+0000","last_clean":"2024-09-12T02:57:10.367313+0000","last_became_active":"2024-09-12T02:57:04.841367+0000","last_became_peered":"2024-09-12T02:57:04.841367+0000","last_unstale":"2024-09-12T02:57:10.367313+0000","last_undegraded":"2024-09-12T02:57:10.367313+0000","last_fullsized":"2024-09-12T02:57:10.367313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:24.890973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346275+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:57:10.346275+0000","last_peered":"2024-09-12T02:57:10.346275+0000","last_clean":"2024-09-12T02:57:10.346275+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:57:10.346275+0000","last_undegraded":"2024-09-12T02:57:10.346275+0000","last_fullsized":"2024-09-12T02:57:10.346275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":698324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:57:34.218 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:57:34.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.389+0000 7f7147400640 1 Processor -- start 2024-09-12T02:57:34.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.389+0000 7f7147400640 1 -- start start 2024-09-12T02:57:34.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7147400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7140151a80 0x7f7140072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7147400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7140074070 0x7f7140073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7147400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71401580c0 con 0x7f71400c2380 2024-09-12T02:57:34.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7147400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f71400c8500 con 0x7f7140074070 2024-09-12T02:57:34.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7147400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f71401583a0 con 0x7f7140151a80 2024-09-12T02:57:34.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7137e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7140074070 0x7f7140073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7137e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7140074070 0x7f7140073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39004/0 (socket says 172.21.15.63:39004) 2024-09-12T02:57:34.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7137e00640 1 -- 172.21.15.63:0/361639504 learned_addr learned my addr 172.21.15.63:0/361639504 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:34.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7144a00640 1 --2- 172.21.15.63:0/361639504 >> v2:172.21.15.119:3300/0 conn(0x7f7140151a80 0x7f7140072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7137e00640 1 -- 172.21.15.63:0/361639504 >> v2:172.21.15.119:3300/0 conn(0x7f7140151a80 msgr2=0x7f7140072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:34.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7137e00640 1 --2- 172.21.15.63:0/361639504 >> v2:172.21.15.119:3300/0 conn(0x7f7140151a80 0x7f7140072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7137e00640 1 -- 172.21.15.63:0/361639504 >> v1:172.21.15.119:6789/0 conn(0x7f71400c2380 legacy=0x7f71400c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7137e00640 1 -- 172.21.15.63:0/361639504 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71400cbf00 con 0x7f7140074070 2024-09-12T02:57:34.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.393+0000 7f7144a00640 1 --2- 172.21.15.63:0/361639504 >> v2:172.21.15.119:3300/0 conn(0x7f7140151a80 0x7f7140072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:34.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7137e00640 1 --2- 172.21.15.63:0/361639504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140074070 0x7f7140073390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f71400c9b30 tx=0x7f71280213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990e85f02cbf3190 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:34.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f713fe00640 1 -- 172.21.15.63:0/361639504 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71280b6070 con 0x7f7140074070 2024-09-12T02:57:34.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f713fe00640 1 -- 172.21.15.63:0/361639504 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71280b1600 con 0x7f7140074070 2024-09-12T02:57:34.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f713fe00640 1 -- 172.21.15.63:0/361639504 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71280b19d0 con 0x7f7140074070 2024-09-12T02:57:34.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 -- 172.21.15.63:0/361639504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140074070 msgr2=0x7f7140073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 --2- 172.21.15.63:0/361639504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140074070 0x7f7140073390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f71400c9b30 tx=0x7f71280213e0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 -- 172.21.15.63:0/361639504 shutdown_connections 2024-09-12T02:57:34.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 --2- 172.21.15.63:0/361639504 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140074070 0x7f7140073390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 --2- 172.21.15.63:0/361639504 >> v2:172.21.15.119:3300/0 conn(0x7f7140151a80 0x7f7140072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 -- 172.21.15.63:0/361639504 >> 172.21.15.63:0/361639504 conn(0x7f714006f3d0 msgr2=0x7f714006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:34.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 -- 172.21.15.63:0/361639504 shutdown_connections 2024-09-12T02:57:34.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 -- 172.21.15.63:0/361639504 wait complete. 2024-09-12T02:57:34.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 Processor -- start 2024-09-12T02:57:34.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.397+0000 7f7147400640 1 -- start start 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7147400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7140074070 0x7f71400c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7147400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71400c2380 0x7f71401e3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7147400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140151a80 0x7f71401e3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7147400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f71400c81f0 con 0x7f7140151a80 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7147400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f71400cc4c0 con 0x7f7140074070 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7147400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f71400c7cf0 con 0x7f71400c2380 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7145400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140151a80 0x7f71401e3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7145400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140151a80 0x7f71401e3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39016/0 (socket says 172.21.15.63:39016) 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7145400640 1 -- 172.21.15.63:0/821023347 learned_addr learned my addr 172.21.15.63:0/821023347 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7144a00640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7140074070 0x7f71400c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7137e00640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71400c2380 0x7f71401e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7145400640 1 -- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71400c2380 msgr2=0x7f71401e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7145400640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71400c2380 0x7f71401e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7145400640 1 -- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7140074070 msgr2=0x7f71400c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7145400640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7140074070 0x7f71400c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7145400640 1 -- 172.21.15.63:0/821023347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71400cbb70 con 0x7f7140151a80 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7145400640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140151a80 0x7f71401e3dc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f713800c770 tx=0x7f713800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f713d600640 1 -- 172.21.15.63:0/821023347 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138003b80 con 0x7f7140151a80 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f713d600640 1 -- 172.21.15.63:0/821023347 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7138003d20 con 0x7f7140151a80 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f713d600640 1 -- 172.21.15.63:0/821023347 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713800aa90 con 0x7f7140151a80 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71401e1d00 con 0x7f7140151a80 2024-09-12T02:57:34.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71401e22c0 con 0x7f7140151a80 2024-09-12T02:57:34.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714006fef0 con 0x7f7140151a80 2024-09-12T02:57:34.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.401+0000 7f713d600640 1 -- 172.21.15.63:0/821023347 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f713800ac30 con 0x7f7140151a80 2024-09-12T02:57:34.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.405+0000 7f713d600640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f711c0678f0 0x7f711c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.405+0000 7f713d600640 1 -- 172.21.15.63:0/821023347 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7138085dc0 con 0x7f7140151a80 2024-09-12T02:57:34.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.405+0000 7f7144a00640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f711c0678f0 0x7f711c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.405+0000 7f7144a00640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f711c0678f0 0x7f711c069db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71300045f0 tx=0x7f7130008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:34.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.409+0000 7f713d600640 1 -- 172.21.15.63:0/821023347 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7138055f60 con 0x7f7140151a80 2024-09-12T02:57:34.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.569+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71400c7fd0 con 0x7f711c0678f0 2024-09-12T02:57:34.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.593+0000 7f713d600640 1 -- 172.21.15.63:0/821023347 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f71400c7fd0 con 0x7f711c0678f0 2024-09-12T02:57:34.599 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:34.601 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:57:34.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f711c0678f0 msgr2=0x7f711c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f711c0678f0 0x7f711c069db0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f71300045f0 tx=0x7f7130008040 comp rx=0 tx=0).stop 2024-09-12T02:57:34.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140151a80 msgr2=0x7f71401e3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140151a80 0x7f71401e3dc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f713800c770 tx=0x7f713800cc30 comp rx=0 tx=0).stop 2024-09-12T02:57:34.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 shutdown_connections 2024-09-12T02:57:34.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7140151a80 0x7f71401e3dc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f711c0678f0 0x7f711c069db0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71400c2380 0x7f71401e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 --2- 172.21.15.63:0/821023347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7140074070 0x7f71400c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 >> 172.21.15.63:0/821023347 conn(0x7f714006f3d0 msgr2=0x7f714006f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:34.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 shutdown_connections 2024-09-12T02:57:34.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.597+0000 7f7147400640 1 -- 172.21.15.63:0/821023347 wait complete. 2024-09-12T02:57:34.620 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-09-12T02:57:33.756749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2049012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004852"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886709+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:57:09.886709+0000","last_peered":"2024-09-12T02:57:09.886709+0000","last_clean":"2024-09-12T02:57:09.886709+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:57:09.886709+0000","last_undegraded":"2024-09-12T02:57:09.886709+0000","last_fullsized":"2024-09-12T02:57:09.886709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872098+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:57:09.872098+0000","last_peered":"2024-09-12T02:57:09.872098+0000","last_clean":"2024-09-12T02:57:09.872098+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:57:09.872098+0000","last_undegraded":"2024-09-12T02:57:09.872098+0000","last_fullsized":"2024-09-12T02:57:09.872098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871428+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:57:09.871428+0000","last_peered":"2024-09-12T02:57:09.871428+0000","last_clean":"2024-09-12T02:57:09.871428+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:57:09.871428+0000","last_undegraded":"2024-09-12T02:57:09.871428+0000","last_fullsized":"2024-09-12T02:57:09.871428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872215+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:57:09.872215+0000","last_peered":"2024-09-12T02:57:09.872215+0000","last_clean":"2024-09-12T02:57:09.872215+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:57:09.872215+0000","last_undegraded":"2024-09-12T02:57:09.872215+0000","last_fullsized":"2024-09-12T02:57:09.872215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886576+0000","last_change":"2024-09-12T02:57:04.882473+0000","last_active":"2024-09-12T02:57:09.886576+0000","last_peered":"2024-09-12T02:57:09.886576+0000","last_clean":"2024-09-12T02:57:09.886576+0000","last_became_active":"2024-09-12T02:57:04.882182+0000","last_became_peered":"2024-09-12T02:57:04.882182+0000","last_unstale":"2024-09-12T02:57:09.886576+0000","last_undegraded":"2024-09-12T02:57:09.886576+0000","last_fullsized":"2024-09-12T02:57:09.886576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367426+0000","last_change":"2024-09-12T02:57:08.878799+0000","last_active":"2024-09-12T02:57:10.367426+0000","last_peered":"2024-09-12T02:57:10.367426+0000","last_clean":"2024-09-12T02:57:10.367426+0000","last_became_active":"2024-09-12T02:57:08.877274+0000","last_became_peered":"2024-09-12T02:57:08.877274+0000","last_unstale":"2024-09-12T02:57:10.367426+0000","last_undegraded":"2024-09-12T02:57:10.367426+0000","last_fullsized":"2024-09-12T02:57:10.367426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:27.611325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346487+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:57:10.346487+0000","last_peered":"2024-09-12T02:57:10.346487+0000","last_clean":"2024-09-12T02:57:10.346487+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:57:10.346487+0000","last_undegraded":"2024-09-12T02:57:10.346487+0000","last_fullsized":"2024-09-12T02:57:10.346487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875248+0000","last_change":"2024-09-12T02:57:04.875312+0000","last_active":"2024-09-12T02:57:09.875248+0000","last_peered":"2024-09-12T02:57:09.875248+0000","last_clean":"2024-09-12T02:57:09.875248+0000","last_became_active":"2024-09-12T02:57:04.863748+0000","last_became_peered":"2024-09-12T02:57:04.863748+0000","last_unstale":"2024-09-12T02:57:09.875248+0000","last_undegraded":"2024-09-12T02:57:09.875248+0000","last_fullsized":"2024-09-12T02:57:09.875248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:39.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368200+0000","last_change":"2024-09-12T02:57:08.888677+0000","last_active":"2024-09-12T02:57:10.368200+0000","last_peered":"2024-09-12T02:57:10.368200+0000","last_clean":"2024-09-12T02:57:10.368200+0000","last_became_active":"2024-09-12T02:57:08.875948+0000","last_became_peered":"2024-09-12T02:57:08.875948+0000","last_unstale":"2024-09-12T02:57:10.368200+0000","last_undegraded":"2024-09-12T02:57:10.368200+0000","last_fullsized":"2024-09-12T02:57:10.368200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.194444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345910+0000","last_change":"2024-09-12T02:57:03.832933+0000","last_active":"2024-09-12T02:57:10.345910+0000","last_peered":"2024-09-12T02:57:10.345910+0000","last_clean":"2024-09-12T02:57:10.345910+0000","last_became_active":"2024-09-12T02:57:03.832253+0000","last_became_peered":"2024-09-12T02:57:03.832253+0000","last_unstale":"2024-09-12T02:57:10.345910+0000","last_undegraded":"2024-09-12T02:57:10.345910+0000","last_fullsized":"2024-09-12T02:57:10.345910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877844+0000","last_change":"2024-09-12T02:57:04.880036+0000","last_active":"2024-09-12T02:57:09.877844+0000","last_peered":"2024-09-12T02:57:09.877844+0000","last_clean":"2024-09-12T02:57:09.877844+0000","last_became_active":"2024-09-12T02:57:04.879490+0000","last_became_peered":"2024-09-12T02:57:04.879490+0000","last_unstale":"2024-09-12T02:57:09.877844+0000","last_undegraded":"2024-09-12T02:57:09.877844+0000","last_fullsized":"2024-09-12T02:57:09.877844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.579939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367568+0000","last_change":"2024-09-12T02:57:08.890508+0000","last_active":"2024-09-12T02:57:10.367568+0000","last_peered":"2024-09-12T02:57:10.367568+0000","last_clean":"2024-09-12T02:57:10.367568+0000","last_became_active":"2024-09-12T02:57:08.886515+0000","last_became_peered":"2024-09-12T02:57:08.886515+0000","last_unstale":"2024-09-12T02:57:10.367568+0000","last_undegraded":"2024-09-12T02:57:10.367568+0000","last_fullsized":"2024-09-12T02:57:10.367568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:28.963220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875670+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:57:09.875670+0000","last_peered":"2024-09-12T02:57:09.875670+0000","last_clean":"2024-09-12T02:57:09.875670+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:57:09.875670+0000","last_undegraded":"2024-09-12T02:57:09.875670+0000","last_fullsized":"2024-09-12T02:57:09.875670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346531+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:57:10.346531+0000","last_peered":"2024-09-12T02:57:10.346531+0000","last_clean":"2024-09-12T02:57:10.346531+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:57:10.346531+0000","last_undegraded":"2024-09-12T02:57:10.346531+0000","last_fullsized":"2024-09-12T02:57:10.346531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368605+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:57:10.368605+0000","last_peered":"2024-09-12T02:57:10.368605+0000","last_clean":"2024-09-12T02:57:10.368605+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:57:10.368605+0000","last_undegraded":"2024-09-12T02:57:10.368605+0000","last_fullsized":"2024-09-12T02:57:10.368605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871686+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:57:09.871686+0000","last_peered":"2024-09-12T02:57:09.871686+0000","last_clean":"2024-09-12T02:57:09.871686+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:57:09.871686+0000","last_undegraded":"2024-09-12T02:57:09.871686+0000","last_fullsized":"2024-09-12T02:57:09.871686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366516+0000","last_change":"2024-09-12T02:57:03.790544+0000","last_active":"2024-09-12T02:57:10.366516+0000","last_peered":"2024-09-12T02:57:10.366516+0000","last_clean":"2024-09-12T02:57:10.366516+0000","last_became_active":"2024-09-12T02:57:03.790195+0000","last_became_peered":"2024-09-12T02:57:03.790195+0000","last_unstale":"2024-09-12T02:57:10.366516+0000","last_undegraded":"2024-09-12T02:57:10.366516+0000","last_fullsized":"2024-09-12T02:57:10.366516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368276+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:57:10.368276+0000","last_peered":"2024-09-12T02:57:10.368276+0000","last_clean":"2024-09-12T02:57:10.368276+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:57:10.368276+0000","last_undegraded":"2024-09-12T02:57:10.368276+0000","last_fullsized":"2024-09-12T02:57:10.368276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871830+0000","last_change":"2024-09-12T02:57:04.835949+0000","last_active":"2024-09-12T02:57:09.871830+0000","last_peered":"2024-09-12T02:57:09.871830+0000","last_clean":"2024-09-12T02:57:09.871830+0000","last_became_active":"2024-09-12T02:57:04.835628+0000","last_became_peered":"2024-09-12T02:57:04.835628+0000","last_unstale":"2024-09-12T02:57:09.871830+0000","last_undegraded":"2024-09-12T02:57:09.871830+0000","last_fullsized":"2024-09-12T02:57:09.871830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366134+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:57:10.366134+0000","last_peered":"2024-09-12T02:57:10.366134+0000","last_clean":"2024-09-12T02:57:10.366134+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:57:10.366134+0000","last_undegraded":"2024-09-12T02:57:10.366134+0000","last_fullsized":"2024-09-12T02:57:10.366134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367370+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:57:10.367370+0000","last_peered":"2024-09-12T02:57:10.367370+0000","last_clean":"2024-09-12T02:57:10.367370+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:57:10.367370+0000","last_undegraded":"2024-09-12T02:57:10.367370+0000","last_fullsized":"2024-09-12T02:57:10.367370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367963+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:57:10.367963+0000","last_peered":"2024-09-12T02:57:10.367963+0000","last_clean":"2024-09-12T02:57:10.367963+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:57:10.367963+0000","last_undegraded":"2024-09-12T02:57:10.367963+0000","last_fullsized":"2024-09-12T02:57:10.367963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345073+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:57:10.345073+0000","last_peered":"2024-09-12T02:57:10.345073+0000","last_clean":"2024-09-12T02:57:10.345073+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:57:10.345073+0000","last_undegraded":"2024-09-12T02:57:10.345073+0000","last_fullsized":"2024-09-12T02:57:10.345073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368760+0000","last_change":"2024-09-12T02:57:08.881925+0000","last_active":"2024-09-12T02:57:10.368760+0000","last_peered":"2024-09-12T02:57:10.368760+0000","last_clean":"2024-09-12T02:57:10.368760+0000","last_became_active":"2024-09-12T02:57:08.880913+0000","last_became_peered":"2024-09-12T02:57:08.880913+0000","last_unstale":"2024-09-12T02:57:10.368760+0000","last_undegraded":"2024-09-12T02:57:10.368760+0000","last_fullsized":"2024-09-12T02:57:10.368760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:48.637854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885883+0000","last_change":"2024-09-12T02:57:04.837566+0000","last_active":"2024-09-12T02:57:09.885883+0000","last_peered":"2024-09-12T02:57:09.885883+0000","last_clean":"2024-09-12T02:57:09.885883+0000","last_became_active":"2024-09-12T02:57:04.837281+0000","last_became_peered":"2024-09-12T02:57:04.837281+0000","last_unstale":"2024-09-12T02:57:09.885883+0000","last_undegraded":"2024-09-12T02:57:09.885883+0000","last_fullsized":"2024-09-12T02:57:09.885883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:23.664487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.878159+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:57:09.878159+0000","last_peered":"2024-09-12T02:57:09.878159+0000","last_clean":"2024-09-12T02:57:09.878159+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:57:09.878159+0000","last_undegraded":"2024-09-12T02:57:09.878159+0000","last_fullsized":"2024-09-12T02:57:09.878159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367595+0000","last_change":"2024-09-12T02:57:09.038564+0000","last_active":"2024-09-12T02:57:10.367595+0000","last_peered":"2024-09-12T02:57:10.367595+0000","last_clean":"2024-09-12T02:57:10.367595+0000","last_became_active":"2024-09-12T02:57:09.036310+0000","last_became_peered":"2024-09-12T02:57:09.036310+0000","last_unstale":"2024-09-12T02:57:10.367595+0000","last_undegraded":"2024-09-12T02:57:10.367595+0000","last_fullsized":"2024-09-12T02:57:10.367595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.627698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872469+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:57:09.872469+0000","last_peered":"2024-09-12T02:57:09.872469+0000","last_clean":"2024-09-12T02:57:09.872469+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:57:09.872469+0000","last_undegraded":"2024-09-12T02:57:09.872469+0000","last_fullsized":"2024-09-12T02:57:09.872469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367376+0000","last_change":"2024-09-12T02:57:03.809884+0000","last_active":"2024-09-12T02:57:10.367376+0000","last_peered":"2024-09-12T02:57:10.367376+0000","last_clean":"2024-09-12T02:57:10.367376+0000","last_became_active":"2024-09-12T02:57:03.809610+0000","last_became_peered":"2024-09-12T02:57:03.809610+0000","last_unstale":"2024-09-12T02:57:10.367376+0000","last_undegraded":"2024-09-12T02:57:10.367376+0000","last_fullsized":"2024-09-12T02:57:10.367376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871306+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:57:09.871306+0000","last_peered":"2024-09-12T02:57:09.871306+0000","last_clean":"2024-09-12T02:57:09.871306+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:57:09.871306+0000","last_undegraded":"2024-09-12T02:57:09.871306+0000","last_fullsized":"2024-09-12T02:57:09.871306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366942+0000","last_change":"2024-09-12T02:57:04.837330+0000","last_active":"2024-09-12T02:57:10.366942+0000","last_peered":"2024-09-12T02:57:10.366942+0000","last_clean":"2024-09-12T02:57:10.366942+0000","last_became_active":"2024-09-12T02:57:04.836984+0000","last_became_peered":"2024-09-12T02:57:04.836984+0000","last_unstale":"2024-09-12T02:57:10.366942+0000","last_undegraded":"2024-09-12T02:57:10.366942+0000","last_fullsized":"2024-09-12T02:57:10.366942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346664+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:57:10.346664+0000","last_peered":"2024-09-12T02:57:10.346664+0000","last_clean":"2024-09-12T02:57:10.346664+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:57:10.346664+0000","last_undegraded":"2024-09-12T02:57:10.346664+0000","last_fullsized":"2024-09-12T02:57:10.346664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885339+0000","last_change":"2024-09-12T02:57:09.025446+0000","last_active":"2024-09-12T02:57:09.885339+0000","last_peered":"2024-09-12T02:57:09.885339+0000","last_clean":"2024-09-12T02:57:09.885339+0000","last_became_active":"2024-09-12T02:57:09.025008+0000","last_became_peered":"2024-09-12T02:57:09.025008+0000","last_unstale":"2024-09-12T02:57:09.885339+0000","last_undegraded":"2024-09-12T02:57:09.885339+0000","last_fullsized":"2024-09-12T02:57:09.885339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877996+0000","last_change":"2024-09-12T02:57:04.861898+0000","last_active":"2024-09-12T02:57:09.877996+0000","last_peered":"2024-09-12T02:57:09.877996+0000","last_clean":"2024-09-12T02:57:09.877996+0000","last_became_active":"2024-09-12T02:57:04.858339+0000","last_became_peered":"2024-09-12T02:57:04.858339+0000","last_unstale":"2024-09-12T02:57:09.877996+0000","last_undegraded":"2024-09-12T02:57:09.877996+0000","last_fullsized":"2024-09-12T02:57:09.877996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367038+0000","last_change":"2024-09-12T02:57:03.796368+0000","last_active":"2024-09-12T02:57:10.367038+0000","last_peered":"2024-09-12T02:57:10.367038+0000","last_clean":"2024-09-12T02:57:10.367038+0000","last_became_active":"2024-09-12T02:57:03.796016+0000","last_became_peered":"2024-09-12T02:57:03.796016+0000","last_unstale":"2024-09-12T02:57:10.367038+0000","last_undegraded":"2024-09-12T02:57:10.367038+0000","last_fullsized":"2024-09-12T02:57:10.367038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:27.840978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366160+0000","last_change":"2024-09-12T02:57:08.877519+0000","last_active":"2024-09-12T02:57:10.366160+0000","last_peered":"2024-09-12T02:57:10.366160+0000","last_clean":"2024-09-12T02:57:10.366160+0000","last_became_active":"2024-09-12T02:57:08.872329+0000","last_became_peered":"2024-09-12T02:57:08.872329+0000","last_unstale":"2024-09-12T02:57:10.366160+0000","last_undegraded":"2024-09-12T02:57:10.366160+0000","last_fullsized":"2024-09-12T02:57:10.366160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.661785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368703+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:57:10.368703+0000","last_peered":"2024-09-12T02:57:10.368703+0000","last_clean":"2024-09-12T02:57:10.368703+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:57:10.368703+0000","last_undegraded":"2024-09-12T02:57:10.368703+0000","last_fullsized":"2024-09-12T02:57:10.368703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875332+0000","last_change":"2024-09-12T02:57:03.802797+0000","last_active":"2024-09-12T02:57:09.875332+0000","last_peered":"2024-09-12T02:57:09.875332+0000","last_clean":"2024-09-12T02:57:09.875332+0000","last_became_active":"2024-09-12T02:57:03.798969+0000","last_became_peered":"2024-09-12T02:57:03.798969+0000","last_unstale":"2024-09-12T02:57:09.875332+0000","last_undegraded":"2024-09-12T02:57:09.875332+0000","last_fullsized":"2024-09-12T02:57:09.875332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.025589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367036+0000","last_change":"2024-09-12T02:57:08.883289+0000","last_active":"2024-09-12T02:57:10.367036+0000","last_peered":"2024-09-12T02:57:10.367036+0000","last_clean":"2024-09-12T02:57:10.367036+0000","last_became_active":"2024-09-12T02:57:08.880476+0000","last_became_peered":"2024-09-12T02:57:08.880476+0000","last_unstale":"2024-09-12T02:57:10.367036+0000","last_undegraded":"2024-09-12T02:57:10.367036+0000","last_fullsized":"2024-09-12T02:57:10.367036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:04.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366058+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:57:10.366058+0000","last_peered":"2024-09-12T02:57:10.366058+0000","last_clean":"2024-09-12T02:57:10.366058+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:57:10.366058+0000","last_undegraded":"2024-09-12T02:57:10.366058+0000","last_fullsized":"2024-09-12T02:57:10.366058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366630+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:57:10.366630+0000","last_peered":"2024-09-12T02:57:10.366630+0000","last_clean":"2024-09-12T02:57:10.366630+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:57:10.366630+0000","last_undegraded":"2024-09-12T02:57:10.366630+0000","last_fullsized":"2024-09-12T02:57:10.366630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367404+0000","last_change":"2024-09-12T02:57:08.872506+0000","last_active":"2024-09-12T02:57:10.367404+0000","last_peered":"2024-09-12T02:57:10.367404+0000","last_clean":"2024-09-12T02:57:10.367404+0000","last_became_active":"2024-09-12T02:57:08.872127+0000","last_became_peered":"2024-09-12T02:57:08.872127+0000","last_unstale":"2024-09-12T02:57:10.367404+0000","last_undegraded":"2024-09-12T02:57:10.367404+0000","last_fullsized":"2024-09-12T02:57:10.367404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:19.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885022+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:57:09.885022+0000","last_peered":"2024-09-12T02:57:09.885022+0000","last_clean":"2024-09-12T02:57:09.885022+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:57:09.885022+0000","last_undegraded":"2024-09-12T02:57:09.885022+0000","last_fullsized":"2024-09-12T02:57:09.885022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345274+0000","last_change":"2024-09-12T02:57:03.827694+0000","last_active":"2024-09-12T02:57:10.345274+0000","last_peered":"2024-09-12T02:57:10.345274+0000","last_clean":"2024-09-12T02:57:10.345274+0000","last_became_active":"2024-09-12T02:57:03.827099+0000","last_became_peered":"2024-09-12T02:57:03.827099+0000","last_unstale":"2024-09-12T02:57:10.345274+0000","last_undegraded":"2024-09-12T02:57:10.345274+0000","last_fullsized":"2024-09-12T02:57:10.345274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885728+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:57:09.885728+0000","last_peered":"2024-09-12T02:57:09.885728+0000","last_clean":"2024-09-12T02:57:09.885728+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:57:09.885728+0000","last_undegraded":"2024-09-12T02:57:09.885728+0000","last_fullsized":"2024-09-12T02:57:09.885728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871567+0000","last_change":"2024-09-12T02:57:04.882517+0000","last_active":"2024-09-12T02:57:09.871567+0000","last_peered":"2024-09-12T02:57:09.871567+0000","last_clean":"2024-09-12T02:57:09.871567+0000","last_became_active":"2024-09-12T02:57:04.882159+0000","last_became_peered":"2024-09-12T02:57:04.882159+0000","last_unstale":"2024-09-12T02:57:09.871567+0000","last_undegraded":"2024-09-12T02:57:09.871567+0000","last_fullsized":"2024-09-12T02:57:09.871567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876576+0000","last_change":"2024-09-12T02:57:03.798773+0000","last_active":"2024-09-12T02:57:09.876576+0000","last_peered":"2024-09-12T02:57:09.876576+0000","last_clean":"2024-09-12T02:57:09.876576+0000","last_became_active":"2024-09-12T02:57:03.797799+0000","last_became_peered":"2024-09-12T02:57:03.797799+0000","last_unstale":"2024-09-12T02:57:09.876576+0000","last_undegraded":"2024-09-12T02:57:09.876576+0000","last_fullsized":"2024-09-12T02:57:09.876576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345357+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:57:10.345357+0000","last_peered":"2024-09-12T02:57:10.345357+0000","last_clean":"2024-09-12T02:57:10.345357+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:57:10.345357+0000","last_undegraded":"2024-09-12T02:57:10.345357+0000","last_fullsized":"2024-09-12T02:57:10.345357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876527+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:57:09.876527+0000","last_peered":"2024-09-12T02:57:09.876527+0000","last_clean":"2024-09-12T02:57:09.876527+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:57:09.876527+0000","last_undegraded":"2024-09-12T02:57:09.876527+0000","last_fullsized":"2024-09-12T02:57:09.876527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346026+0000","last_change":"2024-09-12T02:57:04.879076+0000","last_active":"2024-09-12T02:57:10.346026+0000","last_peered":"2024-09-12T02:57:10.346026+0000","last_clean":"2024-09-12T02:57:10.346026+0000","last_became_active":"2024-09-12T02:57:04.878160+0000","last_became_peered":"2024-09-12T02:57:04.878160+0000","last_unstale":"2024-09-12T02:57:10.346026+0000","last_undegraded":"2024-09-12T02:57:10.346026+0000","last_fullsized":"2024-09-12T02:57:10.346026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.589537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366400+0000","last_change":"2024-09-12T02:57:03.798239+0000","last_active":"2024-09-12T02:57:10.366400+0000","last_peered":"2024-09-12T02:57:10.366400+0000","last_clean":"2024-09-12T02:57:10.366400+0000","last_became_active":"2024-09-12T02:57:03.797935+0000","last_became_peered":"2024-09-12T02:57:03.797935+0000","last_unstale":"2024-09-12T02:57:10.366400+0000","last_undegraded":"2024-09-12T02:57:10.366400+0000","last_fullsized":"2024-09-12T02:57:10.366400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875409+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:57:09.875409+0000","last_peered":"2024-09-12T02:57:09.875409+0000","last_clean":"2024-09-12T02:57:09.875409+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:57:09.875409+0000","last_undegraded":"2024-09-12T02:57:09.875409+0000","last_fullsized":"2024-09-12T02:57:09.875409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875411+0000","last_change":"2024-09-12T02:57:04.858809+0000","last_active":"2024-09-12T02:57:09.875411+0000","last_peered":"2024-09-12T02:57:09.875411+0000","last_clean":"2024-09-12T02:57:09.875411+0000","last_became_active":"2024-09-12T02:57:04.858048+0000","last_became_peered":"2024-09-12T02:57:04.858048+0000","last_unstale":"2024-09-12T02:57:09.875411+0000","last_undegraded":"2024-09-12T02:57:09.875411+0000","last_fullsized":"2024-09-12T02:57:09.875411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:59.698440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367203+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:57:10.367203+0000","last_peered":"2024-09-12T02:57:10.367203+0000","last_clean":"2024-09-12T02:57:10.367203+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:57:10.367203+0000","last_undegraded":"2024-09-12T02:57:10.367203+0000","last_fullsized":"2024-09-12T02:57:10.367203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885593+0000","last_change":"2024-09-12T02:57:08.874656+0000","last_active":"2024-09-12T02:57:09.885593+0000","last_peered":"2024-09-12T02:57:09.885593+0000","last_clean":"2024-09-12T02:57:09.885593+0000","last_became_active":"2024-09-12T02:57:08.874202+0000","last_became_peered":"2024-09-12T02:57:08.874202+0000","last_unstale":"2024-09-12T02:57:09.885593+0000","last_undegraded":"2024-09-12T02:57:09.885593+0000","last_fullsized":"2024-09-12T02:57:09.885593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.794828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346615+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:57:10.346615+0000","last_peered":"2024-09-12T02:57:10.346615+0000","last_clean":"2024-09-12T02:57:10.346615+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:57:10.346615+0000","last_undegraded":"2024-09-12T02:57:10.346615+0000","last_fullsized":"2024-09-12T02:57:10.346615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366863+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:57:10.366863+0000","last_peered":"2024-09-12T02:57:10.366863+0000","last_clean":"2024-09-12T02:57:10.366863+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:57:10.366863+0000","last_undegraded":"2024-09-12T02:57:10.366863+0000","last_fullsized":"2024-09-12T02:57:10.366863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874320+0000","last_change":"2024-09-12T02:57:09.030839+0000","last_active":"2024-09-12T02:57:09.874320+0000","last_peered":"2024-09-12T02:57:09.874320+0000","last_clean":"2024-09-12T02:57:09.874320+0000","last_became_active":"2024-09-12T02:57:09.029808+0000","last_became_peered":"2024-09-12T02:57:09.029808+0000","last_unstale":"2024-09-12T02:57:09.874320+0000","last_undegraded":"2024-09-12T02:57:09.874320+0000","last_fullsized":"2024-09-12T02:57:09.874320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346464+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:57:10.346464+0000","last_peered":"2024-09-12T02:57:10.346464+0000","last_clean":"2024-09-12T02:57:10.346464+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:57:10.346464+0000","last_undegraded":"2024-09-12T02:57:10.346464+0000","last_fullsized":"2024-09-12T02:57:10.346464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368984+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:57:10.368984+0000","last_peered":"2024-09-12T02:57:10.368984+0000","last_clean":"2024-09-12T02:57:10.368984+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:57:10.368984+0000","last_undegraded":"2024-09-12T02:57:10.368984+0000","last_fullsized":"2024-09-12T02:57:10.368984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367280+0000","last_change":"2024-09-12T02:57:08.896161+0000","last_active":"2024-09-12T02:57:10.367280+0000","last_peered":"2024-09-12T02:57:10.367280+0000","last_clean":"2024-09-12T02:57:10.367280+0000","last_became_active":"2024-09-12T02:57:08.895379+0000","last_became_peered":"2024-09-12T02:57:08.895379+0000","last_unstale":"2024-09-12T02:57:10.367280+0000","last_undegraded":"2024-09-12T02:57:10.367280+0000","last_fullsized":"2024-09-12T02:57:10.367280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:34.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345587+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:57:10.345587+0000","last_peered":"2024-09-12T02:57:10.345587+0000","last_clean":"2024-09-12T02:57:10.345587+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:57:10.345587+0000","last_undegraded":"2024-09-12T02:57:10.345587+0000","last_fullsized":"2024-09-12T02:57:10.345587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366369+0000","last_change":"2024-09-12T02:57:03.788301+0000","last_active":"2024-09-12T02:57:10.366369+0000","last_peered":"2024-09-12T02:57:10.366369+0000","last_clean":"2024-09-12T02:57:10.366369+0000","last_became_active":"2024-09-12T02:57:03.788002+0000","last_became_peered":"2024-09-12T02:57:03.788002+0000","last_unstale":"2024-09-12T02:57:10.366369+0000","last_undegraded":"2024-09-12T02:57:10.366369+0000","last_fullsized":"2024-09-12T02:57:10.366369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885578+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:57:09.885578+0000","last_peered":"2024-09-12T02:57:09.885578+0000","last_clean":"2024-09-12T02:57:09.885578+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:57:09.885578+0000","last_undegraded":"2024-09-12T02:57:09.885578+0000","last_fullsized":"2024-09-12T02:57:09.885578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875635+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:57:09.875635+0000","last_peered":"2024-09-12T02:57:09.875635+0000","last_clean":"2024-09-12T02:57:09.875635+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:57:09.875635+0000","last_undegraded":"2024-09-12T02:57:09.875635+0000","last_fullsized":"2024-09-12T02:57:09.875635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876542+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:57:09.876542+0000","last_peered":"2024-09-12T02:57:09.876542+0000","last_clean":"2024-09-12T02:57:09.876542+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:57:09.876542+0000","last_undegraded":"2024-09-12T02:57:09.876542+0000","last_fullsized":"2024-09-12T02:57:09.876542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872348+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:57:09.872348+0000","last_peered":"2024-09-12T02:57:09.872348+0000","last_clean":"2024-09-12T02:57:09.872348+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:57:09.872348+0000","last_undegraded":"2024-09-12T02:57:09.872348+0000","last_fullsized":"2024-09-12T02:57:09.872348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346216+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:57:10.346216+0000","last_peered":"2024-09-12T02:57:10.346216+0000","last_clean":"2024-09-12T02:57:10.346216+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:57:10.346216+0000","last_undegraded":"2024-09-12T02:57:10.346216+0000","last_fullsized":"2024-09-12T02:57:10.346216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875168+0000","last_change":"2024-09-12T02:57:03.802047+0000","last_active":"2024-09-12T02:57:09.875168+0000","last_peered":"2024-09-12T02:57:09.875168+0000","last_clean":"2024-09-12T02:57:09.875168+0000","last_became_active":"2024-09-12T02:57:03.797936+0000","last_became_peered":"2024-09-12T02:57:03.797936+0000","last_unstale":"2024-09-12T02:57:09.875168+0000","last_undegraded":"2024-09-12T02:57:09.875168+0000","last_fullsized":"2024-09-12T02:57:09.875168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:10.176640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872067+0000","last_change":"2024-09-12T02:57:09.030826+0000","last_active":"2024-09-12T02:57:09.872067+0000","last_peered":"2024-09-12T02:57:09.872067+0000","last_clean":"2024-09-12T02:57:09.872067+0000","last_became_active":"2024-09-12T02:57:09.029437+0000","last_became_peered":"2024-09-12T02:57:09.029437+0000","last_unstale":"2024-09-12T02:57:09.872067+0000","last_undegraded":"2024-09-12T02:57:09.872067+0000","last_fullsized":"2024-09-12T02:57:09.872067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:15.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886359+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:57:09.886359+0000","last_peered":"2024-09-12T02:57:09.886359+0000","last_clean":"2024-09-12T02:57:09.886359+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:57:09.886359+0000","last_undegraded":"2024-09-12T02:57:09.886359+0000","last_fullsized":"2024-09-12T02:57:09.886359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885915+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:57:09.885915+0000","last_peered":"2024-09-12T02:57:09.885915+0000","last_clean":"2024-09-12T02:57:09.885915+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:57:09.885915+0000","last_undegraded":"2024-09-12T02:57:09.885915+0000","last_fullsized":"2024-09-12T02:57:09.885915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877662+0000","last_change":"2024-09-12T02:57:09.031080+0000","last_active":"2024-09-12T02:57:09.877662+0000","last_peered":"2024-09-12T02:57:09.877662+0000","last_clean":"2024-09-12T02:57:09.877662+0000","last_became_active":"2024-09-12T02:57:09.029892+0000","last_became_peered":"2024-09-12T02:57:09.029892+0000","last_unstale":"2024-09-12T02:57:09.877662+0000","last_undegraded":"2024-09-12T02:57:09.877662+0000","last_fullsized":"2024-09-12T02:57:09.877662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345803+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:57:10.345803+0000","last_peered":"2024-09-12T02:57:10.345803+0000","last_clean":"2024-09-12T02:57:10.345803+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:57:10.345803+0000","last_undegraded":"2024-09-12T02:57:10.345803+0000","last_fullsized":"2024-09-12T02:57:10.345803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:22.371934+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:57:22.371934+0000","last_peered":"2024-09-12T02:57:22.371934+0000","last_clean":"2024-09-12T02:57:22.371934+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:57:22.371934+0000","last_undegraded":"2024-09-12T02:57:22.371934+0000","last_fullsized":"2024-09-12T02:57:22.371934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366364+0000","last_change":"2024-09-12T02:57:08.884030+0000","last_active":"2024-09-12T02:57:10.366364+0000","last_peered":"2024-09-12T02:57:10.366364+0000","last_clean":"2024-09-12T02:57:10.366364+0000","last_became_active":"2024-09-12T02:57:08.880332+0000","last_became_peered":"2024-09-12T02:57:08.880332+0000","last_unstale":"2024-09-12T02:57:10.366364+0000","last_undegraded":"2024-09-12T02:57:10.366364+0000","last_fullsized":"2024-09-12T02:57:10.366364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:25.232846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368553+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:57:10.368553+0000","last_peered":"2024-09-12T02:57:10.368553+0000","last_clean":"2024-09-12T02:57:10.368553+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:57:10.368553+0000","last_undegraded":"2024-09-12T02:57:10.368553+0000","last_fullsized":"2024-09-12T02:57:10.368553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367151+0000","last_change":"2024-09-12T02:57:03.798009+0000","last_active":"2024-09-12T02:57:10.367151+0000","last_peered":"2024-09-12T02:57:10.367151+0000","last_clean":"2024-09-12T02:57:10.367151+0000","last_became_active":"2024-09-12T02:57:03.797749+0000","last_became_peered":"2024-09-12T02:57:03.797749+0000","last_unstale":"2024-09-12T02:57:10.367151+0000","last_undegraded":"2024-09-12T02:57:10.367151+0000","last_fullsized":"2024-09-12T02:57:10.367151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.058712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367936+0000","last_change":"2024-09-12T02:57:08.885401+0000","last_active":"2024-09-12T02:57:10.367936+0000","last_peered":"2024-09-12T02:57:10.367936+0000","last_clean":"2024-09-12T02:57:10.367936+0000","last_became_active":"2024-09-12T02:57:08.883296+0000","last_became_peered":"2024-09-12T02:57:08.883296+0000","last_unstale":"2024-09-12T02:57:10.367936+0000","last_undegraded":"2024-09-12T02:57:10.367936+0000","last_fullsized":"2024-09-12T02:57:10.367936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:24.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886680+0000","last_change":"2024-09-12T02:57:04.882349+0000","last_active":"2024-09-12T02:57:09.886680+0000","last_peered":"2024-09-12T02:57:09.886680+0000","last_clean":"2024-09-12T02:57:09.886680+0000","last_became_active":"2024-09-12T02:57:04.882060+0000","last_became_peered":"2024-09-12T02:57:04.882060+0000","last_unstale":"2024-09-12T02:57:09.886680+0000","last_undegraded":"2024-09-12T02:57:09.886680+0000","last_fullsized":"2024-09-12T02:57:09.886680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876076+0000","last_change":"2024-09-12T02:57:03.811429+0000","last_active":"2024-09-12T02:57:09.876076+0000","last_peered":"2024-09-12T02:57:09.876076+0000","last_clean":"2024-09-12T02:57:09.876076+0000","last_became_active":"2024-09-12T02:57:03.810672+0000","last_became_peered":"2024-09-12T02:57:03.810672+0000","last_unstale":"2024-09-12T02:57:09.876076+0000","last_undegraded":"2024-09-12T02:57:09.876076+0000","last_fullsized":"2024-09-12T02:57:09.876076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871687+0000","last_change":"2024-09-12T02:57:08.875903+0000","last_active":"2024-09-12T02:57:09.871687+0000","last_peered":"2024-09-12T02:57:09.871687+0000","last_clean":"2024-09-12T02:57:09.871687+0000","last_became_active":"2024-09-12T02:57:08.875270+0000","last_became_peered":"2024-09-12T02:57:08.875270+0000","last_unstale":"2024-09-12T02:57:09.871687+0000","last_undegraded":"2024-09-12T02:57:09.871687+0000","last_fullsized":"2024-09-12T02:57:09.871687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875836+0000","last_change":"2024-09-12T02:57:04.864904+0000","last_active":"2024-09-12T02:57:09.875836+0000","last_peered":"2024-09-12T02:57:09.875836+0000","last_clean":"2024-09-12T02:57:09.875836+0000","last_became_active":"2024-09-12T02:57:04.861650+0000","last_became_peered":"2024-09-12T02:57:04.861650+0000","last_unstale":"2024-09-12T02:57:09.875836+0000","last_undegraded":"2024-09-12T02:57:09.875836+0000","last_fullsized":"2024-09-12T02:57:09.875836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:31.529412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877718+0000","last_change":"2024-09-12T02:57:03.812106+0000","last_active":"2024-09-12T02:57:09.877718+0000","last_peered":"2024-09-12T02:57:09.877718+0000","last_clean":"2024-09-12T02:57:09.877718+0000","last_became_active":"2024-09-12T02:57:03.810041+0000","last_became_peered":"2024-09-12T02:57:03.810041+0000","last_unstale":"2024-09-12T02:57:09.877718+0000","last_undegraded":"2024-09-12T02:57:09.877718+0000","last_fullsized":"2024-09-12T02:57:09.877718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871655+0000","last_change":"2024-09-12T02:57:09.030507+0000","last_active":"2024-09-12T02:57:09.871655+0000","last_peered":"2024-09-12T02:57:09.871655+0000","last_clean":"2024-09-12T02:57:09.871655+0000","last_became_active":"2024-09-12T02:57:09.029459+0000","last_became_peered":"2024-09-12T02:57:09.029459+0000","last_unstale":"2024-09-12T02:57:09.871655+0000","last_undegraded":"2024-09-12T02:57:09.871655+0000","last_fullsized":"2024-09-12T02:57:09.871655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:26.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885411+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:57:09.885411+0000","last_peered":"2024-09-12T02:57:09.885411+0000","last_clean":"2024-09-12T02:57:09.885411+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:57:09.885411+0000","last_undegraded":"2024-09-12T02:57:09.885411+0000","last_fullsized":"2024-09-12T02:57:09.885411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.365943+0000","last_change":"2024-09-12T02:57:04.834192+0000","last_active":"2024-09-12T02:57:10.365943+0000","last_peered":"2024-09-12T02:57:10.365943+0000","last_clean":"2024-09-12T02:57:10.365943+0000","last_became_active":"2024-09-12T02:57:04.833901+0000","last_became_peered":"2024-09-12T02:57:04.833901+0000","last_unstale":"2024-09-12T02:57:10.365943+0000","last_undegraded":"2024-09-12T02:57:10.365943+0000","last_fullsized":"2024-09-12T02:57:10.365943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:51:30.019270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874853+0000","last_change":"2024-09-12T02:57:03.807210+0000","last_active":"2024-09-12T02:57:09.874853+0000","last_peered":"2024-09-12T02:57:09.874853+0000","last_clean":"2024-09-12T02:57:09.874853+0000","last_became_active":"2024-09-12T02:57:03.805335+0000","last_became_peered":"2024-09-12T02:57:03.805335+0000","last_unstale":"2024-09-12T02:57:09.874853+0000","last_undegraded":"2024-09-12T02:57:09.874853+0000","last_fullsized":"2024-09-12T02:57:09.874853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876801+0000","last_change":"2024-09-12T02:57:08.895753+0000","last_active":"2024-09-12T02:57:09.876801+0000","last_peered":"2024-09-12T02:57:09.876801+0000","last_clean":"2024-09-12T02:57:09.876801+0000","last_became_active":"2024-09-12T02:57:08.894542+0000","last_became_peered":"2024-09-12T02:57:08.894542+0000","last_unstale":"2024-09-12T02:57:09.876801+0000","last_undegraded":"2024-09-12T02:57:09.876801+0000","last_fullsized":"2024-09-12T02:57:09.876801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871791+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:57:09.871791+0000","last_peered":"2024-09-12T02:57:09.871791+0000","last_clean":"2024-09-12T02:57:09.871791+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:57:09.871791+0000","last_undegraded":"2024-09-12T02:57:09.871791+0000","last_fullsized":"2024-09-12T02:57:09.871791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871652+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:57:09.871652+0000","last_peered":"2024-09-12T02:57:09.871652+0000","last_clean":"2024-09-12T02:57:09.871652+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:57:09.871652+0000","last_undegraded":"2024-09-12T02:57:09.871652+0000","last_fullsized":"2024-09-12T02:57:09.871652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875973+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:57:09.875973+0000","last_peered":"2024-09-12T02:57:09.875973+0000","last_clean":"2024-09-12T02:57:09.875973+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:57:09.875973+0000","last_undegraded":"2024-09-12T02:57:09.875973+0000","last_fullsized":"2024-09-12T02:57:09.875973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885802+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:57:09.885802+0000","last_peered":"2024-09-12T02:57:09.885802+0000","last_clean":"2024-09-12T02:57:09.885802+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:57:09.885802+0000","last_undegraded":"2024-09-12T02:57:09.885802+0000","last_fullsized":"2024-09-12T02:57:09.885802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366287+0000","last_change":"2024-09-12T02:57:08.873190+0000","last_active":"2024-09-12T02:57:10.366287+0000","last_peered":"2024-09-12T02:57:10.366287+0000","last_clean":"2024-09-12T02:57:10.366287+0000","last_became_active":"2024-09-12T02:57:08.872526+0000","last_became_peered":"2024-09-12T02:57:08.872526+0000","last_unstale":"2024-09-12T02:57:10.366287+0000","last_undegraded":"2024-09-12T02:57:10.366287+0000","last_fullsized":"2024-09-12T02:57:10.366287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:15.257391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871819+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:57:09.871819+0000","last_peered":"2024-09-12T02:57:09.871819+0000","last_clean":"2024-09-12T02:57:09.871819+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:57:09.871819+0000","last_undegraded":"2024-09-12T02:57:09.871819+0000","last_fullsized":"2024-09-12T02:57:09.871819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367905+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:57:10.367905+0000","last_peered":"2024-09-12T02:57:10.367905+0000","last_clean":"2024-09-12T02:57:10.367905+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:57:10.367905+0000","last_undegraded":"2024-09-12T02:57:10.367905+0000","last_fullsized":"2024-09-12T02:57:10.367905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872056+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:57:09.872056+0000","last_peered":"2024-09-12T02:57:09.872056+0000","last_clean":"2024-09-12T02:57:09.872056+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:57:09.872056+0000","last_undegraded":"2024-09-12T02:57:09.872056+0000","last_fullsized":"2024-09-12T02:57:09.872056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875137+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:57:09.875137+0000","last_peered":"2024-09-12T02:57:09.875137+0000","last_clean":"2024-09-12T02:57:09.875137+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:57:09.875137+0000","last_undegraded":"2024-09-12T02:57:09.875137+0000","last_fullsized":"2024-09-12T02:57:09.875137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366549+0000","last_change":"2024-09-12T02:57:04.841244+0000","last_active":"2024-09-12T02:57:10.366549+0000","last_peered":"2024-09-12T02:57:10.366549+0000","last_clean":"2024-09-12T02:57:10.366549+0000","last_became_active":"2024-09-12T02:57:04.837935+0000","last_became_peered":"2024-09-12T02:57:04.837935+0000","last_unstale":"2024-09-12T02:57:10.366549+0000","last_undegraded":"2024-09-12T02:57:10.366549+0000","last_fullsized":"2024-09-12T02:57:10.366549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:50.023694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875090+0000","last_change":"2024-09-12T02:57:04.874054+0000","last_active":"2024-09-12T02:57:09.875090+0000","last_peered":"2024-09-12T02:57:09.875090+0000","last_clean":"2024-09-12T02:57:09.875090+0000","last_became_active":"2024-09-12T02:57:04.867372+0000","last_became_peered":"2024-09-12T02:57:04.867372+0000","last_unstale":"2024-09-12T02:57:09.875090+0000","last_undegraded":"2024-09-12T02:57:09.875090+0000","last_fullsized":"2024-09-12T02:57:09.875090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:06.010582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885676+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:57:09.885676+0000","last_peered":"2024-09-12T02:57:09.885676+0000","last_clean":"2024-09-12T02:57:09.885676+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:57:09.885676+0000","last_undegraded":"2024-09-12T02:57:09.885676+0000","last_fullsized":"2024-09-12T02:57:09.885676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872206+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:57:09.872206+0000","last_peered":"2024-09-12T02:57:09.872206+0000","last_clean":"2024-09-12T02:57:09.872206+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:57:09.872206+0000","last_undegraded":"2024-09-12T02:57:09.872206+0000","last_fullsized":"2024-09-12T02:57:09.872206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367050+0000","last_change":"2024-09-12T02:57:04.836873+0000","last_active":"2024-09-12T02:57:10.367050+0000","last_peered":"2024-09-12T02:57:10.367050+0000","last_clean":"2024-09-12T02:57:10.367050+0000","last_became_active":"2024-09-12T02:57:04.836564+0000","last_became_peered":"2024-09-12T02:57:04.836564+0000","last_unstale":"2024-09-12T02:57:10.367050+0000","last_undegraded":"2024-09-12T02:57:10.367050+0000","last_fullsized":"2024-09-12T02:57:10.367050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.539077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877094+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:57:09.877094+0000","last_peered":"2024-09-12T02:57:09.877094+0000","last_clean":"2024-09-12T02:57:09.877094+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:57:09.877094+0000","last_undegraded":"2024-09-12T02:57:09.877094+0000","last_fullsized":"2024-09-12T02:57:09.877094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872473+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:57:09.872473+0000","last_peered":"2024-09-12T02:57:09.872473+0000","last_clean":"2024-09-12T02:57:09.872473+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:57:09.872473+0000","last_undegraded":"2024-09-12T02:57:09.872473+0000","last_fullsized":"2024-09-12T02:57:09.872473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874601+0000","last_change":"2024-09-12T02:57:04.874760+0000","last_active":"2024-09-12T02:57:09.874601+0000","last_peered":"2024-09-12T02:57:09.874601+0000","last_clean":"2024-09-12T02:57:09.874601+0000","last_became_active":"2024-09-12T02:57:04.861196+0000","last_became_peered":"2024-09-12T02:57:04.861196+0000","last_unstale":"2024-09-12T02:57:09.874601+0000","last_undegraded":"2024-09-12T02:57:09.874601+0000","last_fullsized":"2024-09-12T02:57:09.874601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871359+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:57:09.871359+0000","last_peered":"2024-09-12T02:57:09.871359+0000","last_clean":"2024-09-12T02:57:09.871359+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:57:09.871359+0000","last_undegraded":"2024-09-12T02:57:09.871359+0000","last_fullsized":"2024-09-12T02:57:09.871359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874921+0000","last_change":"2024-09-12T02:57:04.879052+0000","last_active":"2024-09-12T02:57:09.874921+0000","last_peered":"2024-09-12T02:57:09.874921+0000","last_clean":"2024-09-12T02:57:09.874921+0000","last_became_active":"2024-09-12T02:57:04.877672+0000","last_became_peered":"2024-09-12T02:57:04.877672+0000","last_unstale":"2024-09-12T02:57:09.874921+0000","last_undegraded":"2024-09-12T02:57:09.874921+0000","last_fullsized":"2024-09-12T02:57:09.874921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885442+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:57:09.885442+0000","last_peered":"2024-09-12T02:57:09.885442+0000","last_clean":"2024-09-12T02:57:09.885442+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:57:09.885442+0000","last_undegraded":"2024-09-12T02:57:09.885442+0000","last_fullsized":"2024-09-12T02:57:09.885442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876589+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:57:09.876589+0000","last_peered":"2024-09-12T02:57:09.876589+0000","last_clean":"2024-09-12T02:57:09.876589+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:57:09.876589+0000","last_undegraded":"2024-09-12T02:57:09.876589+0000","last_fullsized":"2024-09-12T02:57:09.876589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346360+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:57:10.346360+0000","last_peered":"2024-09-12T02:57:10.346360+0000","last_clean":"2024-09-12T02:57:10.346360+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:57:10.346360+0000","last_undegraded":"2024-09-12T02:57:10.346360+0000","last_fullsized":"2024-09-12T02:57:10.346360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366832+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:57:10.366832+0000","last_peered":"2024-09-12T02:57:10.366832+0000","last_clean":"2024-09-12T02:57:10.366832+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:57:10.366832+0000","last_undegraded":"2024-09-12T02:57:10.366832+0000","last_fullsized":"2024-09-12T02:57:10.366832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877276+0000","last_change":"2024-09-12T02:57:04.867799+0000","last_active":"2024-09-12T02:57:09.877276+0000","last_peered":"2024-09-12T02:57:09.877276+0000","last_clean":"2024-09-12T02:57:09.877276+0000","last_became_active":"2024-09-12T02:57:04.863800+0000","last_became_peered":"2024-09-12T02:57:04.863800+0000","last_unstale":"2024-09-12T02:57:09.877276+0000","last_undegraded":"2024-09-12T02:57:09.877276+0000","last_fullsized":"2024-09-12T02:57:09.877276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874304+0000","last_change":"2024-09-12T02:57:04.864906+0000","last_active":"2024-09-12T02:57:09.874304+0000","last_peered":"2024-09-12T02:57:09.874304+0000","last_clean":"2024-09-12T02:57:09.874304+0000","last_became_active":"2024-09-12T02:57:04.863556+0000","last_became_peered":"2024-09-12T02:57:04.863556+0000","last_unstale":"2024-09-12T02:57:09.874304+0000","last_undegraded":"2024-09-12T02:57:09.874304+0000","last_fullsized":"2024-09-12T02:57:09.874304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366044+0000","last_change":"2024-09-12T02:57:04.826304+0000","last_active":"2024-09-12T02:57:10.366044+0000","last_peered":"2024-09-12T02:57:10.366044+0000","last_clean":"2024-09-12T02:57:10.366044+0000","last_became_active":"2024-09-12T02:57:04.825998+0000","last_became_peered":"2024-09-12T02:57:04.825998+0000","last_unstale":"2024-09-12T02:57:10.366044+0000","last_undegraded":"2024-09-12T02:57:10.366044+0000","last_fullsized":"2024-09-12T02:57:10.366044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:35.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886270+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:57:09.886270+0000","last_peered":"2024-09-12T02:57:09.886270+0000","last_clean":"2024-09-12T02:57:09.886270+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:57:09.886270+0000","last_undegraded":"2024-09-12T02:57:09.886270+0000","last_fullsized":"2024-09-12T02:57:09.886270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871588+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:57:09.871588+0000","last_peered":"2024-09-12T02:57:09.871588+0000","last_clean":"2024-09-12T02:57:09.871588+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:57:09.871588+0000","last_undegraded":"2024-09-12T02:57:09.871588+0000","last_fullsized":"2024-09-12T02:57:09.871588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368395+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:57:10.368395+0000","last_peered":"2024-09-12T02:57:10.368395+0000","last_clean":"2024-09-12T02:57:10.368395+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:57:10.368395+0000","last_undegraded":"2024-09-12T02:57:10.368395+0000","last_fullsized":"2024-09-12T02:57:10.368395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877007+0000","last_change":"2024-09-12T02:57:04.864295+0000","last_active":"2024-09-12T02:57:09.877007+0000","last_peered":"2024-09-12T02:57:09.877007+0000","last_clean":"2024-09-12T02:57:09.877007+0000","last_became_active":"2024-09-12T02:57:04.863563+0000","last_became_peered":"2024-09-12T02:57:04.863563+0000","last_unstale":"2024-09-12T02:57:09.877007+0000","last_undegraded":"2024-09-12T02:57:09.877007+0000","last_fullsized":"2024-09-12T02:57:09.877007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877026+0000","last_change":"2024-09-12T02:57:04.860987+0000","last_active":"2024-09-12T02:57:09.877026+0000","last_peered":"2024-09-12T02:57:09.877026+0000","last_clean":"2024-09-12T02:57:09.877026+0000","last_became_active":"2024-09-12T02:57:04.859032+0000","last_became_peered":"2024-09-12T02:57:04.859032+0000","last_unstale":"2024-09-12T02:57:09.877026+0000","last_undegraded":"2024-09-12T02:57:09.877026+0000","last_fullsized":"2024-09-12T02:57:09.877026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346559+0000","last_change":"2024-09-12T02:57:04.881172+0000","last_active":"2024-09-12T02:57:10.346559+0000","last_peered":"2024-09-12T02:57:10.346559+0000","last_clean":"2024-09-12T02:57:10.346559+0000","last_became_active":"2024-09-12T02:57:04.880660+0000","last_became_peered":"2024-09-12T02:57:04.880660+0000","last_unstale":"2024-09-12T02:57:10.346559+0000","last_undegraded":"2024-09-12T02:57:10.346559+0000","last_fullsized":"2024-09-12T02:57:10.346559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:15.389185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871386+0000","last_change":"2024-09-12T02:57:04.876735+0000","last_active":"2024-09-12T02:57:09.871386+0000","last_peered":"2024-09-12T02:57:09.871386+0000","last_clean":"2024-09-12T02:57:09.871386+0000","last_became_active":"2024-09-12T02:57:04.876321+0000","last_became_peered":"2024-09-12T02:57:04.876321+0000","last_unstale":"2024-09-12T02:57:09.871386+0000","last_undegraded":"2024-09-12T02:57:09.871386+0000","last_fullsized":"2024-09-12T02:57:09.871386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345483+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:57:10.345483+0000","last_peered":"2024-09-12T02:57:10.345483+0000","last_clean":"2024-09-12T02:57:10.345483+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:57:10.345483+0000","last_undegraded":"2024-09-12T02:57:10.345483+0000","last_fullsized":"2024-09-12T02:57:10.345483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874829+0000","last_change":"2024-09-12T02:57:04.878277+0000","last_active":"2024-09-12T02:57:09.874829+0000","last_peered":"2024-09-12T02:57:09.874829+0000","last_clean":"2024-09-12T02:57:09.874829+0000","last_became_active":"2024-09-12T02:57:04.876816+0000","last_became_peered":"2024-09-12T02:57:04.876816+0000","last_unstale":"2024-09-12T02:57:09.874829+0000","last_undegraded":"2024-09-12T02:57:09.874829+0000","last_fullsized":"2024-09-12T02:57:09.874829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345685+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:57:10.345685+0000","last_peered":"2024-09-12T02:57:10.345685+0000","last_clean":"2024-09-12T02:57:10.345685+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:57:10.345685+0000","last_undegraded":"2024-09-12T02:57:10.345685+0000","last_fullsized":"2024-09-12T02:57:10.345685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875150+0000","last_change":"2024-09-12T02:57:04.876472+0000","last_active":"2024-09-12T02:57:09.875150+0000","last_peered":"2024-09-12T02:57:09.875150+0000","last_clean":"2024-09-12T02:57:09.875150+0000","last_became_active":"2024-09-12T02:57:04.867264+0000","last_became_peered":"2024-09-12T02:57:04.867264+0000","last_unstale":"2024-09-12T02:57:09.875150+0000","last_undegraded":"2024-09-12T02:57:09.875150+0000","last_fullsized":"2024-09-12T02:57:09.875150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885265+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:57:09.885265+0000","last_peered":"2024-09-12T02:57:09.885265+0000","last_clean":"2024-09-12T02:57:09.885265+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:57:09.885265+0000","last_undegraded":"2024-09-12T02:57:09.885265+0000","last_fullsized":"2024-09-12T02:57:09.885265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367313+0000","last_change":"2024-09-12T02:57:04.841638+0000","last_active":"2024-09-12T02:57:10.367313+0000","last_peered":"2024-09-12T02:57:10.367313+0000","last_clean":"2024-09-12T02:57:10.367313+0000","last_became_active":"2024-09-12T02:57:04.841367+0000","last_became_peered":"2024-09-12T02:57:04.841367+0000","last_unstale":"2024-09-12T02:57:10.367313+0000","last_undegraded":"2024-09-12T02:57:10.367313+0000","last_fullsized":"2024-09-12T02:57:10.367313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:24.890973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346275+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:57:10.346275+0000","last_peered":"2024-09-12T02:57:10.346275+0000","last_clean":"2024-09-12T02:57:10.346275+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:57:10.346275+0000","last_undegraded":"2024-09-12T02:57:10.346275+0000","last_fullsized":"2024-09-12T02:57:10.346275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":698324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:57:34.625 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:57:34.625 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:57:34.625 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:57:34.625 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T02:57:34.626 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T02:57:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f83400640 1 Processor -- start 2024-09-12T02:57:34.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f83400640 1 -- start start 2024-09-12T02:57:34.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f83400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9f7c074070 0x7f9f7c0c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f83400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9f7c0c28c0 0x7f9f7c161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f83400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7c0c2d50 con 0x7f9f7c151a80 2024-09-12T02:57:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f83400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7c0c8500 con 0x7f9f7c0c28c0 2024-09-12T02:57:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f83400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7c1580c0 con 0x7f9f7c074070 2024-09-12T02:57:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f81400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9f7c0c28c0 0x7f9f7c161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f81400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9f7c0c28c0 0x7f9f7c161e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39026/0 (socket says 172.21.15.63:39026) 2024-09-12T02:57:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f81400640 1 -- 172.21.15.63:0/413507410 learned_addr learned my addr 172.21.15.63:0/413507410 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f80a00640 1 --1- 172.21.15.63:0/413507410 >> v1:172.21.15.63:6789/0 conn(0x7f9f7c151a80 0x7f9f7c072e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56330/0 (socket says 172.21.15.63:56330) 2024-09-12T02:57:34.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f7be00640 1 --2- 172.21.15.63:0/413507410 >> v2:172.21.15.119:3300/0 conn(0x7f9f7c074070 0x7f9f7c0c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f81400640 1 -- 172.21.15.63:0/413507410 >> v2:172.21.15.119:3300/0 conn(0x7f9f7c074070 msgr2=0x7f9f7c0c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:34.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f81400640 1 --2- 172.21.15.63:0/413507410 >> v2:172.21.15.119:3300/0 conn(0x7f9f7c074070 0x7f9f7c0c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f81400640 1 -- 172.21.15.63:0/413507410 >> v1:172.21.15.63:6789/0 conn(0x7f9f7c151a80 legacy=0x7f9f7c072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.801+0000 7f9f81400640 1 -- 172.21.15.63:0/413507410 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c1583a0 con 0x7f9f7c0c28c0 2024-09-12T02:57:34.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f81400640 1 --2- 172.21.15.63:0/413507410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c0c28c0 0x7f9f7c161e30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c155160 tx=0x7f9f7401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b6b95495a98bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:34.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f7b400640 1 -- 172.21.15.63:0/413507410 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f740b4070 con 0x7f9f7c0c28c0 2024-09-12T02:57:34.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f7b400640 1 -- 172.21.15.63:0/413507410 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f740af400 con 0x7f9f7c0c28c0 2024-09-12T02:57:34.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f7b400640 1 -- 172.21.15.63:0/413507410 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f740af7d0 con 0x7f9f7c0c28c0 2024-09-12T02:57:34.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f83400640 1 -- 172.21.15.63:0/413507410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c0c28c0 msgr2=0x7f9f7c161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f83400640 1 --2- 172.21.15.63:0/413507410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c0c28c0 0x7f9f7c161e30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c155160 tx=0x7f9f7401f1e0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f83400640 1 -- 172.21.15.63:0/413507410 shutdown_connections 2024-09-12T02:57:34.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f83400640 1 --2- 172.21.15.63:0/413507410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c0c28c0 0x7f9f7c161e30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f83400640 1 --2- 172.21.15.63:0/413507410 >> v2:172.21.15.119:3300/0 conn(0x7f9f7c074070 0x7f9f7c0c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f83400640 1 -- 172.21.15.63:0/413507410 >> 172.21.15.63:0/413507410 conn(0x7f9f7c06f3d0 msgr2=0x7f9f7c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:34.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f83400640 1 -- 172.21.15.63:0/413507410 shutdown_connections 2024-09-12T02:57:34.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.805+0000 7f9f83400640 1 -- 172.21.15.63:0/413507410 wait complete. 2024-09-12T02:57:34.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 Processor -- start 2024-09-12T02:57:34.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 -- start start 2024-09-12T02:57:34.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c074070 0x7f9f7c14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0c28c0 0x7f9f7c1e2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c151a80 0x7f9f7c1e3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c0cc4c0 con 0x7f9f7c074070 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c0cc1e0 con 0x7f9f7c151a80 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c0c81f0 con 0x7f9f7c0c28c0 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f80a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c074070 0x7f9f7c14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f80a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c074070 0x7f9f7c14c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39038/0 (socket says 172.21.15.63:39038) 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f80a00640 1 -- 172.21.15.63:0/444594581 learned_addr learned my addr 172.21.15.63:0/444594581 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f7be00640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0c28c0 0x7f9f7c1e2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f81400640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c151a80 0x7f9f7c1e3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f80a00640 1 -- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0c28c0 msgr2=0x7f9f7c1e2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f80a00640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0c28c0 0x7f9f7c1e2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f80a00640 1 -- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c151a80 msgr2=0x7f9f7c1e3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f80a00640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c151a80 0x7f9f7c1e3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f80a00640 1 -- 172.21.15.63:0/444594581 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c14b140 con 0x7f9f7c074070 2024-09-12T02:57:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f81400640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c151a80 0x7f9f7c1e3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f80a00640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c074070 0x7f9f7c14c950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00c370 tx=0x7f9f6c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f78c00640 1 -- 172.21.15.63:0/444594581 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0074e0 con 0x7f9f7c074070 2024-09-12T02:57:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f78c00640 1 -- 172.21.15.63:0/444594581 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6c007680 con 0x7f9f7c074070 2024-09-12T02:57:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f78c00640 1 -- 172.21.15.63:0/444594581 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c004a30 con 0x7f9f7c074070 2024-09-12T02:57:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7c14b420 con 0x7f9f7c074070 2024-09-12T02:57:34.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.809+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7c0cad40 con 0x7f9f7c074070 2024-09-12T02:57:34.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.813+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7c0c7cf0 con 0x7f9f7c074070 2024-09-12T02:57:34.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.813+0000 7f9f78c00640 1 -- 172.21.15.63:0/444594581 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9f6c01a020 con 0x7f9f7c074070 2024-09-12T02:57:34.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.813+0000 7f9f78c00640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9f5c0678c0 0x7f9f5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:34.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.813+0000 7f9f78c00640 1 -- 172.21.15.63:0/444594581 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9f6c0856b0 con 0x7f9f7c074070 2024-09-12T02:57:34.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.813+0000 7f9f7be00640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9f5c0678c0 0x7f9f5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:34.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.813+0000 7f9f7be00640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9f5c0678c0 0x7f9f5c069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c06df90 tx=0x7f9f68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:34.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:34.817+0000 7f9f78c00640 1 -- 172.21.15.63:0/444594581 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9f6c055f40 con 0x7f9f7c074070 2024-09-12T02:57:35.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.025+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9f7c0c7fd0 con 0x7f9f7c074070 2024-09-12T02:57:35.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.029+0000 7f9f78c00640 1 -- 172.21.15.63:0/444594581 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166887 (secure 0 0 0) 0x7f9f6c055840 con 0x7f9f7c074070 2024-09-12T02:57:35.035 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9f5c0678c0 msgr2=0x7f9f5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9f5c0678c0 0x7f9f5c069d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c06df90 tx=0x7f9f68008040 comp rx=0 tx=0).stop 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c074070 msgr2=0x7f9f7c14c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c074070 0x7f9f7c14c950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00c370 tx=0x7f9f6c00c830 comp rx=0 tx=0).stop 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 shutdown_connections 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f7c151a80 0x7f9f7c1e3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9f5c0678c0 0x7f9f5c069d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f7c0c28c0 0x7f9f7c1e2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 --2- 172.21.15.63:0/444594581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f7c074070 0x7f9f7c14c950 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 >> 172.21.15.63:0/444594581 conn(0x7f9f7c06f3d0 msgr2=0x7f9f7c1509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 shutdown_connections 2024-09-12T02:57:35.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.033+0000 7f9f83400640 1 -- 172.21.15.63:0/444594581 wait complete. 2024-09-12T02:57:35.056 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":57260755},{"type":"v1","addr":"172.21.15.119:6833","nonce":57260755}]},"active_addr":"172.21.15.119:6833/57260755","active_change":"2024-09-12T02:56:45.729386+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3178396035}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":4048895224}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":2322721904}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":658838604}]}]} 2024-09-12T02:57:35.060 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T02:57:35.060 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T02:57:35.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:57:35.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.197+0000 7f0dad000640 1 Processor -- start 2024-09-12T02:57:35.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.197+0000 7f0dad000640 1 -- start start 2024-09-12T02:57:35.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0dad000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0da81529f0 0x7f0da80c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0dad000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0da80c9670 0x7f0da8163100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0dad000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da80cdc90 con 0x7f0da80ca870 2024-09-12T02:57:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0dad000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0da806c7f0 con 0x7f0da81529f0 2024-09-12T02:57:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0dad000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0da80c7b40 con 0x7f0da80c9670 2024-09-12T02:57:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0d9d400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0da80ca870 0x7f0da806ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56340/0 (socket says 172.21.15.63:56340) 2024-09-12T02:57:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0d9d400640 1 -- 172.21.15.63:0/1099908842 learned_addr learned my addr 172.21.15.63:0/1099908842 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da6800640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0da80c9670 0x7f0da8163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5e00640 1 --2- 172.21.15.63:0/1099908842 >> v2:172.21.15.119:3300/0 conn(0x7f0da81529f0 0x7f0da80c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579664022 0 0) 0x7f0da80cdc90 con 0x7f0da80ca870 2024-09-12T02:57:35.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d8c003530 con 0x7f0da80ca870 2024-09-12T02:57:35.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3636243751 0 0) 0x7f0d8c003530 con 0x7f0da80ca870 2024-09-12T02:57:35.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0da80c9670 msgr2=0x7f0da8163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:35.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0da80c9670 0x7f0da8163100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 >> v2:172.21.15.119:3300/0 conn(0x7f0da81529f0 msgr2=0x7f0da80c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:35.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 --2- 172.21.15.63:0/1099908842 >> v2:172.21.15.119:3300/0 conn(0x7f0da81529f0 0x7f0da80c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da80c7e20 con 0x7f0da80ca870 2024-09-12T02:57:35.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f0d90001680 con 0x7f0da80ca870 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5e00640 1 --2- 172.21.15.63:0/1099908842 >> v2:172.21.15.119:3300/0 conn(0x7f0da81529f0 0x7f0da80c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 >> v1:172.21.15.63:6789/0 conn(0x7f0da80ca870 legacy=0x7f0da806ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d8c0039c0 0x7f0d8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d8c0043b0 0x7f0d8c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d8c004f00 0x7f0d8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0da80c7b40 con 0x7f0d8c0043b0 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8c00bf10 con 0x7f0d8c004f00 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8c00c090 con 0x7f0d8c0039c0 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da6800640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0da80c9670 0x7f0da8163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0d9d400640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d8c0043b0 0x7f0d8c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da5e00640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d8c0039c0 0x7f0d8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0da6800640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d8c004f00 0x7f0d8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0d9d400640 1 -- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d8c0039c0 msgr2=0x7f0d8c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:35.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0d9d400640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d8c0039c0 0x7f0d8c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0d9d400640 1 -- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d8c004f00 msgr2=0x7f0d8c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:35.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0d9d400640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d8c004f00 0x7f0d8c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.201+0000 7f0d9d400640 1 -- 172.21.15.63:0/1099908842 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8c003530 con 0x7f0d8c0043b0 2024-09-12T02:57:35.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0d9d400640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d8c0043b0 0x7f0d8c004890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000c270 tx=0x7f0d9001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f2c230518ec1f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:35.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90007d40 con 0x7f0d8c0043b0 2024-09-12T02:57:35.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d900a9020 con 0x7f0d8c0043b0 2024-09-12T02:57:35.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0da5400640 1 -- 172.21.15.63:0/1099908842 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d900a5ba0 con 0x7f0d8c0043b0 2024-09-12T02:57:35.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0dad000640 1 -- 172.21.15.63:0/1099908842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d8c0043b0 msgr2=0x7f0d8c004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0dad000640 1 --2- 172.21.15.63:0/1099908842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d8c0043b0 0x7f0d8c004890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000c270 tx=0x7f0d9001cca0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0da6800640 1 -- 172.21.15.63:0/1099908842 reap_dead start 2024-09-12T02:57:35.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0dad000640 1 -- 172.21.15.63:0/1099908842 shutdown_connections 2024-09-12T02:57:35.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0dad000640 1 -- 172.21.15.63:0/1099908842 >> 172.21.15.63:0/1099908842 conn(0x7f0da8072960 msgr2=0x7f0da8072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:35.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0dad000640 1 -- 172.21.15.63:0/1099908842 shutdown_connections 2024-09-12T02:57:35.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.205+0000 7f0dad000640 1 -- 172.21.15.63:0/1099908842 wait complete. 2024-09-12T02:57:35.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 Processor -- start 2024-09-12T02:57:35.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 -- start start 2024-09-12T02:57:35.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d8c0043b0 0x7f0da813d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da813dea0 0x7f0da814e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da814ec70 0x7f0da81f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0da80c3f60 con 0x7f0da814ec70 2024-09-12T02:57:35.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0da80cdf70 con 0x7f0da813dea0 2024-09-12T02:57:35.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0da814f0f0 con 0x7f0d8c0043b0 2024-09-12T02:57:35.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da814ec70 0x7f0da81f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da814ec70 0x7f0da81f3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39066/0 (socket says 172.21.15.63:39066) 2024-09-12T02:57:35.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da6800640 1 -- 172.21.15.63:0/356588723 learned_addr learned my addr 172.21.15.63:0/356588723 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:35.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da5e00640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d8c0043b0 0x7f0da813d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0d9d400640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da813dea0 0x7f0da814e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da6800640 1 -- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d8c0043b0 msgr2=0x7f0da813d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da6800640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d8c0043b0 0x7f0da813d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da6800640 1 -- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da813dea0 msgr2=0x7f0da814e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da6800640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da813dea0 0x7f0da814e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da6800640 1 -- 172.21.15.63:0/356588723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da8151de0 con 0x7f0da814ec70 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0da6800640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da814ec70 0x7f0da81f3810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0da80c9a50 tx=0x7f0da0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0d9ea00640 1 -- 172.21.15.63:0/356588723 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da00039a0 con 0x7f0da814ec70 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0d9ea00640 1 -- 172.21.15.63:0/356588723 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da001b070 con 0x7f0da814ec70 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0d9ea00640 1 -- 172.21.15.63:0/356588723 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0003b60 con 0x7f0da814ec70 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da81520c0 con 0x7f0da814ec70 2024-09-12T02:57:35.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da814de10 con 0x7f0da814ec70 2024-09-12T02:57:35.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.209+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da806ca80 con 0x7f0da814ec70 2024-09-12T02:57:35.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.213+0000 7f0d9ea00640 1 -- 172.21.15.63:0/356588723 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0da0003d00 con 0x7f0da814ec70 2024-09-12T02:57:35.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.213+0000 7f0d9ea00640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0d840678c0 0x7f0d84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.213+0000 7f0d9ea00640 1 -- 172.21.15.63:0/356588723 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0da0086900 con 0x7f0da814ec70 2024-09-12T02:57:35.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.213+0000 7f0da5e00640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0d840678c0 0x7f0d84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.213+0000 7f0da5e00640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0d840678c0 0x7f0d84069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d980093f0 tx=0x7f0d98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:35.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.217+0000 7f0d9ea00640 1 -- 172.21.15.63:0/356588723 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0da0056980 con 0x7f0da814ec70 2024-09-12T02:57:35.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0da8148b50 con 0x7f0da814ec70 2024-09-12T02:57:35.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0d9ea00640 1 -- 172.21.15.63:0/356588723 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18598 (secure 0 0 0) 0x7f0da005ac80 con 0x7f0da814ec70 2024-09-12T02:57:35.388 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:35.388 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:57:09.262695+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:57:35.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0d840678c0 msgr2=0x7f0d84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0d840678c0 0x7f0d84069d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d980093f0 tx=0x7f0d98008040 comp rx=0 tx=0).stop 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da814ec70 msgr2=0x7f0da81f3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da814ec70 0x7f0da81f3810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0da80c9a50 tx=0x7f0da0011890 comp rx=0 tx=0).stop 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 shutdown_connections 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0da814ec70 0x7f0da81f3810 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da813dea0 0x7f0da814e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0d840678c0 0x7f0d84069d80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 --2- 172.21.15.63:0/356588723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d8c0043b0 0x7f0da813d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 >> 172.21.15.63:0/356588723 conn(0x7f0da8072960 msgr2=0x7f0da8070310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 shutdown_connections 2024-09-12T02:57:35.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.385+0000 7f0dad000640 1 -- 172.21.15.63:0/356588723 wait complete. 2024-09-12T02:57:35.410 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T02:57:35.410 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:57:35.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d3200640 1 Processor -- start 2024-09-12T02:57:35.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d3200640 1 -- start start 2024-09-12T02:57:35.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d3200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3d4154b00 0x7fb3d40c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d3200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb3d40c8eb0 0x7fb3d4071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d3200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d415dec0 con 0x7fb3d40cb670 2024-09-12T02:57:35.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d3200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d415ead0 con 0x7fb3d4154b00 2024-09-12T02:57:35.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d3200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d415e1a0 con 0x7fb3d40c8eb0 2024-09-12T02:57:35.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d1e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3d4154b00 0x7fb3d40c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d1e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb3d4154b00 0x7fb3d40c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39072/0 (socket says 172.21.15.63:39072) 2024-09-12T02:57:35.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d1e00640 1 -- 172.21.15.63:0/2303005833 learned_addr learned my addr 172.21.15.63:0/2303005833 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:35.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d2800640 1 --1- 172.21.15.63:0/2303005833 >> v1:172.21.15.63:6789/0 conn(0x7fb3d40cb670 0x7fb3d415a8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56350/0 (socket says 172.21.15.63:56350) 2024-09-12T02:57:35.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d1400640 1 --2- 172.21.15.63:0/2303005833 >> v2:172.21.15.119:3300/0 conn(0x7fb3d40c8eb0 0x7fb3d4071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d1e00640 1 -- 172.21.15.63:0/2303005833 >> v2:172.21.15.119:3300/0 conn(0x7fb3d40c8eb0 msgr2=0x7fb3d4071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:35.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d1e00640 1 --2- 172.21.15.63:0/2303005833 >> v2:172.21.15.119:3300/0 conn(0x7fb3d40c8eb0 0x7fb3d4071450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d1e00640 1 -- 172.21.15.63:0/2303005833 >> v1:172.21.15.63:6789/0 conn(0x7fb3d40cb670 legacy=0x7fb3d415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d1e00640 1 -- 172.21.15.63:0/2303005833 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d415e480 con 0x7fb3d4154b00 2024-09-12T02:57:35.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.549+0000 7fb3d1400640 1 --2- 172.21.15.63:0/2303005833 >> v2:172.21.15.119:3300/0 conn(0x7fb3d40c8eb0 0x7fb3d4071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:35.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d1e00640 1 --2- 172.21.15.63:0/2303005833 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 0x7fb3d40c97c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40b4440 tx=0x7fb3c401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8c4400a558efc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:35.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d0a00640 1 -- 172.21.15.63:0/2303005833 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40b5070 con 0x7fb3d4154b00 2024-09-12T02:57:35.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d0a00640 1 -- 172.21.15.63:0/2303005833 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c40a8a10 con 0x7fb3d4154b00 2024-09-12T02:57:35.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d0a00640 1 -- 172.21.15.63:0/2303005833 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40a8de0 con 0x7fb3d4154b00 2024-09-12T02:57:35.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d3200640 1 -- 172.21.15.63:0/2303005833 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 msgr2=0x7fb3d40c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d3200640 1 --2- 172.21.15.63:0/2303005833 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 0x7fb3d40c97c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40b4440 tx=0x7fb3c401ed10 comp rx=0 tx=0).stop 2024-09-12T02:57:35.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d3200640 1 -- 172.21.15.63:0/2303005833 shutdown_connections 2024-09-12T02:57:35.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d3200640 1 --2- 172.21.15.63:0/2303005833 >> v2:172.21.15.119:3300/0 conn(0x7fb3d40c8eb0 0x7fb3d4071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d3200640 1 --2- 172.21.15.63:0/2303005833 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 0x7fb3d40c97c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d3200640 1 -- 172.21.15.63:0/2303005833 >> 172.21.15.63:0/2303005833 conn(0x7fb3d406f6e0 msgr2=0x7fb3d406faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:35.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d3200640 1 -- 172.21.15.63:0/2303005833 shutdown_connections 2024-09-12T02:57:35.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.553+0000 7fb3d3200640 1 -- 172.21.15.63:0/2303005833 wait complete. 2024-09-12T02:57:35.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 Processor -- start 2024-09-12T02:57:35.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 -- start start 2024-09-12T02:57:35.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3d40c8eb0 0x7fb3d41f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3d40cb670 0x7fb3d415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 0x7fb3d40af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d415afb0 con 0x7fb3d4154b00 2024-09-12T02:57:35.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d40c8b70 con 0x7fb3d40cb670 2024-09-12T02:57:35.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d415b130 con 0x7fb3d40c8eb0 2024-09-12T02:57:35.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d2800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 0x7fb3d40af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d2800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 0x7fb3d40af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39088/0 (socket says 172.21.15.63:39088) 2024-09-12T02:57:35.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d2800640 1 -- 172.21.15.63:0/4187153404 learned_addr learned my addr 172.21.15.63:0/4187153404 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:35.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d1400640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3d40cb670 0x7fb3d415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d1e00640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3d40c8eb0 0x7fb3d41f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d2800640 1 -- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3d40c8eb0 msgr2=0x7fb3d41f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d2800640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3d40c8eb0 0x7fb3d41f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d2800640 1 -- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3d40cb670 msgr2=0x7fb3d415c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d2800640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3d40cb670 0x7fb3d415c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d2800640 1 -- 172.21.15.63:0/4187153404 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d406d5a0 con 0x7fb3d4154b00 2024-09-12T02:57:35.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d2800640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 0x7fb3d40af260 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00c7d0 tx=0x7fb3cc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:35.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3ca000640 1 -- 172.21.15.63:0/4187153404 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc017070 con 0x7fb3d4154b00 2024-09-12T02:57:35.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3ca000640 1 -- 172.21.15.63:0/4187153404 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc00a640 con 0x7fb3d4154b00 2024-09-12T02:57:35.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3ca000640 1 -- 172.21.15.63:0/4187153404 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00a9f0 con 0x7fb3d4154b00 2024-09-12T02:57:35.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d41f07c0 con 0x7fb3d4154b00 2024-09-12T02:57:35.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.557+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d40c4670 con 0x7fb3d4154b00 2024-09-12T02:57:35.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.561+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d40c97c0 con 0x7fb3d4154b00 2024-09-12T02:57:35.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.561+0000 7fb3ca000640 1 -- 172.21.15.63:0/4187153404 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3cc01a070 con 0x7fb3d4154b00 2024-09-12T02:57:35.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.561+0000 7fb3ca000640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb3b40678f0 0x7fb3b4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:35.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.561+0000 7fb3ca000640 1 -- 172.21.15.63:0/4187153404 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb3cc0855a0 con 0x7fb3d4154b00 2024-09-12T02:57:35.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.561+0000 7fb3d1e00640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb3b40678f0 0x7fb3b4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:35.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.565+0000 7fb3d1e00640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb3b40678f0 0x7fb3b4069db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40b2000 tx=0x7fb3c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:35.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.565+0000 7fb3ca000640 1 -- 172.21.15.63:0/4187153404 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb3cc0556b0 con 0x7fb3d4154b00 2024-09-12T02:57:35.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.733+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3d415b3d0 con 0x7fb3d4154b00 2024-09-12T02:57:35.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.733+0000 7fb3ca000640 1 -- 172.21.15.63:0/4187153404 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18598 (secure 0 0 0) 0x7fb3cc0599b0 con 0x7fb3d4154b00 2024-09-12T02:57:35.737 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:35.737 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:57:09.262695+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb3b40678f0 msgr2=0x7fb3b4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb3b40678f0 0x7fb3b4069db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40b2000 tx=0x7fb3c4009040 comp rx=0 tx=0).stop 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 msgr2=0x7fb3d40af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 0x7fb3d40af260 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00c7d0 tx=0x7fb3cc00cc90 comp rx=0 tx=0).stop 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 shutdown_connections 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3d4154b00 0x7fb3d40af260 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb3d40cb670 0x7fb3d415c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb3b40678f0 0x7fb3b4069db0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 --2- 172.21.15.63:0/4187153404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb3d40c8eb0 0x7fb3d41f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:35.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 >> 172.21.15.63:0/4187153404 conn(0x7fb3d406f6e0 msgr2=0x7fb3d415a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 shutdown_connections 2024-09-12T02:57:35.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:35.737+0000 7fb3d3200640 1 -- 172.21.15.63:0/4187153404 wait complete. 2024-09-12T02:57:35.759 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T02:57:35.759 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T02:57:35.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T02:57:35.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T02:57:35.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T02:57:35.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T02:57:35.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T02:57:35.761 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T02:57:36.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.009+0000 7fb7bfa00640 1 Processor -- start 2024-09-12T02:57:36.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.009+0000 7fd08ac00640 1 Processor -- start 2024-09-12T02:57:36.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.009+0000 7fd08ac00640 1 -- start start 2024-09-12T02:57:36.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.009+0000 7fb7bfa00640 1 -- start start 2024-09-12T02:57:36.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.009+0000 7fb7bfa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb7b80c1810 0x7fb7b815ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.009+0000 7fb7bfa00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b806dec0 con 0x7fb7b8160ac0 2024-09-12T02:57:36.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.009+0000 7fb7bfa00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b806cfd0 con 0x7fb7b80c9690 2024-09-12T02:57:36.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.009+0000 7fb7bfa00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fb7b806d2b0 con 0x7fb7b80c1810 2024-09-12T02:57:36.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb7b80c9690 0x7fb7b81603b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:40306/0 (socket says 172.21.15.63:40306) 2024-09-12T02:57:36.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7e00640 1 -- 172.21.15.63:0/1959770613 learned_addr learned my addr 172.21.15.63:0/1959770613 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:36.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7bd000640 1 --2- 172.21.15.63:0/1959770613 >> v2:172.21.15.119:3300/0 conn(0x7fb7b80c1810 0x7fb7b815ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7f0ed1400640 1 Processor -- start 2024-09-12T02:57:36.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1830065279 0 0) 0x7fb7b806cfd0 con 0x7fb7b80c9690 2024-09-12T02:57:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd08ac00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0840cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd08ac00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd0840c5540 0x7fd0840c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd08ac00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0840cc140 con 0x7fd0840d0da0 2024-09-12T02:57:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd08ac00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd0840cce40 con 0x7fd0840c5540 2024-09-12T02:57:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd08ac00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fd0840cd100 con 0x7fd0840d09c0 2024-09-12T02:57:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a0003530 con 0x7fb7b80c9690 2024-09-12T02:57:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876166886 0 0) 0x7fb7b806dec0 con 0x7fb7b8160ac0 2024-09-12T02:57:36.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7b806cfd0 con 0x7fb7b8160ac0 2024-09-12T02:57:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd083e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0840cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd083e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0840cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37508/0 (socket says 172.21.15.63:37508) 2024-09-12T02:57:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd083e00640 1 -- 172.21.15.63:0/4233862718 learned_addr learned my addr 172.21.15.63:0/4233862718 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2705304722 0 0) 0x7fb7b806cfd0 con 0x7fb7b8160ac0 2024-09-12T02:57:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 >> v2:172.21.15.119:3300/0 conn(0x7fb7b80c1810 msgr2=0x7fb7b815ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 --2- 172.21.15.63:0/1959770613 >> v2:172.21.15.119:3300/0 conn(0x7fb7b80c1810 0x7fb7b815ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7f0ed1400640 1 -- start start 2024-09-12T02:57:36.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 >> v1:172.21.15.119:6789/0 conn(0x7fb7b80c9690 legacy=0x7fb7b81603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b806d590 con 0x7fb7b8160ac0 2024-09-12T02:57:36.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7f0adf200640 1 Processor -- start 2024-09-12T02:57:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7fb7b0001a00 con 0x7fb7b8160ac0 2024-09-12T02:57:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 >> v1:172.21.15.63:6789/0 conn(0x7fb7b8160ac0 legacy=0x7fb7b81695a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7a0004c00 0x7fb7a0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a00037b0 0x7fb7a0003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a00041c0 0x7fb7a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b806d2b0 con 0x7fb7a00041c0 2024-09-12T02:57:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a000c0a0 con 0x7fb7a00037b0 2024-09-12T02:57:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a000c2a0 con 0x7fb7a0004c00 2024-09-12T02:57:36.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7bd000640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7a0004c00 0x7fb7a0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fb7b7e00640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a00037b0 0x7fb7a0003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7f0adf200640 1 -- start start 2024-09-12T02:57:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adf200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0ae00c6bd0 0x7f0ae00c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adf200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ae00c6fb0 0x7f0ae01626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adf200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae01621a0 con 0x7f0ae006fcb0 2024-09-12T02:57:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adf200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f0ae00c7bf0 con 0x7f0ae00c6bd0 2024-09-12T02:57:36.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adf200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0ae00c7ed0 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7fb7bd000640 1 -- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a00037b0 msgr2=0x7fb7a0003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7fb7bd000640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a00037b0 0x7fb7a0003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7fb7bd000640 1 -- 172.21.15.63:0/1959770613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a00041c0 msgr2=0x7fb7a000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7fb7bd000640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7a00041c0 0x7fb7a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7fb7b7e00640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7a00037b0 0x7fb7a0003c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7fb7bda00640 1 -- 172.21.15.63:0/1959770613 reap_dead start 2024-09-12T02:57:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ed1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0ecc0c1810 0x7f0ecc15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ed1400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ecc160ac0 0x7f0ecc0c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ed1400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ecc06dec0 con 0x7f0ecc0c9690 2024-09-12T02:57:36.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ed1400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f0ecc06cfd0 con 0x7f0ecc0c1810 2024-09-12T02:57:36.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ed1400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc06d2b0 con 0x7f0ecc160ac0 2024-09-12T02:57:36.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7fb7bd000640 1 -- 172.21.15.63:0/1959770613 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b806cfd0 con 0x7fb7a0004c00 2024-09-12T02:57:36.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ec9e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0ecc0c9690 0x7f0ecc1603b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56384/0 (socket says 172.21.15.63:56384) 2024-09-12T02:57:36.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ec9e00640 1 -- 172.21.15.63:0/957360410 learned_addr learned my addr 172.21.15.63:0/957360410 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:36.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd083e00640 1 -- 172.21.15.63:0/4233862718 >> v2:172.21.15.63:3300/0 conn(0x7fd0840c5540 msgr2=0x7fd0840c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd083e00640 1 --2- 172.21.15.63:0/4233862718 >> v2:172.21.15.63:3300/0 conn(0x7fd0840c5540 0x7fd0840c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd083e00640 1 -- 172.21.15.63:0/4233862718 >> v1:172.21.15.63:6789/0 conn(0x7fd0840d0da0 legacy=0x7fd0840c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0eca800640 1 --2- 172.21.15.63:0/957360410 >> v2:172.21.15.63:3300/0 conn(0x7f0ecc0c1810 0x7f0ecc15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.013+0000 7fd083e00640 1 -- 172.21.15.63:0/4233862718 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0840cd3e0 con 0x7fd0840d09c0 2024-09-12T02:57:36.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0add400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ae00c6fb0 0x7f0ae01626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0add400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ae00c6fb0 0x7f0ae01626a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47492/0 (socket says 172.21.15.63:47492) 2024-09-12T02:57:36.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0add400640 1 -- 172.21.15.63:0/2877654115 learned_addr learned my addr 172.21.15.63:0/2877654115 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adde00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0ae00c6bd0 0x7f0ae00c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7fea02e00640 1 Processor -- start 2024-09-12T02:57:36.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adca00640 1 -- 172.21.15.63:0/2877654115 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525823502 0 0) 0x7f0ae01621a0 con 0x7f0ae006fcb0 2024-09-12T02:57:36.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adca00640 1 -- 172.21.15.63:0/2877654115 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ac4003530 con 0x7f0ae006fcb0 2024-09-12T02:57:36.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adde00640 1 -- 172.21.15.63:0/2877654115 >> v2:172.21.15.119:3300/0 conn(0x7f0ae00c6fb0 msgr2=0x7f0ae01626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adde00640 1 --2- 172.21.15.63:0/2877654115 >> v2:172.21.15.119:3300/0 conn(0x7f0ae00c6fb0 0x7f0ae01626a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ecb200640 1 --2- 172.21.15.63:0/957360410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ecc160ac0 0x7f0ecc0c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adde00640 1 -- 172.21.15.63:0/2877654115 >> v1:172.21.15.119:6789/0 conn(0x7f0ae006fcb0 legacy=0x7f0ae0158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0adde00640 1 -- 172.21.15.63:0/2877654115 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae00c81b0 con 0x7f0ae00c6bd0 2024-09-12T02:57:36.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ec9400640 1 -- 172.21.15.63:0/957360410 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942855628 0 0) 0x7f0ecc06dec0 con 0x7f0ecc0c9690 2024-09-12T02:57:36.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0ec9400640 1 -- 172.21.15.63:0/957360410 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0eb0003530 con 0x7f0ecc0c9690 2024-09-12T02:57:36.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7fea02e00640 1 -- start start 2024-09-12T02:57:36.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fea02e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9fc0cb330 0x7fe9fc0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fea02e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe9fc0c6a30 0x7fe9fc0c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fea02e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9fc15aba0 con 0x7fe9fc0cb710 2024-09-12T02:57:36.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fea02e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0c7c20 con 0x7fe9fc0cb330 2024-09-12T02:57:36.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fea02e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc15a960 con 0x7fe9fc0c6a30 2024-09-12T02:57:36.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fe9fb400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe9fc0cb710 0x7fe9fc0c6320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:40328/0 (socket says 172.21.15.63:40328) 2024-09-12T02:57:36.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fe9fb400640 1 -- 172.21.15.63:0/2983800043 learned_addr learned my addr 172.21.15.63:0/2983800043 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:36.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fe9fbe00640 1 --2- 172.21.15.63:0/2983800043 >> v2:172.21.15.63:3300/0 conn(0x7fe9fc0cb330 0x7fe9fc0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.017+0000 7f0eca800640 1 -- 172.21.15.63:0/957360410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ecc160ac0 msgr2=0x7f0ecc0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fd083e00640 1 --2- 172.21.15.63:0/4233862718 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0840cbc00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd074009870 tx=0x7fd07401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e91ac14e12ade14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7f0eca800640 1 --2- 172.21.15.63:0/957360410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ecc160ac0 0x7f0ecc0c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7f0eca800640 1 -- 172.21.15.63:0/957360410 >> v1:172.21.15.63:6789/0 conn(0x7f0ecc0c9690 legacy=0x7f0ecc1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7f0eca800640 1 -- 172.21.15.63:0/957360410 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc06d590 con 0x7f0ecc0c1810 2024-09-12T02:57:36.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fea00e00640 1 --2- 172.21.15.63:0/2983800043 >> v2:172.21.15.119:3300/0 conn(0x7fe9fc0c6a30 0x7fe9fc0c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fe9fbe00640 1 -- 172.21.15.63:0/2983800043 >> v2:172.21.15.119:3300/0 conn(0x7fe9fc0c6a30 msgr2=0x7fe9fc0c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fe9fbe00640 1 --2- 172.21.15.63:0/2983800043 >> v2:172.21.15.119:3300/0 conn(0x7fe9fc0c6a30 0x7fe9fc0c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fe9fbe00640 1 -- 172.21.15.63:0/2983800043 >> v1:172.21.15.119:6789/0 conn(0x7fe9fc0cb710 legacy=0x7fe9fc0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fe9fbe00640 1 -- 172.21.15.63:0/2983800043 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc15ae40 con 0x7fe9fc0cb330 2024-09-12T02:57:36.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fea00e00640 1 --2- 172.21.15.63:0/2983800043 >> v2:172.21.15.119:3300/0 conn(0x7fe9fc0c6a30 0x7fe9fc0c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:36.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fd082a00640 1 -- 172.21.15.63:0/4233862718 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0740b5070 con 0x7fd0840d09c0 2024-09-12T02:57:36.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fd082a00640 1 -- 172.21.15.63:0/4233862718 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0740a89d0 con 0x7fd0840d09c0 2024-09-12T02:57:36.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fd082a00640 1 -- 172.21.15.63:0/4233862718 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0740a8da0 con 0x7fd0840d09c0 2024-09-12T02:57:36.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7f1f3f000640 1 Processor -- start 2024-09-12T02:57:36.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7f0181800640 1 Processor -- start 2024-09-12T02:57:36.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7f1f3f000640 1 -- start start 2024-09-12T02:57:36.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.021+0000 7fb7bd000640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7a0004c00 0x7fb7a0005000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00045a0 tx=0x7fb7ac01c610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=782dc21fa79240c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fd08ac00640 1 -- 172.21.15.63:0/4233862718 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 msgr2=0x7fd0840cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fd08ac00640 1 --2- 172.21.15.63:0/4233862718 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0840cbc00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd074009870 tx=0x7fd07401ed30 comp rx=0 tx=0).stop 2024-09-12T02:57:36.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac00b600 con 0x7fb7a0004c00 2024-09-12T02:57:36.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0b0070 con 0x7fb7a0004c00 2024-09-12T02:57:36.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7b7400640 1 -- 172.21.15.63:0/1959770613 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0ab840 con 0x7fb7a0004c00 2024-09-12T02:57:36.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fd08ac00640 1 -- 172.21.15.63:0/4233862718 shutdown_connections 2024-09-12T02:57:36.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fd08ac00640 1 --2- 172.21.15.63:0/4233862718 >> v2:172.21.15.63:3300/0 conn(0x7fd0840c5540 0x7fd0840c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fd08ac00640 1 --2- 172.21.15.63:0/4233862718 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0840cbc00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fd08ac00640 1 -- 172.21.15.63:0/4233862718 >> 172.21.15.63:0/4233862718 conn(0x7fd08406e430 msgr2=0x7fd08406e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0181800640 1 -- start start 2024-09-12T02:57:36.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fd08ac00640 1 -- 172.21.15.63:0/4233862718 shutdown_connections 2024-09-12T02:57:36.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adde00640 1 --2- 172.21.15.63:0/2877654115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae00c6bd0 0x7f0ae00c8f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ae006f2c0 tx=0x7f0ad801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c64deee5343c7c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7a0004c00 msgr2=0x7fb7a0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7bfa00640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7a0004c00 0x7fb7a0005000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00045a0 tx=0x7fb7ac01c610 comp rx=0 tx=0).stop 2024-09-12T02:57:36.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adca00640 1 -- 172.21.15.63:0/2877654115 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80b2070 con 0x7f0ae00c6bd0 2024-09-12T02:57:36.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adca00640 1 -- 172.21.15.63:0/2877654115 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad80a5830 con 0x7f0ae00c6bd0 2024-09-12T02:57:36.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adca00640 1 -- 172.21.15.63:0/2877654115 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80a5c00 con 0x7f0ae00c6bd0 2024-09-12T02:57:36.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1959770613 shutdown_connections 2024-09-12T02:57:36.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7bfa00640 1 --2- 172.21.15.63:0/1959770613 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7a0004c00 0x7fb7a0005000 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00045a0 tx=0x7fb7ac01c610 comp rx=0 tx=0).stop 2024-09-12T02:57:36.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1959770613 >> 172.21.15.63:0/1959770613 conn(0x7fb7b806f3d0 msgr2=0x7fb7b806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f1f3f000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3806fef0 0x7f1f380c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1959770613 shutdown_connections 2024-09-12T02:57:36.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f1f37e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f1f380c6970 0x7f1f380c76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:40340/0 (socket says 172.21.15.63:40340) 2024-09-12T02:57:36.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f1f37e00640 1 -- 172.21.15.63:0/260320424 learned_addr learned my addr 172.21.15.63:0/260320424 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:36.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0eca800640 1 --2- 172.21.15.63:0/957360410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 0x7f0ecc15ec40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0097c0 tx=0x7f0ebc01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9088921faa454bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adf200640 1 -- 172.21.15.63:0/2877654115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae00c6bd0 msgr2=0x7f0ae00c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adf200640 1 --2- 172.21.15.63:0/2877654115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae00c6bd0 0x7f0ae00c8f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ae006f2c0 tx=0x7f0ad801c910 comp rx=0 tx=0).stop 2024-09-12T02:57:36.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f1f3f000640 1 -- 172.21.15.63:0/260320424 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f380c1a40 con 0x7f1f380c8210 2024-09-12T02:57:36.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f1f3f000640 1 -- 172.21.15.63:0/260320424 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f380c1d00 con 0x7f1f380c6970 2024-09-12T02:57:36.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adf200640 1 -- 172.21.15.63:0/2877654115 shutdown_connections 2024-09-12T02:57:36.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adf200640 1 --2- 172.21.15.63:0/2877654115 >> v2:172.21.15.119:3300/0 conn(0x7f0ae00c6fb0 0x7f0ae01626a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adf200640 1 --2- 172.21.15.63:0/2877654115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae00c6bd0 0x7f0ae00c8f50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f0adf200640 1 -- 172.21.15.63:0/2877654115 >> 172.21.15.63:0/2877654115 conn(0x7f0ae006d900 msgr2=0x7f0ae006f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1959770613 wait complete. 2024-09-12T02:57:36.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f1f3f000640 1 -- 172.21.15.63:0/260320424 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1f380c7de0 con 0x7f1f3806fef0 2024-09-12T02:57:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fd08ac00640 1 -- 172.21.15.63:0/4233862718 wait complete. 2024-09-12T02:57:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fe9fbe00640 1 --2- 172.21.15.63:0/2983800043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 0x7fe9fc0b5ef0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc08e3f0 tx=0x7fe9f401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32b46aa4faf264b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 189167669 0 0) 0x7f1f380c1d00 con 0x7f1f380c6970 2024-09-12T02:57:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f1c005740 con 0x7f1f380c6970 2024-09-12T02:57:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fd08ac00640 1 Processor -- start 2024-09-12T02:57:36.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fe9faa00640 1 -- 172.21.15.63:0/2983800043 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40b4070 con 0x7fe9fc0cb330 2024-09-12T02:57:36.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7fe9faa00640 1 -- 172.21.15.63:0/2983800043 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f40af600 con 0x7fe9fc0cb330 2024-09-12T02:57:36.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fe9faa00640 1 -- 172.21.15.63:0/2983800043 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40b4070 con 0x7fe9fc0cb330 2024-09-12T02:57:36.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.025+0000 7f1f37400640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3806fef0 0x7f1f380c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ec9400640 1 -- 172.21.15.63:0/957360410 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0b5070 con 0x7f0ecc0c1810 2024-09-12T02:57:36.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ec9400640 1 -- 172.21.15.63:0/957360410 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ebc0a8990 con 0x7f0ecc0c1810 2024-09-12T02:57:36.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ec9400640 1 -- 172.21.15.63:0/957360410 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0a8d60 con 0x7f0ecc0c1810 2024-09-12T02:57:36.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3006000373 0 0) 0x7f1f1c005740 con 0x7f1f380c6970 2024-09-12T02:57:36.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3806fef0 msgr2=0x7f1f380c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0181800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f017c157420 0x7f017c0c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3806fef0 0x7f1f380c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 >> v1:172.21.15.63:6789/0 conn(0x7f1f380c8210 legacy=0x7f1f38156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f380c1fe0 con 0x7f1f380c6970 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f1f28001680 con 0x7f1f380c6970 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 >> v1:172.21.15.119:6789/0 conn(0x7f1f380c6970 legacy=0x7f1f380c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1c005bd0 0x7f1f1c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c006a20 0x7f1f1c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f1c007430 0x7f1f1c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c00e220 con 0x7f1f1c006a20 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c00e3d0 con 0x7f1f1c005bd0 2024-09-12T02:57:36.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c00e5d0 con 0x7f1f1c007430 2024-09-12T02:57:36.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f37400640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3806fef0 0x7f1f380c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:36.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ed1400640 1 -- 172.21.15.63:0/957360410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 msgr2=0x7f0ecc15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ed1400640 1 --2- 172.21.15.63:0/957360410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 0x7f0ecc15ec40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0097c0 tx=0x7f0ebc01ecb0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd08ac00640 1 -- start start 2024-09-12T02:57:36.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fea02e00640 1 -- 172.21.15.63:0/2983800043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 msgr2=0x7fe9fc0b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fea02e00640 1 --2- 172.21.15.63:0/2983800043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 0x7fe9fc0b5ef0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc08e3f0 tx=0x7fe9f401f110 comp rx=0 tx=0).stop 2024-09-12T02:57:36.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0181800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017c0c1a40 con 0x7f017c0c6970 2024-09-12T02:57:36.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0181800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017c0c1d00 con 0x7f017c0c8210 2024-09-12T02:57:36.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0181800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f017c0c7de0 con 0x7f017c157420 2024-09-12T02:57:36.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f017a000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f017c0c8210 0x7f017c156d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:40342/0 (socket says 172.21.15.63:40342) 2024-09-12T02:57:36.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f017a000640 1 -- 172.21.15.63:0/1933765578 learned_addr learned my addr 172.21.15.63:0/1933765578 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:36.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f37e00640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1c005bd0 0x7f1f1c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0adf200640 1 -- 172.21.15.63:0/2877654115 shutdown_connections 2024-09-12T02:57:36.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0adf200640 1 -- 172.21.15.63:0/2877654115 wait complete. 2024-09-12T02:57:36.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fb7bfa00640 1 Processor -- start 2024-09-12T02:57:36.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f017aa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f017c0c6970 0x7f017c0c76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56392/0 (socket says 172.21.15.63:56392) 2024-09-12T02:57:36.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f017b400640 1 --2- 172.21.15.63:0/1933765578 >> v2:172.21.15.63:3300/0 conn(0x7f017c157420 0x7f017c0c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd08ac00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0840c5540 0x7fd0841f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd08ac00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0841e8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd08ac00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0840d0da0 0x7fd0841e8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f3d000640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f1c007430 0x7f1f1c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fb7bfa00640 1 -- start start 2024-09-12T02:57:36.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0179600640 1 -- 172.21.15.63:0/1933765578 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167134899 0 0) 0x7f017c0c1d00 con 0x7f017c0c8210 2024-09-12T02:57:36.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0179600640 1 -- 172.21.15.63:0/1933765578 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0160003530 con 0x7f017c0c8210 2024-09-12T02:57:36.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f37400640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c006a20 0x7f1f1c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fea02e00640 1 -- 172.21.15.63:0/2983800043 shutdown_connections 2024-09-12T02:57:36.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fea02e00640 1 --2- 172.21.15.63:0/2983800043 >> v2:172.21.15.119:3300/0 conn(0x7fe9fc0c6a30 0x7fe9fc0c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fea02e00640 1 --2- 172.21.15.63:0/2983800043 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 0x7fe9fc0b5ef0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fea02e00640 1 -- 172.21.15.63:0/2983800043 >> 172.21.15.63:0/2983800043 conn(0x7fe9fc0d02e0 msgr2=0x7fe9fc0d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f37e00640 1 -- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f1c007430 msgr2=0x7f1f1c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f37e00640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f1c007430 0x7f1f1c00dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f37e00640 1 -- 172.21.15.63:0/260320424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c006a20 msgr2=0x7f1f1c006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f37e00640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f1c006a20 0x7f1f1c006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0adf200640 1 Processor -- start 2024-09-12T02:57:36.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd08ac00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd0840c4330 con 0x7fd0840c5540 2024-09-12T02:57:36.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fea02e00640 1 -- 172.21.15.63:0/2983800043 shutdown_connections 2024-09-12T02:57:36.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd08ac00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd0840cd9a0 con 0x7fd0840d0da0 2024-09-12T02:57:36.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd088c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0840d0da0 0x7fd0841e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f017b400640 1 -- 172.21.15.63:0/1933765578 >> v1:172.21.15.119:6789/0 conn(0x7f017c0c8210 legacy=0x7f017c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f017b400640 1 -- 172.21.15.63:0/1933765578 >> v1:172.21.15.63:6789/0 conn(0x7f017c0c6970 legacy=0x7f017c0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ed1400640 1 -- 172.21.15.63:0/957360410 shutdown_connections 2024-09-12T02:57:36.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ed1400640 1 --2- 172.21.15.63:0/957360410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ecc160ac0 0x7f0ecc0c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ed1400640 1 --2- 172.21.15.63:0/957360410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 0x7f0ecc15ec40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ed1400640 1 -- 172.21.15.63:0/957360410 >> 172.21.15.63:0/957360410 conn(0x7f0ecc06f3d0 msgr2=0x7f0ecc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fea02e00640 1 -- 172.21.15.63:0/2983800043 wait complete. 2024-09-12T02:57:36.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd088c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0840d0da0 0x7fd0841e8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47520/0 (socket says 172.21.15.63:47520) 2024-09-12T02:57:36.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd088c00640 1 -- 172.21.15.63:0/4074019457 learned_addr learned my addr 172.21.15.63:0/4074019457 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd083e00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0840c5540 0x7fd0841f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd083400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0841e8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fd0840c44b0 con 0x7fd0840d09c0 2024-09-12T02:57:36.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0adf200640 1 -- start start 2024-09-12T02:57:36.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f1f37e00640 1 -- 172.21.15.63:0/260320424 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c005740 con 0x7f1f1c005bd0 2024-09-12T02:57:36.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fb7bfa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b815dd40 0x7fb7b8151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fb7bfa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7b80cc670 0x7fb7b81f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7fb7bfa00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b815e120 0x7fb7b81f7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bfa00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b80c0f90 con 0x7fb7b80cc670 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bfa00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b806db50 con 0x7fb7b815dd40 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bfa00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b81592d0 con 0x7fb7b815e120 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bd000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b815dd40 0x7fb7b8151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bd000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b815dd40 0x7fb7b8151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47528/0 (socket says 172.21.15.63:47528) 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bd000640 1 -- 172.21.15.63:0/1950279270 learned_addr learned my addr 172.21.15.63:0/1950279270 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7b7e00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7b80cc670 0x7fb7b81f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd083400640 1 -- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0840d0da0 msgr2=0x7fd0841e8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd083400640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0840d0da0 0x7fd0841e8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd083400640 1 -- 172.21.15.63:0/4074019457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0840c5540 msgr2=0x7fd0841f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd083400640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0840c5540 0x7fd0841f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd083400640 1 -- 172.21.15.63:0/4074019457 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0840c7a80 con 0x7fd0840d09c0 2024-09-12T02:57:36.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd088c00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0840d0da0 0x7fd0841e8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:36.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd083e00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0840c5540 0x7fd0841f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:36.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0adf200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae006fcb0 0x7f0ae0154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bda00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b815e120 0x7fb7b81f7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fea02e00640 1 Processor -- start 2024-09-12T02:57:36.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0adf200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae00c6bd0 0x7f0ae015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0adf200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00c6fb0 0x7f0ae015e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0adf200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae016bbd0 con 0x7f0ae006fcb0 2024-09-12T02:57:36.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0adf200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae0162ff0 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0adf200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae016bd50 con 0x7f0ae00c6bd0 2024-09-12T02:57:36.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fea02e00640 1 -- start start 2024-09-12T02:57:36.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bd000640 1 -- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b815e120 msgr2=0x7fb7b81f7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bd000640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7b815e120 0x7fb7b81f7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bd000640 1 -- 172.21.15.63:0/1950279270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7b80cc670 msgr2=0x7fb7b81f70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bd000640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7b80cc670 0x7fb7b81f70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bd000640 1 -- 172.21.15.63:0/1950279270 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b8152f90 con 0x7fb7b815dd40 2024-09-12T02:57:36.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd083400640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0841e8010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd07000b410 tx=0x7fd07000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ed1400640 1 -- 172.21.15.63:0/957360410 shutdown_connections 2024-09-12T02:57:36.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.029+0000 7f0ed1400640 1 -- 172.21.15.63:0/957360410 wait complete. 2024-09-12T02:57:36.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ade800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00c6fb0 0x7f0ae015e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ade800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00c6fb0 0x7f0ae015e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47536/0 (socket says 172.21.15.63:47536) 2024-09-12T02:57:36.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ade800640 1 -- 172.21.15.63:0/3046806122 learned_addr learned my addr 172.21.15.63:0/3046806122 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f017b400640 1 -- 172.21.15.63:0/1933765578 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c0c1fe0 con 0x7f017c157420 2024-09-12T02:57:36.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0add400640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae00c6bd0 0x7f0ae015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0adde00640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae006fcb0 0x7f0ae0154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ed1400640 1 Processor -- start 2024-09-12T02:57:36.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd07be00640 1 -- 172.21.15.63:0/4074019457 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070015030 con 0x7fd0840d09c0 2024-09-12T02:57:36.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bd000640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b815dd40 0x7fb7b8151d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0ad040 tx=0x7fb7a0005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ed1400640 1 -- start start 2024-09-12T02:57:36.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd07be00640 1 -- 172.21.15.63:0/4074019457 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd070004020 con 0x7fd0840d09c0 2024-09-12T02:57:36.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd07be00640 1 -- 172.21.15.63:0/4074019457 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070004410 con 0x7fd0840d09c0 2024-09-12T02:57:36.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7b4c00640 1 -- 172.21.15.63:0/1950279270 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0ba070 con 0x7fb7b815dd40 2024-09-12T02:57:36.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7b4c00640 1 -- 172.21.15.63:0/1950279270 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ac004220 con 0x7fb7b815dd40 2024-09-12T02:57:36.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7b4c00640 1 -- 172.21.15.63:0/1950279270 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0ab710 con 0x7fb7b815dd40 2024-09-12T02:57:36.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fea02e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9fc0c6a30 0x7fe9fc14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fea02e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 0x7fe9fc150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd084071e20 con 0x7fd0840d09c0 2024-09-12T02:57:36.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fea02e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9fc0cb710 0x7fe9fc150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fea02e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc15b6e0 con 0x7fe9fc0cb330 2024-09-12T02:57:36.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ade800640 1 -- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae00c6bd0 msgr2=0x7f0ae015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ade800640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae00c6bd0 0x7f0ae015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ade800640 1 -- 172.21.15.63:0/3046806122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae006fcb0 msgr2=0x7f0ae0154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ade800640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae006fcb0 0x7f0ae0154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fea02e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc15b400 con 0x7fe9fc0cb710 2024-09-12T02:57:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fea02e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe9fc0c76e0 con 0x7fe9fc0c6a30 2024-09-12T02:57:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0841f4930 con 0x7fd0840d09c0 2024-09-12T02:57:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b81f6c10 con 0x7fb7b815dd40 2024-09-12T02:57:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ade800640 1 -- 172.21.15.63:0/3046806122 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae015cab0 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f0ade800640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00c6fb0 0x7f0ae015e370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00c470 tx=0x7f0acc00c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ad6000640 1 -- 172.21.15.63:0/3046806122 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc0052d0 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b81529d0 con 0x7fb7b815dd40 2024-09-12T02:57:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.033+0000 7f1f37e00640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1c005bd0 0x7f1f1c005fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c160 tx=0x7f1f2801f350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bb43d64bd85d2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28007c90 con 0x7f1f1c005bd0 2024-09-12T02:57:36.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f28005b00 con 0x7f1f1c005bd0 2024-09-12T02:57:36.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f1f36a00640 1 -- 172.21.15.63:0/260320424 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28007070 con 0x7f1f1c005bd0 2024-09-12T02:57:36.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0841f8710 con 0x7fd0840d09c0 2024-09-12T02:57:36.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae01577e0 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fea00e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9fc0cb710 0x7fe9fc150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae0153d40 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fe9fb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 0x7fe9fc150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fe9fbe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9fc0c6a30 0x7fe9fc14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fe9fb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 0x7fe9fc150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39196/0 (socket says 172.21.15.63:39196) 2024-09-12T02:57:36.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fe9fb400640 1 -- 172.21.15.63:0/645352727 learned_addr learned my addr 172.21.15.63:0/645352727 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ad6000640 1 -- 172.21.15.63:0/3046806122 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0acc005470 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7b80ccdc0 con 0x7fb7b815dd40 2024-09-12T02:57:36.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ad6000640 1 -- 172.21.15.63:0/3046806122 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0acc012870 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ae01626a0 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ed1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 0x7f0ecc1f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ed1400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ecc0c9690 0x7f0ecc14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0eca800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 0x7f0ecc1f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0eca800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 0x7f0ecc1f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39210/0 (socket says 172.21.15.63:39210) 2024-09-12T02:57:36.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f1f3f000640 1 -- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1c005bd0 msgr2=0x7f1f1c005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f1f3f000640 1 --2- 172.21.15.63:0/260320424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1c005bd0 0x7f1f1c005fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c160 tx=0x7f1f2801f350 comp rx=0 tx=0).stop 2024-09-12T02:57:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f1f3d000640 1 -- 172.21.15.63:0/260320424 reap_dead start 2024-09-12T02:57:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0eca800640 1 -- 172.21.15.63:0/3218575252 learned_addr learned my addr 172.21.15.63:0/3218575252 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ed1400640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc160ac0 0x7f0ecc14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ec9e00640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ecc0c9690 0x7f0ecc14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f1f3f000640 1 -- 172.21.15.63:0/260320424 shutdown_connections 2024-09-12T02:57:36.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f017b400640 1 --2- 172.21.15.63:0/1933765578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c157420 0x7f017c0c6d50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f016c0071d0 tx=0x7f016c01fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c58f973f95f38bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f1f3f000640 1 -- 172.21.15.63:0/260320424 >> 172.21.15.63:0/260320424 conn(0x7f1f3806f3d0 msgr2=0x7f1f3806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fe9fb400640 1 -- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9fc0c6a30 msgr2=0x7fe9fc14f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fe9fb400640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9fc0c6a30 0x7fe9fc14f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc0c0f90 con 0x7f0ecc0c1810 2024-09-12T02:57:36.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc06db50 con 0x7f0ecc160ac0 2024-09-12T02:57:36.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fe9fb400640 1 -- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9fc0cb710 msgr2=0x7fe9fc150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fe9fb400640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9fc0cb710 0x7fe9fc150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7fe9fb400640 1 -- 172.21.15.63:0/645352727 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc14e3c0 con 0x7fe9fc0cb330 2024-09-12T02:57:36.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0179600640 1 -- 172.21.15.63:0/1933765578 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c008be0 con 0x7f017c157420 2024-09-12T02:57:36.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc1592d0 con 0x7f0ecc0c9690 2024-09-12T02:57:36.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f0ecb200640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc160ac0 0x7f0ecc14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.037+0000 7f1f3f000640 1 -- 172.21.15.63:0/260320424 shutdown_connections 2024-09-12T02:57:36.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fb7b4c00640 1 -- 172.21.15.63:0/1950279270 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7ac0ab8b0 con 0x7fb7b815dd40 2024-09-12T02:57:36.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f1f3f000640 1 -- 172.21.15.63:0/260320424 wait complete. 2024-09-12T02:57:36.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fd07be00640 1 -- 172.21.15.63:0/4074019457 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd070018070 con 0x7fd0840d09c0 2024-09-12T02:57:36.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0361200640 1 Processor -- start 2024-09-12T02:57:36.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fe9fb400640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 0x7fe9fc150920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800c3a0 tx=0x7fe9e800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ad6000640 1 -- 172.21.15.63:0/3046806122 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0acc012a10 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ecb200640 1 -- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ecc0c9690 msgr2=0x7f0ecc14cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fe9f3e00640 1 -- 172.21.15.63:0/645352727 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8017070 con 0x7fe9fc0cb330 2024-09-12T02:57:36.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ecb200640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ecc0c9690 0x7f0ecc14cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fd07be00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0640678c0 0x7fd064069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fd07be00640 1 -- 172.21.15.63:0/4074019457 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd070086210 con 0x7fd0840d09c0 2024-09-12T02:57:36.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fd07be00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fd064071040 0x7fd064073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fd07be00640 1 -- 172.21.15.63:0/4074019457 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd064073b50 con 0x7fd064071040 2024-09-12T02:57:36.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fd07be00640 1 -- 172.21.15.63:0/4074019457 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd070086600 con 0x7fd0840d09c0 2024-09-12T02:57:36.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ad6000640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac00678c0 0x7f0ac0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fb7b4c00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7980678c0 0x7fb798069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fb7b4c00640 1 -- 172.21.15.63:0/1950279270 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb7ac120700 con 0x7fb7b815dd40 2024-09-12T02:57:36.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fb7b4c00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb798070fb0 0x7fb7980733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fb7b4c00640 1 -- 172.21.15.63:0/1950279270 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb798073ac0 con 0x7fb798070fb0 2024-09-12T02:57:36.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fb7b4c00640 1 -- 172.21.15.63:0/1950279270 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb7ac120b90 con 0x7fb7b815dd40 2024-09-12T02:57:36.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ecb200640 1 -- 172.21.15.63:0/3218575252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 msgr2=0x7f0ecc1f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ecb200640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 0x7f0ecc1f78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ecb200640 1 -- 172.21.15.63:0/3218575252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc14c970 con 0x7f0ecc160ac0 2024-09-12T02:57:36.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0eca800640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ecc0c1810 0x7f0ecc1f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:36.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ecb200640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc160ac0 0x7f0ecc14d1b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400ebd0 tx=0x7f0ec400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0179600640 1 -- 172.21.15.63:0/1933765578 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c008d80 con 0x7f017c157420 2024-09-12T02:57:36.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0179600640 1 -- 172.21.15.63:0/1933765578 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c008be0 con 0x7f017c157420 2024-09-12T02:57:36.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fe9f3e00640 1 -- 172.21.15.63:0/645352727 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e8005cf0 con 0x7fe9fc0cb330 2024-09-12T02:57:36.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fe9f3e00640 1 -- 172.21.15.63:0/645352727 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8017070 con 0x7fe9fc0cb330 2024-09-12T02:57:36.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9fc14e660 con 0x7fe9fc0cb330 2024-09-12T02:57:36.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9fc14ec00 con 0x7fe9fc0cb330 2024-09-12T02:57:36.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0181800640 1 -- 172.21.15.63:0/1933765578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c157420 msgr2=0x7f017c0c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9fc0c7dc0 con 0x7fe9fc0cb330 2024-09-12T02:57:36.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ad6000640 1 -- 172.21.15.63:0/3046806122 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0acc0866a0 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ad6000640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0ac0071030 0x7f0ac0073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ad6000640 1 -- 172.21.15.63:0/3046806122 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0acc01ce50 con 0x7f0ac0071030 2024-09-12T02:57:36.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0ad6000640 1 -- 172.21.15.63:0/3046806122 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0acc086a90 con 0x7f0ae00c6fb0 2024-09-12T02:57:36.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7fb7b7e00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7980678c0 0x7fb798069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0181800640 1 --2- 172.21.15.63:0/1933765578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c157420 0x7f017c0c6d50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f016c0071d0 tx=0x7f016c01fca0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f1f3f000640 1 Processor -- start 2024-09-12T02:57:36.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0adde00640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac00678c0 0x7f0ac0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0361200640 1 -- start start 2024-09-12T02:57:36.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0361200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f035c160ac0 0x7f035c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0361200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f035c0c9690 0x7f035c0c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f1f3f000640 1 -- start start 2024-09-12T02:57:36.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0add400640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0ac0071030 0x7f0ac0073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0361200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f035c06dec0 con 0x7f035c0c1810 2024-09-12T02:57:36.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0361200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f035c06cfd0 con 0x7f035c160ac0 2024-09-12T02:57:36.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.041+0000 7f0361200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f035c06d2b0 con 0x7f035c0c9690 2024-09-12T02:57:36.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0353e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f035c160ac0 0x7f035c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0181800640 1 -- 172.21.15.63:0/1933765578 shutdown_connections 2024-09-12T02:57:36.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0181800640 1 --2- 172.21.15.63:0/1933765578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c157420 0x7f017c0c6d50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0181800640 1 -- 172.21.15.63:0/1933765578 >> 172.21.15.63:0/1933765578 conn(0x7f017c06f3d0 msgr2=0x7f017c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0353e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f035c160ac0 0x7f035c15ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47562/0 (socket says 172.21.15.63:47562) 2024-09-12T02:57:36.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0353e00640 1 -- 172.21.15.63:0/2381667402 learned_addr learned my addr 172.21.15.63:0/2381667402 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7fd088c00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fd064071040 0x7fd064073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7fd083e00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0640678c0 0x7fd064069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f035a800640 1 --2- 172.21.15.63:0/2381667402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f035c0c9690 0x7f035c0c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7fb7b7e00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7980678c0 0x7fb798069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80cc540 tx=0x7fb7a4007d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0add400640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0ac0071030 0x7f0ac0073470 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0adde00640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac00678c0 0x7f0ac0069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80af000 tx=0x7f0ad80a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0ec2a00640 1 -- 172.21.15.63:0/3218575252 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4018020 con 0x7f0ecc160ac0 2024-09-12T02:57:36.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0ec2a00640 1 -- 172.21.15.63:0/3218575252 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec400cd20 con 0x7f0ecc160ac0 2024-09-12T02:57:36.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0ec2a00640 1 -- 172.21.15.63:0/3218575252 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40146c0 con 0x7f0ecc160ac0 2024-09-12T02:57:36.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc14d790 con 0x7f0ecc160ac0 2024-09-12T02:57:36.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc073640 con 0x7f0ecc160ac0 2024-09-12T02:57:36.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0181800640 1 -- 172.21.15.63:0/1933765578 shutdown_connections 2024-09-12T02:57:36.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0181800640 1 -- 172.21.15.63:0/1933765578 wait complete. 2024-09-12T02:57:36.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0353e00640 1 -- 172.21.15.63:0/2381667402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f035c0c9690 msgr2=0x7f035c0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0353e00640 1 --2- 172.21.15.63:0/2381667402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f035c0c9690 0x7f035c0c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0353e00640 1 -- 172.21.15.63:0/2381667402 >> v1:172.21.15.63:6789/0 conn(0x7f035c0c1810 legacy=0x7f035c1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0353e00640 1 -- 172.21.15.63:0/2381667402 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c06d590 con 0x7f035c160ac0 2024-09-12T02:57:36.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3f000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1c005bd0 0x7f1f381535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3f000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f381557d0 0x7f1f38151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3f000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f38152010 0x7f1f380c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3f000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1f380c1660 con 0x7f1f38152010 2024-09-12T02:57:36.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3f000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1f380c25a0 con 0x7f1f1c005bd0 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3f000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1f3814da20 con 0x7f1f381557d0 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f38152010 0x7f1f380c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f38152010 0x7f1f380c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39214/0 (socket says 172.21.15.63:39214) 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3d000640 1 -- 172.21.15.63:0/2876032545 learned_addr learned my addr 172.21.15.63:0/2876032545 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3d000640 1 -- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f381557d0 msgr2=0x7f1f38151ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3d000640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f381557d0 0x7f1f38151ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3d000640 1 -- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1c005bd0 msgr2=0x7f1f381535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3d000640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f1c005bd0 0x7f1f381535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3d000640 1 -- 172.21.15.63:0/2876032545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f38154020 con 0x7f1f38152010 2024-09-12T02:57:36.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0ad6000640 1 -- 172.21.15.63:0/3046806122 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0acc01ce50 con 0x7f0ac0071030 2024-09-12T02:57:36.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7fb7bda00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb798070fb0 0x7fb7980733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ecc0b14b0 con 0x7f0ecc160ac0 2024-09-12T02:57:36.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7fd083e00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0640678c0 0x7fd064069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0740b2000 tx=0x7fd0740aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7fd088c00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fd064071040 0x7fd064073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7fe9f3e00640 1 -- 172.21.15.63:0/645352727 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe9e801a070 con 0x7fe9fc0cb330 2024-09-12T02:57:36.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f3d000640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f38152010 0x7f1f380c3370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f3806f360 tx=0x7f1f3000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f2fe00640 1 -- 172.21.15.63:0/2876032545 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30018070 con 0x7f1f38152010 2024-09-12T02:57:36.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f2fe00640 1 -- 172.21.15.63:0/2876032545 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f30003d90 con 0x7f1f38152010 2024-09-12T02:57:36.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.045+0000 7f1f2fe00640 1 -- 172.21.15.63:0/2876032545 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f30005290 con 0x7f1f38152010 2024-09-12T02:57:36.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0181800640 1 Processor -- start 2024-09-12T02:57:36.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0181800640 1 -- start start 2024-09-12T02:57:36.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fe9f3e00640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9dc067af0 0x7fe9dc069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fe9f3e00640 1 -- 172.21.15.63:0/645352727 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe9e8085700 con 0x7fe9fc0cb330 2024-09-12T02:57:36.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fd07be00640 1 -- 172.21.15.63:0/4074019457 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd064073b50 con 0x7fd064071040 2024-09-12T02:57:36.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fb7bda00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb798070fb0 0x7fb7980733f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0ec2a00640 1 -- 172.21.15.63:0/3218575252 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ec401b020 con 0x7f0ecc160ac0 2024-09-12T02:57:36.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fe9f3e00640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe9dc0711e0 0x7fe9dc073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fe9f3e00640 1 -- 172.21.15.63:0/645352727 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9e8013e50 con 0x7fe9dc0711e0 2024-09-12T02:57:36.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fe9f3e00640 1 -- 172.21.15.63:0/645352727 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe9e8085ab0 con 0x7fe9fc0cb330 2024-09-12T02:57:36.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fe9fbe00640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9dc067af0 0x7fe9dc069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fea00e00640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe9dc0711e0 0x7fe9dc073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f380c5020 con 0x7f1f38152010 2024-09-12T02:57:36.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f381512d0 con 0x7f1f38152010 2024-09-12T02:57:36.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0353e00640 1 --2- 172.21.15.63:0/2381667402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c160ac0 0x7f035c15ec40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0344009870 tx=0x7f034401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=373f4faf5e149333 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f380c4dd0 con 0x7f1f38152010 2024-09-12T02:57:36.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fb7b4c00640 1 -- 172.21.15.63:0/1950279270 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb798073ac0 con 0x7fb798070fb0 2024-09-12T02:57:36.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7fe9fbe00640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9dc067af0 0x7fe9dc069fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40b1000 tx=0x7fe9f40aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0359400640 1 -- 172.21.15.63:0/2381667402 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03440ab650 con 0x7f035c160ac0 2024-09-12T02:57:36.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0359400640 1 -- 172.21.15.63:0/2381667402 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03440b0070 con 0x7f035c160ac0 2024-09-12T02:57:36.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0359400640 1 -- 172.21.15.63:0/2381667402 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03440aba10 con 0x7f035c160ac0 2024-09-12T02:57:36.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0361200640 1 -- 172.21.15.63:0/2381667402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c160ac0 msgr2=0x7f035c15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0361200640 1 --2- 172.21.15.63:0/2381667402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c160ac0 0x7f035c15ec40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0344009870 tx=0x7f034401c560 comp rx=0 tx=0).stop 2024-09-12T02:57:36.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7fea00e00640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe9dc0711e0 0x7fe9dc073620 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0181800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c0c6970 0x7f017c1e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0181800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c0c8210 0x7f017c1e3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0181800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f017c157420 0x7f017c1f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0181800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f017c0c1660 con 0x7f017c0c8210 2024-09-12T02:57:36.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0181800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f017c0c25a0 con 0x7f017c157420 2024-09-12T02:57:36.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0181800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f017c14da20 con 0x7f017c0c6970 2024-09-12T02:57:36.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0ec2a00640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0eac0679c0 0x7f0eac069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0ec2a00640 1 -- 172.21.15.63:0/3218575252 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0ec4087390 con 0x7f0ecc160ac0 2024-09-12T02:57:36.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0ec2a00640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0eac071130 0x7f0eac073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0ec2a00640 1 -- 172.21.15.63:0/3218575252 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ec4004820 con 0x7f0eac071130 2024-09-12T02:57:36.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.049+0000 7f0ec2a00640 1 -- 172.21.15.63:0/3218575252 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0ec4087780 con 0x7f0ecc160ac0 2024-09-12T02:57:36.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0361200640 1 -- 172.21.15.63:0/2381667402 shutdown_connections 2024-09-12T02:57:36.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0361200640 1 --2- 172.21.15.63:0/2381667402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f035c0c9690 0x7f035c0c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0361200640 1 --2- 172.21.15.63:0/2381667402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c160ac0 0x7f035c15ec40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0361200640 1 -- 172.21.15.63:0/2381667402 >> 172.21.15.63:0/2381667402 conn(0x7f035c06f3d0 msgr2=0x7f035c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f017a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c0c8210 0x7f017c1e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f017a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c0c8210 0x7f017c1e3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39220/0 (socket says 172.21.15.63:39220) 2024-09-12T02:57:36.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f017a000640 1 -- 172.21.15.63:0/221500086 learned_addr learned my addr 172.21.15.63:0/221500086 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f017a000640 1 -- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c0c6970 msgr2=0x7f017c1e33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f017a000640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c0c6970 0x7f017c1e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f017a000640 1 -- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f017c157420 msgr2=0x7f017c1f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f017a000640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f017c157420 0x7f017c1f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f017a000640 1 -- 172.21.15.63:0/221500086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c156580 con 0x7f017c0c8210 2024-09-12T02:57:36.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f1f2fe00640 1 -- 172.21.15.63:0/2876032545 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1f3001b070 con 0x7f1f38152010 2024-09-12T02:57:36.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0ec9e00640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0eac071130 0x7f0eac073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0eca800640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0eac0679c0 0x7f0eac069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f017a000640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c0c8210 0x7f017c1e3910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f016800c500 tx=0x7f016800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0361200640 1 -- 172.21.15.63:0/2381667402 shutdown_connections 2024-09-12T02:57:36.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0ec9e00640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0eac071130 0x7f0eac073570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0172a00640 1 -- 172.21.15.63:0/221500086 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168017070 con 0x7f017c0c8210 2024-09-12T02:57:36.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0eca800640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0eac0679c0 0x7f0eac069e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0097c0 tx=0x7f0ebc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0361200640 1 -- 172.21.15.63:0/2381667402 wait complete. 2024-09-12T02:57:36.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017c14a120 con 0x7f017c0c8210 2024-09-12T02:57:36.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017c0cae60 con 0x7f017c0c8210 2024-09-12T02:57:36.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f1f2fe00640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1f18067990 0x7f1f18069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.053+0000 7f1f2fe00640 1 -- 172.21.15.63:0/2876032545 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1f30085fb0 con 0x7f1f38152010 2024-09-12T02:57:36.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f1f37e00640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1f18067990 0x7f1f18069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f1f2fe00640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f1f18071110 0x7f1f18073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f1f2fe00640 1 -- 172.21.15.63:0/2876032545 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f300057f0 con 0x7f1f18071110 2024-09-12T02:57:36.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f1f2fe00640 1 -- 172.21.15.63:0/2876032545 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1f300863a0 con 0x7f1f38152010 2024-09-12T02:57:36.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0172a00640 1 -- 172.21.15.63:0/221500086 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0168005cf0 con 0x7f017c0c8210 2024-09-12T02:57:36.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0172a00640 1 -- 172.21.15.63:0/221500086 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01680072f0 con 0x7f017c0c8210 2024-09-12T02:57:36.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0361200640 1 Processor -- start 2024-09-12T02:57:36.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7fe9f3e00640 1 -- 172.21.15.63:0/645352727 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe9e8013e50 con 0x7fe9dc0711e0 2024-09-12T02:57:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0ec2a00640 1 -- 172.21.15.63:0/3218575252 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ec4004820 con 0x7f0eac071130 2024-09-12T02:57:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f1f37400640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f1f18071110 0x7f1f18073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0361200640 1 -- start start 2024-09-12T02:57:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f017c06fef0 con 0x7f017c0c8210 2024-09-12T02:57:36.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f1f37400640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f1f18071110 0x7f1f18073550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f1f37e00640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1f18067990 0x7f1f18069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f280af000 tx=0x7f1f28001980 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0361200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f035c0c1810 0x7f035c14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0361200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c0c9690 0x7f035c14b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0361200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f035c160ac0 0x7f035c1f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f1f2fe00640 1 -- 172.21.15.63:0/2876032545 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f300057f0 con 0x7f1f18071110 2024-09-12T02:57:36.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0172a00640 1 -- 172.21.15.63:0/221500086 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f016801a070 con 0x7f017c0c8210 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0361200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f035c0c6cc0 con 0x7f035c0c1810 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0361200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f035c1592d0 con 0x7f035c0c9690 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0361200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f035c0c6e40 con 0x7f035c160ac0 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0353e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c0c9690 0x7f035c14b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0353e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c0c9690 0x7f035c14b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47590/0 (socket says 172.21.15.63:47590) 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f0353e00640 1 -- 172.21.15.63:0/2396561242 learned_addr learned my addr 172.21.15.63:0/2396561242 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.057+0000 7f035a800640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f035c160ac0 0x7f035c1f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0359e00640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f035c0c1810 0x7f035c14afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0353e00640 1 -- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f035c160ac0 msgr2=0x7f035c1f7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0353e00640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f035c160ac0 0x7f035c1f7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0353e00640 1 -- 172.21.15.63:0/2396561242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f035c0c1810 msgr2=0x7f035c14afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0353e00640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f035c0c1810 0x7f035c14afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0353e00640 1 -- 172.21.15.63:0/2396561242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c15f990 con 0x7f035c0c9690 2024-09-12T02:57:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0172a00640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f015c0678c0 0x7f015c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0172a00640 1 -- 172.21.15.63:0/221500086 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0168085bc0 con 0x7f017c0c8210 2024-09-12T02:57:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0172a00640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f015c071030 0x7f015c073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0172a00640 1 -- 172.21.15.63:0/221500086 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f016801eec0 con 0x7f015c071030 2024-09-12T02:57:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0172a00640 1 -- 172.21.15.63:0/221500086 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0168085fb0 con 0x7f017c0c8210 2024-09-12T02:57:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f017aa00640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f015c0678c0 0x7f015c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f017b400640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f015c071030 0x7f015c073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0353e00640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c0c9690 0x7f035c14b510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f03440ad040 tx=0x7f034401ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0352000640 1 -- 172.21.15.63:0/2396561242 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03440be5f0 con 0x7f035c0c9690 2024-09-12T02:57:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f035c0c32b0 con 0x7f035c0c9690 2024-09-12T02:57:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035c159ca0 con 0x7f035c0c9690 2024-09-12T02:57:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.061+0000 7f0352000640 1 -- 172.21.15.63:0/2396561242 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03440be790 con 0x7f035c0c9690 2024-09-12T02:57:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.065+0000 7f0352000640 1 -- 172.21.15.63:0/2396561242 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03440beb80 con 0x7f035c0c9690 2024-09-12T02:57:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.065+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0334001040 con 0x7f035c0c9690 2024-09-12T02:57:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.065+0000 7f017aa00640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f015c0678c0 0x7f015c069d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01740012f0 tx=0x7f0174007d90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.065+0000 7f017b400640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f015c071030 0x7f015c073470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.065+0000 7f0352000640 1 -- 172.21.15.63:0/2396561242 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03440b43f0 con 0x7f035c0c9690 2024-09-12T02:57:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f0172a00640 1 -- 172.21.15.63:0/221500086 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f016801eec0 con 0x7f015c071030 2024-09-12T02:57:36.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f0352000640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0338067910 0x7f0338069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f0352000640 1 -- 172.21.15.63:0/2396561242 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0344120bb0 con 0x7f035c0c9690 2024-09-12T02:57:36.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f0352000640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0338071080 0x7f03380734c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f0352000640 1 -- 172.21.15.63:0/2396561242 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03440ace90 con 0x7f0338071080 2024-09-12T02:57:36.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f0352000640 1 -- 172.21.15.63:0/2396561242 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0344121090 con 0x7f035c0c9690 2024-09-12T02:57:36.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f035a800640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0338071080 0x7f03380734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f0359e00640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0338067910 0x7f0338069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f035a800640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0338071080 0x7f03380734c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.069+0000 7f0359e00640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0338067910 0x7f0338069dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f034c0015b0 tx=0x7f034c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.073+0000 7f0352000640 1 -- 172.21.15.63:0/2396561242 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03440ace90 con 0x7f0338071080 2024-09-12T02:57:36.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.073+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ae00c2f30 con 0x7f0ac0071030 2024-09-12T02:57:36.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0840cbc00 con 0x7fd064071040 2024-09-12T02:57:36.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0ad6000640 1 -- 172.21.15.63:0/3046806122 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ae00c2f30 con 0x7f0ac0071030 2024-09-12T02:57:36.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0ac0071030 msgr2=0x7f0ac0073470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0ac0071030 0x7f0ac0073470 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac00678c0 msgr2=0x7f0ac0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac00678c0 0x7f0ac0069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80af000 tx=0x7f0ad80a7070 comp rx=0 tx=0).stop 2024-09-12T02:57:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00c6fb0 msgr2=0x7f0ae015e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 --2- 172.21.15.63:0/3046806122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00c6fb0 0x7f0ae015e370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0acc00c470 tx=0x7f0acc00c930 comp rx=0 tx=0).stop 2024-09-12T02:57:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0ade800640 1 -- 172.21.15.63:0/3046806122 reap_dead start 2024-09-12T02:57:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 shutdown_connections 2024-09-12T02:57:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 >> 172.21.15.63:0/3046806122 conn(0x7f0ae006d900 msgr2=0x7f0ae014f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 shutdown_connections 2024-09-12T02:57:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7f0adf200640 1 -- 172.21.15.63:0/3046806122 wait complete. 2024-09-12T02:57:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7fd07be00640 1 -- 172.21.15.63:0/4074019457 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd0840cbc00 con 0x7fd064071040 2024-09-12T02:57:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fd064071040 msgr2=0x7fd064073480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7fd08ac00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fd064071040 0x7fd064073480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0640678c0 msgr2=0x7fd064069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7fd08ac00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0640678c0 0x7fd064069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd0740b2000 tx=0x7fd0740aa070 comp rx=0 tx=0).stop 2024-09-12T02:57:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 msgr2=0x7fd0841e8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7fd08ac00640 1 --2- 172.21.15.63:0/4074019457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0840d09c0 0x7fd0841e8010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd07000b410 tx=0x7fd07000b8d0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.077+0000 7fd088c00640 1 -- 172.21.15.63:0/4074019457 reap_dead start 2024-09-12T02:57:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.081+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 shutdown_connections 2024-09-12T02:57:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.081+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 >> 172.21.15.63:0/4074019457 conn(0x7fd08406e430 msgr2=0x7fd0841e0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.081+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 shutdown_connections 2024-09-12T02:57:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.081+0000 7fd08ac00640 1 -- 172.21.15.63:0/4074019457 wait complete. 2024-09-12T02:57:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.081+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb7b80b14b0 con 0x7fb798070fb0 2024-09-12T02:57:36.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.081+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe9fc1513e0 con 0x7fe9dc0711e0 2024-09-12T02:57:36.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.081+0000 7fb7b4c00640 1 -- 172.21.15.63:0/1950279270 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb7b80b14b0 con 0x7fb798070fb0 2024-09-12T02:57:36.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fe9f3e00640 1 -- 172.21.15.63:0/645352727 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe9fc1513e0 con 0x7fe9dc0711e0 2024-09-12T02:57:36.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb798070fb0 msgr2=0x7fb7980733f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb798070fb0 0x7fb7980733f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7980678c0 msgr2=0x7fb798069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb7980678c0 0x7fb798069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80cc540 tx=0x7fb7a4007d80 comp rx=0 tx=0).stop 2024-09-12T02:57:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b815dd40 msgr2=0x7fb7b8151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 --2- 172.21.15.63:0/1950279270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7b815dd40 0x7fb7b8151d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0ad040 tx=0x7fb7a0005840 comp rx=0 tx=0).stop 2024-09-12T02:57:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bda00640 1 -- 172.21.15.63:0/1950279270 reap_dead start 2024-09-12T02:57:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 shutdown_connections 2024-09-12T02:57:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 >> 172.21.15.63:0/1950279270 conn(0x7fb7b806f3d0 msgr2=0x7fb7b806f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe9dc0711e0 msgr2=0x7fe9dc073620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fea02e00640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe9dc0711e0 0x7fe9dc073620 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 shutdown_connections 2024-09-12T02:57:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fb7bfa00640 1 -- 172.21.15.63:0/1950279270 wait complete. 2024-09-12T02:57:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9dc067af0 msgr2=0x7fe9dc069fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fea02e00640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe9dc067af0 0x7fe9dc069fb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40b1000 tx=0x7fe9f40aa000 comp rx=0 tx=0).stop 2024-09-12T02:57:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 msgr2=0x7fe9fc150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fea02e00640 1 --2- 172.21.15.63:0/645352727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9fc0cb330 0x7fe9fc150920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800c3a0 tx=0x7fe9e800c860 comp rx=0 tx=0).stop 2024-09-12T02:57:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fea00e00640 1 -- 172.21.15.63:0/645352727 reap_dead start 2024-09-12T02:57:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 shutdown_connections 2024-09-12T02:57:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.085+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 >> 172.21.15.63:0/645352727 conn(0x7fe9fc0d02e0 msgr2=0x7fe9fc0cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.089+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 shutdown_connections 2024-09-12T02:57:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.089+0000 7fea02e00640 1 -- 172.21.15.63:0/645352727 wait complete. 2024-09-12T02:57:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.089+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ecc0c7030 con 0x7f0eac071130 2024-09-12T02:57:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.089+0000 7f0ec2a00640 1 -- 172.21.15.63:0/3218575252 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ecc0c7030 con 0x7f0eac071130 2024-09-12T02:57:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.089+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f381524c0 con 0x7f1f18071110 2024-09-12T02:57:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0eac071130 msgr2=0x7f0eac073570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0eac071130 0x7f0eac073570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0eac0679c0 msgr2=0x7f0eac069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0eac0679c0 0x7f0eac069e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0097c0 tx=0x7f0ebc008040 comp rx=0 tx=0).stop 2024-09-12T02:57:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc160ac0 msgr2=0x7f0ecc14d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 --2- 172.21.15.63:0/3218575252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ecc160ac0 0x7f0ecc14d1b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400ebd0 tx=0x7f0ec400c490 comp rx=0 tx=0).stop 2024-09-12T02:57:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ecb200640 1 -- 172.21.15.63:0/3218575252 reap_dead start 2024-09-12T02:57:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 shutdown_connections 2024-09-12T02:57:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 >> 172.21.15.63:0/3218575252 conn(0x7f0ecc06f3d0 msgr2=0x7f0ecc1ea4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 shutdown_connections 2024-09-12T02:57:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f0ed1400640 1 -- 172.21.15.63:0/3218575252 wait complete. 2024-09-12T02:57:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f1f2fe00640 1 -- 172.21.15.63:0/2876032545 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f381524c0 con 0x7f1f18071110 2024-09-12T02:57:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f1f18071110 msgr2=0x7f1f18073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f1f3f000640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f1f18071110 0x7f1f18073550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1f18067990 msgr2=0x7f1f18069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f1f3f000640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1f18067990 0x7f1f18069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f280af000 tx=0x7f1f28001980 comp rx=0 tx=0).stop 2024-09-12T02:57:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f38152010 msgr2=0x7f1f380c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.093+0000 7f1f3f000640 1 --2- 172.21.15.63:0/2876032545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f38152010 0x7f1f380c3370 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f3806f360 tx=0x7f1f3000dc00 comp rx=0 tx=0).stop 2024-09-12T02:57:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.097+0000 7f1f3d000640 1 -- 172.21.15.63:0/2876032545 reap_dead start 2024-09-12T02:57:36.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.097+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f017c142940 con 0x7f015c071030 2024-09-12T02:57:36.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.097+0000 7f0172a00640 1 -- 172.21.15.63:0/221500086 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f016c004040 con 0x7f015c071030 2024-09-12T02:57:36.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 shutdown_connections 2024-09-12T02:57:36.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 >> 172.21.15.63:0/2876032545 conn(0x7f1f3806f3d0 msgr2=0x7f1f3814a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 shutdown_connections 2024-09-12T02:57:36.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f1f3f000640 1 -- 172.21.15.63:0/2876032545 wait complete. 2024-09-12T02:57:36.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f015c071030 msgr2=0x7f015c073470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f0181800640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f015c071030 0x7f015c073470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0334002de0 con 0x7f0338071080 2024-09-12T02:57:36.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f015c0678c0 msgr2=0x7f015c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f0181800640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f015c0678c0 0x7f015c069d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01740012f0 tx=0x7f0174007d90 comp rx=0 tx=0).stop 2024-09-12T02:57:36.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c0c8210 msgr2=0x7f017c1e3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f0181800640 1 --2- 172.21.15.63:0/221500086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f017c0c8210 0x7f017c1e3910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f016800c500 tx=0x7f016800c9c0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f017b400640 1 -- 172.21.15.63:0/221500086 reap_dead start 2024-09-12T02:57:36.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 shutdown_connections 2024-09-12T02:57:36.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.101+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 >> 172.21.15.63:0/221500086 conn(0x7f017c06f3d0 msgr2=0x7f017c143500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0352000640 1 -- 172.21.15.63:0/2396561242 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0334002de0 con 0x7f0338071080 2024-09-12T02:57:36.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 shutdown_connections 2024-09-12T02:57:36.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0181800640 1 -- 172.21.15.63:0/221500086 wait complete. 2024-09-12T02:57:36.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0338071080 msgr2=0x7f03380734c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0361200640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0338071080 0x7f03380734c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0338067910 msgr2=0x7f0338069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0361200640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0338067910 0x7f0338069dd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f034c0015b0 tx=0x7f034c009040 comp rx=0 tx=0).stop 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c0c9690 msgr2=0x7f035c14b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0361200640 1 --2- 172.21.15.63:0/2396561242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f035c0c9690 0x7f035c14b510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f03440ad040 tx=0x7f034401ada0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f035a800640 1 -- 172.21.15.63:0/2396561242 reap_dead start 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 shutdown_connections 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 >> 172.21.15.63:0/2396561242 conn(0x7f035c06f3d0 msgr2=0x7f035c153580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.105+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 shutdown_connections 2024-09-12T02:57:36.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.109+0000 7f0361200640 1 -- 172.21.15.63:0/2396561242 wait complete. 2024-09-12T02:57:36.126 INFO:teuthology.orchestra.run.smithi063.stdout:55834574860 2024-09-12T02:57:36.126 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:57:36.127 INFO:teuthology.orchestra.run.smithi063.stdout:64424509453 2024-09-12T02:57:36.127 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:57:36.128 INFO:teuthology.orchestra.run.smithi063.stdout:64424509453 2024-09-12T02:57:36.128 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:57:36.133 INFO:teuthology.orchestra.run.smithi063.stdout:64424509451 2024-09-12T02:57:36.133 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:57:36.146 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2024-09-12T02:57:36.147 INFO:teuthology.orchestra.run.smithi063.stdout:60129542157 2024-09-12T02:57:36.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:57:36.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:57:36.149 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2024-09-12T02:57:36.149 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:57:36.150 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2024-09-12T02:57:36.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:57:36.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.357+0000 7f0aee400640 1 Processor -- start 2024-09-12T02:57:36.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.357+0000 7f0aee400640 1 -- start start 2024-09-12T02:57:36.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.357+0000 7f0aee400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ae8152950 0x7f0ae81588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0aee400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0ae806c6d0 0x7f0ae8158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0aee400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae8152d30 con 0x7f0ae8073e20 2024-09-12T02:57:36.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0aee400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f0ae806d8e0 con 0x7f0ae806c6d0 2024-09-12T02:57:36.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0aee400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0ae806e740 con 0x7f0ae8152950 2024-09-12T02:57:36.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0ae7400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ae8152950 0x7f0ae81588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0ae7400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ae8152950 0x7f0ae81588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47606/0 (socket says 172.21.15.63:47606) 2024-09-12T02:57:36.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0ae7400640 1 -- 172.21.15.63:0/984743347 learned_addr learned my addr 172.21.15.63:0/984743347 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0ae7400640 1 -- 172.21.15.63:0/984743347 >> v2:172.21.15.63:3300/0 conn(0x7f0ae806c6d0 msgr2=0x7f0ae8158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0ae7400640 1 --2- 172.21.15.63:0/984743347 >> v2:172.21.15.63:3300/0 conn(0x7f0ae806c6d0 0x7f0ae8158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0ae7400640 1 -- 172.21.15.63:0/984743347 >> v1:172.21.15.63:6789/0 conn(0x7f0ae8073e20 legacy=0x7f0ae80c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.361+0000 7f0ae7400640 1 -- 172.21.15.63:0/984743347 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae806db30 con 0x7f0ae8152950 2024-09-12T02:57:36.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.365+0000 7f4087e00640 1 Processor -- start 2024-09-12T02:57:36.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.365+0000 7f4087e00640 1 -- start start 2024-09-12T02:57:36.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4087e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800d8870 0x7f4080046110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f0ae7400640 1 --2- 172.21.15.63:0/984743347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae8152950 0x7f0ae81588e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8070240 tx=0x7f0ad801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c060b163182a78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4087e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4080044b40 0x7f40800de4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4087e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40800509b0 con 0x7f40800de9e0 2024-09-12T02:57:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4087e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4080045c80 con 0x7f4080044b40 2024-09-12T02:57:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4086a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800d8870 0x7f4080046110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4086a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800d8870 0x7f4080046110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37622/0 (socket says 172.21.15.63:37622) 2024-09-12T02:57:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4086a00640 1 -- 172.21.15.63:0/1250266725 learned_addr learned my addr 172.21.15.63:0/1250266725 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4086000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4080044b40 0x7f40800de4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4087e00640 1 -- 172.21.15.63:0/1250266725 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f408004acd0 con 0x7f40800d8870 2024-09-12T02:57:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4086000640 1 -- 172.21.15.63:0/1250266725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800d8870 msgr2=0x7f4080046110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4085600640 1 -- 172.21.15.63:0/1250266725 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507954774 0 0) 0x7f40800509b0 con 0x7f40800de9e0 2024-09-12T02:57:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f0ae6000640 1 -- 172.21.15.63:0/984743347 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80b0070 con 0x7f0ae8152950 2024-09-12T02:57:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f0ae6000640 1 -- 172.21.15.63:0/984743347 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad80ab600 con 0x7f0ae8152950 2024-09-12T02:57:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f0ae6000640 1 -- 172.21.15.63:0/984743347 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad80ab9d0 con 0x7f0ae8152950 2024-09-12T02:57:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f0aee400640 1 -- 172.21.15.63:0/984743347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae8152950 msgr2=0x7f0ae81588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f0aee400640 1 --2- 172.21.15.63:0/984743347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae8152950 0x7f0ae81588e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8070240 tx=0x7f0ad801c500 comp rx=0 tx=0).stop 2024-09-12T02:57:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.369+0000 7f4086000640 1 --2- 172.21.15.63:0/1250266725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800d8870 0x7f4080046110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.373+0000 7f4086000640 1 -- 172.21.15.63:0/1250266725 >> v1:172.21.15.63:6789/0 conn(0x7f40800de9e0 legacy=0x7f40800e1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.373+0000 7f4086000640 1 -- 172.21.15.63:0/1250266725 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4080045350 con 0x7f4080044b40 2024-09-12T02:57:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.373+0000 7f4086a00640 1 --2- 172.21.15.63:0/1250266725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800d8870 0x7f4080046110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.373+0000 7f0aee400640 1 -- 172.21.15.63:0/984743347 shutdown_connections 2024-09-12T02:57:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.373+0000 7f0aee400640 1 --2- 172.21.15.63:0/984743347 >> v2:172.21.15.63:3300/0 conn(0x7f0ae806c6d0 0x7f0ae8158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.373+0000 7f0aee400640 1 --2- 172.21.15.63:0/984743347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae8152950 0x7f0ae81588e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.373+0000 7f0aee400640 1 -- 172.21.15.63:0/984743347 >> 172.21.15.63:0/984743347 conn(0x7f0ae80cbf70 msgr2=0x7f0ae80cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.373+0000 7f0aee400640 1 -- 172.21.15.63:0/984743347 shutdown_connections 2024-09-12T02:57:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff753800640 1 Processor -- start 2024-09-12T02:57:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff753800640 1 -- start start 2024-09-12T02:57:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7f0aee400640 1 -- 172.21.15.63:0/984743347 wait complete. 2024-09-12T02:57:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7f4086000640 1 --2- 172.21.15.63:0/1250266725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4080044b40 0x7f40800de4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f40740097c0 tx=0x7f407401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d510e06f39c02bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff753800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff74c0c1810 0x7ff74c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff753800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff74c0c9690 0x7ff74c0c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff753800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c1603b0 0x7ff74c160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff753800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff74c06dec0 con 0x7ff74c0c1810 2024-09-12T02:57:36.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff753800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff74c160d60 con 0x7ff74c0c9690 2024-09-12T02:57:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff753800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c06cfd0 con 0x7ff74c1603b0 2024-09-12T02:57:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7f4085600640 1 -- 172.21.15.63:0/1250266725 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40740b5070 con 0x7f4080044b40 2024-09-12T02:57:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7f0aee400640 1 Processor -- start 2024-09-12T02:57:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7f4085600640 1 -- 172.21.15.63:0/1250266725 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40740a89b0 con 0x7f4080044b40 2024-09-12T02:57:36.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7f4085600640 1 -- 172.21.15.63:0/1250266725 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40740a8d80 con 0x7f4080044b40 2024-09-12T02:57:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff750e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff74c0c1810 0x7ff74c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff74be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff74c0c9690 0x7ff74c0c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff751800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c1603b0 0x7ff74c160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff751800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c1603b0 0x7ff74c160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37626/0 (socket says 172.21.15.63:37626) 2024-09-12T02:57:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff751800640 1 -- 172.21.15.63:0/4154624022 learned_addr learned my addr 172.21.15.63:0/4154624022 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7f0aee400640 1 -- start start 2024-09-12T02:57:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7f78c3200640 1 Processor -- start 2024-09-12T02:57:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f78c3200640 1 -- start start 2024-09-12T02:57:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f4087e00640 1 -- 172.21.15.63:0/1250266725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4080044b40 msgr2=0x7f40800de4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f4087e00640 1 --2- 172.21.15.63:0/1250266725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4080044b40 0x7f40800de4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f40740097c0 tx=0x7f407401ecb0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.377+0000 7ff750e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff74c0c1810 0x7ff74c15ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39244/0 (socket says 172.21.15.63:39244) 2024-09-12T02:57:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7ff751800640 1 -- 172.21.15.63:0/4154624022 >> v2:172.21.15.119:3300/0 conn(0x7ff74c0c9690 msgr2=0x7ff74c0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7ff751800640 1 --2- 172.21.15.63:0/4154624022 >> v2:172.21.15.119:3300/0 conn(0x7ff74c0c9690 0x7ff74c0c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f4087e00640 1 -- 172.21.15.63:0/1250266725 shutdown_connections 2024-09-12T02:57:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f4087e00640 1 --2- 172.21.15.63:0/1250266725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4080044b40 0x7f40800de4a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f4087e00640 1 --2- 172.21.15.63:0/1250266725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800d8870 0x7f4080046110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f4087e00640 1 -- 172.21.15.63:0/1250266725 >> 172.21.15.63:0/1250266725 conn(0x7f408004fc60 msgr2=0x7f4080050070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7ff751800640 1 -- 172.21.15.63:0/4154624022 >> v2:172.21.15.63:3300/0 conn(0x7ff74c0c1810 msgr2=0x7ff74c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7ff751800640 1 --2- 172.21.15.63:0/4154624022 >> v2:172.21.15.63:3300/0 conn(0x7ff74c0c1810 0x7ff74c15ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7ff751800640 1 -- 172.21.15.63:0/4154624022 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c06d2b0 con 0x7ff74c1603b0 2024-09-12T02:57:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0aee400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae806c6d0 0x7f0ae81f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0aee400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae8073e20 0x7f0ae81fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0aee400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae8152950 0x7f0ae8148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0aee400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80c1110 con 0x7f0ae8073e20 2024-09-12T02:57:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0aee400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae80c0f90 con 0x7f0ae806c6d0 2024-09-12T02:57:36.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0aee400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae80c1290 con 0x7f0ae8152950 2024-09-12T02:57:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f4087e00640 1 -- 172.21.15.63:0/1250266725 shutdown_connections 2024-09-12T02:57:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae8073e20 0x7f0ae81fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae8073e20 0x7f0ae81fba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39258/0 (socket says 172.21.15.63:39258) 2024-09-12T02:57:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae6a00640 1 -- 172.21.15.63:0/501963757 learned_addr learned my addr 172.21.15.63:0/501963757 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae7e00640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae8152950 0x7f0ae8148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae7400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae806c6d0 0x7f0ae81f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f4087e00640 1 -- 172.21.15.63:0/1250266725 wait complete. 2024-09-12T02:57:36.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae6a00640 1 -- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae8152950 msgr2=0x7f0ae8148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae6a00640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae8152950 0x7f0ae8148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae6a00640 1 -- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae806c6d0 msgr2=0x7f0ae81f7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae6a00640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae806c6d0 0x7f0ae81f7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae6a00640 1 -- 172.21.15.63:0/501963757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae8148570 con 0x7f0ae8073e20 2024-09-12T02:57:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae7e00640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae8152950 0x7f0ae8148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0ae6a00640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae8073e20 0x7f0ae81fba20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400c4c0 tx=0x7f0ad4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0adf400640 1 -- 172.21.15.63:0/501963757 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4017070 con 0x7f0ae8073e20 2024-09-12T02:57:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0adf400640 1 -- 172.21.15.63:0/501963757 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad4003600 con 0x7f0ae8073e20 2024-09-12T02:57:36.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0adf400640 1 -- 172.21.15.63:0/501963757 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40039f0 con 0x7f0ae8073e20 2024-09-12T02:57:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae81558b0 con 0x7f0ae8073e20 2024-09-12T02:57:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f78c3200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 0x7f78bc160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f78c3200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f78bc0c9230 0x7f78bc0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c1e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 0x7f78bc160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c2800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f78bc0c9230 0x7f78bc0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c2800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f78bc0c9230 0x7f78bc0cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47646/0 (socket says 172.21.15.63:47646) 2024-09-12T02:57:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c2800640 1 -- 172.21.15.63:0/948778070 learned_addr learned my addr 172.21.15.63:0/948778070 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c3200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78bc0c8b30 con 0x7f78bc15fb20 2024-09-12T02:57:36.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c3200640 1 -- 172.21.15.63:0/948778070 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f78bc0cb1c0 con 0x7f78bc0c9230 2024-09-12T02:57:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c3200640 1 -- 172.21.15.63:0/948778070 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f78bc0c7d20 con 0x7f78bc15f740 2024-09-12T02:57:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae8155e70 con 0x7f0ae8073e20 2024-09-12T02:57:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.381+0000 7ff750e00640 1 --2- 172.21.15.63:0/4154624022 >> v2:172.21.15.63:3300/0 conn(0x7ff74c0c1810 0x7ff74c15ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:36.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4087e00640 1 Processor -- start 2024-09-12T02:57:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac00052a0 con 0x7f0ae8073e20 2024-09-12T02:57:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4087e00640 1 -- start start 2024-09-12T02:57:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4087e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4080044b40 0x7f40800dd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4087e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40800d8870 0x7f4080169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4087e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800de9e0 0x7f40800da1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4087e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f408004a970 con 0x7f40800d8870 2024-09-12T02:57:36.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4087e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4080045910 con 0x7f4080044b40 2024-09-12T02:57:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4087e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4080005a10 con 0x7f40800de9e0 2024-09-12T02:57:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c1e00640 1 -- 172.21.15.63:0/948778070 >> v2:172.21.15.119:3300/0 conn(0x7f78bc0c9230 msgr2=0x7f78bc0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c1e00640 1 --2- 172.21.15.63:0/948778070 >> v2:172.21.15.119:3300/0 conn(0x7f78bc0c9230 0x7f78bc0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c1e00640 1 -- 172.21.15.63:0/948778070 >> v1:172.21.15.63:6789/0 conn(0x7f78bc15fb20 legacy=0x7f78bc0c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f78c1e00640 1 -- 172.21.15.63:0/948778070 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc0ca4e0 con 0x7f78bc15f740 2024-09-12T02:57:36.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7ff751800640 1 --2- 172.21.15.63:0/4154624022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c1603b0 0x7ff74c160820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0c3340 tx=0x7ff74401f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d726b6ef80d0dce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4087400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800de9e0 0x7f40800da1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4086000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40800d8870 0x7f4080169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4086000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40800d8870 0x7f4080169730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39274/0 (socket says 172.21.15.63:39274) 2024-09-12T02:57:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.385+0000 7f4086000640 1 -- 172.21.15.63:0/2232786151 learned_addr learned my addr 172.21.15.63:0/2232786151 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f4086000640 1 -- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800de9e0 msgr2=0x7f40800da1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f4086000640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800de9e0 0x7f40800da1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f4086000640 1 -- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4080044b40 msgr2=0x7f40800dd6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:57:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f4086000640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4080044b40 0x7f40800dd6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f4086000640 1 -- 172.21.15.63:0/2232786151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4080178aa0 con 0x7f40800d8870 2024-09-12T02:57:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f4087400640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800de9e0 0x7f40800da1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f4086000640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40800d8870 0x7f4080169730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f407401c8e0 tx=0x7f407401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f0adf400640 1 -- 172.21.15.63:0/501963757 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ad401a070 con 0x7f0ae8073e20 2024-09-12T02:57:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f0adf400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac8067990 0x7f0ac8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f0adf400640 1 -- 172.21.15.63:0/501963757 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0ad4085790 con 0x7f0ae8073e20 2024-09-12T02:57:36.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff74b400640 1 -- 172.21.15.63:0/4154624022 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7440b4070 con 0x7ff74c1603b0 2024-09-12T02:57:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f78c1e00640 1 --2- 172.21.15.63:0/948778070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 0x7f78bc160260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f78b00097c0 tx=0x7f78b001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3525680b010e6dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff74b400640 1 -- 172.21.15.63:0/4154624022 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7440af400 con 0x7ff74c1603b0 2024-09-12T02:57:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff74b400640 1 -- 172.21.15.63:0/4154624022 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7440af7d0 con 0x7ff74c1603b0 2024-09-12T02:57:36.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f0ae7400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac8067990 0x7f0ac8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f78c0a00640 1 -- 172.21.15.63:0/948778070 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00b0070 con 0x7f78bc15f740 2024-09-12T02:57:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f78c0a00640 1 -- 172.21.15.63:0/948778070 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b00ab600 con 0x7f78bc15f740 2024-09-12T02:57:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7f78c0a00640 1 -- 172.21.15.63:0/948778070 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00ab9d0 con 0x7f78bc15f740 2024-09-12T02:57:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff753800640 1 -- 172.21.15.63:0/4154624022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c1603b0 msgr2=0x7ff74c160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff753800640 1 --2- 172.21.15.63:0/4154624022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c1603b0 0x7ff74c160820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0c3340 tx=0x7ff74401f200 comp rx=0 tx=0).stop 2024-09-12T02:57:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff753800640 1 -- 172.21.15.63:0/4154624022 shutdown_connections 2024-09-12T02:57:36.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff753800640 1 --2- 172.21.15.63:0/4154624022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c1603b0 0x7ff74c160820 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff753800640 1 --2- 172.21.15.63:0/4154624022 >> v2:172.21.15.119:3300/0 conn(0x7ff74c0c9690 0x7ff74c0c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff753800640 1 --2- 172.21.15.63:0/4154624022 >> v2:172.21.15.63:3300/0 conn(0x7ff74c0c1810 0x7ff74c15ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.389+0000 7ff753800640 1 -- 172.21.15.63:0/4154624022 >> 172.21.15.63:0/4154624022 conn(0x7ff74c06f3d0 msgr2=0x7ff74c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 -- 172.21.15.63:0/948778070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 msgr2=0x7f78bc160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 --2- 172.21.15.63:0/948778070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 0x7f78bc160260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f78b00097c0 tx=0x7f78b001c3f0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 -- 172.21.15.63:0/948778070 shutdown_connections 2024-09-12T02:57:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 --2- 172.21.15.63:0/948778070 >> v2:172.21.15.119:3300/0 conn(0x7f78bc0c9230 0x7f78bc0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 --2- 172.21.15.63:0/948778070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 0x7f78bc160260 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 -- 172.21.15.63:0/948778070 >> 172.21.15.63:0/948778070 conn(0x7f78bc067bd0 msgr2=0x7f78bc067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7ff753800640 1 -- 172.21.15.63:0/4154624022 shutdown_connections 2024-09-12T02:57:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7ff753800640 1 -- 172.21.15.63:0/4154624022 wait complete. 2024-09-12T02:57:36.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 -- 172.21.15.63:0/948778070 shutdown_connections 2024-09-12T02:57:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 -- 172.21.15.63:0/948778070 wait complete. 2024-09-12T02:57:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f0ae7400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac8067990 0x7f0ac8069e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80ad000 tx=0x7f0ad80a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f9364c00640 1 Processor -- start 2024-09-12T02:57:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f9364c00640 1 -- start start 2024-09-12T02:57:36.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 Processor -- start 2024-09-12T02:57:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7ff753800640 1 Processor -- start 2024-09-12T02:57:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7ff753800640 1 -- start start 2024-09-12T02:57:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f407ea00640 1 -- 172.21.15.63:0/2232786151 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40740b5040 con 0x7f40800d8870 2024-09-12T02:57:36.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff8f6a00640 1 Processor -- start 2024-09-12T02:57:36.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f9364c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f93601570a0 0x7f93600c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f9364c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601502f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff8f6a00640 1 -- start start 2024-09-12T02:57:36.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f0adf400640 1 -- 172.21.15.63:0/501963757 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ad4021020 con 0x7f0ae8073e20 2024-09-12T02:57:36.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f9364c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9360157530 con 0x7f9360071770 2024-09-12T02:57:36.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f9364c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9360159c60 con 0x7f93601570a0 2024-09-12T02:57:36.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff753800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0c1810 0x7ff74c1f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f935fe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f935fe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37656/0 (socket says 172.21.15.63:37656) 2024-09-12T02:57:36.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f935fe00640 1 -- 172.21.15.63:0/4002795955 learned_addr learned my addr 172.21.15.63:0/4002795955 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f9364c00640 1 -- 172.21.15.63:0/4002795955 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9360159f40 con 0x7f936006fcb0 2024-09-12T02:57:36.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f407ea00640 1 -- 172.21.15.63:0/2232786151 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40740bf070 con 0x7f40800d8870 2024-09-12T02:57:36.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40800d9100 con 0x7f40800d8870 2024-09-12T02:57:36.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40800d96c0 con 0x7f40800d8870 2024-09-12T02:57:36.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.393+0000 7f78c3200640 1 -- start start 2024-09-12T02:57:36.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f407ea00640 1 -- 172.21.15.63:0/2232786151 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40740b5040 con 0x7f40800d8870 2024-09-12T02:57:36.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff753800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c0c9690 0x7ff74c0c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78bc0c9230 0x7f78bc0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c3200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 0x7f78bc1f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c3200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78bc15fb20 0x7f78bc0b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc0cae50 con 0x7f78bc0c9230 2024-09-12T02:57:36.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c3200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc0cab70 con 0x7f78bc15fb20 2024-09-12T02:57:36.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c3200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f78bc16b6a0 con 0x7f78bc15f740 2024-09-12T02:57:36.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff750e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0c1810 0x7ff74c1f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff750e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0c1810 0x7ff74c1f91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37670/0 (socket says 172.21.15.63:37670) 2024-09-12T02:57:36.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff750e00640 1 -- 172.21.15.63:0/3169082104 learned_addr learned my addr 172.21.15.63:0/3169082104 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f935f400640 1 --2- 172.21.15.63:0/4002795955 >> v2:172.21.15.119:3300/0 conn(0x7f93601570a0 0x7f93600c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff753800640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c1603b0 0x7ff74c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c06db50 con 0x7ff74c1603b0 2024-09-12T02:57:36.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c06d870 con 0x7ff74c0c9690 2024-09-12T02:57:36.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c0c0f90 con 0x7ff74c0c1810 2024-09-12T02:57:36.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff74be00640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c0c9690 0x7ff74c0c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff751800640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c1603b0 0x7ff74c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78bc0c9230 0x7f78bc0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78bc0c9230 0x7f78bc0b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39278/0 (socket says 172.21.15.63:39278) 2024-09-12T02:57:36.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c1e00640 1 -- 172.21.15.63:0/4213949712 learned_addr learned my addr 172.21.15.63:0/4213949712 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40800de4a0 con 0x7f40800d8870 2024-09-12T02:57:36.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f78c1e00640 1 -- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 msgr2=0x7f78bc1f77f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:57:36.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff750e00640 1 -- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c0c9690 msgr2=0x7ff74c0c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff750e00640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c0c9690 0x7ff74c0c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff750e00640 1 -- 172.21.15.63:0/3169082104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c1603b0 msgr2=0x7ff74c14d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff750e00640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c1603b0 0x7ff74c14d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff750e00640 1 -- 172.21.15.63:0/3169082104 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c0c5be0 con 0x7ff74c0c1810 2024-09-12T02:57:36.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff751800640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c1603b0 0x7ff74c14d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:36.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff8f6a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff8f0157fc0 0x7ff8f006d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff750e00640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0c1810 0x7ff74c1f91c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c7f0 tx=0x7ff73c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f407ea00640 1 -- 172.21.15.63:0/2232786151 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40740b1790 con 0x7f40800d8870 2024-09-12T02:57:36.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff748c00640 1 -- 172.21.15.63:0/3169082104 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c015070 con 0x7ff74c0c1810 2024-09-12T02:57:36.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff748c00640 1 -- 172.21.15.63:0/3169082104 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73c007820 con 0x7ff74c0c1810 2024-09-12T02:57:36.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff748c00640 1 -- 172.21.15.63:0/3169082104 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c007c10 con 0x7ff74c0c1810 2024-09-12T02:57:36.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff8f6a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 0x7ff8f006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff8efe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff8f0157fc0 0x7ff8f006d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff8efe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff8f0157fc0 0x7ff8f006d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47696/0 (socket says 172.21.15.63:47696) 2024-09-12T02:57:36.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff8efe00640 1 -- 172.21.15.63:0/2933797993 learned_addr learned my addr 172.21.15.63:0/2933797993 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74c0c5ec0 con 0x7ff74c0c1810 2024-09-12T02:57:36.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74c14e3c0 con 0x7ff74c0c1810 2024-09-12T02:57:36.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7f407ea00640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4068067af0 0x7f4068069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7ff8f6a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f015b450 con 0x7ff8f00c9690 2024-09-12T02:57:36.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff8f6a00640 1 -- 172.21.15.63:0/2933797993 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff8f006cec0 con 0x7ff8f0157fc0 2024-09-12T02:57:36.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff8f6a00640 1 -- 172.21.15.63:0/2933797993 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f01583a0 con 0x7ff8f00c0f90 2024-09-12T02:57:36.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7f407ea00640 1 -- 172.21.15.63:0/2232786151 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4074122e70 con 0x7f40800d8870 2024-09-12T02:57:36.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7f4086a00640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4068067af0 0x7f4068069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f935fe00640 1 -- 172.21.15.63:0/4002795955 >> v2:172.21.15.119:3300/0 conn(0x7f93601570a0 msgr2=0x7f93600c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f935fe00640 1 --2- 172.21.15.63:0/4002795955 >> v2:172.21.15.119:3300/0 conn(0x7f93601570a0 0x7f93600c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f935fe00640 1 -- 172.21.15.63:0/4002795955 >> v1:172.21.15.119:6789/0 conn(0x7f9360071770 legacy=0x7f93600c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.397+0000 7f935fe00640 1 -- 172.21.15.63:0/4002795955 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936015a220 con 0x7f936006fcb0 2024-09-12T02:57:36.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7f78c1e00640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 0x7f78bc1f77f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7f78c1e00640 1 -- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78bc15fb20 msgr2=0x7f78bc0b5d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:57:36.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7f78c1e00640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78bc15fb20 0x7f78bc0b5d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7f78c1e00640 1 -- 172.21.15.63:0/4213949712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc0d0e00 con 0x7f78bc0c9230 2024-09-12T02:57:36.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff74c1592d0 con 0x7ff74c0c1810 2024-09-12T02:57:36.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff8efe00640 1 -- 172.21.15.63:0/2933797993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 msgr2=0x7ff8f006db70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:57:36.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff8efe00640 1 --2- 172.21.15.63:0/2933797993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 0x7ff8f006db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff8efe00640 1 -- 172.21.15.63:0/2933797993 >> v1:172.21.15.63:6789/0 conn(0x7ff8f00c9690 legacy=0x7ff8f00c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7ff8efe00640 1 -- 172.21.15.63:0/2933797993 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f00c6aa0 con 0x7ff8f0157fc0 2024-09-12T02:57:36.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.401+0000 7f78c1e00640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78bc0c9230 0x7f78bc0b45b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78b00097c0 tx=0x7f78b0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f935fe00640 1 --2- 172.21.15.63:0/4002795955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601502f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e50 tx=0x7f935801f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7619e165e1d41adf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f4086a00640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4068067af0 0x7f4068069fb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4078009630 tx=0x7f4078009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f935e000640 1 -- 172.21.15.63:0/4002795955 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93580b4070 con 0x7f936006fcb0 2024-09-12T02:57:36.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f935e000640 1 -- 172.21.15.63:0/4002795955 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93580af400 con 0x7f936006fcb0 2024-09-12T02:57:36.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f935e000640 1 -- 172.21.15.63:0/4002795955 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93580af7d0 con 0x7f936006fcb0 2024-09-12T02:57:36.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f9364c00640 1 -- 172.21.15.63:0/4002795955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 msgr2=0x7f93601502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f9364c00640 1 --2- 172.21.15.63:0/4002795955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601502f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e50 tx=0x7f935801f200 comp rx=0 tx=0).stop 2024-09-12T02:57:36.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f9364c00640 1 -- 172.21.15.63:0/4002795955 shutdown_connections 2024-09-12T02:57:36.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f9364c00640 1 --2- 172.21.15.63:0/4002795955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601502f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f9364c00640 1 --2- 172.21.15.63:0/4002795955 >> v2:172.21.15.119:3300/0 conn(0x7f93601570a0 0x7f93600c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f9364c00640 1 -- 172.21.15.63:0/4002795955 >> 172.21.15.63:0/4002795955 conn(0x7f936006d900 msgr2=0x7f936006f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f9364c00640 1 -- 172.21.15.63:0/4002795955 shutdown_connections 2024-09-12T02:57:36.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7f9364c00640 1 -- 172.21.15.63:0/4002795955 wait complete. 2024-09-12T02:57:36.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7ff748c00640 1 -- 172.21.15.63:0/3169082104 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff73c018070 con 0x7ff74c0c1810 2024-09-12T02:57:36.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7ff748c00640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff72c067990 0x7ff72c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.405+0000 7ff748c00640 1 -- 172.21.15.63:0/3169082104 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff73c086030 con 0x7ff74c0c1810 2024-09-12T02:57:36.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7ff8efe00640 1 --2- 172.21.15.63:0/2933797993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8f0157fc0 0x7ff8f006d630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009870 tx=0x7ff8dc01c580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f714858cec63fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7ff74be00640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff72c067990 0x7ff72c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f78b6000640 1 -- 172.21.15.63:0/4213949712 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00b0040 con 0x7f78bc0c9230 2024-09-12T02:57:36.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f9364c00640 1 Processor -- start 2024-09-12T02:57:36.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f78b6000640 1 -- 172.21.15.63:0/4213949712 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b00b43f0 con 0x7f78bc0c9230 2024-09-12T02:57:36.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f78b6000640 1 -- 172.21.15.63:0/4213949712 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00b47e0 con 0x7f78bc0c9230 2024-09-12T02:57:36.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f407ea00640 1 -- 172.21.15.63:0/2232786151 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4074018810 con 0x7f40800d8870 2024-09-12T02:57:36.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f9364c00640 1 -- start start 2024-09-12T02:57:36.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78bc06f230 con 0x7f78bc0c9230 2024-09-12T02:57:36.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78bc0b50d0 con 0x7f78bc0c9230 2024-09-12T02:57:36.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7ff8eea00640 1 -- 172.21.15.63:0/2933797993 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0a9640 con 0x7ff8f0157fc0 2024-09-12T02:57:36.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f9364c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601eee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78bc0cb650 con 0x7f78bc0c9230 2024-09-12T02:57:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f9364c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9360071770 0x7f93600ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f9364c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9360142460 0x7f9360141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f9364c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f93600c9110 con 0x7f9360071770 2024-09-12T02:57:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f9364c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f936015a7e0 con 0x7f9360142460 2024-09-12T02:57:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f9364c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f93600c9290 con 0x7f936006fcb0 2024-09-12T02:57:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f935fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9360142460 0x7f9360141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f935fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9360142460 0x7f9360141ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47700/0 (socket says 172.21.15.63:47700) 2024-09-12T02:57:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f935fe00640 1 -- 172.21.15.63:0/411214903 learned_addr learned my addr 172.21.15.63:0/411214903 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f935f400640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f78b6000640 1 -- 172.21.15.63:0/4213949712 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78b00b4980 con 0x7f78bc0c9230 2024-09-12T02:57:36.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7ff8eea00640 1 -- 172.21.15.63:0/2933797993 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8dc0a97e0 con 0x7ff8f0157fc0 2024-09-12T02:57:36.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7ff8eea00640 1 -- 172.21.15.63:0/2933797993 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0a9bb0 con 0x7ff8f0157fc0 2024-09-12T02:57:36.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7ff8f6a00640 1 -- 172.21.15.63:0/2933797993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8f0157fc0 msgr2=0x7ff8f006d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7ff8f6a00640 1 --2- 172.21.15.63:0/2933797993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8f0157fc0 0x7ff8f006d630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009870 tx=0x7ff8dc01c580 comp rx=0 tx=0).stop 2024-09-12T02:57:36.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7ff8f6a00640 1 -- 172.21.15.63:0/2933797993 shutdown_connections 2024-09-12T02:57:36.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7ff8f6a00640 1 --2- 172.21.15.63:0/2933797993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 0x7ff8f006db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7ff8f6a00640 1 --2- 172.21.15.63:0/2933797993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8f0157fc0 0x7ff8f006d630 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7ff8f6a00640 1 -- 172.21.15.63:0/2933797993 >> 172.21.15.63:0/2933797993 conn(0x7ff8f006f3d0 msgr2=0x7ff8f006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f935fe00640 1 -- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 msgr2=0x7f93601eee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f935fe00640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601eee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f935fe00640 1 -- 172.21.15.63:0/411214903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9360071770 msgr2=0x7f93600ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f935fe00640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9360071770 0x7f93600ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.409+0000 7f935fe00640 1 -- 172.21.15.63:0/411214903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93600c9e10 con 0x7f9360142460 2024-09-12T02:57:36.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f935fe00640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9360142460 0x7f9360141ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f935801d8b0 tx=0x7f935801bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f9357400640 1 -- 172.21.15.63:0/411214903 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93580b4040 con 0x7f9360142460 2024-09-12T02:57:36.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f9357400640 1 -- 172.21.15.63:0/411214903 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93580090d0 con 0x7f9360142460 2024-09-12T02:57:36.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f9357400640 1 -- 172.21.15.63:0/411214903 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93580b9650 con 0x7f9360142460 2024-09-12T02:57:36.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93600cadc0 con 0x7f9360142460 2024-09-12T02:57:36.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9360073db0 con 0x7f9360142460 2024-09-12T02:57:36.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7ff8f6a00640 1 -- 172.21.15.63:0/2933797993 shutdown_connections 2024-09-12T02:57:36.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7ff8f6a00640 1 -- 172.21.15.63:0/2933797993 wait complete. 2024-09-12T02:57:36.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7ff74be00640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff72c067990 0x7ff72c069e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff74c154050 tx=0x7ff738009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f78b6000640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78a0067990 0x7f78a0069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f78b6000640 1 -- 172.21.15.63:0/4213949712 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f78b01205e0 con 0x7f78bc0c9230 2024-09-12T02:57:36.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.413+0000 7f78c1400640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78a0067990 0x7f78a0069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7f78c1400640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78a0067990 0x7f78a0069e50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f78ac007fd0 tx=0x7f78ac0079a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93600c6970 con 0x7f9360142460 2024-09-12T02:57:36.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7ff8f6a00640 1 Processor -- start 2024-09-12T02:57:36.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7ff8f6a00640 1 -- start start 2024-09-12T02:57:36.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7f9357400640 1 -- 172.21.15.63:0/411214903 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93580c1030 con 0x7f9360142460 2024-09-12T02:57:36.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7f78b6000640 1 -- 172.21.15.63:0/4213949712 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f78b00a4e20 con 0x7f78bc0c9230 2024-09-12T02:57:36.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7f9357400640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f933c067940 0x7f933c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7ff8f6a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 0x7ff8f015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7f9357400640 1 -- 172.21.15.63:0/411214903 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9358002020 con 0x7f9360142460 2024-09-12T02:57:36.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7ff8f6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9690 0x7ff8f015a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7ff8f6a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8f0157fc0 0x7ff8f0153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7ff8f6a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f00c21a0 con 0x7ff8f00c9690 2024-09-12T02:57:36.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7ff8f6a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f00c2020 con 0x7ff8f0157fc0 2024-09-12T02:57:36.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7ff8f6a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f01679f0 con 0x7ff8f00c0f90 2024-09-12T02:57:36.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.417+0000 7f935f400640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f933c067940 0x7f933c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8efe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 0x7ff8f015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff748c00640 1 -- 172.21.15.63:0/3169082104 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff73c056250 con 0x7ff74c0c1810 2024-09-12T02:57:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8efe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 0x7ff8f015a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37700/0 (socket says 172.21.15.63:37700) 2024-09-12T02:57:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8efe00640 1 -- 172.21.15.63:0/1430700172 learned_addr learned my addr 172.21.15.63:0/1430700172 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8f4a00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8f0157fc0 0x7ff8f0153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8ef400640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9690 0x7ff8f015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8efe00640 1 -- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8f0157fc0 msgr2=0x7ff8f0153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8efe00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8f0157fc0 0x7ff8f0153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8efe00640 1 -- 172.21.15.63:0/1430700172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9690 msgr2=0x7ff8f015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8efe00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9690 0x7ff8f015a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8efe00640 1 -- 172.21.15.63:0/1430700172 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f01f7f70 con 0x7ff8f00c0f90 2024-09-12T02:57:36.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8ef400640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9690 0x7ff8f015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:36.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7f935f400640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f933c067940 0x7f933c069e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f935000aae0 tx=0x7f9350008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8efe00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 0x7ff8f015a440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc01ac30 tx=0x7ff8dc01adc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8e7e00640 1 -- 172.21.15.63:0/1430700172 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0b1800 con 0x7ff8f00c0f90 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8e7e00640 1 -- 172.21.15.63:0/1430700172 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8dc0b19c0 con 0x7ff8f00c0f90 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8e7e00640 1 -- 172.21.15.63:0/1430700172 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0b1db0 con 0x7ff8f00c0f90 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f0072c10 con 0x7ff8f00c0f90 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.421+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f0159960 con 0x7ff8f00c0f90 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.425+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f00c1910 con 0x7ff8f00c0f90 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.429+0000 7ff8e7e00640 1 -- 172.21.15.63:0/1430700172 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8dc0c53f0 con 0x7ff8f00c0f90 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.429+0000 7ff8e7e00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff8d00678c0 0x7ff8d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.429+0000 7ff8e7e00640 1 -- 172.21.15.63:0/1430700172 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff8dc121100 con 0x7ff8f00c0f90 2024-09-12T02:57:36.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.429+0000 7ff8ef400640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff8d00678c0 0x7ff8d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.429+0000 7ff8ef400640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff8d00678c0 0x7ff8d0069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0155860 tx=0x7ff8e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.437+0000 7f9357400640 1 -- 172.21.15.63:0/411214903 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f93580c8060 con 0x7f9360142460 2024-09-12T02:57:36.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.437+0000 7ff8e7e00640 1 -- 172.21.15.63:0/1430700172 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff8dc0ca020 con 0x7ff8f00c0f90 2024-09-12T02:57:36.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.453+0000 7f0568c00640 1 Processor -- start 2024-09-12T02:57:36.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.453+0000 7f0568c00640 1 -- start start 2024-09-12T02:57:36.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.457+0000 7f0568c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05640c3170 0x7f056416a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.457+0000 7f0568c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05640c5310 con 0x7f0564159220 2024-09-12T02:57:36.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.457+0000 7f0568c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f056406ffa0 con 0x7f0564158e40 2024-09-12T02:57:36.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.457+0000 7f0568c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0564070560 con 0x7f05640c3170 2024-09-12T02:57:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.457+0000 7f0561400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0564159220 0x7f05640ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56434/0 (socket says 172.21.15.63:56434) 2024-09-12T02:57:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.457+0000 7f0561e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0564158e40 0x7f056415f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:40352/0 (socket says 172.21.15.63:40352) 2024-09-12T02:57:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.457+0000 7f0562800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05640c3170 0x7f056416a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.457+0000 7f0561e00640 1 -- 172.21.15.63:0/4179725702 learned_addr learned my addr 172.21.15.63:0/4179725702 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:36.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.461+0000 7f0560a00640 1 -- 172.21.15.63:0/4179725702 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701548174 0 0) 0x7f056406ffa0 con 0x7f0564158e40 2024-09-12T02:57:36.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.461+0000 7f0560a00640 1 -- 172.21.15.63:0/4179725702 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0548003530 con 0x7f0564158e40 2024-09-12T02:57:36.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.461+0000 7f0562800640 1 -- 172.21.15.63:0/4179725702 >> v1:172.21.15.119:6789/0 conn(0x7f0564158e40 legacy=0x7f056415f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.461+0000 7f0562800640 1 -- 172.21.15.63:0/4179725702 >> v1:172.21.15.63:6789/0 conn(0x7f0564159220 legacy=0x7f05640ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.461+0000 7f0560a00640 1 -- 172.21.15.63:0/4179725702 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 28649388 0 0) 0x7f05640c5310 con 0x7f0564159220 2024-09-12T02:57:36.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.461+0000 7f0562800640 1 -- 172.21.15.63:0/4179725702 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0564070280 con 0x7f05640c3170 2024-09-12T02:57:36.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.461+0000 7f80f1400640 1 Processor -- start 2024-09-12T02:57:36.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.461+0000 7f80f1400640 1 -- start start 2024-09-12T02:57:36.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80f1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f80ec0c8210 0x7f80ec0c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80f1400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 0x7f80ec1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80f1400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80ec1576e0 con 0x7f80ec0c6970 2024-09-12T02:57:36.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80ea800640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f80ec0c6970 0x7f80ec0c76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:40364/0 (socket says 172.21.15.63:40364) 2024-09-12T02:57:36.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80ea800640 1 -- 172.21.15.63:0/976350563 learned_addr learned my addr 172.21.15.63:0/976350563 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:36.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80f1400640 1 -- 172.21.15.63:0/976350563 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f80ec0c7de0 con 0x7f80ec0c8210 2024-09-12T02:57:36.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80eb200640 1 --2- 172.21.15.63:0/976350563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 0x7f80ec1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80e9e00640 1 --2- 172.21.15.63:0/976350563 >> v2:172.21.15.63:3300/0 conn(0x7f80ec0c8210 0x7f80ec0c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80f1400640 1 -- 172.21.15.63:0/976350563 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f80ec0c1a40 con 0x7f80ec156d10 2024-09-12T02:57:36.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80e9e00640 1 -- 172.21.15.63:0/976350563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 msgr2=0x7f80ec1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80e9e00640 1 --2- 172.21.15.63:0/976350563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 0x7f80ec1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80e9e00640 1 -- 172.21.15.63:0/976350563 >> v1:172.21.15.119:6789/0 conn(0x7f80ec0c6970 legacy=0x7f80ec0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:36.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.465+0000 7f80e9e00640 1 -- 172.21.15.63:0/976350563 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec0c1d00 con 0x7f80ec0c8210 2024-09-12T02:57:36.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.469+0000 7f0562800640 1 --2- 172.21.15.63:0/4179725702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05640c3170 0x7f056416a5b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f055c009d90 tx=0x7f055c01f140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec6baa35ef3c9a41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.469+0000 7f0560a00640 1 -- 172.21.15.63:0/4179725702 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c0b4070 con 0x7f05640c3170 2024-09-12T02:57:36.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.469+0000 7f0560a00640 1 -- 172.21.15.63:0/4179725702 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055c0af600 con 0x7f05640c3170 2024-09-12T02:57:36.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.469+0000 7f0560a00640 1 -- 172.21.15.63:0/4179725702 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c0af9d0 con 0x7f05640c3170 2024-09-12T02:57:36.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f0568c00640 1 -- 172.21.15.63:0/4179725702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05640c3170 msgr2=0x7f056416a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f0568c00640 1 --2- 172.21.15.63:0/4179725702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05640c3170 0x7f056416a5b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f055c009d90 tx=0x7f055c01f140 comp rx=0 tx=0).stop 2024-09-12T02:57:36.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80e9e00640 1 --2- 172.21.15.63:0/976350563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0c8210 0x7f80ec0c6d50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0071d0 tx=0x7f80dc01fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abee068d802b0af3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f0568c00640 1 -- 172.21.15.63:0/4179725702 shutdown_connections 2024-09-12T02:57:36.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f0568c00640 1 --2- 172.21.15.63:0/4179725702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05640c3170 0x7f056416a5b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f0568c00640 1 -- 172.21.15.63:0/4179725702 >> 172.21.15.63:0/4179725702 conn(0x7f0564067a00 msgr2=0x7f0564067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80e9400640 1 -- 172.21.15.63:0/976350563 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc008be0 con 0x7f80ec0c8210 2024-09-12T02:57:36.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80e9400640 1 -- 172.21.15.63:0/976350563 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80dc008d80 con 0x7f80ec0c8210 2024-09-12T02:57:36.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f0568c00640 1 -- 172.21.15.63:0/4179725702 shutdown_connections 2024-09-12T02:57:36.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f0568c00640 1 -- 172.21.15.63:0/4179725702 wait complete. 2024-09-12T02:57:36.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80e9400640 1 -- 172.21.15.63:0/976350563 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0a9a50 con 0x7f80ec0c8210 2024-09-12T02:57:36.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80f1400640 1 -- 172.21.15.63:0/976350563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0c8210 msgr2=0x7f80ec0c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80f1400640 1 --2- 172.21.15.63:0/976350563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0c8210 0x7f80ec0c6d50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0071d0 tx=0x7f80dc01fc60 comp rx=0 tx=0).stop 2024-09-12T02:57:36.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80f1400640 1 -- 172.21.15.63:0/976350563 shutdown_connections 2024-09-12T02:57:36.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80f1400640 1 --2- 172.21.15.63:0/976350563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 0x7f80ec1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80f1400640 1 --2- 172.21.15.63:0/976350563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0c8210 0x7f80ec0c6d50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80f1400640 1 -- 172.21.15.63:0/976350563 >> 172.21.15.63:0/976350563 conn(0x7f80ec06f3d0 msgr2=0x7f80ec06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80f1400640 1 -- 172.21.15.63:0/976350563 shutdown_connections 2024-09-12T02:57:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.473+0000 7f80f1400640 1 -- 172.21.15.63:0/976350563 wait complete. 2024-09-12T02:57:36.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f80f1400640 1 Processor -- start 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0568c00640 1 Processor -- start 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0568c00640 1 -- start start 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0568c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05640c3170 0x7f05640c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0561e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05640c3170 0x7f05640c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0568c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0564158e40 0x7f05640cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0568c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05640cae10 0x7f0564149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0568c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f056415f190 con 0x7f05640c3170 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0568c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f056406edf0 con 0x7f0564158e40 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0568c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f056406f110 con 0x7f05640cae10 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0561e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05640c3170 0x7f05640c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39314/0 (socket says 172.21.15.63:39314) 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0561e00640 1 -- 172.21.15.63:0/3033302627 learned_addr learned my addr 172.21.15.63:0/3033302627 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.477+0000 7f0561400640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0564158e40 0x7f05640cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f80f1400640 1 -- start start 2024-09-12T02:57:36.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f0561e00640 1 -- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05640cae10 msgr2=0x7f0564149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f0561e00640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05640cae10 0x7f0564149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f0561e00640 1 -- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0564158e40 msgr2=0x7f05640cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f0561e00640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0564158e40 0x7f05640cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f0561e00640 1 -- 172.21.15.63:0/3033302627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05640cb750 con 0x7f05640c3170 2024-09-12T02:57:36.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f0561e00640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05640c3170 0x7f05640c9d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f055400c520 tx=0x7f055400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f055a000640 1 -- 172.21.15.63:0/3033302627 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554018070 con 0x7f05640c3170 2024-09-12T02:57:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f055a000640 1 -- 172.21.15.63:0/3033302627 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05540074e0 con 0x7f05640c3170 2024-09-12T02:57:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f055a000640 1 -- 172.21.15.63:0/3033302627 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05540049f0 con 0x7f05640c3170 2024-09-12T02:57:36.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056414f3a0 con 0x7f05640c3170 2024-09-12T02:57:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80f1400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80ec0c6970 0x7f80ec155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80f1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0c8210 0x7f80ec0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80f1400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 0x7f80ec0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80f1400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec0c25a0 con 0x7f80ec0c8210 2024-09-12T02:57:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80f1400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec0c22c0 con 0x7f80ec0c6970 2024-09-12T02:57:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80f1400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f80ec0c1660 con 0x7f80ec156d10 2024-09-12T02:57:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.481+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05641f5070 con 0x7f05640c3170 2024-09-12T02:57:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05641f55a0 con 0x7f05640c3170 2024-09-12T02:57:36.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80ea800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80ec0c6970 0x7f80ec155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80ea800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80ec0c6970 0x7f80ec155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47734/0 (socket says 172.21.15.63:47734) 2024-09-12T02:57:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80ea800640 1 -- 172.21.15.63:0/4292224233 learned_addr learned my addr 172.21.15.63:0/4292224233 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80eb200640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 0x7f80ec0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80ea800640 1 -- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 msgr2=0x7f80ec0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80ea800640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 0x7f80ec0cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80ea800640 1 -- 172.21.15.63:0/4292224233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0c8210 msgr2=0x7f80ec0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80ea800640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0c8210 0x7f80ec0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80ea800640 1 -- 172.21.15.63:0/4292224233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec0c9e10 con 0x7f80ec0c6970 2024-09-12T02:57:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f80ea800640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80ec0c6970 0x7f80ec155f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80d800b430 tx=0x7f80d800b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.485+0000 7f055a000640 1 -- 172.21.15.63:0/3033302627 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f055401b070 con 0x7f05640c3170 2024-09-12T02:57:36.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.489+0000 7f80e2a00640 1 -- 172.21.15.63:0/4292224233 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8015020 con 0x7f80ec0c6970 2024-09-12T02:57:36.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.489+0000 7f80e2a00640 1 -- 172.21.15.63:0/4292224233 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d8011830 con 0x7f80ec0c6970 2024-09-12T02:57:36.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.489+0000 7f80e2a00640 1 -- 172.21.15.63:0/4292224233 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8011c20 con 0x7f80ec0c6970 2024-09-12T02:57:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.489+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ec154f00 con 0x7f80ec0c6970 2024-09-12T02:57:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.489+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ec0ca0b0 con 0x7f80ec0c6970 2024-09-12T02:57:36.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.489+0000 7f055a000640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0544067940 0x7f0544069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.489+0000 7f055a000640 1 -- 172.21.15.63:0/3033302627 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0554085a50 con 0x7f05640c3170 2024-09-12T02:57:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.489+0000 7f0561400640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0544067940 0x7f0544069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.489+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80ec14da20 con 0x7f80ec0c6970 2024-09-12T02:57:36.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.493+0000 7f80e2a00640 1 -- 172.21.15.63:0/4292224233 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80d8018020 con 0x7f80ec0c6970 2024-09-12T02:57:36.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.493+0000 7f80e2a00640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f80cc067940 0x7f80cc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:36.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.493+0000 7f80e2a00640 1 -- 172.21.15.63:0/4292224233 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f80d8054340 con 0x7f80ec0c6970 2024-09-12T02:57:36.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.493+0000 7f80e9e00640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f80cc067940 0x7f80cc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:36.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.493+0000 7f0561400640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0544067940 0x7f0544069e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0550007bc0 tx=0x7f0550007b10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.497+0000 7f80e9e00640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f80cc067940 0x7f80cc069e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0b2000 tx=0x7f80dc004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:36.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.497+0000 7f055a000640 1 -- 172.21.15.63:0/3033302627 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f05641f55a0 con 0x7f05640c3170 2024-09-12T02:57:36.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.505+0000 7f80e2a00640 1 -- 172.21.15.63:0/4292224233 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f80d801f020 con 0x7f80ec0c6970 2024-09-12T02:57:36.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.737+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0ac0005860 con 0x7f0ae8073e20 2024-09-12T02:57:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.741+0000 7f0adf400640 1 -- 172.21.15.63:0/501963757 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ad4055920 con 0x7f0ae8073e20 2024-09-12T02:57:36.743 INFO:teuthology.orchestra.run.smithi063.stdout:64424509452 2024-09-12T02:57:36.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.741+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac8067990 msgr2=0x7f0ac8069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.741+0000 7f0aee400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac8067990 0x7f0ac8069e50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0ad80ad000 tx=0x7f0ad80a6000 comp rx=0 tx=0).stop 2024-09-12T02:57:36.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.741+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae8073e20 msgr2=0x7f0ae81fba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.745+0000 7f0aee400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae8073e20 0x7f0ae81fba20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400c4c0 tx=0x7f0ad4001e80 comp rx=0 tx=0).stop 2024-09-12T02:57:36.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.745+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 shutdown_connections 2024-09-12T02:57:36.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.745+0000 7f0aee400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0ac8067990 0x7f0ac8069e50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.745+0000 7f0aee400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae8152950 0x7f0ae8148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.745+0000 7f0aee400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ae8073e20 0x7f0ae81fba20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.745+0000 7f0aee400640 1 --2- 172.21.15.63:0/501963757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae806c6d0 0x7f0ae81f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.745+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 >> 172.21.15.63:0/501963757 conn(0x7f0ae80cbf70 msgr2=0x7f0ae80c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.745+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 shutdown_connections 2024-09-12T02:57:36.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.745+0000 7f0aee400640 1 -- 172.21.15.63:0/501963757 wait complete. 2024-09-12T02:57:36.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.757+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f78bc0c8770 con 0x7f78bc0c9230 2024-09-12T02:57:36.765 INFO:teuthology.orchestra.run.smithi063.stdout:64424509452 2024-09-12T02:57:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.757+0000 7f78b6000640 1 -- 172.21.15.63:0/4213949712 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f78b00a4e20 con 0x7f78bc0c9230 2024-09-12T02:57:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.761+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78a0067990 msgr2=0x7f78a0069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.761+0000 7f78c3200640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78a0067990 0x7f78a0069e50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f78ac007fd0 tx=0x7f78ac0079a0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.761+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78bc0c9230 msgr2=0x7f78bc0b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.761+0000 7f78c3200640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78bc0c9230 0x7f78bc0b45b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f78b00097c0 tx=0x7f78b0019190 comp rx=0 tx=0).stop 2024-09-12T02:57:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.765+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 shutdown_connections 2024-09-12T02:57:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.765+0000 7f78c3200640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78bc15fb20 0x7f78bc0b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.765+0000 7f78c3200640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78a0067990 0x7f78a0069e50 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f78ac007fd0 tx=0x7f78ac0079a0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.765+0000 7f78c3200640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78bc15f740 0x7f78bc1f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.765+0000 7f78c3200640 1 --2- 172.21.15.63:0/4213949712 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78bc0c9230 0x7f78bc0b45b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.765+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 >> 172.21.15.63:0/4213949712 conn(0x7f78bc067bd0 msgr2=0x7f78bc0c5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.765+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 shutdown_connections 2024-09-12T02:57:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.765+0000 7f78c3200640 1 -- 172.21.15.63:0/4213949712 wait complete. 2024-09-12T02:57:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.769+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff74c0b14b0 con 0x7ff74c0c1810 2024-09-12T02:57:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.769+0000 7ff748c00640 1 -- 172.21.15.63:0/3169082104 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff73c05a550 con 0x7ff74c0c1810 2024-09-12T02:57:36.774 INFO:teuthology.orchestra.run.smithi063.stdout:55834574859 2024-09-12T02:57:36.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.2 2024-09-12T02:57:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff72c067990 msgr2=0x7ff72c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff72c067990 0x7ff72c069e50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff74c154050 tx=0x7ff738009190 comp rx=0 tx=0).stop 2024-09-12T02:57:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0c1810 msgr2=0x7ff74c1f91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0c1810 0x7ff74c1f91c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c7f0 tx=0x7ff73c00ccb0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f40800dbda0 con 0x7f40800d8870 2024-09-12T02:57:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 shutdown_connections 2024-09-12T02:57:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c1603b0 0x7ff74c14d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c0c9690 0x7ff74c0c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff72c067990 0x7ff72c069e50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 --2- 172.21.15.63:0/3169082104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0c1810 0x7ff74c1f91c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 >> 172.21.15.63:0/3169082104 conn(0x7ff74c06f3d0 msgr2=0x7ff74c06f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 shutdown_connections 2024-09-12T02:57:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7ff753800640 1 -- 172.21.15.63:0/3169082104 wait complete. 2024-09-12T02:57:36.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7f407ea00640 1 -- 172.21.15.63:0/2232786151 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40740a8980 con 0x7f40800d8870 2024-09-12T02:57:36.782 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2024-09-12T02:57:36.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4068067af0 msgr2=0x7f4068069fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7f4087e00640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4068067af0 0x7f4068069fb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4078009630 tx=0x7f4078009240 comp rx=0 tx=0).stop 2024-09-12T02:57:36.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40800d8870 msgr2=0x7f4080169730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.777+0000 7f4087e00640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40800d8870 0x7f4080169730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f407401c8e0 tx=0x7f407401ba50 comp rx=0 tx=0).stop 2024-09-12T02:57:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.781+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 shutdown_connections 2024-09-12T02:57:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.781+0000 7f4087e00640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4068067af0 0x7f4068069fb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.781+0000 7f4087e00640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40800de9e0 0x7f40800da1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.781+0000 7f4087e00640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40800d8870 0x7f4080169730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.781+0000 7f4087e00640 1 --2- 172.21.15.63:0/2232786151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4080044b40 0x7f40800dd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.781+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 >> 172.21.15.63:0/2232786151 conn(0x7f408004fc60 msgr2=0x7f4080006640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.781+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 shutdown_connections 2024-09-12T02:57:36.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.781+0000 7f4087e00640 1 -- 172.21.15.63:0/2232786151 wait complete. 2024-09-12T02:57:36.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.785+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff8f006f950 con 0x7ff8f00c0f90 2024-09-12T02:57:36.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.785+0000 7ff8e7e00640 1 -- 172.21.15.63:0/1430700172 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8dc0ad020 con 0x7ff8f00c0f90 2024-09-12T02:57:36.790 INFO:teuthology.orchestra.run.smithi063.stdout:60129542154 2024-09-12T02:57:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff8d00678c0 msgr2=0x7ff8d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff8d00678c0 0x7ff8d0069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0155860 tx=0x7ff8e0009040 comp rx=0 tx=0).stop 2024-09-12T02:57:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 msgr2=0x7ff8f015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 0x7ff8f015a440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc01ac30 tx=0x7ff8dc01adc0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 shutdown_connections 2024-09-12T02:57:36.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8f0157fc0 0x7ff8f0153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9690 0x7ff8f015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff8d00678c0 0x7ff8d0069d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 --2- 172.21.15.63:0/1430700172 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8f00c0f90 0x7ff8f015a440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 >> 172.21.15.63:0/1430700172 conn(0x7ff8f006f3d0 msgr2=0x7ff8f01642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 shutdown_connections 2024-09-12T02:57:36.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.789+0000 7ff8f6a00640 1 -- 172.21.15.63:0/1430700172 wait complete. 2024-09-12T02:57:36.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.797+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f93600c7360 con 0x7f9360142460 2024-09-12T02:57:36.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.0 2024-09-12T02:57:36.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.797+0000 7f9357400640 1 -- 172.21.15.63:0/411214903 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9358018d60 con 0x7f9360142460 2024-09-12T02:57:36.801 INFO:teuthology.orchestra.run.smithi063.stdout:60129542156 2024-09-12T02:57:36.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f933c067940 msgr2=0x7f933c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f933c067940 0x7f933c069e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f935000aae0 tx=0x7f9350008040 comp rx=0 tx=0).stop 2024-09-12T02:57:36.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9360142460 msgr2=0x7f9360141ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9360142460 0x7f9360141ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f935801d8b0 tx=0x7f935801bfa0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 shutdown_connections 2024-09-12T02:57:36.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9360142460 0x7f9360141ba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9360071770 0x7f93600ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f933c067940 0x7f933c069e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 --2- 172.21.15.63:0/411214903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f936006fcb0 0x7f93601eee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 >> 172.21.15.63:0/411214903 conn(0x7f936006d900 msgr2=0x7f93600c1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 shutdown_connections 2024-09-12T02:57:36.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.801+0000 7f9364c00640 1 -- 172.21.15.63:0/411214903 wait complete. 2024-09-12T02:57:36.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-09-12T02:57:36.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2024-09-12T02:57:36.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.5 2024-09-12T02:57:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f05640c8b50 con 0x7f05640c3170 2024-09-12T02:57:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f055a000640 1 -- 172.21.15.63:0/3033302627 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0554055540 con 0x7f05640c3170 2024-09-12T02:57:36.833 INFO:teuthology.orchestra.run.smithi063.stdout:60129542154 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0544067940 msgr2=0x7f0544069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0544067940 0x7f0544069e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0550007bc0 tx=0x7f0550007b10 comp rx=0 tx=0).stop 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05640c3170 msgr2=0x7f05640c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05640c3170 0x7f05640c9d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f055400c520 tx=0x7f055400c9e0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 shutdown_connections 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0544067940 0x7f0544069e00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05640cae10 0x7f0564149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0564158e40 0x7f05640cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 --2- 172.21.15.63:0/3033302627 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05640c3170 0x7f05640c9d50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 >> 172.21.15.63:0/3033302627 conn(0x7f0564067a00 msgr2=0x7f0564154290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 shutdown_connections 2024-09-12T02:57:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.829+0000 7f0568c00640 1 -- 172.21.15.63:0/3033302627 wait complete. 2024-09-12T02:57:36.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.7 2024-09-12T02:57:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.849+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f80ec071d40 con 0x7f80ec0c6970 2024-09-12T02:57:36.854 INFO:teuthology.orchestra.run.smithi063.stdout:60129542154 2024-09-12T02:57:36.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80e2a00640 1 -- 172.21.15.63:0/4292224233 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f80d80569a0 con 0x7f80ec0c6970 2024-09-12T02:57:36.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.6 2024-09-12T02:57:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f80cc067940 msgr2=0x7f80cc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f80cc067940 0x7f80cc069e00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0b2000 tx=0x7f80dc004740 comp rx=0 tx=0).stop 2024-09-12T02:57:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80ec0c6970 msgr2=0x7f80ec155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80ec0c6970 0x7f80ec155f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80d800b430 tx=0x7f80d800b8f0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 shutdown_connections 2024-09-12T02:57:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f80cc067940 0x7f80cc069e00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80ec156d10 0x7f80ec0cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0c8210 0x7f80ec0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 --2- 172.21.15.63:0/4292224233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80ec0c6970 0x7f80ec155f80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:36.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 >> 172.21.15.63:0/4292224233 conn(0x7f80ec06f3d0 msgr2=0x7f80ec14c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:36.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 shutdown_connections 2024-09-12T02:57:36.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:36.853+0000 7f80f1400640 1 -- 172.21.15.63:0/4292224233 wait complete. 2024-09-12T02:57:36.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.4 2024-09-12T02:57:37.779 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:57:37.802 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:57:37.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:57:37.821 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:57:37.823 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:57:37.840 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:57:37.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:57:37.879 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:57:37.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.965+0000 7fe881e00640 1 Processor -- start 2024-09-12T02:57:37.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.965+0000 7fe881e00640 1 -- start start 2024-09-12T02:57:37.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.965+0000 7fe881e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe87c151690 0x7fe87c073ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:37.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.965+0000 7fe87aa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe87c151690 0x7fe87c073ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:37.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.965+0000 7fe881e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c157b40 con 0x7fe87c06c660 2024-09-12T02:57:37.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.965+0000 7fe881e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c157e20 con 0x7fe87c0c10e0 2024-09-12T02:57:37.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.965+0000 7fe881e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c06c1d0 con 0x7fe87c151690 2024-09-12T02:57:37.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe873e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe87c0c10e0 0x7fe87c157370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:40370/0 (socket says 172.21.15.63:40370) 2024-09-12T02:57:37.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe873e00640 1 -- 172.21.15.63:0/2773692763 learned_addr learned my addr 172.21.15.63:0/2773692763 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:37.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808477880 0 0) 0x7fe87c157e20 con 0x7fe87c0c10e0 2024-09-12T02:57:37.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe860003530 con 0x7fe87c0c10e0 2024-09-12T02:57:37.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2023701551 0 0) 0x7fe860003530 con 0x7fe87c0c10e0 2024-09-12T02:57:37.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 >> v2:172.21.15.63:3300/0 conn(0x7fe87c151690 msgr2=0x7fe87c073ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:37.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 --2- 172.21.15.63:0/2773692763 >> v2:172.21.15.63:3300/0 conn(0x7fe87c151690 0x7fe87c073ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:37.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 >> v1:172.21.15.63:6789/0 conn(0x7fe87c06c660 legacy=0x7fe87c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:37.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c158100 con 0x7fe87c0c10e0 2024-09-12T02:57:37.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7fe86c001a00 con 0x7fe87c0c10e0 2024-09-12T02:57:37.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 >> v1:172.21.15.119:6789/0 conn(0x7fe87c0c10e0 legacy=0x7fe87c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:37.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe860003a60 0x7fe860003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:37.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe860004810 0x7fe860004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:37.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8600051d0 0x7fe86000fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:37.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87aa00640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe860003a60 0x7fe860003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:37.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c06c1d0 con 0x7fe8600051d0 2024-09-12T02:57:37.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe860010560 con 0x7fe860003a60 2024-09-12T02:57:37.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe860010760 con 0x7fe860004810 2024-09-12T02:57:37.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87b400640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8600051d0 0x7fe86000fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:37.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87aa00640 1 -- 172.21.15.63:0/2773692763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe860004810 msgr2=0x7fe860004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:57:37.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87aa00640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe860004810 0x7fe860004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:37.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87aa00640 1 -- 172.21.15.63:0/2773692763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8600051d0 msgr2=0x7fe86000fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:37.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87aa00640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8600051d0 0x7fe86000fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:37.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.969+0000 7fe87aa00640 1 -- 172.21.15.63:0/2773692763 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe860003530 con 0x7fe860003a60 2024-09-12T02:57:37.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe87b400640 1 -- 172.21.15.63:0/2773692763 reap_dead start 2024-09-12T02:57:37.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe87aa00640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe860003a60 0x7fe860003e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe864009ae0 tx=0x7fe86401cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1011712d91f6587 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:37.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640b2070 con 0x7fe860003a60 2024-09-12T02:57:37.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe87a000640 1 -- 172.21.15.63:0/2773692763 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8640a5680 con 0x7fe860003a60 2024-09-12T02:57:37.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe881e00640 1 -- 172.21.15.63:0/2773692763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe860003a60 msgr2=0x7fe860003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:37.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe881e00640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe860003a60 0x7fe860003e80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe864009ae0 tx=0x7fe86401cab0 comp rx=0 tx=0).stop 2024-09-12T02:57:37.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe881e00640 1 -- 172.21.15.63:0/2773692763 shutdown_connections 2024-09-12T02:57:37.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe881e00640 1 --2- 172.21.15.63:0/2773692763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe860003a60 0x7fe860003e80 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe864009ae0 tx=0x7fe86401cab0 comp rx=0 tx=0).stop 2024-09-12T02:57:37.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe881e00640 1 -- 172.21.15.63:0/2773692763 >> 172.21.15.63:0/2773692763 conn(0x7fe87c0cbf70 msgr2=0x7fe87c0cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:37.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe881e00640 1 -- 172.21.15.63:0/2773692763 shutdown_connections 2024-09-12T02:57:37.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.977+0000 7fe881e00640 1 -- 172.21.15.63:0/2773692763 wait complete. 2024-09-12T02:57:37.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.981+0000 7fe881e00640 1 Processor -- start 2024-09-12T02:57:37.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.981+0000 7fe881e00640 1 -- start start 2024-09-12T02:57:37.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe881e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe87c1563b0 0x7fe87c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:37.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe881e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe87c156790 0x7fe87c1520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:37.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe881e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe87c1fdcf0 0x7fe87c1fe170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:37.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe87c1563b0 0x7fe87c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:37.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe87c1563b0 0x7fe87c153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47750/0 (socket says 172.21.15.63:47750) 2024-09-12T02:57:37.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87aa00640 1 -- 172.21.15.63:0/1122204311 learned_addr learned my addr 172.21.15.63:0/1122204311 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:37.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0c1f90 con 0x7fe87c1fdcf0 2024-09-12T02:57:37.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe873e00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe87c156790 0x7fe87c1520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:37.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c151a70 con 0x7fe87c1563b0 2024-09-12T02:57:37.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c0c2110 con 0x7fe87c156790 2024-09-12T02:57:37.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87b400640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe87c1fdcf0 0x7fe87c1fe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:37.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87aa00640 1 -- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe87c156790 msgr2=0x7fe87c1520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:37.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87aa00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe87c156790 0x7fe87c1520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:37.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87aa00640 1 -- 172.21.15.63:0/1122204311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe87c1fdcf0 msgr2=0x7fe87c1fe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:37.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87aa00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe87c1fdcf0 0x7fe87c1fe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:37.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87aa00640 1 -- 172.21.15.63:0/1122204311 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c154b70 con 0x7fe87c1563b0 2024-09-12T02:57:37.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87b400640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe87c1fdcf0 0x7fe87c1fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:37.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.985+0000 7fe87aa00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe87c1563b0 0x7fe87c153520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe86401c8e0 tx=0x7fe860005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:37.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.989+0000 7fe873400640 1 -- 172.21.15.63:0/1122204311 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640ba070 con 0x7fe87c1563b0 2024-09-12T02:57:37.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.989+0000 7fe873400640 1 -- 172.21.15.63:0/1122204311 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8640ad680 con 0x7fe87c1563b0 2024-09-12T02:57:37.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.989+0000 7fe873400640 1 -- 172.21.15.63:0/1122204311 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640b2040 con 0x7fe87c1563b0 2024-09-12T02:57:37.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.989+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c14c110 con 0x7fe87c1563b0 2024-09-12T02:57:37.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.989+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c1fe6b0 con 0x7fe87c1563b0 2024-09-12T02:57:37.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.989+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87c151ce0 con 0x7fe87c1563b0 2024-09-12T02:57:37.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.993+0000 7fe873400640 1 -- 172.21.15.63:0/1122204311 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8640bd070 con 0x7fe87c1563b0 2024-09-12T02:57:37.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.993+0000 7fe873400640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe8580678f0 0x7fe858069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:37.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.993+0000 7fe873400640 1 -- 172.21.15.63:0/1122204311 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe8641206b0 con 0x7fe87c1563b0 2024-09-12T02:57:37.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.993+0000 7fe873e00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe8580678f0 0x7fe858069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:37.997+0000 7fe873e00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe8580678f0 0x7fe858069db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe86c000f90 tx=0x7fe86c0018b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.005+0000 7fe873400640 1 -- 172.21.15.63:0/1122204311 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe8640167c0 con 0x7fe87c1563b0 2024-09-12T02:57:38.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.041+0000 7f2feb200640 1 Processor -- start 2024-09-12T02:57:38.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.041+0000 7f2feb200640 1 -- start start 2024-09-12T02:57:38.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.045+0000 7f2feb200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2fe404b8a0 0x7f2fe404b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.045+0000 7f2feb200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe40d6730 0x7f2fe40df920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.045+0000 7f2feb200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe4034ce0 con 0x7f2fe4050910 2024-09-12T02:57:38.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.045+0000 7f2feb200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe40d6b30 con 0x7f2fe404b8a0 2024-09-12T02:57:38.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.045+0000 7f2feb200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe404be00 con 0x7f2fe40d6730 2024-09-12T02:57:38.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.045+0000 7f2fe9400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2fe404b8a0 0x7f2fe404b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.045+0000 7f2fe9400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2fe404b8a0 0x7f2fe404b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47760/0 (socket says 172.21.15.63:47760) 2024-09-12T02:57:38.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.045+0000 7f2fe9400640 1 -- 172.21.15.63:0/1494434730 learned_addr learned my addr 172.21.15.63:0/1494434730 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.045+0000 7f2fea800640 1 --2- 172.21.15.63:0/1494434730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe40d6730 0x7f2fe40df920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.049+0000 7f2fea800640 1 -- 172.21.15.63:0/1494434730 >> v2:172.21.15.119:3300/0 conn(0x7f2fe404b8a0 msgr2=0x7f2fe404b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:38.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.049+0000 7f2fea800640 1 --2- 172.21.15.63:0/1494434730 >> v2:172.21.15.119:3300/0 conn(0x7f2fe404b8a0 0x7f2fe404b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.049+0000 7f2fea800640 1 -- 172.21.15.63:0/1494434730 >> v1:172.21.15.119:6789/0 conn(0x7f2fe4050910 legacy=0x7f2fe4044b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.049+0000 7f2fea800640 1 -- 172.21.15.63:0/1494434730 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe404a780 con 0x7f2fe40d6730 2024-09-12T02:57:38.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.053+0000 7f2fea800640 1 --2- 172.21.15.63:0/1494434730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe40d6730 0x7f2fe40df920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2fe404bf80 tx=0x7f2fec098e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6093cf4d8e0cc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2fe8a00640 1 -- 172.21.15.63:0/1494434730 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec12e070 con 0x7f2fe40d6730 2024-09-12T02:57:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2fe8a00640 1 -- 172.21.15.63:0/1494434730 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fec121c00 con 0x7f2fe40d6730 2024-09-12T02:57:38.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2fe8a00640 1 -- 172.21.15.63:0/1494434730 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec129640 con 0x7f2fe40d6730 2024-09-12T02:57:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2feb200640 1 -- 172.21.15.63:0/1494434730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe40d6730 msgr2=0x7f2fe40df920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2feb200640 1 --2- 172.21.15.63:0/1494434730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe40d6730 0x7f2fe40df920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2fe404bf80 tx=0x7f2fec098e90 comp rx=0 tx=0).stop 2024-09-12T02:57:38.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2feb200640 1 -- 172.21.15.63:0/1494434730 shutdown_connections 2024-09-12T02:57:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2feb200640 1 --2- 172.21.15.63:0/1494434730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe40d6730 0x7f2fe40df920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2feb200640 1 --2- 172.21.15.63:0/1494434730 >> v2:172.21.15.119:3300/0 conn(0x7f2fe404b8a0 0x7f2fe404b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2feb200640 1 -- 172.21.15.63:0/1494434730 >> 172.21.15.63:0/1494434730 conn(0x7f2fe404fc60 msgr2=0x7f2fe4050070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2feb200640 1 -- 172.21.15.63:0/1494434730 shutdown_connections 2024-09-12T02:57:38.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.057+0000 7f2feb200640 1 -- 172.21.15.63:0/1494434730 wait complete. 2024-09-12T02:57:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2feb200640 1 Processor -- start 2024-09-12T02:57:38.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2feb200640 1 -- start start 2024-09-12T02:57:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2feb200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe404b8a0 0x7f2fe404edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2feb200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe4050910 0x7f2fe417ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2feb200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe40d6730 0x7f2fe417f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2feb200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4006f50 con 0x7f2fe404b8a0 2024-09-12T02:57:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2feb200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe4006dd0 con 0x7f2fe40d6730 2024-09-12T02:57:38.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2feb200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe4045250 con 0x7f2fe4050910 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2fe9e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe404b8a0 0x7f2fe404edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2fea800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe40d6730 0x7f2fe417f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2fea800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe40d6730 0x7f2fe417f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47766/0 (socket says 172.21.15.63:47766) 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.061+0000 7f2fea800640 1 -- 172.21.15.63:0/2849748716 learned_addr learned my addr 172.21.15.63:0/2849748716 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fe9400640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe4050910 0x7f2fe417ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fea800640 1 -- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe4050910 msgr2=0x7f2fe417ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fea800640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe4050910 0x7f2fe417ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fea800640 1 -- 172.21.15.63:0/2849748716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe404b8a0 msgr2=0x7f2fe404edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fea800640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe404b8a0 0x7f2fe404edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fea800640 1 -- 172.21.15.63:0/2849748716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40d8e50 con 0x7f2fe40d6730 2024-09-12T02:57:38.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f66e3000640 1 Processor -- start 2024-09-12T02:57:38.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fea800640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe40d6730 0x7f2fe417f230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2fec000b70 tx=0x7f2fec095cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f66e3000640 1 -- start start 2024-09-12T02:57:38.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fe2000640 1 -- 172.21.15.63:0/2849748716 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec136070 con 0x7f2fe40d6730 2024-09-12T02:57:38.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fe2000640 1 -- 172.21.15.63:0/2849748716 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fec129c30 con 0x7f2fe40d6730 2024-09-12T02:57:38.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2fe2000640 1 -- 172.21.15.63:0/2849748716 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec12e040 con 0x7f2fe40d6730 2024-09-12T02:57:38.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe40d90c0 con 0x7f2fe40d6730 2024-09-12T02:57:38.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.065+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe40d9680 con 0x7f2fe40d6730 2024-09-12T02:57:38.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66e3000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f66d404b0c0 0x7f66d40de1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66e1c00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f66d40d45f0 0x7f66d4034260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56448/0 (socket says 172.21.15.63:56448) 2024-09-12T02:57:38.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66e3000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d404b620 con 0x7f66d40d45f0 2024-09-12T02:57:38.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66e1c00640 1 -- 172.21.15.63:0/2499711292 learned_addr learned my addr 172.21.15.63:0/2499711292 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:38.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc40052a0 con 0x7f2fe40d6730 2024-09-12T02:57:38.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66e3000640 1 -- 172.21.15.63:0/2499711292 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d4006670 con 0x7f66d4034970 2024-09-12T02:57:38.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66e2600640 1 --2- 172.21.15.63:0/2499711292 >> v2:172.21.15.119:3300/0 conn(0x7f66d404b0c0 0x7f66d40de1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66e3000640 1 -- 172.21.15.63:0/2499711292 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f66d4006420 con 0x7f66d404b0c0 2024-09-12T02:57:38.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f2fe2000640 1 -- 172.21.15.63:0/2849748716 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fec139070 con 0x7f2fe40d6730 2024-09-12T02:57:38.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f53cac00640 1 Processor -- start 2024-09-12T02:57:38.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66dbe00640 1 -- 172.21.15.63:0/2499711292 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280633917 0 0) 0x7f66d404b620 con 0x7f66d40d45f0 2024-09-12T02:57:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66dbe00640 1 -- 172.21.15.63:0/2499711292 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66c4003530 con 0x7f66d40d45f0 2024-09-12T02:57:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66dbe00640 1 -- 172.21.15.63:0/2499711292 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1767620268 0 0) 0x7f66d4006670 con 0x7f66d4034970 2024-09-12T02:57:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f66dbe00640 1 -- 172.21.15.63:0/2499711292 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66d404b620 con 0x7f66d4034970 2024-09-12T02:57:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f2fe2000640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2fcc067910 0x7f2fcc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f2fe2000640 1 -- 172.21.15.63:0/2849748716 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2fec19bf10 con 0x7f2fe40d6730 2024-09-12T02:57:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.069+0000 7f53cac00640 1 -- start start 2024-09-12T02:57:38.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f2fe9e00640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2fcc067910 0x7f2fcc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f66e2600640 1 -- 172.21.15.63:0/2499711292 >> v1:172.21.15.119:6789/0 conn(0x7f66d4034970 legacy=0x7f66d40ddac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f66e2600640 1 -- 172.21.15.63:0/2499711292 >> v1:172.21.15.63:6789/0 conn(0x7f66d40d45f0 legacy=0x7f66d4034260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f66e2600640 1 -- 172.21.15.63:0/2499711292 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d4006950 con 0x7f66d404b0c0 2024-09-12T02:57:38.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53cac00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c40c6970 0x7f53c40c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53cac00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53c4156d10 0x7f53c41571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53cac00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c40c1a40 con 0x7f53c40c8210 2024-09-12T02:57:38.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53cac00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f53c40c7de0 con 0x7f53c4156d10 2024-09-12T02:57:38.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f78ed000640 1 Processor -- start 2024-09-12T02:57:38.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53cac00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f53c4157700 con 0x7f53c40c6970 2024-09-12T02:57:38.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53c3e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c40c6970 0x7f53c40c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53c3400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f53c40c8210 0x7f53c40c76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56460/0 (socket says 172.21.15.63:56460) 2024-09-12T02:57:38.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53c3400640 1 -- 172.21.15.63:0/838318283 learned_addr learned my addr 172.21.15.63:0/838318283 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:38.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f78ed000640 1 -- start start 2024-09-12T02:57:38.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53c3e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c40c6970 0x7f53c40c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37758/0 (socket says 172.21.15.63:37758) 2024-09-12T02:57:38.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53c8c00640 1 --2- 172.21.15.63:0/838318283 >> v2:172.21.15.63:3300/0 conn(0x7f53c4156d10 0x7f53c41571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53c3e00640 1 -- 172.21.15.63:0/838318283 >> v2:172.21.15.63:3300/0 conn(0x7f53c4156d10 msgr2=0x7f53c41571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:38.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53c2a00640 1 -- 172.21.15.63:0/838318283 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067724998 0 0) 0x7f53c40c1a40 con 0x7f53c40c8210 2024-09-12T02:57:38.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53c3e00640 1 --2- 172.21.15.63:0/838318283 >> v2:172.21.15.63:3300/0 conn(0x7f53c4156d10 0x7f53c41571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.077+0000 7f2fe9e00640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2fcc067910 0x7f2fcc069dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc007fd0 tx=0x7f2fdc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f53c3e00640 1 -- 172.21.15.63:0/838318283 >> v1:172.21.15.63:6789/0 conn(0x7f53c40c8210 legacy=0x7f53c40c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.077+0000 7f53c3e00640 1 -- 172.21.15.63:0/838318283 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c40c1d00 con 0x7f53c40c6970 2024-09-12T02:57:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f78ed000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f78e81549f0 0x7f78e80c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f78ed000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e80cadc0 con 0x7f78e80cbe60 2024-09-12T02:57:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f78ed000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e80cb0a0 con 0x7f78e815dca0 2024-09-12T02:57:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.073+0000 7f78ed000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f78e80cab70 con 0x7f78e81549f0 2024-09-12T02:57:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.077+0000 7f78e7e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f78e815dca0 0x7f78e815e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:40390/0 (socket says 172.21.15.63:40390) 2024-09-12T02:57:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.077+0000 7f78e7e00640 1 -- 172.21.15.63:0/642360047 learned_addr learned my addr 172.21.15.63:0/642360047 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.077+0000 7f78e7400640 1 --2- 172.21.15.63:0/642360047 >> v2:172.21.15.119:3300/0 conn(0x7f78e81549f0 0x7f78e80c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.077+0000 7f78e7400640 1 -- 172.21.15.63:0/642360047 >> v1:172.21.15.119:6789/0 conn(0x7f78e815dca0 legacy=0x7f78e815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.077+0000 7f78e7400640 1 -- 172.21.15.63:0/642360047 >> v1:172.21.15.63:6789/0 conn(0x7f78e80cbe60 legacy=0x7f78e80cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.077+0000 7f78e7400640 1 -- 172.21.15.63:0/642360047 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e80cb380 con 0x7f78e81549f0 2024-09-12T02:57:38.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.077+0000 7f66e2600640 1 --2- 172.21.15.63:0/2499711292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d404b0c0 0x7f66d40de1d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66d40065a0 tx=0x7f66c801e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b00777feb492acd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53c3e00640 1 --2- 172.21.15.63:0/838318283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c40c6970 0x7f53c40c6d50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00bfa0 tx=0x7f53bc021370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=868c88ee4eb3b45a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53c2a00640 1 -- 172.21.15.63:0/838318283 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0b6070 con 0x7f53c40c6970 2024-09-12T02:57:38.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53c2a00640 1 -- 172.21.15.63:0/838318283 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc0aae50 con 0x7f53c40c6970 2024-09-12T02:57:38.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53c2a00640 1 -- 172.21.15.63:0/838318283 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc009540 con 0x7f53c40c6970 2024-09-12T02:57:38.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53cac00640 1 -- 172.21.15.63:0/838318283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c40c6970 msgr2=0x7f53c40c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53cac00640 1 --2- 172.21.15.63:0/838318283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c40c6970 0x7f53c40c6d50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00bfa0 tx=0x7f53bc021370 comp rx=0 tx=0).stop 2024-09-12T02:57:38.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53cac00640 1 -- 172.21.15.63:0/838318283 shutdown_connections 2024-09-12T02:57:38.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53cac00640 1 --2- 172.21.15.63:0/838318283 >> v2:172.21.15.63:3300/0 conn(0x7f53c4156d10 0x7f53c41571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53cac00640 1 --2- 172.21.15.63:0/838318283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c40c6970 0x7f53c40c6d50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53cac00640 1 -- 172.21.15.63:0/838318283 >> 172.21.15.63:0/838318283 conn(0x7f53c406f3d0 msgr2=0x7f53c406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f78e7400640 1 --2- 172.21.15.63:0/642360047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e81549f0 0x7f78e80c8730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f78d80097c0 tx=0x7f78d801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e23a9b33627b205 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53cac00640 1 -- 172.21.15.63:0/838318283 shutdown_connections 2024-09-12T02:57:38.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.081+0000 7f53cac00640 1 -- 172.21.15.63:0/838318283 wait complete. 2024-09-12T02:57:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f66dbe00640 1 -- 172.21.15.63:0/2499711292 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8008be0 con 0x7f66d404b0c0 2024-09-12T02:57:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f2fe2000640 1 -- 172.21.15.63:0/2849748716 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2fec140070 con 0x7f2fe40d6730 2024-09-12T02:57:38.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f66dbe00640 1 -- 172.21.15.63:0/2499711292 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c80b1070 con 0x7f66d404b0c0 2024-09-12T02:57:38.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f66e3000640 1 -- 172.21.15.63:0/2499711292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d404b0c0 msgr2=0x7f66d40de1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78e6000640 1 -- 172.21.15.63:0/642360047 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80b5070 con 0x7f78e81549f0 2024-09-12T02:57:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78e6000640 1 -- 172.21.15.63:0/642360047 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d80a8990 con 0x7f78e81549f0 2024-09-12T02:57:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78e6000640 1 -- 172.21.15.63:0/642360047 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80a8d60 con 0x7f78e81549f0 2024-09-12T02:57:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78ed000640 1 -- 172.21.15.63:0/642360047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e81549f0 msgr2=0x7f78e80c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78ed000640 1 --2- 172.21.15.63:0/642360047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e81549f0 0x7f78e80c8730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f78d80097c0 tx=0x7f78d801ec90 comp rx=0 tx=0).stop 2024-09-12T02:57:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f53cac00640 1 Processor -- start 2024-09-12T02:57:38.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f66e3000640 1 --2- 172.21.15.63:0/2499711292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d404b0c0 0x7f66d40de1d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66d40065a0 tx=0x7f66c801e5a0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f66e3000640 1 -- 172.21.15.63:0/2499711292 shutdown_connections 2024-09-12T02:57:38.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f66e3000640 1 --2- 172.21.15.63:0/2499711292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d404b0c0 0x7f66d40de1d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f66e3000640 1 -- 172.21.15.63:0/2499711292 >> 172.21.15.63:0/2499711292 conn(0x7f66d404fc60 msgr2=0x7f66d4050070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f66e3000640 1 -- 172.21.15.63:0/2499711292 shutdown_connections 2024-09-12T02:57:38.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f66e3000640 1 -- 172.21.15.63:0/2499711292 wait complete. 2024-09-12T02:57:38.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f66e3000640 1 Processor -- start 2024-09-12T02:57:38.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f66e3000640 1 -- start start 2024-09-12T02:57:38.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f53cac00640 1 -- start start 2024-09-12T02:57:38.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53cac00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53c40c6970 0x7f53c4155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53cac00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53c40c8210 0x7f53c40c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53cac00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c4156d10 0x7f53c40c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53cac00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40c25a0 con 0x7f53c40c8210 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53cac00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40c22c0 con 0x7f53c40c6970 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53cac00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f53c40c1660 con 0x7f53c4156d10 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53c3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53c40c8210 0x7f53c40c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53c3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53c40c8210 0x7f53c40c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39380/0 (socket says 172.21.15.63:39380) 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53c3400640 1 -- 172.21.15.63:0/596446319 learned_addr learned my addr 172.21.15.63:0/596446319 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53c3400640 1 -- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c4156d10 msgr2=0x7f53c40c4380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53c3400640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c4156d10 0x7f53c40c4380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53c3400640 1 -- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53c40c6970 msgr2=0x7f53c4155d70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53c3400640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53c40c6970 0x7f53c4155d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53c3400640 1 -- 172.21.15.63:0/596446319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c40cc710 con 0x7f53c40c8210 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f53c3400640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53c40c8210 0x7f53c40c3e40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c480 tx=0x7f53b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f53bbe00640 1 -- 172.21.15.63:0/596446319 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0018070 con 0x7f53c40c8210 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f53bbe00640 1 -- 172.21.15.63:0/596446319 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b00075a0 con 0x7f53c40c8210 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f53bbe00640 1 -- 172.21.15.63:0/596446319 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0004a30 con 0x7f53c40c8210 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78ed000640 1 -- 172.21.15.63:0/642360047 shutdown_connections 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78ed000640 1 --2- 172.21.15.63:0/642360047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e81549f0 0x7f78e80c8730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78ed000640 1 -- 172.21.15.63:0/642360047 >> 172.21.15.63:0/642360047 conn(0x7f78e806e390 msgr2=0x7f78e806e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78ed000640 1 -- 172.21.15.63:0/642360047 shutdown_connections 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.085+0000 7f78ed000640 1 -- 172.21.15.63:0/642360047 wait complete. 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78ed000640 1 Processor -- start 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78ed000640 1 -- start start 2024-09-12T02:57:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78ed000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78e80cbe60 0x7f78e80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78ed000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78e81549f0 0x7f78e815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78ed000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e815dca0 0x7f78e80b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78ed000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f78e80c8c70 con 0x7f78e81549f0 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78ed000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f78e80cb9d0 con 0x7f78e815dca0 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78ed000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f78e8154dd0 con 0x7f78e80cbe60 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78e6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78e81549f0 0x7f78e815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.089+0000 7f78e7400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78e80cbe60 0x7f78e80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78e7400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78e80cbe60 0x7f78e80b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37772/0 (socket says 172.21.15.63:37772) 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78e7400640 1 -- 172.21.15.63:0/978785468 learned_addr learned my addr 172.21.15.63:0/978785468 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78e7e00640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e815dca0 0x7f78e80b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78e7400640 1 -- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e815dca0 msgr2=0x7f78e80b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78e7400640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e815dca0 0x7f78e80b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78e7400640 1 -- 172.21.15.63:0/978785468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78e81549f0 msgr2=0x7f78e815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78e7400640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78e81549f0 0x7f78e815d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78e7400640 1 -- 172.21.15.63:0/978785468 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e80c59c0 con 0x7f78e80cbe60 2024-09-12T02:57:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e3000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66d4034970 0x7f66d404f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e3000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66d404b0c0 0x7f66d40472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e3000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d40d45f0 0x7f66d4188160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78e7400640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78e80cbe60 0x7f78e80b3090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78d80b3040 tx=0x7f78d801ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c4147ec0 con 0x7f53c40c8210 2024-09-12T02:57:38.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e3000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f66d404a760 con 0x7f66d404b0c0 2024-09-12T02:57:38.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e3000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f66d404a5e0 con 0x7f66d40d45f0 2024-09-12T02:57:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e3000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f66d4032b40 con 0x7f66d4034970 2024-09-12T02:57:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e1c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66d4034970 0x7f66d404f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e2600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d40d45f0 0x7f66d4188160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e2600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d40d45f0 0x7f66d4188160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47832/0 (socket says 172.21.15.63:47832) 2024-09-12T02:57:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e2600640 1 -- 172.21.15.63:0/3452613137 learned_addr learned my addr 172.21.15.63:0/3452613137 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78df400640 1 -- 172.21.15.63:0/978785468 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80bf070 con 0x7f78e80cbe60 2024-09-12T02:57:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78df400640 1 -- 172.21.15.63:0/978785468 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d80b0920 con 0x7f78e80cbe60 2024-09-12T02:57:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e1200640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66d404b0c0 0x7f66d40472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e2600640 1 -- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66d4034970 msgr2=0x7f66d404f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e2600640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66d4034970 0x7f66d404f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e2600640 1 -- 172.21.15.63:0/3452613137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66d404b0c0 msgr2=0x7f66d40472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e2600640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66d404b0c0 0x7f66d40472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f66e2600640 1 -- 172.21.15.63:0/3452613137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d40cdf60 con 0x7f66d40d45f0 2024-09-12T02:57:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c40c3360 con 0x7f53c40c8210 2024-09-12T02:57:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e80b4b10 con 0x7f78e80cbe60 2024-09-12T02:57:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.093+0000 7f78df400640 1 -- 172.21.15.63:0/978785468 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80b5040 con 0x7f78e80cbe60 2024-09-12T02:57:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f66e2600640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d40d45f0 0x7f66d4188160 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f66c80ae040 tx=0x7f66c801cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e80b50d0 con 0x7f78e80cbe60 2024-09-12T02:57:38.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c414da20 con 0x7f53c40c8210 2024-09-12T02:57:38.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f66d9600640 1 -- 172.21.15.63:0/3452613137 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c80bb070 con 0x7f66d40d45f0 2024-09-12T02:57:38.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f66d9600640 1 -- 172.21.15.63:0/3452613137 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c800f120 con 0x7f66d40d45f0 2024-09-12T02:57:38.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e80d0c00 con 0x7f78e80cbe60 2024-09-12T02:57:38.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f66d9600640 1 -- 172.21.15.63:0/3452613137 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c80b7640 con 0x7f66d40d45f0 2024-09-12T02:57:38.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d40cb450 con 0x7f66d40d45f0 2024-09-12T02:57:38.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d40cba10 con 0x7f66d40d45f0 2024-09-12T02:57:38.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d4034260 con 0x7f66d40d45f0 2024-09-12T02:57:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.097+0000 7f53bbe00640 1 -- 172.21.15.63:0/596446319 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53b001b070 con 0x7f53c40c8210 2024-09-12T02:57:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.101+0000 7f53bbe00640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f53a4067990 0x7f53a4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.101+0000 7f53bbe00640 1 -- 172.21.15.63:0/596446319 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f53b0085510 con 0x7f53c40c8210 2024-09-12T02:57:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.101+0000 7f53c3e00640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f53a4067990 0x7f53a4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.101+0000 7f66d9600640 1 -- 172.21.15.63:0/3452613137 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66c80be070 con 0x7f66d40d45f0 2024-09-12T02:57:38.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.101+0000 7f66d9600640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f66bc0678c0 0x7f66bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.105+0000 7f66d9600640 1 -- 172.21.15.63:0/3452613137 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f66c8120190 con 0x7f66d40d45f0 2024-09-12T02:57:38.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.101+0000 7f78df400640 1 -- 172.21.15.63:0/978785468 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78d80c2070 con 0x7f78e80cbe60 2024-09-12T02:57:38.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.101+0000 7f78df400640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78c8067910 0x7f78c8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.101+0000 7f78df400640 1 -- 172.21.15.63:0/978785468 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f78d81228a0 con 0x7f78e80cbe60 2024-09-12T02:57:38.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.105+0000 7f66e1c00640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f66bc0678c0 0x7f66bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.105+0000 7f78e6a00640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78c8067910 0x7f78c8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.105+0000 7f53c3e00640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f53a4067990 0x7f53a4069e50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0b3000 tx=0x7f53bc0ac000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.105+0000 7f66e1c00640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f66bc0678c0 0x7f66bc069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f66dc000b70 tx=0x7f66dc06e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.105+0000 7f78e6a00640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78c8067910 0x7f78c8069dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f78e815da50 tx=0x7f78d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.109+0000 7f53bbe00640 1 -- 172.21.15.63:0/596446319 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f53b0055d80 con 0x7f53c40c8210 2024-09-12T02:57:38.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.113+0000 7f66d9600640 1 -- 172.21.15.63:0/3452613137 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f66c8018190 con 0x7f66d40d45f0 2024-09-12T02:57:38.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.117+0000 7f78df400640 1 -- 172.21.15.63:0/978785468 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f78d80187f0 con 0x7f78e80cbe60 2024-09-12T02:57:38.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.129+0000 7f083fa00640 1 Processor -- start 2024-09-12T02:57:38.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.129+0000 7f083fa00640 1 -- start start 2024-09-12T02:57:38.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.129+0000 7f083fa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f083806fef0 0x7f083814d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.129+0000 7f083fa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f08380c6970 0x7f08380c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.129+0000 7f083d000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f083806fef0 0x7f083814d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.129+0000 7f0837e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f08380c8210 0x7f08380c76d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56470/0 (socket says 172.21.15.63:56470) 2024-09-12T02:57:38.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.129+0000 7f083d000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f083806fef0 0x7f083814d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47840/0 (socket says 172.21.15.63:47840) 2024-09-12T02:57:38.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f083da00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f08380c6970 0x7f08380c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f083da00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f08380c6970 0x7f08380c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39406/0 (socket says 172.21.15.63:39406) 2024-09-12T02:57:38.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f0837e00640 1 -- 172.21.15.63:0/3036222783 learned_addr learned my addr 172.21.15.63:0/3036222783 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:38.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f083fa00640 1 -- 172.21.15.63:0/3036222783 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08380c1d00 con 0x7f08380c8210 2024-09-12T02:57:38.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f083fa00640 1 -- 172.21.15.63:0/3036222783 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f08380c7de0 con 0x7f08380c6970 2024-09-12T02:57:38.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f083fa00640 1 -- 172.21.15.63:0/3036222783 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f08380c1fe0 con 0x7f083806fef0 2024-09-12T02:57:38.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f083da00640 1 -- 172.21.15.63:0/3036222783 >> v2:172.21.15.119:3300/0 conn(0x7f083806fef0 msgr2=0x7f083814d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:38.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f083da00640 1 --2- 172.21.15.63:0/3036222783 >> v2:172.21.15.119:3300/0 conn(0x7f083806fef0 0x7f083814d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f083da00640 1 -- 172.21.15.63:0/3036222783 >> v1:172.21.15.63:6789/0 conn(0x7f08380c8210 legacy=0x7f08380c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f083da00640 1 -- 172.21.15.63:0/3036222783 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08380c22c0 con 0x7f08380c6970 2024-09-12T02:57:38.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.133+0000 7f0837400640 1 -- 172.21.15.63:0/3036222783 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379952715 0 0) 0x7f08380c1d00 con 0x7f08380c8210 2024-09-12T02:57:38.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.141+0000 7f083d000640 1 --2- 172.21.15.63:0/3036222783 >> v2:172.21.15.119:3300/0 conn(0x7f083806fef0 0x7f083814d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.141+0000 7f083da00640 1 --2- 172.21.15.63:0/3036222783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c6970 0x7f08380c6e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f08380714a0 tx=0x7f083001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0d75af1d1fa465 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.141+0000 7f0837400640 1 -- 172.21.15.63:0/3036222783 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08300b4070 con 0x7f08380c6970 2024-09-12T02:57:38.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.141+0000 7f0837400640 1 -- 172.21.15.63:0/3036222783 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08300af600 con 0x7f08380c6970 2024-09-12T02:57:38.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.141+0000 7f0837400640 1 -- 172.21.15.63:0/3036222783 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08300af9d0 con 0x7f08380c6970 2024-09-12T02:57:38.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.141+0000 7ff51a600640 1 Processor -- start 2024-09-12T02:57:38.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7f083fa00640 1 -- 172.21.15.63:0/3036222783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c6970 msgr2=0x7f08380c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7f083fa00640 1 --2- 172.21.15.63:0/3036222783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c6970 0x7f08380c6e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f08380714a0 tx=0x7f083001f130 comp rx=0 tx=0).stop 2024-09-12T02:57:38.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7f083fa00640 1 -- 172.21.15.63:0/3036222783 shutdown_connections 2024-09-12T02:57:38.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7f083fa00640 1 --2- 172.21.15.63:0/3036222783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c6970 0x7f08380c6e00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7f083fa00640 1 --2- 172.21.15.63:0/3036222783 >> v2:172.21.15.119:3300/0 conn(0x7f083806fef0 0x7f083814d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7f083fa00640 1 -- 172.21.15.63:0/3036222783 >> 172.21.15.63:0/3036222783 conn(0x7f083806f3d0 msgr2=0x7f083806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7f083fa00640 1 -- 172.21.15.63:0/3036222783 shutdown_connections 2024-09-12T02:57:38.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7ff51a600640 1 -- start start 2024-09-12T02:57:38.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7ff51a600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff5140c9e10 0x7ff5140cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7ff51a600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5140cc020 con 0x7ff51406d420 2024-09-12T02:57:38.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7ff51a600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5140cc620 con 0x7ff5140ca1f0 2024-09-12T02:57:38.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7ff51a600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff5140cc8e0 con 0x7ff5140c9e10 2024-09-12T02:57:38.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7ff513e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff51406d420 0x7ff5141622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56476/0 (socket says 172.21.15.63:56476) 2024-09-12T02:57:38.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7ff513e00640 1 -- 172.21.15.63:0/1568944263 learned_addr learned my addr 172.21.15.63:0/1568944263 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:38.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7f083fa00640 1 -- 172.21.15.63:0/3036222783 wait complete. 2024-09-12T02:57:38.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.145+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2794936539 0 0) 0x7ff5140cc020 con 0x7ff51406d420 2024-09-12T02:57:38.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4f8003530 con 0x7ff51406d420 2024-09-12T02:57:38.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff513400640 1 --2- 172.21.15.63:0/1568944263 >> v2:172.21.15.119:3300/0 conn(0x7ff5140c9e10 0x7ff5140cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2348827475 0 0) 0x7ff4f8003530 con 0x7ff51406d420 2024-09-12T02:57:38.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 >> v2:172.21.15.119:3300/0 conn(0x7ff5140c9e10 msgr2=0x7ff5140cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:38.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 --2- 172.21.15.63:0/1568944263 >> v2:172.21.15.119:3300/0 conn(0x7ff5140c9e10 0x7ff5140cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 >> v1:172.21.15.119:6789/0 conn(0x7ff5140ca1f0 legacy=0x7ff51406cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:38.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51406bf50 con 0x7ff51406d420 2024-09-12T02:57:38.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7ff50c001a00 con 0x7ff51406d420 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7f083fa00640 1 Processor -- start 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7f083fa00640 1 -- start start 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083fa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f083806fef0 0x7f08381586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083fa00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08380c6970 0x7f083815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083fa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c8210 0x7f08380c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083d000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f083806fef0 0x7f08381586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083d000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f083806fef0 0x7f08381586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47862/0 (socket says 172.21.15.63:47862) 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f0837e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08380c6970 0x7f083815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083d000640 1 -- 172.21.15.63:0/294960290 learned_addr learned my addr 172.21.15.63:0/294960290 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0838156d10 con 0x7f08380c8210 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08380c1660 con 0x7f083806fef0 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0838156e90 con 0x7f08380c6970 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083da00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c8210 0x7f08380c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083d000640 1 -- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08380c6970 msgr2=0x7f083815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083d000640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08380c6970 0x7f083815a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083d000640 1 -- 172.21.15.63:0/294960290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c8210 msgr2=0x7f08380c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 >> v1:172.21.15.63:6789/0 conn(0x7ff51406d420 legacy=0x7ff5141622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 --2- 172.21.15.63:0/1568944263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f80039c0 0x7ff4f8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 --2- 172.21.15.63:0/1568944263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4f8004810 0x7ff4f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 --2- 172.21.15.63:0/1568944263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4f80052f0 0x7ff4f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff5140cc8e0 con 0x7ff4f80052f0 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f800c1f0 con 0x7ff4f80039c0 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f800c3f0 con 0x7ff4f8004810 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff513400640 1 --2- 172.21.15.63:0/1568944263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f80039c0 0x7ff4f8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff513400640 1 -- 172.21.15.63:0/1568944263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4f8004810 msgr2=0x7ff4f8004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff513400640 1 --2- 172.21.15.63:0/1568944263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4f8004810 0x7ff4f8004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff513400640 1 -- 172.21.15.63:0/1568944263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4f80052f0 msgr2=0x7ff4f800b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff513400640 1 --2- 172.21.15.63:0/1568944263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4f80052f0 0x7ff4f800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff513400640 1 -- 172.21.15.63:0/1568944263 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51406bf50 con 0x7ff4f80039c0 2024-09-12T02:57:38.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.149+0000 7ff513e00640 1 -- 172.21.15.63:0/1568944263 reap_dead start 2024-09-12T02:57:38.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083d000640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c8210 0x7f08380c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083d000640 1 -- 172.21.15.63:0/294960290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08381576f0 con 0x7f083806fef0 2024-09-12T02:57:38.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f0837e00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08380c6970 0x7f083815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:38.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083da00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c8210 0x7f08380c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:38.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7ff513400640 1 --2- 172.21.15.63:0/1568944263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f80039c0 0x7ff4f8003dc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc006fd0 tx=0x7ff4fc01c5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1218c07fe5a97937 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.153+0000 7f083d000640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f083806fef0 0x7f08381586a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f082800c7f0 tx=0x7f082800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00a590 con 0x7ff4f80039c0 2024-09-12T02:57:38.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7f0834c00640 1 -- 172.21.15.63:0/294960290 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828015070 con 0x7f083806fef0 2024-09-12T02:57:38.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7f0834c00640 1 -- 172.21.15.63:0/294960290 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0828007820 con 0x7f083806fef0 2024-09-12T02:57:38.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7f0834c00640 1 -- 172.21.15.63:0/294960290 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828015070 con 0x7f083806fef0 2024-09-12T02:57:38.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc0af070 con 0x7ff4f80039c0 2024-09-12T02:57:38.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff51a600640 1 -- 172.21.15.63:0/1568944263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f80039c0 msgr2=0x7ff4f8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08380c5060 con 0x7f083806fef0 2024-09-12T02:57:38.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08381579b0 con 0x7f083806fef0 2024-09-12T02:57:38.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff512000640 1 -- 172.21.15.63:0/1568944263 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00a590 con 0x7ff4f80039c0 2024-09-12T02:57:38.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff51a600640 1 --2- 172.21.15.63:0/1568944263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f80039c0 0x7ff4f8003dc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc006fd0 tx=0x7ff4fc01c5b0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff51a600640 1 -- 172.21.15.63:0/1568944263 shutdown_connections 2024-09-12T02:57:38.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff51a600640 1 --2- 172.21.15.63:0/1568944263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4f80039c0 0x7ff4f8003dc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff51a600640 1 -- 172.21.15.63:0/1568944263 >> 172.21.15.63:0/1568944263 conn(0x7ff5140d02e0 msgr2=0x7ff5140d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083814d7c0 con 0x7f083806fef0 2024-09-12T02:57:38.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff51a600640 1 -- 172.21.15.63:0/1568944263 shutdown_connections 2024-09-12T02:57:38.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.161+0000 7f0834c00640 1 -- 172.21.15.63:0/294960290 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0828018070 con 0x7f083806fef0 2024-09-12T02:57:38.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.161+0000 7f0834c00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0818067cc0 0x7f081806a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.157+0000 7ff51a600640 1 -- 172.21.15.63:0/1568944263 wait complete. 2024-09-12T02:57:38.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.161+0000 7fb283200640 1 Processor -- start 2024-09-12T02:57:38.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.161+0000 7fb283200640 1 -- start start 2024-09-12T02:57:38.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.161+0000 7ff51a600640 1 Processor -- start 2024-09-12T02:57:38.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.161+0000 7f0834c00640 1 -- 172.21.15.63:0/294960290 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0828007620 con 0x7f083806fef0 2024-09-12T02:57:38.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.161+0000 7f0837e00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0818067cc0 0x7f081806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.161+0000 7ff51a600640 1 -- start start 2024-09-12T02:57:38.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.161+0000 7f0837e00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0818067cc0 0x7f081806a180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0824007fd0 tx=0x7f0824000f20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb283200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb283200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb27c073f10 0x7fb27c0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb27be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb27be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37788/0 (socket says 172.21.15.63:37788) 2024-09-12T02:57:38.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb27be00640 1 -- 172.21.15.63:0/3127299805 learned_addr learned my addr 172.21.15.63:0/3127299805 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb283200640 1 -- 172.21.15.63:0/3127299805 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb27c15ec30 con 0x7fb27c15e6f0 2024-09-12T02:57:38.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb283200640 1 -- 172.21.15.63:0/3127299805 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fb27c0c7750 con 0x7fb27c073f10 2024-09-12T02:57:38.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb283200640 1 -- 172.21.15.63:0/3127299805 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb27c0c71d0 con 0x7fb27c06c8b0 2024-09-12T02:57:38.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff51a600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4f80039c0 0x7ff5141f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb27aa00640 1 -- 172.21.15.63:0/3127299805 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693638620 0 0) 0x7fb27c15ec30 con 0x7fb27c15e6f0 2024-09-12T02:57:38.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff51a600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141581a0 0x7ff5141f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff51a600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5141f86f0 0x7ff5141f7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff51a600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff51406c7f0 con 0x7ff4f80039c0 2024-09-12T02:57:38.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff51a600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff51406c510 con 0x7ff5141581a0 2024-09-12T02:57:38.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff51a600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff5140cbae0 con 0x7ff5141f86f0 2024-09-12T02:57:38.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb27aa00640 1 -- 172.21.15.63:0/3127299805 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb260003530 con 0x7fb27c15e6f0 2024-09-12T02:57:38.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb27be00640 1 -- 172.21.15.63:0/3127299805 >> v2:172.21.15.63:3300/0 conn(0x7fb27c073f10 msgr2=0x7fb27c0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:38.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb281200640 1 --2- 172.21.15.63:0/3127299805 >> v2:172.21.15.63:3300/0 conn(0x7fb27c073f10 0x7fb27c0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff513e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5141f86f0 0x7ff5141f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb27be00640 1 --2- 172.21.15.63:0/3127299805 >> v2:172.21.15.63:3300/0 conn(0x7fb27c073f10 0x7fb27c0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb27be00640 1 -- 172.21.15.63:0/3127299805 >> v1:172.21.15.63:6789/0 conn(0x7fb27c15e6f0 legacy=0x7fb27c0c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff513e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5141f86f0 0x7ff5141f7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37800/0 (socket says 172.21.15.63:37800) 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff513e00640 1 -- 172.21.15.63:0/178988439 learned_addr learned my addr 172.21.15.63:0/178988439 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7ff512a00640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141581a0 0x7ff5141f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.169+0000 7ff513400640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4f80039c0 0x7ff5141f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.169+0000 7ff513e00640 1 -- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141581a0 msgr2=0x7ff5141f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.169+0000 7ff513e00640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141581a0 0x7ff5141f7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.169+0000 7ff513e00640 1 -- 172.21.15.63:0/178988439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4f80039c0 msgr2=0x7ff5141f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.169+0000 7ff513e00640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4f80039c0 0x7ff5141f81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.169+0000 7ff513e00640 1 -- 172.21.15.63:0/178988439 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5140b6220 con 0x7ff5141f86f0 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.169+0000 7ff513400640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4f80039c0 0x7ff5141f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:38.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.169+0000 7ff513e00640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5141f86f0 0x7ff5141f7680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff51408d810 tx=0x7ff50c00ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7ff50b400640 1 -- 172.21.15.63:0/178988439 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c018070 con 0x7ff5141f86f0 2024-09-12T02:57:38.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.165+0000 7fb27be00640 1 -- 172.21.15.63:0/3127299805 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c06cc90 con 0x7fb27c06c8b0 2024-09-12T02:57:38.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb281200640 1 --2- 172.21.15.63:0/3127299805 >> v2:172.21.15.63:3300/0 conn(0x7fb27c073f10 0x7fb27c0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:38.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7ff50b400640 1 -- 172.21.15.63:0/178988439 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50c00a5b0 con 0x7ff5141f86f0 2024-09-12T02:57:38.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff514076370 con 0x7ff5141f86f0 2024-09-12T02:57:38.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb27be00640 1 --2- 172.21.15.63:0/3127299805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15b160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009870 tx=0x7fb26c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3acb04a6e2118ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7ff50b400640 1 -- 172.21.15.63:0/178988439 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00a9a0 con 0x7ff5141f86f0 2024-09-12T02:57:38.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5141f8c70 con 0x7ff5141f86f0 2024-09-12T02:57:38.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb27aa00640 1 -- 172.21.15.63:0/3127299805 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0ab600 con 0x7fb27c06c8b0 2024-09-12T02:57:38.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb27aa00640 1 -- 172.21.15.63:0/3127299805 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c0b0070 con 0x7fb27c06c8b0 2024-09-12T02:57:38.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb27aa00640 1 -- 172.21.15.63:0/3127299805 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0aba00 con 0x7fb27c06c8b0 2024-09-12T02:57:38.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5140d1430 con 0x7ff5141f86f0 2024-09-12T02:57:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb283200640 1 -- 172.21.15.63:0/3127299805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 msgr2=0x7fb27c15b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb283200640 1 --2- 172.21.15.63:0/3127299805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15b160 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009870 tx=0x7fb26c01c4f0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb283200640 1 -- 172.21.15.63:0/3127299805 shutdown_connections 2024-09-12T02:57:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb283200640 1 --2- 172.21.15.63:0/3127299805 >> v2:172.21.15.63:3300/0 conn(0x7fb27c073f10 0x7fb27c0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb283200640 1 --2- 172.21.15.63:0/3127299805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15b160 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb283200640 1 -- 172.21.15.63:0/3127299805 >> 172.21.15.63:0/3127299805 conn(0x7fb27c0cbf70 msgr2=0x7fb27c0cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb283200640 1 -- 172.21.15.63:0/3127299805 shutdown_connections 2024-09-12T02:57:38.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.173+0000 7fb283200640 1 -- 172.21.15.63:0/3127299805 wait complete. 2024-09-12T02:57:38.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.177+0000 7ff50b400640 1 -- 172.21.15.63:0/178988439 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff50c01b070 con 0x7ff5141f86f0 2024-09-12T02:57:38.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.177+0000 7f0834c00640 1 -- 172.21.15.63:0/294960290 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f08280559c0 con 0x7f083806fef0 2024-09-12T02:57:38.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.177+0000 7ff50b400640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4f0067910 0x7ff4f0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.177+0000 7fb283200640 1 Processor -- start 2024-09-12T02:57:38.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.177+0000 7ff50b400640 1 -- 172.21.15.63:0/178988439 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff50c085560 con 0x7ff5141f86f0 2024-09-12T02:57:38.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.177+0000 7fb283200640 1 -- start start 2024-09-12T02:57:38.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7ff513400640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4f0067910 0x7ff4f0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb283200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb283200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb27c073f10 0x7fb27c161c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb283200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c15e6f0 0x7fb27c162850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb283200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c0c6af0 con 0x7fb27c073f10 2024-09-12T02:57:38.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb283200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c0c6970 con 0x7fb27c15e6f0 2024-09-12T02:57:38.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb283200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb27c06bcc0 con 0x7fb27c06c8b0 2024-09-12T02:57:38.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb27be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb27be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:37804/0 (socket says 172.21.15.63:37804) 2024-09-12T02:57:38.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb27be00640 1 -- 172.21.15.63:0/384431947 learned_addr learned my addr 172.21.15.63:0/384431947 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7ff513400640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4f0067910 0x7ff4f0069dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0ae000 tx=0x7ff4fc0046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb281200640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c15e6f0 0x7fb27c162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb27be00640 1 -- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c15e6f0 msgr2=0x7fb27c162850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb27be00640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c15e6f0 0x7fb27c162850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb27be00640 1 -- 172.21.15.63:0/384431947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb27c073f10 msgr2=0x7fb27c161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb27be00640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb27c073f10 0x7fb27c161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb27be00640 1 -- 172.21.15.63:0/384431947 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c0c4f90 con 0x7fb27c06c8b0 2024-09-12T02:57:38.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.181+0000 7fb27be00640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15db90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0ad040 tx=0x7fb26c01ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.189+0000 7fb273e00640 1 -- 172.21.15.63:0/384431947 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0be5f0 con 0x7fb27c06c8b0 2024-09-12T02:57:38.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.189+0000 7fb273e00640 1 -- 172.21.15.63:0/384431947 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c0be7b0 con 0x7fb27c06c8b0 2024-09-12T02:57:38.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.189+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27c0c5230 con 0x7fb27c06c8b0 2024-09-12T02:57:38.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.189+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27c0c57f0 con 0x7fb27c06c8b0 2024-09-12T02:57:38.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.189+0000 7fb273e00640 1 -- 172.21.15.63:0/384431947 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0beba0 con 0x7fb27c06c8b0 2024-09-12T02:57:38.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.189+0000 7ff50b400640 1 -- 172.21.15.63:0/178988439 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff50c055780 con 0x7ff5141f86f0 2024-09-12T02:57:38.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.193+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2540052a0 con 0x7fb27c06c8b0 2024-09-12T02:57:38.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.193+0000 7fb273e00640 1 -- 172.21.15.63:0/384431947 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb26c0aa070 con 0x7fb27c06c8b0 2024-09-12T02:57:38.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.197+0000 7fb273e00640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb25c067940 0x7fb25c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.197+0000 7fb273e00640 1 -- 172.21.15.63:0/384431947 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb26c1205c0 con 0x7fb27c06c8b0 2024-09-12T02:57:38.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.197+0000 7fb27b400640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb25c067940 0x7fb25c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.197+0000 7fb27b400640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb25c067940 0x7fb25c069e00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb268007fd0 tx=0x7fb268007900 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.205+0000 7fb273e00640 1 -- 172.21.15.63:0/384431947 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb26c016170 con 0x7fb27c06c8b0 2024-09-12T02:57:38.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.349+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe87c06cad0 con 0x7fe87c1563b0 2024-09-12T02:57:38.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.349+0000 7fe873400640 1 -- 172.21.15.63:0/1122204311 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8640f08d0 con 0x7fe87c1563b0 2024-09-12T02:57:38.354 INFO:teuthology.orchestra.run.smithi063.stdout:64424509453 2024-09-12T02:57:38.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe8580678f0 msgr2=0x7fe858069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe8580678f0 0x7fe858069db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe86c000f90 tx=0x7fe86c0018b0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe87c1563b0 msgr2=0x7fe87c153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe87c1563b0 0x7fe87c153520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe86401c8e0 tx=0x7fe860005840 comp rx=0 tx=0).stop 2024-09-12T02:57:38.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 shutdown_connections 2024-09-12T02:57:38.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe87c1fdcf0 0x7fe87c1fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe8580678f0 0x7fe858069db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe87c156790 0x7fe87c1520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 --2- 172.21.15.63:0/1122204311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe87c1563b0 0x7fe87c153520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 >> 172.21.15.63:0/1122204311 conn(0x7fe87c0cbf70 msgr2=0x7fe87c0730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 shutdown_connections 2024-09-12T02:57:38.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.357+0000 7fe881e00640 1 -- 172.21.15.63:0/1122204311 wait complete. 2024-09-12T02:57:38.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.381+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2fc4005590 con 0x7f2fe40d6730 2024-09-12T02:57:38.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.385+0000 7f2fe2000640 1 -- 172.21.15.63:0/2849748716 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2fec140070 con 0x7f2fe40d6730 2024-09-12T02:57:38.387 INFO:teuthology.orchestra.run.smithi063.stdout:64424509453 2024-09-12T02:57:38.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.2 2024-09-12T02:57:38.393 DEBUG:teuthology.parallel:result is None 2024-09-12T02:57:38.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2fcc067910 msgr2=0x7f2fcc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2fcc067910 0x7f2fcc069dd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc007fd0 tx=0x7f2fdc009040 comp rx=0 tx=0).stop 2024-09-12T02:57:38.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe40d6730 msgr2=0x7f2fe417f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe40d6730 0x7f2fe417f230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2fec000b70 tx=0x7f2fec095cd0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 shutdown_connections 2024-09-12T02:57:38.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2fe40d6730 0x7f2fe417f230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2fcc067910 0x7f2fcc069dd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2fe4050910 0x7f2fe417ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 --2- 172.21.15.63:0/2849748716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2fe404b8a0 0x7f2fe404edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 >> 172.21.15.63:0/2849748716 conn(0x7f2fe404fc60 msgr2=0x7f2fe4035020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 shutdown_connections 2024-09-12T02:57:38.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.389+0000 7f2feb200640 1 -- 172.21.15.63:0/2849748716 wait complete. 2024-09-12T02:57:38.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.0 2024-09-12T02:57:38.423 DEBUG:teuthology.parallel:result is None 2024-09-12T02:57:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.425+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f53c4071d40 con 0x7f53c40c8210 2024-09-12T02:57:38.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.425+0000 7f53bbe00640 1 -- 172.21.15.63:0/596446319 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53b0055680 con 0x7f53c40c8210 2024-09-12T02:57:38.428 INFO:teuthology.orchestra.run.smithi063.stdout:64424509451 2024-09-12T02:57:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f53a4067990 msgr2=0x7f53a4069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f53a4067990 0x7f53a4069e50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53bc0b3000 tx=0x7f53bc0ac000 comp rx=0 tx=0).stop 2024-09-12T02:57:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53c40c8210 msgr2=0x7f53c40c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53c40c8210 0x7f53c40c3e40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c480 tx=0x7f53b000c940 comp rx=0 tx=0).stop 2024-09-12T02:57:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 shutdown_connections 2024-09-12T02:57:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f53a4067990 0x7f53a4069e50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53c4156d10 0x7f53c40c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53c40c8210 0x7f53c40c3e40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 --2- 172.21.15.63:0/596446319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53c40c6970 0x7f53c4155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 >> 172.21.15.63:0/596446319 conn(0x7f53c406f3d0 msgr2=0x7f53c4149280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 shutdown_connections 2024-09-12T02:57:38.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.429+0000 7f53cac00640 1 -- 172.21.15.63:0/596446319 wait complete. 2024-09-12T02:57:38.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.445+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f66d40d08a0 con 0x7f66d40d45f0 2024-09-12T02:57:38.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.445+0000 7f66d9600640 1 -- 172.21.15.63:0/3452613137 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f66c80f03b0 con 0x7f66d40d45f0 2024-09-12T02:57:38.450 INFO:teuthology.orchestra.run.smithi063.stdout:55834574861 2024-09-12T02:57:38.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2024-09-12T02:57:38.453 DEBUG:teuthology.parallel:result is None 2024-09-12T02:57:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f66bc0678c0 msgr2=0x7f66bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f66bc0678c0 0x7f66bc069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f66dc000b70 tx=0x7f66dc06e040 comp rx=0 tx=0).stop 2024-09-12T02:57:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d40d45f0 msgr2=0x7f66d4188160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d40d45f0 0x7f66d4188160 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f66c80ae040 tx=0x7f66c801cde0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 shutdown_connections 2024-09-12T02:57:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66d40d45f0 0x7f66d4188160 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f66d404b0c0 0x7f66d40472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f66bc0678c0 0x7f66bc069d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 --2- 172.21.15.63:0/3452613137 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66d4034970 0x7f66d404f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 >> 172.21.15.63:0/3452613137 conn(0x7f66d404fc60 msgr2=0x7f66d40d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 shutdown_connections 2024-09-12T02:57:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.449+0000 7f66e3000640 1 -- 172.21.15.63:0/3452613137 wait complete. 2024-09-12T02:57:38.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.461+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f78e80d0f50 con 0x7f78e80cbe60 2024-09-12T02:57:38.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.461+0000 7f78df400640 1 -- 172.21.15.63:0/978785468 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f78d80f2b30 con 0x7f78e80cbe60 2024-09-12T02:57:38.465 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2024-09-12T02:57:38.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78c8067910 msgr2=0x7f78c8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78c8067910 0x7f78c8069dd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f78e815da50 tx=0x7f78d4009040 comp rx=0 tx=0).stop 2024-09-12T02:57:38.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78e80cbe60 msgr2=0x7f78e80b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78e80cbe60 0x7f78e80b3090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78d80b3040 tx=0x7f78d801ba30 comp rx=0 tx=0).stop 2024-09-12T02:57:38.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 shutdown_connections 2024-09-12T02:57:38.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78e815dca0 0x7f78e80b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78e81549f0 0x7f78e815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78c8067910 0x7f78c8069dd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 --2- 172.21.15.63:0/978785468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78e80cbe60 0x7f78e80b3090 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 >> 172.21.15.63:0/978785468 conn(0x7f78e806e390 msgr2=0x7f78e80cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 shutdown_connections 2024-09-12T02:57:38.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.465+0000 7f78ed000640 1 -- 172.21.15.63:0/978785468 wait complete. 2024-09-12T02:57:38.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574861 for osd.1 2024-09-12T02:57:38.487 DEBUG:teuthology.parallel:result is None 2024-09-12T02:57:38.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.5 2024-09-12T02:57:38.488 DEBUG:teuthology.parallel:result is None 2024-09-12T02:57:38.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.513+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0838071d40 con 0x7f083806fef0 2024-09-12T02:57:38.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.513+0000 7f0834c00640 1 -- 172.21.15.63:0/294960290 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0828059cc0 con 0x7f083806fef0 2024-09-12T02:57:38.516 INFO:teuthology.orchestra.run.smithi063.stdout:60129542157 2024-09-12T02:57:38.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0818067cc0 msgr2=0x7f081806a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0818067cc0 0x7f081806a180 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0824007fd0 tx=0x7f0824000f20 comp rx=0 tx=0).stop 2024-09-12T02:57:38.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f083806fef0 msgr2=0x7f08381586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f083806fef0 0x7f08381586a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f082800c7f0 tx=0x7f082800ccb0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 shutdown_connections 2024-09-12T02:57:38.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08380c8210 0x7f08380c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0818067cc0 0x7f081806a180 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08380c6970 0x7f083815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 --2- 172.21.15.63:0/294960290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f083806fef0 0x7f08381586a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 >> 172.21.15.63:0/294960290 conn(0x7f083806f3d0 msgr2=0x7f083814c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 shutdown_connections 2024-09-12T02:57:38.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.517+0000 7f083fa00640 1 -- 172.21.15.63:0/294960290 wait complete. 2024-09-12T02:57:38.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.525+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff5140ca6f0 con 0x7ff5141f86f0 2024-09-12T02:57:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.525+0000 7ff50b400640 1 -- 172.21.15.63:0/178988439 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff50c059a80 con 0x7ff5141f86f0 2024-09-12T02:57:38.529 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2024-09-12T02:57:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4f0067910 msgr2=0x7ff4f0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4f0067910 0x7ff4f0069dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0ae000 tx=0x7ff4fc0046d0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5141f86f0 msgr2=0x7ff5141f7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5141f86f0 0x7ff5141f7680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff51408d810 tx=0x7ff50c00ccd0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 shutdown_connections 2024-09-12T02:57:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4f0067910 0x7ff4f0069dd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5141f86f0 0x7ff5141f7680 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5141581a0 0x7ff5141f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 --2- 172.21.15.63:0/178988439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4f80039c0 0x7ff5141f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 >> 172.21.15.63:0/178988439 conn(0x7ff5140d02e0 msgr2=0x7ff5140d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 shutdown_connections 2024-09-12T02:57:38.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.529+0000 7ff51a600640 1 -- 172.21.15.63:0/178988439 wait complete. 2024-09-12T02:57:38.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.7 2024-09-12T02:57:38.547 DEBUG:teuthology.parallel:result is None 2024-09-12T02:57:38.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.6 2024-09-12T02:57:38.551 DEBUG:teuthology.parallel:result is None 2024-09-12T02:57:38.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.553+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb254005860 con 0x7fb27c06c8b0 2024-09-12T02:57:38.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.553+0000 7fb273e00640 1 -- 172.21.15.63:0/384431947 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb26c0f0900 con 0x7fb27c06c8b0 2024-09-12T02:57:38.558 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2024-09-12T02:57:38.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb25c067940 msgr2=0x7fb25c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb25c067940 0x7fb25c069e00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb268007fd0 tx=0x7fb268007900 comp rx=0 tx=0).stop 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 msgr2=0x7fb27c15db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15db90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0ad040 tx=0x7fb26c01ad30 comp rx=0 tx=0).stop 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 shutdown_connections 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c15e6f0 0x7fb27c162850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb27c073f10 0x7fb27c161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb25c067940 0x7fb25c069e00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 --2- 172.21.15.63:0/384431947 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c06c8b0 0x7fb27c15db90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 >> 172.21.15.63:0/384431947 conn(0x7fb27c0cbf70 msgr2=0x7fb27c0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 shutdown_connections 2024-09-12T02:57:38.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.557+0000 7fb283200640 1 -- 172.21.15.63:0/384431947 wait complete. 2024-09-12T02:57:38.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.4 2024-09-12T02:57:38.580 DEBUG:teuthology.parallel:result is None 2024-09-12T02:57:38.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:57:38.580 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:57:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.761+0000 7faaf1200640 1 Processor -- start 2024-09-12T02:57:38.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.761+0000 7faaf1200640 1 -- start start 2024-09-12T02:57:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faaf1200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faaec074070 0x7faaec0c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faaf1200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec0c28c0 0x7faaec161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faaf1200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaec0c2d50 con 0x7faaec151a80 2024-09-12T02:57:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faaf1200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7faaec0c8500 con 0x7faaec074070 2024-09-12T02:57:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faaf1200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7faaec1580c0 con 0x7faaec0c28c0 2024-09-12T02:57:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faae9400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faaec074070 0x7faaec0c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faae9400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7faaec074070 0x7faaec0c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39452/0 (socket says 172.21.15.63:39452) 2024-09-12T02:57:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faae9400640 1 -- 172.21.15.63:0/2404461749 learned_addr learned my addr 172.21.15.63:0/2404461749 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faaea800640 1 --2- 172.21.15.63:0/2404461749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec0c28c0 0x7faaec161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faae9400640 1 -- 172.21.15.63:0/2404461749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec0c28c0 msgr2=0x7faaec161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faae9400640 1 --2- 172.21.15.63:0/2404461749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec0c28c0 0x7faaec161e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faae9400640 1 -- 172.21.15.63:0/2404461749 >> v1:172.21.15.119:6789/0 conn(0x7faaec151a80 legacy=0x7faaec072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faae9400640 1 -- 172.21.15.63:0/2404461749 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec1583a0 con 0x7faaec074070 2024-09-12T02:57:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.765+0000 7faae9400640 1 --2- 172.21.15.63:0/2404461749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec074070 0x7faaec0c2380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faad8009870 tx=0x7faad801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70229d63a08d2487 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae8a00640 1 -- 172.21.15.63:0/2404461749 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad80b5070 con 0x7faaec074070 2024-09-12T02:57:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae8a00640 1 -- 172.21.15.63:0/2404461749 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad80a8a50 con 0x7faaec074070 2024-09-12T02:57:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae8a00640 1 -- 172.21.15.63:0/2404461749 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad80a8e20 con 0x7faaec074070 2024-09-12T02:57:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 -- 172.21.15.63:0/2404461749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec074070 msgr2=0x7faaec0c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 --2- 172.21.15.63:0/2404461749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec074070 0x7faaec0c2380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faad8009870 tx=0x7faad801ed50 comp rx=0 tx=0).stop 2024-09-12T02:57:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 -- 172.21.15.63:0/2404461749 shutdown_connections 2024-09-12T02:57:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 --2- 172.21.15.63:0/2404461749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec0c28c0 0x7faaec161e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 --2- 172.21.15.63:0/2404461749 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec074070 0x7faaec0c2380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 -- 172.21.15.63:0/2404461749 >> 172.21.15.63:0/2404461749 conn(0x7faaec06f3d0 msgr2=0x7faaec06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 -- 172.21.15.63:0/2404461749 shutdown_connections 2024-09-12T02:57:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 -- 172.21.15.63:0/2404461749 wait complete. 2024-09-12T02:57:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 Processor -- start 2024-09-12T02:57:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 -- start start 2024-09-12T02:57:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaec074070 0x7faaec15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec0c28c0 0x7faaec147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec151a80 0x7faaec164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faaec0cc4c0 con 0x7faaec0c28c0 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faaec0cc1e0 con 0x7faaec074070 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaf1200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7faaec0c81f0 con 0x7faaec151a80 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec0c28c0 0x7faaec147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec0c28c0 0x7faaec147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39468/0 (socket says 172.21.15.63:39468) 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9400640 1 -- 172.21.15.63:0/3203002459 learned_addr learned my addr 172.21.15.63:0/3203002459 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9e00640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaec074070 0x7faaec15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaea800640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec151a80 0x7faaec164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9400640 1 -- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec151a80 msgr2=0x7faaec164d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9400640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec151a80 0x7faaec164d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9400640 1 -- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaec074070 msgr2=0x7faaec15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9400640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaec074070 0x7faaec15b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9400640 1 -- 172.21.15.63:0/3203002459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec148390 con 0x7faaec0c28c0 2024-09-12T02:57:38.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faaea800640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec151a80 0x7faaec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:38.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.769+0000 7faae9e00640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaec074070 0x7faaec15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:38.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faae9400640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec0c28c0 0x7faaec147e50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faad801c980 tx=0x7faad801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faae2000640 1 -- 172.21.15.63:0/3203002459 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad80c0070 con 0x7faaec0c28c0 2024-09-12T02:57:38.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faae2000640 1 -- 172.21.15.63:0/3203002459 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad80ae550 con 0x7faaec0c28c0 2024-09-12T02:57:38.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faae2000640 1 -- 172.21.15.63:0/3203002459 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad80b5070 con 0x7faaec0c28c0 2024-09-12T02:57:38.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaec149910 con 0x7faaec0c28c0 2024-09-12T02:57:38.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaec1f0f90 con 0x7faaec0c28c0 2024-09-12T02:57:38.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaec0c7cf0 con 0x7faaec0c28c0 2024-09-12T02:57:38.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faae2000640 1 -- 172.21.15.63:0/3203002459 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faad80c3070 con 0x7faaec0c28c0 2024-09-12T02:57:38.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faae2000640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faacc0678c0 0x7faacc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:38.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faae2000640 1 -- 172.21.15.63:0/3203002459 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faad8123720 con 0x7faaec0c28c0 2024-09-12T02:57:38.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.773+0000 7faae9e00640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faacc0678c0 0x7faacc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:38.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.777+0000 7faae9e00640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faacc0678c0 0x7faacc069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faadc001710 tx=0x7faadc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:38.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.777+0000 7faae2000640 1 -- 172.21.15.63:0/3203002459 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faad80188b0 con 0x7faaec0c28c0 2024-09-12T02:57:38.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.941+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faaec149bf0 con 0x7faacc0678c0 2024-09-12T02:57:38.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.965+0000 7faae2000640 1 -- 172.21.15.63:0/3203002459 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7faaec149bf0 con 0x7faacc0678c0 2024-09-12T02:57:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:38.972 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:57:38.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faacc0678c0 msgr2=0x7faacc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faacc0678c0 0x7faacc069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faadc001710 tx=0x7faadc009040 comp rx=0 tx=0).stop 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec0c28c0 msgr2=0x7faaec147e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec0c28c0 0x7faaec147e50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faad801c980 tx=0x7faad801baf0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 shutdown_connections 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faacc0678c0 0x7faacc069d80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faaec151a80 0x7faaec164d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec0c28c0 0x7faaec147e50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 --2- 172.21.15.63:0/3203002459 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faaec074070 0x7faaec15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 >> 172.21.15.63:0/3203002459 conn(0x7faaec06f3d0 msgr2=0x7faaec150940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 shutdown_connections 2024-09-12T02:57:38.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:38.969+0000 7faaf1200640 1 -- 172.21.15.63:0/3203002459 wait complete. 2024-09-12T02:57:38.991 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-12T02:57:37.758524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2049012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005039"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886709+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:57:09.886709+0000","last_peered":"2024-09-12T02:57:09.886709+0000","last_clean":"2024-09-12T02:57:09.886709+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:57:09.886709+0000","last_undegraded":"2024-09-12T02:57:09.886709+0000","last_fullsized":"2024-09-12T02:57:09.886709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872098+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:57:09.872098+0000","last_peered":"2024-09-12T02:57:09.872098+0000","last_clean":"2024-09-12T02:57:09.872098+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:57:09.872098+0000","last_undegraded":"2024-09-12T02:57:09.872098+0000","last_fullsized":"2024-09-12T02:57:09.872098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871428+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:57:09.871428+0000","last_peered":"2024-09-12T02:57:09.871428+0000","last_clean":"2024-09-12T02:57:09.871428+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:57:09.871428+0000","last_undegraded":"2024-09-12T02:57:09.871428+0000","last_fullsized":"2024-09-12T02:57:09.871428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872215+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:57:09.872215+0000","last_peered":"2024-09-12T02:57:09.872215+0000","last_clean":"2024-09-12T02:57:09.872215+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:57:09.872215+0000","last_undegraded":"2024-09-12T02:57:09.872215+0000","last_fullsized":"2024-09-12T02:57:09.872215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886576+0000","last_change":"2024-09-12T02:57:04.882473+0000","last_active":"2024-09-12T02:57:09.886576+0000","last_peered":"2024-09-12T02:57:09.886576+0000","last_clean":"2024-09-12T02:57:09.886576+0000","last_became_active":"2024-09-12T02:57:04.882182+0000","last_became_peered":"2024-09-12T02:57:04.882182+0000","last_unstale":"2024-09-12T02:57:09.886576+0000","last_undegraded":"2024-09-12T02:57:09.886576+0000","last_fullsized":"2024-09-12T02:57:09.886576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367426+0000","last_change":"2024-09-12T02:57:08.878799+0000","last_active":"2024-09-12T02:57:10.367426+0000","last_peered":"2024-09-12T02:57:10.367426+0000","last_clean":"2024-09-12T02:57:10.367426+0000","last_became_active":"2024-09-12T02:57:08.877274+0000","last_became_peered":"2024-09-12T02:57:08.877274+0000","last_unstale":"2024-09-12T02:57:10.367426+0000","last_undegraded":"2024-09-12T02:57:10.367426+0000","last_fullsized":"2024-09-12T02:57:10.367426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:27.611325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346487+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:57:10.346487+0000","last_peered":"2024-09-12T02:57:10.346487+0000","last_clean":"2024-09-12T02:57:10.346487+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:57:10.346487+0000","last_undegraded":"2024-09-12T02:57:10.346487+0000","last_fullsized":"2024-09-12T02:57:10.346487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875248+0000","last_change":"2024-09-12T02:57:04.875312+0000","last_active":"2024-09-12T02:57:09.875248+0000","last_peered":"2024-09-12T02:57:09.875248+0000","last_clean":"2024-09-12T02:57:09.875248+0000","last_became_active":"2024-09-12T02:57:04.863748+0000","last_became_peered":"2024-09-12T02:57:04.863748+0000","last_unstale":"2024-09-12T02:57:09.875248+0000","last_undegraded":"2024-09-12T02:57:09.875248+0000","last_fullsized":"2024-09-12T02:57:09.875248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:39.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368200+0000","last_change":"2024-09-12T02:57:08.888677+0000","last_active":"2024-09-12T02:57:10.368200+0000","last_peered":"2024-09-12T02:57:10.368200+0000","last_clean":"2024-09-12T02:57:10.368200+0000","last_became_active":"2024-09-12T02:57:08.875948+0000","last_became_peered":"2024-09-12T02:57:08.875948+0000","last_unstale":"2024-09-12T02:57:10.368200+0000","last_undegraded":"2024-09-12T02:57:10.368200+0000","last_fullsized":"2024-09-12T02:57:10.368200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.194444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345910+0000","last_change":"2024-09-12T02:57:03.832933+0000","last_active":"2024-09-12T02:57:10.345910+0000","last_peered":"2024-09-12T02:57:10.345910+0000","last_clean":"2024-09-12T02:57:10.345910+0000","last_became_active":"2024-09-12T02:57:03.832253+0000","last_became_peered":"2024-09-12T02:57:03.832253+0000","last_unstale":"2024-09-12T02:57:10.345910+0000","last_undegraded":"2024-09-12T02:57:10.345910+0000","last_fullsized":"2024-09-12T02:57:10.345910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877844+0000","last_change":"2024-09-12T02:57:04.880036+0000","last_active":"2024-09-12T02:57:09.877844+0000","last_peered":"2024-09-12T02:57:09.877844+0000","last_clean":"2024-09-12T02:57:09.877844+0000","last_became_active":"2024-09-12T02:57:04.879490+0000","last_became_peered":"2024-09-12T02:57:04.879490+0000","last_unstale":"2024-09-12T02:57:09.877844+0000","last_undegraded":"2024-09-12T02:57:09.877844+0000","last_fullsized":"2024-09-12T02:57:09.877844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.579939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367568+0000","last_change":"2024-09-12T02:57:08.890508+0000","last_active":"2024-09-12T02:57:10.367568+0000","last_peered":"2024-09-12T02:57:10.367568+0000","last_clean":"2024-09-12T02:57:10.367568+0000","last_became_active":"2024-09-12T02:57:08.886515+0000","last_became_peered":"2024-09-12T02:57:08.886515+0000","last_unstale":"2024-09-12T02:57:10.367568+0000","last_undegraded":"2024-09-12T02:57:10.367568+0000","last_fullsized":"2024-09-12T02:57:10.367568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:28.963220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875670+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:57:09.875670+0000","last_peered":"2024-09-12T02:57:09.875670+0000","last_clean":"2024-09-12T02:57:09.875670+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:57:09.875670+0000","last_undegraded":"2024-09-12T02:57:09.875670+0000","last_fullsized":"2024-09-12T02:57:09.875670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346531+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:57:10.346531+0000","last_peered":"2024-09-12T02:57:10.346531+0000","last_clean":"2024-09-12T02:57:10.346531+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:57:10.346531+0000","last_undegraded":"2024-09-12T02:57:10.346531+0000","last_fullsized":"2024-09-12T02:57:10.346531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368605+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:57:10.368605+0000","last_peered":"2024-09-12T02:57:10.368605+0000","last_clean":"2024-09-12T02:57:10.368605+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:57:10.368605+0000","last_undegraded":"2024-09-12T02:57:10.368605+0000","last_fullsized":"2024-09-12T02:57:10.368605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871686+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:57:09.871686+0000","last_peered":"2024-09-12T02:57:09.871686+0000","last_clean":"2024-09-12T02:57:09.871686+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:57:09.871686+0000","last_undegraded":"2024-09-12T02:57:09.871686+0000","last_fullsized":"2024-09-12T02:57:09.871686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366516+0000","last_change":"2024-09-12T02:57:03.790544+0000","last_active":"2024-09-12T02:57:10.366516+0000","last_peered":"2024-09-12T02:57:10.366516+0000","last_clean":"2024-09-12T02:57:10.366516+0000","last_became_active":"2024-09-12T02:57:03.790195+0000","last_became_peered":"2024-09-12T02:57:03.790195+0000","last_unstale":"2024-09-12T02:57:10.366516+0000","last_undegraded":"2024-09-12T02:57:10.366516+0000","last_fullsized":"2024-09-12T02:57:10.366516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368276+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:57:10.368276+0000","last_peered":"2024-09-12T02:57:10.368276+0000","last_clean":"2024-09-12T02:57:10.368276+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:57:10.368276+0000","last_undegraded":"2024-09-12T02:57:10.368276+0000","last_fullsized":"2024-09-12T02:57:10.368276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871830+0000","last_change":"2024-09-12T02:57:04.835949+0000","last_active":"2024-09-12T02:57:09.871830+0000","last_peered":"2024-09-12T02:57:09.871830+0000","last_clean":"2024-09-12T02:57:09.871830+0000","last_became_active":"2024-09-12T02:57:04.835628+0000","last_became_peered":"2024-09-12T02:57:04.835628+0000","last_unstale":"2024-09-12T02:57:09.871830+0000","last_undegraded":"2024-09-12T02:57:09.871830+0000","last_fullsized":"2024-09-12T02:57:09.871830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366134+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:57:10.366134+0000","last_peered":"2024-09-12T02:57:10.366134+0000","last_clean":"2024-09-12T02:57:10.366134+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:57:10.366134+0000","last_undegraded":"2024-09-12T02:57:10.366134+0000","last_fullsized":"2024-09-12T02:57:10.366134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367370+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:57:10.367370+0000","last_peered":"2024-09-12T02:57:10.367370+0000","last_clean":"2024-09-12T02:57:10.367370+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:57:10.367370+0000","last_undegraded":"2024-09-12T02:57:10.367370+0000","last_fullsized":"2024-09-12T02:57:10.367370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367963+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:57:10.367963+0000","last_peered":"2024-09-12T02:57:10.367963+0000","last_clean":"2024-09-12T02:57:10.367963+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:57:10.367963+0000","last_undegraded":"2024-09-12T02:57:10.367963+0000","last_fullsized":"2024-09-12T02:57:10.367963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345073+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:57:10.345073+0000","last_peered":"2024-09-12T02:57:10.345073+0000","last_clean":"2024-09-12T02:57:10.345073+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:57:10.345073+0000","last_undegraded":"2024-09-12T02:57:10.345073+0000","last_fullsized":"2024-09-12T02:57:10.345073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368760+0000","last_change":"2024-09-12T02:57:08.881925+0000","last_active":"2024-09-12T02:57:10.368760+0000","last_peered":"2024-09-12T02:57:10.368760+0000","last_clean":"2024-09-12T02:57:10.368760+0000","last_became_active":"2024-09-12T02:57:08.880913+0000","last_became_peered":"2024-09-12T02:57:08.880913+0000","last_unstale":"2024-09-12T02:57:10.368760+0000","last_undegraded":"2024-09-12T02:57:10.368760+0000","last_fullsized":"2024-09-12T02:57:10.368760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:48.637854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885883+0000","last_change":"2024-09-12T02:57:04.837566+0000","last_active":"2024-09-12T02:57:09.885883+0000","last_peered":"2024-09-12T02:57:09.885883+0000","last_clean":"2024-09-12T02:57:09.885883+0000","last_became_active":"2024-09-12T02:57:04.837281+0000","last_became_peered":"2024-09-12T02:57:04.837281+0000","last_unstale":"2024-09-12T02:57:09.885883+0000","last_undegraded":"2024-09-12T02:57:09.885883+0000","last_fullsized":"2024-09-12T02:57:09.885883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:23.664487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.878159+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:57:09.878159+0000","last_peered":"2024-09-12T02:57:09.878159+0000","last_clean":"2024-09-12T02:57:09.878159+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:57:09.878159+0000","last_undegraded":"2024-09-12T02:57:09.878159+0000","last_fullsized":"2024-09-12T02:57:09.878159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367595+0000","last_change":"2024-09-12T02:57:09.038564+0000","last_active":"2024-09-12T02:57:10.367595+0000","last_peered":"2024-09-12T02:57:10.367595+0000","last_clean":"2024-09-12T02:57:10.367595+0000","last_became_active":"2024-09-12T02:57:09.036310+0000","last_became_peered":"2024-09-12T02:57:09.036310+0000","last_unstale":"2024-09-12T02:57:10.367595+0000","last_undegraded":"2024-09-12T02:57:10.367595+0000","last_fullsized":"2024-09-12T02:57:10.367595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.627698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872469+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:57:09.872469+0000","last_peered":"2024-09-12T02:57:09.872469+0000","last_clean":"2024-09-12T02:57:09.872469+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:57:09.872469+0000","last_undegraded":"2024-09-12T02:57:09.872469+0000","last_fullsized":"2024-09-12T02:57:09.872469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367376+0000","last_change":"2024-09-12T02:57:03.809884+0000","last_active":"2024-09-12T02:57:10.367376+0000","last_peered":"2024-09-12T02:57:10.367376+0000","last_clean":"2024-09-12T02:57:10.367376+0000","last_became_active":"2024-09-12T02:57:03.809610+0000","last_became_peered":"2024-09-12T02:57:03.809610+0000","last_unstale":"2024-09-12T02:57:10.367376+0000","last_undegraded":"2024-09-12T02:57:10.367376+0000","last_fullsized":"2024-09-12T02:57:10.367376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871306+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:57:09.871306+0000","last_peered":"2024-09-12T02:57:09.871306+0000","last_clean":"2024-09-12T02:57:09.871306+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:57:09.871306+0000","last_undegraded":"2024-09-12T02:57:09.871306+0000","last_fullsized":"2024-09-12T02:57:09.871306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366942+0000","last_change":"2024-09-12T02:57:04.837330+0000","last_active":"2024-09-12T02:57:10.366942+0000","last_peered":"2024-09-12T02:57:10.366942+0000","last_clean":"2024-09-12T02:57:10.366942+0000","last_became_active":"2024-09-12T02:57:04.836984+0000","last_became_peered":"2024-09-12T02:57:04.836984+0000","last_unstale":"2024-09-12T02:57:10.366942+0000","last_undegraded":"2024-09-12T02:57:10.366942+0000","last_fullsized":"2024-09-12T02:57:10.366942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346664+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:57:10.346664+0000","last_peered":"2024-09-12T02:57:10.346664+0000","last_clean":"2024-09-12T02:57:10.346664+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:57:10.346664+0000","last_undegraded":"2024-09-12T02:57:10.346664+0000","last_fullsized":"2024-09-12T02:57:10.346664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885339+0000","last_change":"2024-09-12T02:57:09.025446+0000","last_active":"2024-09-12T02:57:09.885339+0000","last_peered":"2024-09-12T02:57:09.885339+0000","last_clean":"2024-09-12T02:57:09.885339+0000","last_became_active":"2024-09-12T02:57:09.025008+0000","last_became_peered":"2024-09-12T02:57:09.025008+0000","last_unstale":"2024-09-12T02:57:09.885339+0000","last_undegraded":"2024-09-12T02:57:09.885339+0000","last_fullsized":"2024-09-12T02:57:09.885339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877996+0000","last_change":"2024-09-12T02:57:04.861898+0000","last_active":"2024-09-12T02:57:09.877996+0000","last_peered":"2024-09-12T02:57:09.877996+0000","last_clean":"2024-09-12T02:57:09.877996+0000","last_became_active":"2024-09-12T02:57:04.858339+0000","last_became_peered":"2024-09-12T02:57:04.858339+0000","last_unstale":"2024-09-12T02:57:09.877996+0000","last_undegraded":"2024-09-12T02:57:09.877996+0000","last_fullsized":"2024-09-12T02:57:09.877996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367038+0000","last_change":"2024-09-12T02:57:03.796368+0000","last_active":"2024-09-12T02:57:10.367038+0000","last_peered":"2024-09-12T02:57:10.367038+0000","last_clean":"2024-09-12T02:57:10.367038+0000","last_became_active":"2024-09-12T02:57:03.796016+0000","last_became_peered":"2024-09-12T02:57:03.796016+0000","last_unstale":"2024-09-12T02:57:10.367038+0000","last_undegraded":"2024-09-12T02:57:10.367038+0000","last_fullsized":"2024-09-12T02:57:10.367038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:27.840978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366160+0000","last_change":"2024-09-12T02:57:08.877519+0000","last_active":"2024-09-12T02:57:10.366160+0000","last_peered":"2024-09-12T02:57:10.366160+0000","last_clean":"2024-09-12T02:57:10.366160+0000","last_became_active":"2024-09-12T02:57:08.872329+0000","last_became_peered":"2024-09-12T02:57:08.872329+0000","last_unstale":"2024-09-12T02:57:10.366160+0000","last_undegraded":"2024-09-12T02:57:10.366160+0000","last_fullsized":"2024-09-12T02:57:10.366160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.661785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368703+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:57:10.368703+0000","last_peered":"2024-09-12T02:57:10.368703+0000","last_clean":"2024-09-12T02:57:10.368703+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:57:10.368703+0000","last_undegraded":"2024-09-12T02:57:10.368703+0000","last_fullsized":"2024-09-12T02:57:10.368703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875332+0000","last_change":"2024-09-12T02:57:03.802797+0000","last_active":"2024-09-12T02:57:09.875332+0000","last_peered":"2024-09-12T02:57:09.875332+0000","last_clean":"2024-09-12T02:57:09.875332+0000","last_became_active":"2024-09-12T02:57:03.798969+0000","last_became_peered":"2024-09-12T02:57:03.798969+0000","last_unstale":"2024-09-12T02:57:09.875332+0000","last_undegraded":"2024-09-12T02:57:09.875332+0000","last_fullsized":"2024-09-12T02:57:09.875332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.025589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367036+0000","last_change":"2024-09-12T02:57:08.883289+0000","last_active":"2024-09-12T02:57:10.367036+0000","last_peered":"2024-09-12T02:57:10.367036+0000","last_clean":"2024-09-12T02:57:10.367036+0000","last_became_active":"2024-09-12T02:57:08.880476+0000","last_became_peered":"2024-09-12T02:57:08.880476+0000","last_unstale":"2024-09-12T02:57:10.367036+0000","last_undegraded":"2024-09-12T02:57:10.367036+0000","last_fullsized":"2024-09-12T02:57:10.367036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:04.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366058+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:57:10.366058+0000","last_peered":"2024-09-12T02:57:10.366058+0000","last_clean":"2024-09-12T02:57:10.366058+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:57:10.366058+0000","last_undegraded":"2024-09-12T02:57:10.366058+0000","last_fullsized":"2024-09-12T02:57:10.366058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366630+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:57:10.366630+0000","last_peered":"2024-09-12T02:57:10.366630+0000","last_clean":"2024-09-12T02:57:10.366630+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:57:10.366630+0000","last_undegraded":"2024-09-12T02:57:10.366630+0000","last_fullsized":"2024-09-12T02:57:10.366630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367404+0000","last_change":"2024-09-12T02:57:08.872506+0000","last_active":"2024-09-12T02:57:10.367404+0000","last_peered":"2024-09-12T02:57:10.367404+0000","last_clean":"2024-09-12T02:57:10.367404+0000","last_became_active":"2024-09-12T02:57:08.872127+0000","last_became_peered":"2024-09-12T02:57:08.872127+0000","last_unstale":"2024-09-12T02:57:10.367404+0000","last_undegraded":"2024-09-12T02:57:10.367404+0000","last_fullsized":"2024-09-12T02:57:10.367404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:19.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885022+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:57:09.885022+0000","last_peered":"2024-09-12T02:57:09.885022+0000","last_clean":"2024-09-12T02:57:09.885022+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:57:09.885022+0000","last_undegraded":"2024-09-12T02:57:09.885022+0000","last_fullsized":"2024-09-12T02:57:09.885022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345274+0000","last_change":"2024-09-12T02:57:03.827694+0000","last_active":"2024-09-12T02:57:10.345274+0000","last_peered":"2024-09-12T02:57:10.345274+0000","last_clean":"2024-09-12T02:57:10.345274+0000","last_became_active":"2024-09-12T02:57:03.827099+0000","last_became_peered":"2024-09-12T02:57:03.827099+0000","last_unstale":"2024-09-12T02:57:10.345274+0000","last_undegraded":"2024-09-12T02:57:10.345274+0000","last_fullsized":"2024-09-12T02:57:10.345274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885728+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:57:09.885728+0000","last_peered":"2024-09-12T02:57:09.885728+0000","last_clean":"2024-09-12T02:57:09.885728+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:57:09.885728+0000","last_undegraded":"2024-09-12T02:57:09.885728+0000","last_fullsized":"2024-09-12T02:57:09.885728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871567+0000","last_change":"2024-09-12T02:57:04.882517+0000","last_active":"2024-09-12T02:57:09.871567+0000","last_peered":"2024-09-12T02:57:09.871567+0000","last_clean":"2024-09-12T02:57:09.871567+0000","last_became_active":"2024-09-12T02:57:04.882159+0000","last_became_peered":"2024-09-12T02:57:04.882159+0000","last_unstale":"2024-09-12T02:57:09.871567+0000","last_undegraded":"2024-09-12T02:57:09.871567+0000","last_fullsized":"2024-09-12T02:57:09.871567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876576+0000","last_change":"2024-09-12T02:57:03.798773+0000","last_active":"2024-09-12T02:57:09.876576+0000","last_peered":"2024-09-12T02:57:09.876576+0000","last_clean":"2024-09-12T02:57:09.876576+0000","last_became_active":"2024-09-12T02:57:03.797799+0000","last_became_peered":"2024-09-12T02:57:03.797799+0000","last_unstale":"2024-09-12T02:57:09.876576+0000","last_undegraded":"2024-09-12T02:57:09.876576+0000","last_fullsized":"2024-09-12T02:57:09.876576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345357+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:57:10.345357+0000","last_peered":"2024-09-12T02:57:10.345357+0000","last_clean":"2024-09-12T02:57:10.345357+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:57:10.345357+0000","last_undegraded":"2024-09-12T02:57:10.345357+0000","last_fullsized":"2024-09-12T02:57:10.345357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876527+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:57:09.876527+0000","last_peered":"2024-09-12T02:57:09.876527+0000","last_clean":"2024-09-12T02:57:09.876527+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:57:09.876527+0000","last_undegraded":"2024-09-12T02:57:09.876527+0000","last_fullsized":"2024-09-12T02:57:09.876527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346026+0000","last_change":"2024-09-12T02:57:04.879076+0000","last_active":"2024-09-12T02:57:10.346026+0000","last_peered":"2024-09-12T02:57:10.346026+0000","last_clean":"2024-09-12T02:57:10.346026+0000","last_became_active":"2024-09-12T02:57:04.878160+0000","last_became_peered":"2024-09-12T02:57:04.878160+0000","last_unstale":"2024-09-12T02:57:10.346026+0000","last_undegraded":"2024-09-12T02:57:10.346026+0000","last_fullsized":"2024-09-12T02:57:10.346026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.589537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366400+0000","last_change":"2024-09-12T02:57:03.798239+0000","last_active":"2024-09-12T02:57:10.366400+0000","last_peered":"2024-09-12T02:57:10.366400+0000","last_clean":"2024-09-12T02:57:10.366400+0000","last_became_active":"2024-09-12T02:57:03.797935+0000","last_became_peered":"2024-09-12T02:57:03.797935+0000","last_unstale":"2024-09-12T02:57:10.366400+0000","last_undegraded":"2024-09-12T02:57:10.366400+0000","last_fullsized":"2024-09-12T02:57:10.366400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875409+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:57:09.875409+0000","last_peered":"2024-09-12T02:57:09.875409+0000","last_clean":"2024-09-12T02:57:09.875409+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:57:09.875409+0000","last_undegraded":"2024-09-12T02:57:09.875409+0000","last_fullsized":"2024-09-12T02:57:09.875409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875411+0000","last_change":"2024-09-12T02:57:04.858809+0000","last_active":"2024-09-12T02:57:09.875411+0000","last_peered":"2024-09-12T02:57:09.875411+0000","last_clean":"2024-09-12T02:57:09.875411+0000","last_became_active":"2024-09-12T02:57:04.858048+0000","last_became_peered":"2024-09-12T02:57:04.858048+0000","last_unstale":"2024-09-12T02:57:09.875411+0000","last_undegraded":"2024-09-12T02:57:09.875411+0000","last_fullsized":"2024-09-12T02:57:09.875411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:59.698440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367203+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:57:10.367203+0000","last_peered":"2024-09-12T02:57:10.367203+0000","last_clean":"2024-09-12T02:57:10.367203+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:57:10.367203+0000","last_undegraded":"2024-09-12T02:57:10.367203+0000","last_fullsized":"2024-09-12T02:57:10.367203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885593+0000","last_change":"2024-09-12T02:57:08.874656+0000","last_active":"2024-09-12T02:57:09.885593+0000","last_peered":"2024-09-12T02:57:09.885593+0000","last_clean":"2024-09-12T02:57:09.885593+0000","last_became_active":"2024-09-12T02:57:08.874202+0000","last_became_peered":"2024-09-12T02:57:08.874202+0000","last_unstale":"2024-09-12T02:57:09.885593+0000","last_undegraded":"2024-09-12T02:57:09.885593+0000","last_fullsized":"2024-09-12T02:57:09.885593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.794828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346615+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:57:10.346615+0000","last_peered":"2024-09-12T02:57:10.346615+0000","last_clean":"2024-09-12T02:57:10.346615+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:57:10.346615+0000","last_undegraded":"2024-09-12T02:57:10.346615+0000","last_fullsized":"2024-09-12T02:57:10.346615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366863+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:57:10.366863+0000","last_peered":"2024-09-12T02:57:10.366863+0000","last_clean":"2024-09-12T02:57:10.366863+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:57:10.366863+0000","last_undegraded":"2024-09-12T02:57:10.366863+0000","last_fullsized":"2024-09-12T02:57:10.366863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874320+0000","last_change":"2024-09-12T02:57:09.030839+0000","last_active":"2024-09-12T02:57:09.874320+0000","last_peered":"2024-09-12T02:57:09.874320+0000","last_clean":"2024-09-12T02:57:09.874320+0000","last_became_active":"2024-09-12T02:57:09.029808+0000","last_became_peered":"2024-09-12T02:57:09.029808+0000","last_unstale":"2024-09-12T02:57:09.874320+0000","last_undegraded":"2024-09-12T02:57:09.874320+0000","last_fullsized":"2024-09-12T02:57:09.874320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346464+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:57:10.346464+0000","last_peered":"2024-09-12T02:57:10.346464+0000","last_clean":"2024-09-12T02:57:10.346464+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:57:10.346464+0000","last_undegraded":"2024-09-12T02:57:10.346464+0000","last_fullsized":"2024-09-12T02:57:10.346464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368984+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:57:10.368984+0000","last_peered":"2024-09-12T02:57:10.368984+0000","last_clean":"2024-09-12T02:57:10.368984+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:57:10.368984+0000","last_undegraded":"2024-09-12T02:57:10.368984+0000","last_fullsized":"2024-09-12T02:57:10.368984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367280+0000","last_change":"2024-09-12T02:57:08.896161+0000","last_active":"2024-09-12T02:57:10.367280+0000","last_peered":"2024-09-12T02:57:10.367280+0000","last_clean":"2024-09-12T02:57:10.367280+0000","last_became_active":"2024-09-12T02:57:08.895379+0000","last_became_peered":"2024-09-12T02:57:08.895379+0000","last_unstale":"2024-09-12T02:57:10.367280+0000","last_undegraded":"2024-09-12T02:57:10.367280+0000","last_fullsized":"2024-09-12T02:57:10.367280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:34.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345587+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:57:10.345587+0000","last_peered":"2024-09-12T02:57:10.345587+0000","last_clean":"2024-09-12T02:57:10.345587+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:57:10.345587+0000","last_undegraded":"2024-09-12T02:57:10.345587+0000","last_fullsized":"2024-09-12T02:57:10.345587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366369+0000","last_change":"2024-09-12T02:57:03.788301+0000","last_active":"2024-09-12T02:57:10.366369+0000","last_peered":"2024-09-12T02:57:10.366369+0000","last_clean":"2024-09-12T02:57:10.366369+0000","last_became_active":"2024-09-12T02:57:03.788002+0000","last_became_peered":"2024-09-12T02:57:03.788002+0000","last_unstale":"2024-09-12T02:57:10.366369+0000","last_undegraded":"2024-09-12T02:57:10.366369+0000","last_fullsized":"2024-09-12T02:57:10.366369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885578+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:57:09.885578+0000","last_peered":"2024-09-12T02:57:09.885578+0000","last_clean":"2024-09-12T02:57:09.885578+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:57:09.885578+0000","last_undegraded":"2024-09-12T02:57:09.885578+0000","last_fullsized":"2024-09-12T02:57:09.885578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875635+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:57:09.875635+0000","last_peered":"2024-09-12T02:57:09.875635+0000","last_clean":"2024-09-12T02:57:09.875635+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:57:09.875635+0000","last_undegraded":"2024-09-12T02:57:09.875635+0000","last_fullsized":"2024-09-12T02:57:09.875635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876542+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:57:09.876542+0000","last_peered":"2024-09-12T02:57:09.876542+0000","last_clean":"2024-09-12T02:57:09.876542+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:57:09.876542+0000","last_undegraded":"2024-09-12T02:57:09.876542+0000","last_fullsized":"2024-09-12T02:57:09.876542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872348+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:57:09.872348+0000","last_peered":"2024-09-12T02:57:09.872348+0000","last_clean":"2024-09-12T02:57:09.872348+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:57:09.872348+0000","last_undegraded":"2024-09-12T02:57:09.872348+0000","last_fullsized":"2024-09-12T02:57:09.872348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346216+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:57:10.346216+0000","last_peered":"2024-09-12T02:57:10.346216+0000","last_clean":"2024-09-12T02:57:10.346216+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:57:10.346216+0000","last_undegraded":"2024-09-12T02:57:10.346216+0000","last_fullsized":"2024-09-12T02:57:10.346216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875168+0000","last_change":"2024-09-12T02:57:03.802047+0000","last_active":"2024-09-12T02:57:09.875168+0000","last_peered":"2024-09-12T02:57:09.875168+0000","last_clean":"2024-09-12T02:57:09.875168+0000","last_became_active":"2024-09-12T02:57:03.797936+0000","last_became_peered":"2024-09-12T02:57:03.797936+0000","last_unstale":"2024-09-12T02:57:09.875168+0000","last_undegraded":"2024-09-12T02:57:09.875168+0000","last_fullsized":"2024-09-12T02:57:09.875168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:10.176640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872067+0000","last_change":"2024-09-12T02:57:09.030826+0000","last_active":"2024-09-12T02:57:09.872067+0000","last_peered":"2024-09-12T02:57:09.872067+0000","last_clean":"2024-09-12T02:57:09.872067+0000","last_became_active":"2024-09-12T02:57:09.029437+0000","last_became_peered":"2024-09-12T02:57:09.029437+0000","last_unstale":"2024-09-12T02:57:09.872067+0000","last_undegraded":"2024-09-12T02:57:09.872067+0000","last_fullsized":"2024-09-12T02:57:09.872067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:15.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886359+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:57:09.886359+0000","last_peered":"2024-09-12T02:57:09.886359+0000","last_clean":"2024-09-12T02:57:09.886359+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:57:09.886359+0000","last_undegraded":"2024-09-12T02:57:09.886359+0000","last_fullsized":"2024-09-12T02:57:09.886359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885915+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:57:09.885915+0000","last_peered":"2024-09-12T02:57:09.885915+0000","last_clean":"2024-09-12T02:57:09.885915+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:57:09.885915+0000","last_undegraded":"2024-09-12T02:57:09.885915+0000","last_fullsized":"2024-09-12T02:57:09.885915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877662+0000","last_change":"2024-09-12T02:57:09.031080+0000","last_active":"2024-09-12T02:57:09.877662+0000","last_peered":"2024-09-12T02:57:09.877662+0000","last_clean":"2024-09-12T02:57:09.877662+0000","last_became_active":"2024-09-12T02:57:09.029892+0000","last_became_peered":"2024-09-12T02:57:09.029892+0000","last_unstale":"2024-09-12T02:57:09.877662+0000","last_undegraded":"2024-09-12T02:57:09.877662+0000","last_fullsized":"2024-09-12T02:57:09.877662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345803+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:57:10.345803+0000","last_peered":"2024-09-12T02:57:10.345803+0000","last_clean":"2024-09-12T02:57:10.345803+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:57:10.345803+0000","last_undegraded":"2024-09-12T02:57:10.345803+0000","last_fullsized":"2024-09-12T02:57:10.345803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:22.371934+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:57:22.371934+0000","last_peered":"2024-09-12T02:57:22.371934+0000","last_clean":"2024-09-12T02:57:22.371934+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:57:22.371934+0000","last_undegraded":"2024-09-12T02:57:22.371934+0000","last_fullsized":"2024-09-12T02:57:22.371934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366364+0000","last_change":"2024-09-12T02:57:08.884030+0000","last_active":"2024-09-12T02:57:10.366364+0000","last_peered":"2024-09-12T02:57:10.366364+0000","last_clean":"2024-09-12T02:57:10.366364+0000","last_became_active":"2024-09-12T02:57:08.880332+0000","last_became_peered":"2024-09-12T02:57:08.880332+0000","last_unstale":"2024-09-12T02:57:10.366364+0000","last_undegraded":"2024-09-12T02:57:10.366364+0000","last_fullsized":"2024-09-12T02:57:10.366364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:25.232846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368553+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:57:10.368553+0000","last_peered":"2024-09-12T02:57:10.368553+0000","last_clean":"2024-09-12T02:57:10.368553+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:57:10.368553+0000","last_undegraded":"2024-09-12T02:57:10.368553+0000","last_fullsized":"2024-09-12T02:57:10.368553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367151+0000","last_change":"2024-09-12T02:57:03.798009+0000","last_active":"2024-09-12T02:57:10.367151+0000","last_peered":"2024-09-12T02:57:10.367151+0000","last_clean":"2024-09-12T02:57:10.367151+0000","last_became_active":"2024-09-12T02:57:03.797749+0000","last_became_peered":"2024-09-12T02:57:03.797749+0000","last_unstale":"2024-09-12T02:57:10.367151+0000","last_undegraded":"2024-09-12T02:57:10.367151+0000","last_fullsized":"2024-09-12T02:57:10.367151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.058712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367936+0000","last_change":"2024-09-12T02:57:08.885401+0000","last_active":"2024-09-12T02:57:10.367936+0000","last_peered":"2024-09-12T02:57:10.367936+0000","last_clean":"2024-09-12T02:57:10.367936+0000","last_became_active":"2024-09-12T02:57:08.883296+0000","last_became_peered":"2024-09-12T02:57:08.883296+0000","last_unstale":"2024-09-12T02:57:10.367936+0000","last_undegraded":"2024-09-12T02:57:10.367936+0000","last_fullsized":"2024-09-12T02:57:10.367936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:24.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886680+0000","last_change":"2024-09-12T02:57:04.882349+0000","last_active":"2024-09-12T02:57:09.886680+0000","last_peered":"2024-09-12T02:57:09.886680+0000","last_clean":"2024-09-12T02:57:09.886680+0000","last_became_active":"2024-09-12T02:57:04.882060+0000","last_became_peered":"2024-09-12T02:57:04.882060+0000","last_unstale":"2024-09-12T02:57:09.886680+0000","last_undegraded":"2024-09-12T02:57:09.886680+0000","last_fullsized":"2024-09-12T02:57:09.886680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876076+0000","last_change":"2024-09-12T02:57:03.811429+0000","last_active":"2024-09-12T02:57:09.876076+0000","last_peered":"2024-09-12T02:57:09.876076+0000","last_clean":"2024-09-12T02:57:09.876076+0000","last_became_active":"2024-09-12T02:57:03.810672+0000","last_became_peered":"2024-09-12T02:57:03.810672+0000","last_unstale":"2024-09-12T02:57:09.876076+0000","last_undegraded":"2024-09-12T02:57:09.876076+0000","last_fullsized":"2024-09-12T02:57:09.876076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871687+0000","last_change":"2024-09-12T02:57:08.875903+0000","last_active":"2024-09-12T02:57:09.871687+0000","last_peered":"2024-09-12T02:57:09.871687+0000","last_clean":"2024-09-12T02:57:09.871687+0000","last_became_active":"2024-09-12T02:57:08.875270+0000","last_became_peered":"2024-09-12T02:57:08.875270+0000","last_unstale":"2024-09-12T02:57:09.871687+0000","last_undegraded":"2024-09-12T02:57:09.871687+0000","last_fullsized":"2024-09-12T02:57:09.871687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875836+0000","last_change":"2024-09-12T02:57:04.864904+0000","last_active":"2024-09-12T02:57:09.875836+0000","last_peered":"2024-09-12T02:57:09.875836+0000","last_clean":"2024-09-12T02:57:09.875836+0000","last_became_active":"2024-09-12T02:57:04.861650+0000","last_became_peered":"2024-09-12T02:57:04.861650+0000","last_unstale":"2024-09-12T02:57:09.875836+0000","last_undegraded":"2024-09-12T02:57:09.875836+0000","last_fullsized":"2024-09-12T02:57:09.875836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:31.529412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877718+0000","last_change":"2024-09-12T02:57:03.812106+0000","last_active":"2024-09-12T02:57:09.877718+0000","last_peered":"2024-09-12T02:57:09.877718+0000","last_clean":"2024-09-12T02:57:09.877718+0000","last_became_active":"2024-09-12T02:57:03.810041+0000","last_became_peered":"2024-09-12T02:57:03.810041+0000","last_unstale":"2024-09-12T02:57:09.877718+0000","last_undegraded":"2024-09-12T02:57:09.877718+0000","last_fullsized":"2024-09-12T02:57:09.877718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871655+0000","last_change":"2024-09-12T02:57:09.030507+0000","last_active":"2024-09-12T02:57:09.871655+0000","last_peered":"2024-09-12T02:57:09.871655+0000","last_clean":"2024-09-12T02:57:09.871655+0000","last_became_active":"2024-09-12T02:57:09.029459+0000","last_became_peered":"2024-09-12T02:57:09.029459+0000","last_unstale":"2024-09-12T02:57:09.871655+0000","last_undegraded":"2024-09-12T02:57:09.871655+0000","last_fullsized":"2024-09-12T02:57:09.871655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:26.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885411+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:57:09.885411+0000","last_peered":"2024-09-12T02:57:09.885411+0000","last_clean":"2024-09-12T02:57:09.885411+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:57:09.885411+0000","last_undegraded":"2024-09-12T02:57:09.885411+0000","last_fullsized":"2024-09-12T02:57:09.885411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.365943+0000","last_change":"2024-09-12T02:57:04.834192+0000","last_active":"2024-09-12T02:57:10.365943+0000","last_peered":"2024-09-12T02:57:10.365943+0000","last_clean":"2024-09-12T02:57:10.365943+0000","last_became_active":"2024-09-12T02:57:04.833901+0000","last_became_peered":"2024-09-12T02:57:04.833901+0000","last_unstale":"2024-09-12T02:57:10.365943+0000","last_undegraded":"2024-09-12T02:57:10.365943+0000","last_fullsized":"2024-09-12T02:57:10.365943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:51:30.019270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874853+0000","last_change":"2024-09-12T02:57:03.807210+0000","last_active":"2024-09-12T02:57:09.874853+0000","last_peered":"2024-09-12T02:57:09.874853+0000","last_clean":"2024-09-12T02:57:09.874853+0000","last_became_active":"2024-09-12T02:57:03.805335+0000","last_became_peered":"2024-09-12T02:57:03.805335+0000","last_unstale":"2024-09-12T02:57:09.874853+0000","last_undegraded":"2024-09-12T02:57:09.874853+0000","last_fullsized":"2024-09-12T02:57:09.874853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876801+0000","last_change":"2024-09-12T02:57:08.895753+0000","last_active":"2024-09-12T02:57:09.876801+0000","last_peered":"2024-09-12T02:57:09.876801+0000","last_clean":"2024-09-12T02:57:09.876801+0000","last_became_active":"2024-09-12T02:57:08.894542+0000","last_became_peered":"2024-09-12T02:57:08.894542+0000","last_unstale":"2024-09-12T02:57:09.876801+0000","last_undegraded":"2024-09-12T02:57:09.876801+0000","last_fullsized":"2024-09-12T02:57:09.876801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871791+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:57:09.871791+0000","last_peered":"2024-09-12T02:57:09.871791+0000","last_clean":"2024-09-12T02:57:09.871791+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:57:09.871791+0000","last_undegraded":"2024-09-12T02:57:09.871791+0000","last_fullsized":"2024-09-12T02:57:09.871791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871652+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:57:09.871652+0000","last_peered":"2024-09-12T02:57:09.871652+0000","last_clean":"2024-09-12T02:57:09.871652+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:57:09.871652+0000","last_undegraded":"2024-09-12T02:57:09.871652+0000","last_fullsized":"2024-09-12T02:57:09.871652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875973+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:57:09.875973+0000","last_peered":"2024-09-12T02:57:09.875973+0000","last_clean":"2024-09-12T02:57:09.875973+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:57:09.875973+0000","last_undegraded":"2024-09-12T02:57:09.875973+0000","last_fullsized":"2024-09-12T02:57:09.875973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885802+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:57:09.885802+0000","last_peered":"2024-09-12T02:57:09.885802+0000","last_clean":"2024-09-12T02:57:09.885802+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:57:09.885802+0000","last_undegraded":"2024-09-12T02:57:09.885802+0000","last_fullsized":"2024-09-12T02:57:09.885802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366287+0000","last_change":"2024-09-12T02:57:08.873190+0000","last_active":"2024-09-12T02:57:10.366287+0000","last_peered":"2024-09-12T02:57:10.366287+0000","last_clean":"2024-09-12T02:57:10.366287+0000","last_became_active":"2024-09-12T02:57:08.872526+0000","last_became_peered":"2024-09-12T02:57:08.872526+0000","last_unstale":"2024-09-12T02:57:10.366287+0000","last_undegraded":"2024-09-12T02:57:10.366287+0000","last_fullsized":"2024-09-12T02:57:10.366287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:15.257391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871819+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:57:09.871819+0000","last_peered":"2024-09-12T02:57:09.871819+0000","last_clean":"2024-09-12T02:57:09.871819+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:57:09.871819+0000","last_undegraded":"2024-09-12T02:57:09.871819+0000","last_fullsized":"2024-09-12T02:57:09.871819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367905+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:57:10.367905+0000","last_peered":"2024-09-12T02:57:10.367905+0000","last_clean":"2024-09-12T02:57:10.367905+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:57:10.367905+0000","last_undegraded":"2024-09-12T02:57:10.367905+0000","last_fullsized":"2024-09-12T02:57:10.367905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872056+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:57:09.872056+0000","last_peered":"2024-09-12T02:57:09.872056+0000","last_clean":"2024-09-12T02:57:09.872056+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:57:09.872056+0000","last_undegraded":"2024-09-12T02:57:09.872056+0000","last_fullsized":"2024-09-12T02:57:09.872056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875137+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:57:09.875137+0000","last_peered":"2024-09-12T02:57:09.875137+0000","last_clean":"2024-09-12T02:57:09.875137+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:57:09.875137+0000","last_undegraded":"2024-09-12T02:57:09.875137+0000","last_fullsized":"2024-09-12T02:57:09.875137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366549+0000","last_change":"2024-09-12T02:57:04.841244+0000","last_active":"2024-09-12T02:57:10.366549+0000","last_peered":"2024-09-12T02:57:10.366549+0000","last_clean":"2024-09-12T02:57:10.366549+0000","last_became_active":"2024-09-12T02:57:04.837935+0000","last_became_peered":"2024-09-12T02:57:04.837935+0000","last_unstale":"2024-09-12T02:57:10.366549+0000","last_undegraded":"2024-09-12T02:57:10.366549+0000","last_fullsized":"2024-09-12T02:57:10.366549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:50.023694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875090+0000","last_change":"2024-09-12T02:57:04.874054+0000","last_active":"2024-09-12T02:57:09.875090+0000","last_peered":"2024-09-12T02:57:09.875090+0000","last_clean":"2024-09-12T02:57:09.875090+0000","last_became_active":"2024-09-12T02:57:04.867372+0000","last_became_peered":"2024-09-12T02:57:04.867372+0000","last_unstale":"2024-09-12T02:57:09.875090+0000","last_undegraded":"2024-09-12T02:57:09.875090+0000","last_fullsized":"2024-09-12T02:57:09.875090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:06.010582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885676+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:57:09.885676+0000","last_peered":"2024-09-12T02:57:09.885676+0000","last_clean":"2024-09-12T02:57:09.885676+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:57:09.885676+0000","last_undegraded":"2024-09-12T02:57:09.885676+0000","last_fullsized":"2024-09-12T02:57:09.885676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872206+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:57:09.872206+0000","last_peered":"2024-09-12T02:57:09.872206+0000","last_clean":"2024-09-12T02:57:09.872206+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:57:09.872206+0000","last_undegraded":"2024-09-12T02:57:09.872206+0000","last_fullsized":"2024-09-12T02:57:09.872206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367050+0000","last_change":"2024-09-12T02:57:04.836873+0000","last_active":"2024-09-12T02:57:10.367050+0000","last_peered":"2024-09-12T02:57:10.367050+0000","last_clean":"2024-09-12T02:57:10.367050+0000","last_became_active":"2024-09-12T02:57:04.836564+0000","last_became_peered":"2024-09-12T02:57:04.836564+0000","last_unstale":"2024-09-12T02:57:10.367050+0000","last_undegraded":"2024-09-12T02:57:10.367050+0000","last_fullsized":"2024-09-12T02:57:10.367050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.539077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877094+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:57:09.877094+0000","last_peered":"2024-09-12T02:57:09.877094+0000","last_clean":"2024-09-12T02:57:09.877094+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:57:09.877094+0000","last_undegraded":"2024-09-12T02:57:09.877094+0000","last_fullsized":"2024-09-12T02:57:09.877094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872473+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:57:09.872473+0000","last_peered":"2024-09-12T02:57:09.872473+0000","last_clean":"2024-09-12T02:57:09.872473+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:57:09.872473+0000","last_undegraded":"2024-09-12T02:57:09.872473+0000","last_fullsized":"2024-09-12T02:57:09.872473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874601+0000","last_change":"2024-09-12T02:57:04.874760+0000","last_active":"2024-09-12T02:57:09.874601+0000","last_peered":"2024-09-12T02:57:09.874601+0000","last_clean":"2024-09-12T02:57:09.874601+0000","last_became_active":"2024-09-12T02:57:04.861196+0000","last_became_peered":"2024-09-12T02:57:04.861196+0000","last_unstale":"2024-09-12T02:57:09.874601+0000","last_undegraded":"2024-09-12T02:57:09.874601+0000","last_fullsized":"2024-09-12T02:57:09.874601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871359+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:57:09.871359+0000","last_peered":"2024-09-12T02:57:09.871359+0000","last_clean":"2024-09-12T02:57:09.871359+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:57:09.871359+0000","last_undegraded":"2024-09-12T02:57:09.871359+0000","last_fullsized":"2024-09-12T02:57:09.871359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874921+0000","last_change":"2024-09-12T02:57:04.879052+0000","last_active":"2024-09-12T02:57:09.874921+0000","last_peered":"2024-09-12T02:57:09.874921+0000","last_clean":"2024-09-12T02:57:09.874921+0000","last_became_active":"2024-09-12T02:57:04.877672+0000","last_became_peered":"2024-09-12T02:57:04.877672+0000","last_unstale":"2024-09-12T02:57:09.874921+0000","last_undegraded":"2024-09-12T02:57:09.874921+0000","last_fullsized":"2024-09-12T02:57:09.874921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885442+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:57:09.885442+0000","last_peered":"2024-09-12T02:57:09.885442+0000","last_clean":"2024-09-12T02:57:09.885442+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:57:09.885442+0000","last_undegraded":"2024-09-12T02:57:09.885442+0000","last_fullsized":"2024-09-12T02:57:09.885442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876589+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:57:09.876589+0000","last_peered":"2024-09-12T02:57:09.876589+0000","last_clean":"2024-09-12T02:57:09.876589+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:57:09.876589+0000","last_undegraded":"2024-09-12T02:57:09.876589+0000","last_fullsized":"2024-09-12T02:57:09.876589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346360+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:57:10.346360+0000","last_peered":"2024-09-12T02:57:10.346360+0000","last_clean":"2024-09-12T02:57:10.346360+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:57:10.346360+0000","last_undegraded":"2024-09-12T02:57:10.346360+0000","last_fullsized":"2024-09-12T02:57:10.346360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366832+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:57:10.366832+0000","last_peered":"2024-09-12T02:57:10.366832+0000","last_clean":"2024-09-12T02:57:10.366832+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:57:10.366832+0000","last_undegraded":"2024-09-12T02:57:10.366832+0000","last_fullsized":"2024-09-12T02:57:10.366832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877276+0000","last_change":"2024-09-12T02:57:04.867799+0000","last_active":"2024-09-12T02:57:09.877276+0000","last_peered":"2024-09-12T02:57:09.877276+0000","last_clean":"2024-09-12T02:57:09.877276+0000","last_became_active":"2024-09-12T02:57:04.863800+0000","last_became_peered":"2024-09-12T02:57:04.863800+0000","last_unstale":"2024-09-12T02:57:09.877276+0000","last_undegraded":"2024-09-12T02:57:09.877276+0000","last_fullsized":"2024-09-12T02:57:09.877276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874304+0000","last_change":"2024-09-12T02:57:04.864906+0000","last_active":"2024-09-12T02:57:09.874304+0000","last_peered":"2024-09-12T02:57:09.874304+0000","last_clean":"2024-09-12T02:57:09.874304+0000","last_became_active":"2024-09-12T02:57:04.863556+0000","last_became_peered":"2024-09-12T02:57:04.863556+0000","last_unstale":"2024-09-12T02:57:09.874304+0000","last_undegraded":"2024-09-12T02:57:09.874304+0000","last_fullsized":"2024-09-12T02:57:09.874304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366044+0000","last_change":"2024-09-12T02:57:04.826304+0000","last_active":"2024-09-12T02:57:10.366044+0000","last_peered":"2024-09-12T02:57:10.366044+0000","last_clean":"2024-09-12T02:57:10.366044+0000","last_became_active":"2024-09-12T02:57:04.825998+0000","last_became_peered":"2024-09-12T02:57:04.825998+0000","last_unstale":"2024-09-12T02:57:10.366044+0000","last_undegraded":"2024-09-12T02:57:10.366044+0000","last_fullsized":"2024-09-12T02:57:10.366044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:35.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886270+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:57:09.886270+0000","last_peered":"2024-09-12T02:57:09.886270+0000","last_clean":"2024-09-12T02:57:09.886270+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:57:09.886270+0000","last_undegraded":"2024-09-12T02:57:09.886270+0000","last_fullsized":"2024-09-12T02:57:09.886270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871588+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:57:09.871588+0000","last_peered":"2024-09-12T02:57:09.871588+0000","last_clean":"2024-09-12T02:57:09.871588+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:57:09.871588+0000","last_undegraded":"2024-09-12T02:57:09.871588+0000","last_fullsized":"2024-09-12T02:57:09.871588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368395+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:57:10.368395+0000","last_peered":"2024-09-12T02:57:10.368395+0000","last_clean":"2024-09-12T02:57:10.368395+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:57:10.368395+0000","last_undegraded":"2024-09-12T02:57:10.368395+0000","last_fullsized":"2024-09-12T02:57:10.368395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877007+0000","last_change":"2024-09-12T02:57:04.864295+0000","last_active":"2024-09-12T02:57:09.877007+0000","last_peered":"2024-09-12T02:57:09.877007+0000","last_clean":"2024-09-12T02:57:09.877007+0000","last_became_active":"2024-09-12T02:57:04.863563+0000","last_became_peered":"2024-09-12T02:57:04.863563+0000","last_unstale":"2024-09-12T02:57:09.877007+0000","last_undegraded":"2024-09-12T02:57:09.877007+0000","last_fullsized":"2024-09-12T02:57:09.877007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877026+0000","last_change":"2024-09-12T02:57:04.860987+0000","last_active":"2024-09-12T02:57:09.877026+0000","last_peered":"2024-09-12T02:57:09.877026+0000","last_clean":"2024-09-12T02:57:09.877026+0000","last_became_active":"2024-09-12T02:57:04.859032+0000","last_became_peered":"2024-09-12T02:57:04.859032+0000","last_unstale":"2024-09-12T02:57:09.877026+0000","last_undegraded":"2024-09-12T02:57:09.877026+0000","last_fullsized":"2024-09-12T02:57:09.877026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346559+0000","last_change":"2024-09-12T02:57:04.881172+0000","last_active":"2024-09-12T02:57:10.346559+0000","last_peered":"2024-09-12T02:57:10.346559+0000","last_clean":"2024-09-12T02:57:10.346559+0000","last_became_active":"2024-09-12T02:57:04.880660+0000","last_became_peered":"2024-09-12T02:57:04.880660+0000","last_unstale":"2024-09-12T02:57:10.346559+0000","last_undegraded":"2024-09-12T02:57:10.346559+0000","last_fullsized":"2024-09-12T02:57:10.346559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:15.389185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871386+0000","last_change":"2024-09-12T02:57:04.876735+0000","last_active":"2024-09-12T02:57:09.871386+0000","last_peered":"2024-09-12T02:57:09.871386+0000","last_clean":"2024-09-12T02:57:09.871386+0000","last_became_active":"2024-09-12T02:57:04.876321+0000","last_became_peered":"2024-09-12T02:57:04.876321+0000","last_unstale":"2024-09-12T02:57:09.871386+0000","last_undegraded":"2024-09-12T02:57:09.871386+0000","last_fullsized":"2024-09-12T02:57:09.871386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345483+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:57:10.345483+0000","last_peered":"2024-09-12T02:57:10.345483+0000","last_clean":"2024-09-12T02:57:10.345483+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:57:10.345483+0000","last_undegraded":"2024-09-12T02:57:10.345483+0000","last_fullsized":"2024-09-12T02:57:10.345483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874829+0000","last_change":"2024-09-12T02:57:04.878277+0000","last_active":"2024-09-12T02:57:09.874829+0000","last_peered":"2024-09-12T02:57:09.874829+0000","last_clean":"2024-09-12T02:57:09.874829+0000","last_became_active":"2024-09-12T02:57:04.876816+0000","last_became_peered":"2024-09-12T02:57:04.876816+0000","last_unstale":"2024-09-12T02:57:09.874829+0000","last_undegraded":"2024-09-12T02:57:09.874829+0000","last_fullsized":"2024-09-12T02:57:09.874829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345685+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:57:10.345685+0000","last_peered":"2024-09-12T02:57:10.345685+0000","last_clean":"2024-09-12T02:57:10.345685+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:57:10.345685+0000","last_undegraded":"2024-09-12T02:57:10.345685+0000","last_fullsized":"2024-09-12T02:57:10.345685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875150+0000","last_change":"2024-09-12T02:57:04.876472+0000","last_active":"2024-09-12T02:57:09.875150+0000","last_peered":"2024-09-12T02:57:09.875150+0000","last_clean":"2024-09-12T02:57:09.875150+0000","last_became_active":"2024-09-12T02:57:04.867264+0000","last_became_peered":"2024-09-12T02:57:04.867264+0000","last_unstale":"2024-09-12T02:57:09.875150+0000","last_undegraded":"2024-09-12T02:57:09.875150+0000","last_fullsized":"2024-09-12T02:57:09.875150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885265+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:57:09.885265+0000","last_peered":"2024-09-12T02:57:09.885265+0000","last_clean":"2024-09-12T02:57:09.885265+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:57:09.885265+0000","last_undegraded":"2024-09-12T02:57:09.885265+0000","last_fullsized":"2024-09-12T02:57:09.885265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367313+0000","last_change":"2024-09-12T02:57:04.841638+0000","last_active":"2024-09-12T02:57:10.367313+0000","last_peered":"2024-09-12T02:57:10.367313+0000","last_clean":"2024-09-12T02:57:10.367313+0000","last_became_active":"2024-09-12T02:57:04.841367+0000","last_became_peered":"2024-09-12T02:57:04.841367+0000","last_unstale":"2024-09-12T02:57:10.367313+0000","last_undegraded":"2024-09-12T02:57:10.367313+0000","last_fullsized":"2024-09-12T02:57:10.367313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:24.890973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346275+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:57:10.346275+0000","last_peered":"2024-09-12T02:57:10.346275+0000","last_clean":"2024-09-12T02:57:10.346275+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:57:10.346275+0000","last_undegraded":"2024-09-12T02:57:10.346275+0000","last_fullsized":"2024-09-12T02:57:10.346275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":698324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:57:38.996 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:57:39.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a73e00640 1 Processor -- start 2024-09-12T02:57:39.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a73e00640 1 -- start start 2024-09-12T02:57:39.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a73e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c154c90 0x7f4a6c0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a73e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a6c155070 con 0x7f4a6c15b5c0 2024-09-12T02:57:39.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a73e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a6c0c8bf0 con 0x7f4a6c06ec90 2024-09-12T02:57:39.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a73e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4a6c15b130 con 0x7f4a6c154c90 2024-09-12T02:57:39.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a71e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4a6c15b5c0 0x7f4a6c06cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56496/0 (socket says 172.21.15.63:56496) 2024-09-12T02:57:39.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a71e00640 1 -- 172.21.15.63:0/49870099 learned_addr learned my addr 172.21.15.63:0/49870099 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:39.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a71400640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c154c90 0x7f4a6c0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130495905 0 0) 0x7f4a6c155070 con 0x7f4a6c15b5c0 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a54003530 con 0x7f4a6c15b5c0 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 601923066 0 0) 0x7f4a6c0c8bf0 con 0x7f4a6c06ec90 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a6c155070 con 0x7f4a6c06ec90 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2169835311 0 0) 0x7f4a54003530 con 0x7f4a6c15b5c0 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c154c90 msgr2=0x7f4a6c0c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c154c90 0x7f4a6c0c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 >> v1:172.21.15.119:6789/0 conn(0x7f4a6c06ec90 legacy=0x7f4a6c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c0c8ed0 con 0x7f4a6c15b5c0 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f4a64001680 con 0x7f4a6c15b5c0 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.177+0000 7f4a71400640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c154c90 0x7f4a6c0c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 >> v1:172.21.15.63:6789/0 conn(0x7f4a6c15b5c0 legacy=0x7f4a6c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a6be00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54003b80 0x7f4a54003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a6be00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a54004810 0x7f4a54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a6be00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c154c90 0x7f4a540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c15b130 con 0x7f4a54004810 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5400ba80 con 0x7f4a54003b80 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5400bc50 con 0x7f4a6c154c90 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a70a00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a54004810 0x7f4a54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a71e00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c154c90 0x7f4a540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a71400640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54003b80 0x7f4a54003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a70a00640 1 -- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c154c90 msgr2=0x7f4a540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a70a00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c154c90 0x7f4a540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a70a00640 1 -- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54003b80 msgr2=0x7f4a54003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a70a00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54003b80 0x7f4a54003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a70a00640 1 -- 172.21.15.63:0/49870099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a54003530 con 0x7f4a54004810 2024-09-12T02:57:39.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a71400640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54003b80 0x7f4a54003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:39.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a70a00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a54004810 0x7f4a54004c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a58007fd0 tx=0x7f4a5801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc22d2e1f3fe0d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:39.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.181+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a580b0070 con 0x7f4a54004810 2024-09-12T02:57:39.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a580050d0 con 0x7f4a54004810 2024-09-12T02:57:39.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a6be00640 1 -- 172.21.15.63:0/49870099 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a58001520 con 0x7f4a54004810 2024-09-12T02:57:39.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 -- 172.21.15.63:0/49870099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a54004810 msgr2=0x7f4a54004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 --2- 172.21.15.63:0/49870099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a54004810 0x7f4a54004c90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a58007fd0 tx=0x7f4a5801c4e0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a71e00640 1 -- 172.21.15.63:0/49870099 reap_dead start 2024-09-12T02:57:39.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 -- 172.21.15.63:0/49870099 shutdown_connections 2024-09-12T02:57:39.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 -- 172.21.15.63:0/49870099 >> 172.21.15.63:0/49870099 conn(0x7f4a6c06bcc0 msgr2=0x7f4a6c06fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:39.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 -- 172.21.15.63:0/49870099 shutdown_connections 2024-09-12T02:57:39.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 -- 172.21.15.63:0/49870099 wait complete. 2024-09-12T02:57:39.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 Processor -- start 2024-09-12T02:57:39.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 -- start start 2024-09-12T02:57:39.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54004810 0x7f4a6c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c0c7960 0x7f4a6c15c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c1f12a0 0x7f4a6c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c15adc0 con 0x7f4a6c0c7960 2024-09-12T02:57:39.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c15aae0 con 0x7f4a54004810 2024-09-12T02:57:39.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a73e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4a6c0cea80 con 0x7f4a6c1f12a0 2024-09-12T02:57:39.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a70a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c0c7960 0x7f4a6c15c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a70a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c0c7960 0x7f4a6c15c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39490/0 (socket says 172.21.15.63:39490) 2024-09-12T02:57:39.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a70a00640 1 -- 172.21.15.63:0/1479962571 learned_addr learned my addr 172.21.15.63:0/1479962571 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:39.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a71e00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c1f12a0 0x7f4a6c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.185+0000 7f4a71400640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54004810 0x7f4a6c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a70a00640 1 -- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c1f12a0 msgr2=0x7f4a6c0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a70a00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c1f12a0 0x7f4a6c0ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a70a00640 1 -- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54004810 msgr2=0x7f4a6c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a70a00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54004810 0x7f4a6c0c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a70a00640 1 -- 172.21.15.63:0/1479962571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c0cb200 con 0x7f4a6c0c7960 2024-09-12T02:57:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a71e00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c1f12a0 0x7f4a6c0ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a71400640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54004810 0x7f4a6c0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a70a00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c0c7960 0x7f4a6c15c9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a580ae040 tx=0x7f4a54005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a69600640 1 -- 172.21.15.63:0/1479962571 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a580bd070 con 0x7f4a6c0c7960 2024-09-12T02:57:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a69600640 1 -- 172.21.15.63:0/1479962571 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a580067e0 con 0x7f4a6c0c7960 2024-09-12T02:57:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6c0c66f0 con 0x7f4a6c0c7960 2024-09-12T02:57:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a69600640 1 -- 172.21.15.63:0/1479962571 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a580b0040 con 0x7f4a6c0c7960 2024-09-12T02:57:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6c0c8160 con 0x7f4a6c0c7960 2024-09-12T02:57:39.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a6c06c6d0 con 0x7f4a6c0c7960 2024-09-12T02:57:39.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a69600640 1 -- 172.21.15.63:0/1479962571 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a580c0070 con 0x7f4a6c0c7960 2024-09-12T02:57:39.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a69600640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4a4c0678c0 0x7f4a4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.189+0000 7f4a69600640 1 -- 172.21.15.63:0/1479962571 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4a5811f6f0 con 0x7f4a6c0c7960 2024-09-12T02:57:39.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.193+0000 7f4a71400640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4a4c0678c0 0x7f4a4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.193+0000 7f4a71400640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4a4c0678c0 0x7f4a4c069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a60013360 tx=0x7f4a6000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:39.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.193+0000 7f4a69600640 1 -- 172.21.15.63:0/1479962571 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a580161f0 con 0x7f4a6c0c7960 2024-09-12T02:57:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.357+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a6c0c47c0 con 0x7f4a4c0678c0 2024-09-12T02:57:39.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.381+0000 7f4a69600640 1 -- 172.21.15.63:0/1479962571 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f4a6c0c47c0 con 0x7f4a4c0678c0 2024-09-12T02:57:39.386 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:39.388 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:57:39.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4a4c0678c0 msgr2=0x7f4a4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4a4c0678c0 0x7f4a4c069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a60013360 tx=0x7f4a6000b040 comp rx=0 tx=0).stop 2024-09-12T02:57:39.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c0c7960 msgr2=0x7f4a6c15c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c0c7960 0x7f4a6c15c9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4a580ae040 tx=0x7f4a54005840 comp rx=0 tx=0).stop 2024-09-12T02:57:39.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 shutdown_connections 2024-09-12T02:57:39.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4a4c0678c0 0x7f4a4c069d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a6c1f12a0 0x7f4a6c0ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a6c0c7960 0x7f4a6c15c9f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 --2- 172.21.15.63:0/1479962571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a54004810 0x7f4a6c0c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 >> 172.21.15.63:0/1479962571 conn(0x7f4a6c06bcc0 msgr2=0x7f4a6c1524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:39.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 shutdown_connections 2024-09-12T02:57:39.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.385+0000 7f4a73e00640 1 -- 172.21.15.63:0/1479962571 wait complete. 2024-09-12T02:57:39.406 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-12T02:57:37.758524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2049012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005039"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886709+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:57:09.886709+0000","last_peered":"2024-09-12T02:57:09.886709+0000","last_clean":"2024-09-12T02:57:09.886709+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:57:09.886709+0000","last_undegraded":"2024-09-12T02:57:09.886709+0000","last_fullsized":"2024-09-12T02:57:09.886709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872098+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:57:09.872098+0000","last_peered":"2024-09-12T02:57:09.872098+0000","last_clean":"2024-09-12T02:57:09.872098+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:57:09.872098+0000","last_undegraded":"2024-09-12T02:57:09.872098+0000","last_fullsized":"2024-09-12T02:57:09.872098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871428+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:57:09.871428+0000","last_peered":"2024-09-12T02:57:09.871428+0000","last_clean":"2024-09-12T02:57:09.871428+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:57:09.871428+0000","last_undegraded":"2024-09-12T02:57:09.871428+0000","last_fullsized":"2024-09-12T02:57:09.871428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872215+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:57:09.872215+0000","last_peered":"2024-09-12T02:57:09.872215+0000","last_clean":"2024-09-12T02:57:09.872215+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:57:09.872215+0000","last_undegraded":"2024-09-12T02:57:09.872215+0000","last_fullsized":"2024-09-12T02:57:09.872215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886576+0000","last_change":"2024-09-12T02:57:04.882473+0000","last_active":"2024-09-12T02:57:09.886576+0000","last_peered":"2024-09-12T02:57:09.886576+0000","last_clean":"2024-09-12T02:57:09.886576+0000","last_became_active":"2024-09-12T02:57:04.882182+0000","last_became_peered":"2024-09-12T02:57:04.882182+0000","last_unstale":"2024-09-12T02:57:09.886576+0000","last_undegraded":"2024-09-12T02:57:09.886576+0000","last_fullsized":"2024-09-12T02:57:09.886576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367426+0000","last_change":"2024-09-12T02:57:08.878799+0000","last_active":"2024-09-12T02:57:10.367426+0000","last_peered":"2024-09-12T02:57:10.367426+0000","last_clean":"2024-09-12T02:57:10.367426+0000","last_became_active":"2024-09-12T02:57:08.877274+0000","last_became_peered":"2024-09-12T02:57:08.877274+0000","last_unstale":"2024-09-12T02:57:10.367426+0000","last_undegraded":"2024-09-12T02:57:10.367426+0000","last_fullsized":"2024-09-12T02:57:10.367426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:27.611325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346487+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:57:10.346487+0000","last_peered":"2024-09-12T02:57:10.346487+0000","last_clean":"2024-09-12T02:57:10.346487+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:57:10.346487+0000","last_undegraded":"2024-09-12T02:57:10.346487+0000","last_fullsized":"2024-09-12T02:57:10.346487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875248+0000","last_change":"2024-09-12T02:57:04.875312+0000","last_active":"2024-09-12T02:57:09.875248+0000","last_peered":"2024-09-12T02:57:09.875248+0000","last_clean":"2024-09-12T02:57:09.875248+0000","last_became_active":"2024-09-12T02:57:04.863748+0000","last_became_peered":"2024-09-12T02:57:04.863748+0000","last_unstale":"2024-09-12T02:57:09.875248+0000","last_undegraded":"2024-09-12T02:57:09.875248+0000","last_fullsized":"2024-09-12T02:57:09.875248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:39.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368200+0000","last_change":"2024-09-12T02:57:08.888677+0000","last_active":"2024-09-12T02:57:10.368200+0000","last_peered":"2024-09-12T02:57:10.368200+0000","last_clean":"2024-09-12T02:57:10.368200+0000","last_became_active":"2024-09-12T02:57:08.875948+0000","last_became_peered":"2024-09-12T02:57:08.875948+0000","last_unstale":"2024-09-12T02:57:10.368200+0000","last_undegraded":"2024-09-12T02:57:10.368200+0000","last_fullsized":"2024-09-12T02:57:10.368200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.194444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345910+0000","last_change":"2024-09-12T02:57:03.832933+0000","last_active":"2024-09-12T02:57:10.345910+0000","last_peered":"2024-09-12T02:57:10.345910+0000","last_clean":"2024-09-12T02:57:10.345910+0000","last_became_active":"2024-09-12T02:57:03.832253+0000","last_became_peered":"2024-09-12T02:57:03.832253+0000","last_unstale":"2024-09-12T02:57:10.345910+0000","last_undegraded":"2024-09-12T02:57:10.345910+0000","last_fullsized":"2024-09-12T02:57:10.345910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877844+0000","last_change":"2024-09-12T02:57:04.880036+0000","last_active":"2024-09-12T02:57:09.877844+0000","last_peered":"2024-09-12T02:57:09.877844+0000","last_clean":"2024-09-12T02:57:09.877844+0000","last_became_active":"2024-09-12T02:57:04.879490+0000","last_became_peered":"2024-09-12T02:57:04.879490+0000","last_unstale":"2024-09-12T02:57:09.877844+0000","last_undegraded":"2024-09-12T02:57:09.877844+0000","last_fullsized":"2024-09-12T02:57:09.877844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.579939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367568+0000","last_change":"2024-09-12T02:57:08.890508+0000","last_active":"2024-09-12T02:57:10.367568+0000","last_peered":"2024-09-12T02:57:10.367568+0000","last_clean":"2024-09-12T02:57:10.367568+0000","last_became_active":"2024-09-12T02:57:08.886515+0000","last_became_peered":"2024-09-12T02:57:08.886515+0000","last_unstale":"2024-09-12T02:57:10.367568+0000","last_undegraded":"2024-09-12T02:57:10.367568+0000","last_fullsized":"2024-09-12T02:57:10.367568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:28.963220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875670+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:57:09.875670+0000","last_peered":"2024-09-12T02:57:09.875670+0000","last_clean":"2024-09-12T02:57:09.875670+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:57:09.875670+0000","last_undegraded":"2024-09-12T02:57:09.875670+0000","last_fullsized":"2024-09-12T02:57:09.875670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346531+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:57:10.346531+0000","last_peered":"2024-09-12T02:57:10.346531+0000","last_clean":"2024-09-12T02:57:10.346531+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:57:10.346531+0000","last_undegraded":"2024-09-12T02:57:10.346531+0000","last_fullsized":"2024-09-12T02:57:10.346531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368605+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:57:10.368605+0000","last_peered":"2024-09-12T02:57:10.368605+0000","last_clean":"2024-09-12T02:57:10.368605+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:57:10.368605+0000","last_undegraded":"2024-09-12T02:57:10.368605+0000","last_fullsized":"2024-09-12T02:57:10.368605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871686+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:57:09.871686+0000","last_peered":"2024-09-12T02:57:09.871686+0000","last_clean":"2024-09-12T02:57:09.871686+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:57:09.871686+0000","last_undegraded":"2024-09-12T02:57:09.871686+0000","last_fullsized":"2024-09-12T02:57:09.871686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366516+0000","last_change":"2024-09-12T02:57:03.790544+0000","last_active":"2024-09-12T02:57:10.366516+0000","last_peered":"2024-09-12T02:57:10.366516+0000","last_clean":"2024-09-12T02:57:10.366516+0000","last_became_active":"2024-09-12T02:57:03.790195+0000","last_became_peered":"2024-09-12T02:57:03.790195+0000","last_unstale":"2024-09-12T02:57:10.366516+0000","last_undegraded":"2024-09-12T02:57:10.366516+0000","last_fullsized":"2024-09-12T02:57:10.366516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368276+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:57:10.368276+0000","last_peered":"2024-09-12T02:57:10.368276+0000","last_clean":"2024-09-12T02:57:10.368276+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:57:10.368276+0000","last_undegraded":"2024-09-12T02:57:10.368276+0000","last_fullsized":"2024-09-12T02:57:10.368276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871830+0000","last_change":"2024-09-12T02:57:04.835949+0000","last_active":"2024-09-12T02:57:09.871830+0000","last_peered":"2024-09-12T02:57:09.871830+0000","last_clean":"2024-09-12T02:57:09.871830+0000","last_became_active":"2024-09-12T02:57:04.835628+0000","last_became_peered":"2024-09-12T02:57:04.835628+0000","last_unstale":"2024-09-12T02:57:09.871830+0000","last_undegraded":"2024-09-12T02:57:09.871830+0000","last_fullsized":"2024-09-12T02:57:09.871830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366134+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:57:10.366134+0000","last_peered":"2024-09-12T02:57:10.366134+0000","last_clean":"2024-09-12T02:57:10.366134+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:57:10.366134+0000","last_undegraded":"2024-09-12T02:57:10.366134+0000","last_fullsized":"2024-09-12T02:57:10.366134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367370+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:57:10.367370+0000","last_peered":"2024-09-12T02:57:10.367370+0000","last_clean":"2024-09-12T02:57:10.367370+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:57:10.367370+0000","last_undegraded":"2024-09-12T02:57:10.367370+0000","last_fullsized":"2024-09-12T02:57:10.367370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367963+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:57:10.367963+0000","last_peered":"2024-09-12T02:57:10.367963+0000","last_clean":"2024-09-12T02:57:10.367963+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:57:10.367963+0000","last_undegraded":"2024-09-12T02:57:10.367963+0000","last_fullsized":"2024-09-12T02:57:10.367963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345073+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:57:10.345073+0000","last_peered":"2024-09-12T02:57:10.345073+0000","last_clean":"2024-09-12T02:57:10.345073+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:57:10.345073+0000","last_undegraded":"2024-09-12T02:57:10.345073+0000","last_fullsized":"2024-09-12T02:57:10.345073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368760+0000","last_change":"2024-09-12T02:57:08.881925+0000","last_active":"2024-09-12T02:57:10.368760+0000","last_peered":"2024-09-12T02:57:10.368760+0000","last_clean":"2024-09-12T02:57:10.368760+0000","last_became_active":"2024-09-12T02:57:08.880913+0000","last_became_peered":"2024-09-12T02:57:08.880913+0000","last_unstale":"2024-09-12T02:57:10.368760+0000","last_undegraded":"2024-09-12T02:57:10.368760+0000","last_fullsized":"2024-09-12T02:57:10.368760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:48.637854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885883+0000","last_change":"2024-09-12T02:57:04.837566+0000","last_active":"2024-09-12T02:57:09.885883+0000","last_peered":"2024-09-12T02:57:09.885883+0000","last_clean":"2024-09-12T02:57:09.885883+0000","last_became_active":"2024-09-12T02:57:04.837281+0000","last_became_peered":"2024-09-12T02:57:04.837281+0000","last_unstale":"2024-09-12T02:57:09.885883+0000","last_undegraded":"2024-09-12T02:57:09.885883+0000","last_fullsized":"2024-09-12T02:57:09.885883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:23.664487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.878159+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:57:09.878159+0000","last_peered":"2024-09-12T02:57:09.878159+0000","last_clean":"2024-09-12T02:57:09.878159+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:57:09.878159+0000","last_undegraded":"2024-09-12T02:57:09.878159+0000","last_fullsized":"2024-09-12T02:57:09.878159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367595+0000","last_change":"2024-09-12T02:57:09.038564+0000","last_active":"2024-09-12T02:57:10.367595+0000","last_peered":"2024-09-12T02:57:10.367595+0000","last_clean":"2024-09-12T02:57:10.367595+0000","last_became_active":"2024-09-12T02:57:09.036310+0000","last_became_peered":"2024-09-12T02:57:09.036310+0000","last_unstale":"2024-09-12T02:57:10.367595+0000","last_undegraded":"2024-09-12T02:57:10.367595+0000","last_fullsized":"2024-09-12T02:57:10.367595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.627698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872469+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:57:09.872469+0000","last_peered":"2024-09-12T02:57:09.872469+0000","last_clean":"2024-09-12T02:57:09.872469+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:57:09.872469+0000","last_undegraded":"2024-09-12T02:57:09.872469+0000","last_fullsized":"2024-09-12T02:57:09.872469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367376+0000","last_change":"2024-09-12T02:57:03.809884+0000","last_active":"2024-09-12T02:57:10.367376+0000","last_peered":"2024-09-12T02:57:10.367376+0000","last_clean":"2024-09-12T02:57:10.367376+0000","last_became_active":"2024-09-12T02:57:03.809610+0000","last_became_peered":"2024-09-12T02:57:03.809610+0000","last_unstale":"2024-09-12T02:57:10.367376+0000","last_undegraded":"2024-09-12T02:57:10.367376+0000","last_fullsized":"2024-09-12T02:57:10.367376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871306+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:57:09.871306+0000","last_peered":"2024-09-12T02:57:09.871306+0000","last_clean":"2024-09-12T02:57:09.871306+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:57:09.871306+0000","last_undegraded":"2024-09-12T02:57:09.871306+0000","last_fullsized":"2024-09-12T02:57:09.871306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366942+0000","last_change":"2024-09-12T02:57:04.837330+0000","last_active":"2024-09-12T02:57:10.366942+0000","last_peered":"2024-09-12T02:57:10.366942+0000","last_clean":"2024-09-12T02:57:10.366942+0000","last_became_active":"2024-09-12T02:57:04.836984+0000","last_became_peered":"2024-09-12T02:57:04.836984+0000","last_unstale":"2024-09-12T02:57:10.366942+0000","last_undegraded":"2024-09-12T02:57:10.366942+0000","last_fullsized":"2024-09-12T02:57:10.366942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346664+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:57:10.346664+0000","last_peered":"2024-09-12T02:57:10.346664+0000","last_clean":"2024-09-12T02:57:10.346664+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:57:10.346664+0000","last_undegraded":"2024-09-12T02:57:10.346664+0000","last_fullsized":"2024-09-12T02:57:10.346664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885339+0000","last_change":"2024-09-12T02:57:09.025446+0000","last_active":"2024-09-12T02:57:09.885339+0000","last_peered":"2024-09-12T02:57:09.885339+0000","last_clean":"2024-09-12T02:57:09.885339+0000","last_became_active":"2024-09-12T02:57:09.025008+0000","last_became_peered":"2024-09-12T02:57:09.025008+0000","last_unstale":"2024-09-12T02:57:09.885339+0000","last_undegraded":"2024-09-12T02:57:09.885339+0000","last_fullsized":"2024-09-12T02:57:09.885339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877996+0000","last_change":"2024-09-12T02:57:04.861898+0000","last_active":"2024-09-12T02:57:09.877996+0000","last_peered":"2024-09-12T02:57:09.877996+0000","last_clean":"2024-09-12T02:57:09.877996+0000","last_became_active":"2024-09-12T02:57:04.858339+0000","last_became_peered":"2024-09-12T02:57:04.858339+0000","last_unstale":"2024-09-12T02:57:09.877996+0000","last_undegraded":"2024-09-12T02:57:09.877996+0000","last_fullsized":"2024-09-12T02:57:09.877996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367038+0000","last_change":"2024-09-12T02:57:03.796368+0000","last_active":"2024-09-12T02:57:10.367038+0000","last_peered":"2024-09-12T02:57:10.367038+0000","last_clean":"2024-09-12T02:57:10.367038+0000","last_became_active":"2024-09-12T02:57:03.796016+0000","last_became_peered":"2024-09-12T02:57:03.796016+0000","last_unstale":"2024-09-12T02:57:10.367038+0000","last_undegraded":"2024-09-12T02:57:10.367038+0000","last_fullsized":"2024-09-12T02:57:10.367038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:27.840978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366160+0000","last_change":"2024-09-12T02:57:08.877519+0000","last_active":"2024-09-12T02:57:10.366160+0000","last_peered":"2024-09-12T02:57:10.366160+0000","last_clean":"2024-09-12T02:57:10.366160+0000","last_became_active":"2024-09-12T02:57:08.872329+0000","last_became_peered":"2024-09-12T02:57:08.872329+0000","last_unstale":"2024-09-12T02:57:10.366160+0000","last_undegraded":"2024-09-12T02:57:10.366160+0000","last_fullsized":"2024-09-12T02:57:10.366160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.661785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368703+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:57:10.368703+0000","last_peered":"2024-09-12T02:57:10.368703+0000","last_clean":"2024-09-12T02:57:10.368703+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:57:10.368703+0000","last_undegraded":"2024-09-12T02:57:10.368703+0000","last_fullsized":"2024-09-12T02:57:10.368703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875332+0000","last_change":"2024-09-12T02:57:03.802797+0000","last_active":"2024-09-12T02:57:09.875332+0000","last_peered":"2024-09-12T02:57:09.875332+0000","last_clean":"2024-09-12T02:57:09.875332+0000","last_became_active":"2024-09-12T02:57:03.798969+0000","last_became_peered":"2024-09-12T02:57:03.798969+0000","last_unstale":"2024-09-12T02:57:09.875332+0000","last_undegraded":"2024-09-12T02:57:09.875332+0000","last_fullsized":"2024-09-12T02:57:09.875332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.025589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367036+0000","last_change":"2024-09-12T02:57:08.883289+0000","last_active":"2024-09-12T02:57:10.367036+0000","last_peered":"2024-09-12T02:57:10.367036+0000","last_clean":"2024-09-12T02:57:10.367036+0000","last_became_active":"2024-09-12T02:57:08.880476+0000","last_became_peered":"2024-09-12T02:57:08.880476+0000","last_unstale":"2024-09-12T02:57:10.367036+0000","last_undegraded":"2024-09-12T02:57:10.367036+0000","last_fullsized":"2024-09-12T02:57:10.367036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:04.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366058+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:57:10.366058+0000","last_peered":"2024-09-12T02:57:10.366058+0000","last_clean":"2024-09-12T02:57:10.366058+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:57:10.366058+0000","last_undegraded":"2024-09-12T02:57:10.366058+0000","last_fullsized":"2024-09-12T02:57:10.366058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366630+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:57:10.366630+0000","last_peered":"2024-09-12T02:57:10.366630+0000","last_clean":"2024-09-12T02:57:10.366630+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:57:10.366630+0000","last_undegraded":"2024-09-12T02:57:10.366630+0000","last_fullsized":"2024-09-12T02:57:10.366630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367404+0000","last_change":"2024-09-12T02:57:08.872506+0000","last_active":"2024-09-12T02:57:10.367404+0000","last_peered":"2024-09-12T02:57:10.367404+0000","last_clean":"2024-09-12T02:57:10.367404+0000","last_became_active":"2024-09-12T02:57:08.872127+0000","last_became_peered":"2024-09-12T02:57:08.872127+0000","last_unstale":"2024-09-12T02:57:10.367404+0000","last_undegraded":"2024-09-12T02:57:10.367404+0000","last_fullsized":"2024-09-12T02:57:10.367404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:19.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885022+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:57:09.885022+0000","last_peered":"2024-09-12T02:57:09.885022+0000","last_clean":"2024-09-12T02:57:09.885022+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:57:09.885022+0000","last_undegraded":"2024-09-12T02:57:09.885022+0000","last_fullsized":"2024-09-12T02:57:09.885022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345274+0000","last_change":"2024-09-12T02:57:03.827694+0000","last_active":"2024-09-12T02:57:10.345274+0000","last_peered":"2024-09-12T02:57:10.345274+0000","last_clean":"2024-09-12T02:57:10.345274+0000","last_became_active":"2024-09-12T02:57:03.827099+0000","last_became_peered":"2024-09-12T02:57:03.827099+0000","last_unstale":"2024-09-12T02:57:10.345274+0000","last_undegraded":"2024-09-12T02:57:10.345274+0000","last_fullsized":"2024-09-12T02:57:10.345274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885728+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:57:09.885728+0000","last_peered":"2024-09-12T02:57:09.885728+0000","last_clean":"2024-09-12T02:57:09.885728+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:57:09.885728+0000","last_undegraded":"2024-09-12T02:57:09.885728+0000","last_fullsized":"2024-09-12T02:57:09.885728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871567+0000","last_change":"2024-09-12T02:57:04.882517+0000","last_active":"2024-09-12T02:57:09.871567+0000","last_peered":"2024-09-12T02:57:09.871567+0000","last_clean":"2024-09-12T02:57:09.871567+0000","last_became_active":"2024-09-12T02:57:04.882159+0000","last_became_peered":"2024-09-12T02:57:04.882159+0000","last_unstale":"2024-09-12T02:57:09.871567+0000","last_undegraded":"2024-09-12T02:57:09.871567+0000","last_fullsized":"2024-09-12T02:57:09.871567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876576+0000","last_change":"2024-09-12T02:57:03.798773+0000","last_active":"2024-09-12T02:57:09.876576+0000","last_peered":"2024-09-12T02:57:09.876576+0000","last_clean":"2024-09-12T02:57:09.876576+0000","last_became_active":"2024-09-12T02:57:03.797799+0000","last_became_peered":"2024-09-12T02:57:03.797799+0000","last_unstale":"2024-09-12T02:57:09.876576+0000","last_undegraded":"2024-09-12T02:57:09.876576+0000","last_fullsized":"2024-09-12T02:57:09.876576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345357+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:57:10.345357+0000","last_peered":"2024-09-12T02:57:10.345357+0000","last_clean":"2024-09-12T02:57:10.345357+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:57:10.345357+0000","last_undegraded":"2024-09-12T02:57:10.345357+0000","last_fullsized":"2024-09-12T02:57:10.345357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876527+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:57:09.876527+0000","last_peered":"2024-09-12T02:57:09.876527+0000","last_clean":"2024-09-12T02:57:09.876527+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:57:09.876527+0000","last_undegraded":"2024-09-12T02:57:09.876527+0000","last_fullsized":"2024-09-12T02:57:09.876527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346026+0000","last_change":"2024-09-12T02:57:04.879076+0000","last_active":"2024-09-12T02:57:10.346026+0000","last_peered":"2024-09-12T02:57:10.346026+0000","last_clean":"2024-09-12T02:57:10.346026+0000","last_became_active":"2024-09-12T02:57:04.878160+0000","last_became_peered":"2024-09-12T02:57:04.878160+0000","last_unstale":"2024-09-12T02:57:10.346026+0000","last_undegraded":"2024-09-12T02:57:10.346026+0000","last_fullsized":"2024-09-12T02:57:10.346026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.589537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366400+0000","last_change":"2024-09-12T02:57:03.798239+0000","last_active":"2024-09-12T02:57:10.366400+0000","last_peered":"2024-09-12T02:57:10.366400+0000","last_clean":"2024-09-12T02:57:10.366400+0000","last_became_active":"2024-09-12T02:57:03.797935+0000","last_became_peered":"2024-09-12T02:57:03.797935+0000","last_unstale":"2024-09-12T02:57:10.366400+0000","last_undegraded":"2024-09-12T02:57:10.366400+0000","last_fullsized":"2024-09-12T02:57:10.366400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875409+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:57:09.875409+0000","last_peered":"2024-09-12T02:57:09.875409+0000","last_clean":"2024-09-12T02:57:09.875409+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:57:09.875409+0000","last_undegraded":"2024-09-12T02:57:09.875409+0000","last_fullsized":"2024-09-12T02:57:09.875409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875411+0000","last_change":"2024-09-12T02:57:04.858809+0000","last_active":"2024-09-12T02:57:09.875411+0000","last_peered":"2024-09-12T02:57:09.875411+0000","last_clean":"2024-09-12T02:57:09.875411+0000","last_became_active":"2024-09-12T02:57:04.858048+0000","last_became_peered":"2024-09-12T02:57:04.858048+0000","last_unstale":"2024-09-12T02:57:09.875411+0000","last_undegraded":"2024-09-12T02:57:09.875411+0000","last_fullsized":"2024-09-12T02:57:09.875411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:59.698440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367203+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:57:10.367203+0000","last_peered":"2024-09-12T02:57:10.367203+0000","last_clean":"2024-09-12T02:57:10.367203+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:57:10.367203+0000","last_undegraded":"2024-09-12T02:57:10.367203+0000","last_fullsized":"2024-09-12T02:57:10.367203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885593+0000","last_change":"2024-09-12T02:57:08.874656+0000","last_active":"2024-09-12T02:57:09.885593+0000","last_peered":"2024-09-12T02:57:09.885593+0000","last_clean":"2024-09-12T02:57:09.885593+0000","last_became_active":"2024-09-12T02:57:08.874202+0000","last_became_peered":"2024-09-12T02:57:08.874202+0000","last_unstale":"2024-09-12T02:57:09.885593+0000","last_undegraded":"2024-09-12T02:57:09.885593+0000","last_fullsized":"2024-09-12T02:57:09.885593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.794828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346615+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:57:10.346615+0000","last_peered":"2024-09-12T02:57:10.346615+0000","last_clean":"2024-09-12T02:57:10.346615+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:57:10.346615+0000","last_undegraded":"2024-09-12T02:57:10.346615+0000","last_fullsized":"2024-09-12T02:57:10.346615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366863+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:57:10.366863+0000","last_peered":"2024-09-12T02:57:10.366863+0000","last_clean":"2024-09-12T02:57:10.366863+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:57:10.366863+0000","last_undegraded":"2024-09-12T02:57:10.366863+0000","last_fullsized":"2024-09-12T02:57:10.366863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874320+0000","last_change":"2024-09-12T02:57:09.030839+0000","last_active":"2024-09-12T02:57:09.874320+0000","last_peered":"2024-09-12T02:57:09.874320+0000","last_clean":"2024-09-12T02:57:09.874320+0000","last_became_active":"2024-09-12T02:57:09.029808+0000","last_became_peered":"2024-09-12T02:57:09.029808+0000","last_unstale":"2024-09-12T02:57:09.874320+0000","last_undegraded":"2024-09-12T02:57:09.874320+0000","last_fullsized":"2024-09-12T02:57:09.874320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346464+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:57:10.346464+0000","last_peered":"2024-09-12T02:57:10.346464+0000","last_clean":"2024-09-12T02:57:10.346464+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:57:10.346464+0000","last_undegraded":"2024-09-12T02:57:10.346464+0000","last_fullsized":"2024-09-12T02:57:10.346464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368984+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:57:10.368984+0000","last_peered":"2024-09-12T02:57:10.368984+0000","last_clean":"2024-09-12T02:57:10.368984+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:57:10.368984+0000","last_undegraded":"2024-09-12T02:57:10.368984+0000","last_fullsized":"2024-09-12T02:57:10.368984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367280+0000","last_change":"2024-09-12T02:57:08.896161+0000","last_active":"2024-09-12T02:57:10.367280+0000","last_peered":"2024-09-12T02:57:10.367280+0000","last_clean":"2024-09-12T02:57:10.367280+0000","last_became_active":"2024-09-12T02:57:08.895379+0000","last_became_peered":"2024-09-12T02:57:08.895379+0000","last_unstale":"2024-09-12T02:57:10.367280+0000","last_undegraded":"2024-09-12T02:57:10.367280+0000","last_fullsized":"2024-09-12T02:57:10.367280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:34.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345587+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:57:10.345587+0000","last_peered":"2024-09-12T02:57:10.345587+0000","last_clean":"2024-09-12T02:57:10.345587+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:57:10.345587+0000","last_undegraded":"2024-09-12T02:57:10.345587+0000","last_fullsized":"2024-09-12T02:57:10.345587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366369+0000","last_change":"2024-09-12T02:57:03.788301+0000","last_active":"2024-09-12T02:57:10.366369+0000","last_peered":"2024-09-12T02:57:10.366369+0000","last_clean":"2024-09-12T02:57:10.366369+0000","last_became_active":"2024-09-12T02:57:03.788002+0000","last_became_peered":"2024-09-12T02:57:03.788002+0000","last_unstale":"2024-09-12T02:57:10.366369+0000","last_undegraded":"2024-09-12T02:57:10.366369+0000","last_fullsized":"2024-09-12T02:57:10.366369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885578+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:57:09.885578+0000","last_peered":"2024-09-12T02:57:09.885578+0000","last_clean":"2024-09-12T02:57:09.885578+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:57:09.885578+0000","last_undegraded":"2024-09-12T02:57:09.885578+0000","last_fullsized":"2024-09-12T02:57:09.885578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875635+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:57:09.875635+0000","last_peered":"2024-09-12T02:57:09.875635+0000","last_clean":"2024-09-12T02:57:09.875635+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:57:09.875635+0000","last_undegraded":"2024-09-12T02:57:09.875635+0000","last_fullsized":"2024-09-12T02:57:09.875635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876542+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:57:09.876542+0000","last_peered":"2024-09-12T02:57:09.876542+0000","last_clean":"2024-09-12T02:57:09.876542+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:57:09.876542+0000","last_undegraded":"2024-09-12T02:57:09.876542+0000","last_fullsized":"2024-09-12T02:57:09.876542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872348+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:57:09.872348+0000","last_peered":"2024-09-12T02:57:09.872348+0000","last_clean":"2024-09-12T02:57:09.872348+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:57:09.872348+0000","last_undegraded":"2024-09-12T02:57:09.872348+0000","last_fullsized":"2024-09-12T02:57:09.872348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346216+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:57:10.346216+0000","last_peered":"2024-09-12T02:57:10.346216+0000","last_clean":"2024-09-12T02:57:10.346216+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:57:10.346216+0000","last_undegraded":"2024-09-12T02:57:10.346216+0000","last_fullsized":"2024-09-12T02:57:10.346216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875168+0000","last_change":"2024-09-12T02:57:03.802047+0000","last_active":"2024-09-12T02:57:09.875168+0000","last_peered":"2024-09-12T02:57:09.875168+0000","last_clean":"2024-09-12T02:57:09.875168+0000","last_became_active":"2024-09-12T02:57:03.797936+0000","last_became_peered":"2024-09-12T02:57:03.797936+0000","last_unstale":"2024-09-12T02:57:09.875168+0000","last_undegraded":"2024-09-12T02:57:09.875168+0000","last_fullsized":"2024-09-12T02:57:09.875168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:10.176640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872067+0000","last_change":"2024-09-12T02:57:09.030826+0000","last_active":"2024-09-12T02:57:09.872067+0000","last_peered":"2024-09-12T02:57:09.872067+0000","last_clean":"2024-09-12T02:57:09.872067+0000","last_became_active":"2024-09-12T02:57:09.029437+0000","last_became_peered":"2024-09-12T02:57:09.029437+0000","last_unstale":"2024-09-12T02:57:09.872067+0000","last_undegraded":"2024-09-12T02:57:09.872067+0000","last_fullsized":"2024-09-12T02:57:09.872067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:15.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886359+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:57:09.886359+0000","last_peered":"2024-09-12T02:57:09.886359+0000","last_clean":"2024-09-12T02:57:09.886359+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:57:09.886359+0000","last_undegraded":"2024-09-12T02:57:09.886359+0000","last_fullsized":"2024-09-12T02:57:09.886359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885915+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:57:09.885915+0000","last_peered":"2024-09-12T02:57:09.885915+0000","last_clean":"2024-09-12T02:57:09.885915+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:57:09.885915+0000","last_undegraded":"2024-09-12T02:57:09.885915+0000","last_fullsized":"2024-09-12T02:57:09.885915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877662+0000","last_change":"2024-09-12T02:57:09.031080+0000","last_active":"2024-09-12T02:57:09.877662+0000","last_peered":"2024-09-12T02:57:09.877662+0000","last_clean":"2024-09-12T02:57:09.877662+0000","last_became_active":"2024-09-12T02:57:09.029892+0000","last_became_peered":"2024-09-12T02:57:09.029892+0000","last_unstale":"2024-09-12T02:57:09.877662+0000","last_undegraded":"2024-09-12T02:57:09.877662+0000","last_fullsized":"2024-09-12T02:57:09.877662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345803+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:57:10.345803+0000","last_peered":"2024-09-12T02:57:10.345803+0000","last_clean":"2024-09-12T02:57:10.345803+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:57:10.345803+0000","last_undegraded":"2024-09-12T02:57:10.345803+0000","last_fullsized":"2024-09-12T02:57:10.345803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:22.371934+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:57:22.371934+0000","last_peered":"2024-09-12T02:57:22.371934+0000","last_clean":"2024-09-12T02:57:22.371934+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:57:22.371934+0000","last_undegraded":"2024-09-12T02:57:22.371934+0000","last_fullsized":"2024-09-12T02:57:22.371934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366364+0000","last_change":"2024-09-12T02:57:08.884030+0000","last_active":"2024-09-12T02:57:10.366364+0000","last_peered":"2024-09-12T02:57:10.366364+0000","last_clean":"2024-09-12T02:57:10.366364+0000","last_became_active":"2024-09-12T02:57:08.880332+0000","last_became_peered":"2024-09-12T02:57:08.880332+0000","last_unstale":"2024-09-12T02:57:10.366364+0000","last_undegraded":"2024-09-12T02:57:10.366364+0000","last_fullsized":"2024-09-12T02:57:10.366364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:25.232846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368553+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:57:10.368553+0000","last_peered":"2024-09-12T02:57:10.368553+0000","last_clean":"2024-09-12T02:57:10.368553+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:57:10.368553+0000","last_undegraded":"2024-09-12T02:57:10.368553+0000","last_fullsized":"2024-09-12T02:57:10.368553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367151+0000","last_change":"2024-09-12T02:57:03.798009+0000","last_active":"2024-09-12T02:57:10.367151+0000","last_peered":"2024-09-12T02:57:10.367151+0000","last_clean":"2024-09-12T02:57:10.367151+0000","last_became_active":"2024-09-12T02:57:03.797749+0000","last_became_peered":"2024-09-12T02:57:03.797749+0000","last_unstale":"2024-09-12T02:57:10.367151+0000","last_undegraded":"2024-09-12T02:57:10.367151+0000","last_fullsized":"2024-09-12T02:57:10.367151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.058712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367936+0000","last_change":"2024-09-12T02:57:08.885401+0000","last_active":"2024-09-12T02:57:10.367936+0000","last_peered":"2024-09-12T02:57:10.367936+0000","last_clean":"2024-09-12T02:57:10.367936+0000","last_became_active":"2024-09-12T02:57:08.883296+0000","last_became_peered":"2024-09-12T02:57:08.883296+0000","last_unstale":"2024-09-12T02:57:10.367936+0000","last_undegraded":"2024-09-12T02:57:10.367936+0000","last_fullsized":"2024-09-12T02:57:10.367936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:24.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886680+0000","last_change":"2024-09-12T02:57:04.882349+0000","last_active":"2024-09-12T02:57:09.886680+0000","last_peered":"2024-09-12T02:57:09.886680+0000","last_clean":"2024-09-12T02:57:09.886680+0000","last_became_active":"2024-09-12T02:57:04.882060+0000","last_became_peered":"2024-09-12T02:57:04.882060+0000","last_unstale":"2024-09-12T02:57:09.886680+0000","last_undegraded":"2024-09-12T02:57:09.886680+0000","last_fullsized":"2024-09-12T02:57:09.886680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876076+0000","last_change":"2024-09-12T02:57:03.811429+0000","last_active":"2024-09-12T02:57:09.876076+0000","last_peered":"2024-09-12T02:57:09.876076+0000","last_clean":"2024-09-12T02:57:09.876076+0000","last_became_active":"2024-09-12T02:57:03.810672+0000","last_became_peered":"2024-09-12T02:57:03.810672+0000","last_unstale":"2024-09-12T02:57:09.876076+0000","last_undegraded":"2024-09-12T02:57:09.876076+0000","last_fullsized":"2024-09-12T02:57:09.876076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871687+0000","last_change":"2024-09-12T02:57:08.875903+0000","last_active":"2024-09-12T02:57:09.871687+0000","last_peered":"2024-09-12T02:57:09.871687+0000","last_clean":"2024-09-12T02:57:09.871687+0000","last_became_active":"2024-09-12T02:57:08.875270+0000","last_became_peered":"2024-09-12T02:57:08.875270+0000","last_unstale":"2024-09-12T02:57:09.871687+0000","last_undegraded":"2024-09-12T02:57:09.871687+0000","last_fullsized":"2024-09-12T02:57:09.871687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875836+0000","last_change":"2024-09-12T02:57:04.864904+0000","last_active":"2024-09-12T02:57:09.875836+0000","last_peered":"2024-09-12T02:57:09.875836+0000","last_clean":"2024-09-12T02:57:09.875836+0000","last_became_active":"2024-09-12T02:57:04.861650+0000","last_became_peered":"2024-09-12T02:57:04.861650+0000","last_unstale":"2024-09-12T02:57:09.875836+0000","last_undegraded":"2024-09-12T02:57:09.875836+0000","last_fullsized":"2024-09-12T02:57:09.875836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:31.529412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877718+0000","last_change":"2024-09-12T02:57:03.812106+0000","last_active":"2024-09-12T02:57:09.877718+0000","last_peered":"2024-09-12T02:57:09.877718+0000","last_clean":"2024-09-12T02:57:09.877718+0000","last_became_active":"2024-09-12T02:57:03.810041+0000","last_became_peered":"2024-09-12T02:57:03.810041+0000","last_unstale":"2024-09-12T02:57:09.877718+0000","last_undegraded":"2024-09-12T02:57:09.877718+0000","last_fullsized":"2024-09-12T02:57:09.877718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871655+0000","last_change":"2024-09-12T02:57:09.030507+0000","last_active":"2024-09-12T02:57:09.871655+0000","last_peered":"2024-09-12T02:57:09.871655+0000","last_clean":"2024-09-12T02:57:09.871655+0000","last_became_active":"2024-09-12T02:57:09.029459+0000","last_became_peered":"2024-09-12T02:57:09.029459+0000","last_unstale":"2024-09-12T02:57:09.871655+0000","last_undegraded":"2024-09-12T02:57:09.871655+0000","last_fullsized":"2024-09-12T02:57:09.871655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:26.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885411+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:57:09.885411+0000","last_peered":"2024-09-12T02:57:09.885411+0000","last_clean":"2024-09-12T02:57:09.885411+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:57:09.885411+0000","last_undegraded":"2024-09-12T02:57:09.885411+0000","last_fullsized":"2024-09-12T02:57:09.885411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.365943+0000","last_change":"2024-09-12T02:57:04.834192+0000","last_active":"2024-09-12T02:57:10.365943+0000","last_peered":"2024-09-12T02:57:10.365943+0000","last_clean":"2024-09-12T02:57:10.365943+0000","last_became_active":"2024-09-12T02:57:04.833901+0000","last_became_peered":"2024-09-12T02:57:04.833901+0000","last_unstale":"2024-09-12T02:57:10.365943+0000","last_undegraded":"2024-09-12T02:57:10.365943+0000","last_fullsized":"2024-09-12T02:57:10.365943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:51:30.019270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874853+0000","last_change":"2024-09-12T02:57:03.807210+0000","last_active":"2024-09-12T02:57:09.874853+0000","last_peered":"2024-09-12T02:57:09.874853+0000","last_clean":"2024-09-12T02:57:09.874853+0000","last_became_active":"2024-09-12T02:57:03.805335+0000","last_became_peered":"2024-09-12T02:57:03.805335+0000","last_unstale":"2024-09-12T02:57:09.874853+0000","last_undegraded":"2024-09-12T02:57:09.874853+0000","last_fullsized":"2024-09-12T02:57:09.874853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876801+0000","last_change":"2024-09-12T02:57:08.895753+0000","last_active":"2024-09-12T02:57:09.876801+0000","last_peered":"2024-09-12T02:57:09.876801+0000","last_clean":"2024-09-12T02:57:09.876801+0000","last_became_active":"2024-09-12T02:57:08.894542+0000","last_became_peered":"2024-09-12T02:57:08.894542+0000","last_unstale":"2024-09-12T02:57:09.876801+0000","last_undegraded":"2024-09-12T02:57:09.876801+0000","last_fullsized":"2024-09-12T02:57:09.876801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871791+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:57:09.871791+0000","last_peered":"2024-09-12T02:57:09.871791+0000","last_clean":"2024-09-12T02:57:09.871791+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:57:09.871791+0000","last_undegraded":"2024-09-12T02:57:09.871791+0000","last_fullsized":"2024-09-12T02:57:09.871791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871652+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:57:09.871652+0000","last_peered":"2024-09-12T02:57:09.871652+0000","last_clean":"2024-09-12T02:57:09.871652+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:57:09.871652+0000","last_undegraded":"2024-09-12T02:57:09.871652+0000","last_fullsized":"2024-09-12T02:57:09.871652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875973+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:57:09.875973+0000","last_peered":"2024-09-12T02:57:09.875973+0000","last_clean":"2024-09-12T02:57:09.875973+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:57:09.875973+0000","last_undegraded":"2024-09-12T02:57:09.875973+0000","last_fullsized":"2024-09-12T02:57:09.875973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885802+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:57:09.885802+0000","last_peered":"2024-09-12T02:57:09.885802+0000","last_clean":"2024-09-12T02:57:09.885802+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:57:09.885802+0000","last_undegraded":"2024-09-12T02:57:09.885802+0000","last_fullsized":"2024-09-12T02:57:09.885802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366287+0000","last_change":"2024-09-12T02:57:08.873190+0000","last_active":"2024-09-12T02:57:10.366287+0000","last_peered":"2024-09-12T02:57:10.366287+0000","last_clean":"2024-09-12T02:57:10.366287+0000","last_became_active":"2024-09-12T02:57:08.872526+0000","last_became_peered":"2024-09-12T02:57:08.872526+0000","last_unstale":"2024-09-12T02:57:10.366287+0000","last_undegraded":"2024-09-12T02:57:10.366287+0000","last_fullsized":"2024-09-12T02:57:10.366287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:15.257391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871819+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:57:09.871819+0000","last_peered":"2024-09-12T02:57:09.871819+0000","last_clean":"2024-09-12T02:57:09.871819+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:57:09.871819+0000","last_undegraded":"2024-09-12T02:57:09.871819+0000","last_fullsized":"2024-09-12T02:57:09.871819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367905+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:57:10.367905+0000","last_peered":"2024-09-12T02:57:10.367905+0000","last_clean":"2024-09-12T02:57:10.367905+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:57:10.367905+0000","last_undegraded":"2024-09-12T02:57:10.367905+0000","last_fullsized":"2024-09-12T02:57:10.367905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872056+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:57:09.872056+0000","last_peered":"2024-09-12T02:57:09.872056+0000","last_clean":"2024-09-12T02:57:09.872056+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:57:09.872056+0000","last_undegraded":"2024-09-12T02:57:09.872056+0000","last_fullsized":"2024-09-12T02:57:09.872056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875137+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:57:09.875137+0000","last_peered":"2024-09-12T02:57:09.875137+0000","last_clean":"2024-09-12T02:57:09.875137+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:57:09.875137+0000","last_undegraded":"2024-09-12T02:57:09.875137+0000","last_fullsized":"2024-09-12T02:57:09.875137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366549+0000","last_change":"2024-09-12T02:57:04.841244+0000","last_active":"2024-09-12T02:57:10.366549+0000","last_peered":"2024-09-12T02:57:10.366549+0000","last_clean":"2024-09-12T02:57:10.366549+0000","last_became_active":"2024-09-12T02:57:04.837935+0000","last_became_peered":"2024-09-12T02:57:04.837935+0000","last_unstale":"2024-09-12T02:57:10.366549+0000","last_undegraded":"2024-09-12T02:57:10.366549+0000","last_fullsized":"2024-09-12T02:57:10.366549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:50.023694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875090+0000","last_change":"2024-09-12T02:57:04.874054+0000","last_active":"2024-09-12T02:57:09.875090+0000","last_peered":"2024-09-12T02:57:09.875090+0000","last_clean":"2024-09-12T02:57:09.875090+0000","last_became_active":"2024-09-12T02:57:04.867372+0000","last_became_peered":"2024-09-12T02:57:04.867372+0000","last_unstale":"2024-09-12T02:57:09.875090+0000","last_undegraded":"2024-09-12T02:57:09.875090+0000","last_fullsized":"2024-09-12T02:57:09.875090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:06.010582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885676+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:57:09.885676+0000","last_peered":"2024-09-12T02:57:09.885676+0000","last_clean":"2024-09-12T02:57:09.885676+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:57:09.885676+0000","last_undegraded":"2024-09-12T02:57:09.885676+0000","last_fullsized":"2024-09-12T02:57:09.885676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872206+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:57:09.872206+0000","last_peered":"2024-09-12T02:57:09.872206+0000","last_clean":"2024-09-12T02:57:09.872206+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:57:09.872206+0000","last_undegraded":"2024-09-12T02:57:09.872206+0000","last_fullsized":"2024-09-12T02:57:09.872206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367050+0000","last_change":"2024-09-12T02:57:04.836873+0000","last_active":"2024-09-12T02:57:10.367050+0000","last_peered":"2024-09-12T02:57:10.367050+0000","last_clean":"2024-09-12T02:57:10.367050+0000","last_became_active":"2024-09-12T02:57:04.836564+0000","last_became_peered":"2024-09-12T02:57:04.836564+0000","last_unstale":"2024-09-12T02:57:10.367050+0000","last_undegraded":"2024-09-12T02:57:10.367050+0000","last_fullsized":"2024-09-12T02:57:10.367050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.539077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877094+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:57:09.877094+0000","last_peered":"2024-09-12T02:57:09.877094+0000","last_clean":"2024-09-12T02:57:09.877094+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:57:09.877094+0000","last_undegraded":"2024-09-12T02:57:09.877094+0000","last_fullsized":"2024-09-12T02:57:09.877094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872473+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:57:09.872473+0000","last_peered":"2024-09-12T02:57:09.872473+0000","last_clean":"2024-09-12T02:57:09.872473+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:57:09.872473+0000","last_undegraded":"2024-09-12T02:57:09.872473+0000","last_fullsized":"2024-09-12T02:57:09.872473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874601+0000","last_change":"2024-09-12T02:57:04.874760+0000","last_active":"2024-09-12T02:57:09.874601+0000","last_peered":"2024-09-12T02:57:09.874601+0000","last_clean":"2024-09-12T02:57:09.874601+0000","last_became_active":"2024-09-12T02:57:04.861196+0000","last_became_peered":"2024-09-12T02:57:04.861196+0000","last_unstale":"2024-09-12T02:57:09.874601+0000","last_undegraded":"2024-09-12T02:57:09.874601+0000","last_fullsized":"2024-09-12T02:57:09.874601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871359+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:57:09.871359+0000","last_peered":"2024-09-12T02:57:09.871359+0000","last_clean":"2024-09-12T02:57:09.871359+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:57:09.871359+0000","last_undegraded":"2024-09-12T02:57:09.871359+0000","last_fullsized":"2024-09-12T02:57:09.871359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874921+0000","last_change":"2024-09-12T02:57:04.879052+0000","last_active":"2024-09-12T02:57:09.874921+0000","last_peered":"2024-09-12T02:57:09.874921+0000","last_clean":"2024-09-12T02:57:09.874921+0000","last_became_active":"2024-09-12T02:57:04.877672+0000","last_became_peered":"2024-09-12T02:57:04.877672+0000","last_unstale":"2024-09-12T02:57:09.874921+0000","last_undegraded":"2024-09-12T02:57:09.874921+0000","last_fullsized":"2024-09-12T02:57:09.874921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885442+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:57:09.885442+0000","last_peered":"2024-09-12T02:57:09.885442+0000","last_clean":"2024-09-12T02:57:09.885442+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:57:09.885442+0000","last_undegraded":"2024-09-12T02:57:09.885442+0000","last_fullsized":"2024-09-12T02:57:09.885442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876589+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:57:09.876589+0000","last_peered":"2024-09-12T02:57:09.876589+0000","last_clean":"2024-09-12T02:57:09.876589+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:57:09.876589+0000","last_undegraded":"2024-09-12T02:57:09.876589+0000","last_fullsized":"2024-09-12T02:57:09.876589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346360+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:57:10.346360+0000","last_peered":"2024-09-12T02:57:10.346360+0000","last_clean":"2024-09-12T02:57:10.346360+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:57:10.346360+0000","last_undegraded":"2024-09-12T02:57:10.346360+0000","last_fullsized":"2024-09-12T02:57:10.346360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366832+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:57:10.366832+0000","last_peered":"2024-09-12T02:57:10.366832+0000","last_clean":"2024-09-12T02:57:10.366832+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:57:10.366832+0000","last_undegraded":"2024-09-12T02:57:10.366832+0000","last_fullsized":"2024-09-12T02:57:10.366832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877276+0000","last_change":"2024-09-12T02:57:04.867799+0000","last_active":"2024-09-12T02:57:09.877276+0000","last_peered":"2024-09-12T02:57:09.877276+0000","last_clean":"2024-09-12T02:57:09.877276+0000","last_became_active":"2024-09-12T02:57:04.863800+0000","last_became_peered":"2024-09-12T02:57:04.863800+0000","last_unstale":"2024-09-12T02:57:09.877276+0000","last_undegraded":"2024-09-12T02:57:09.877276+0000","last_fullsized":"2024-09-12T02:57:09.877276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874304+0000","last_change":"2024-09-12T02:57:04.864906+0000","last_active":"2024-09-12T02:57:09.874304+0000","last_peered":"2024-09-12T02:57:09.874304+0000","last_clean":"2024-09-12T02:57:09.874304+0000","last_became_active":"2024-09-12T02:57:04.863556+0000","last_became_peered":"2024-09-12T02:57:04.863556+0000","last_unstale":"2024-09-12T02:57:09.874304+0000","last_undegraded":"2024-09-12T02:57:09.874304+0000","last_fullsized":"2024-09-12T02:57:09.874304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366044+0000","last_change":"2024-09-12T02:57:04.826304+0000","last_active":"2024-09-12T02:57:10.366044+0000","last_peered":"2024-09-12T02:57:10.366044+0000","last_clean":"2024-09-12T02:57:10.366044+0000","last_became_active":"2024-09-12T02:57:04.825998+0000","last_became_peered":"2024-09-12T02:57:04.825998+0000","last_unstale":"2024-09-12T02:57:10.366044+0000","last_undegraded":"2024-09-12T02:57:10.366044+0000","last_fullsized":"2024-09-12T02:57:10.366044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:35.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886270+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:57:09.886270+0000","last_peered":"2024-09-12T02:57:09.886270+0000","last_clean":"2024-09-12T02:57:09.886270+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:57:09.886270+0000","last_undegraded":"2024-09-12T02:57:09.886270+0000","last_fullsized":"2024-09-12T02:57:09.886270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871588+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:57:09.871588+0000","last_peered":"2024-09-12T02:57:09.871588+0000","last_clean":"2024-09-12T02:57:09.871588+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:57:09.871588+0000","last_undegraded":"2024-09-12T02:57:09.871588+0000","last_fullsized":"2024-09-12T02:57:09.871588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368395+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:57:10.368395+0000","last_peered":"2024-09-12T02:57:10.368395+0000","last_clean":"2024-09-12T02:57:10.368395+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:57:10.368395+0000","last_undegraded":"2024-09-12T02:57:10.368395+0000","last_fullsized":"2024-09-12T02:57:10.368395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877007+0000","last_change":"2024-09-12T02:57:04.864295+0000","last_active":"2024-09-12T02:57:09.877007+0000","last_peered":"2024-09-12T02:57:09.877007+0000","last_clean":"2024-09-12T02:57:09.877007+0000","last_became_active":"2024-09-12T02:57:04.863563+0000","last_became_peered":"2024-09-12T02:57:04.863563+0000","last_unstale":"2024-09-12T02:57:09.877007+0000","last_undegraded":"2024-09-12T02:57:09.877007+0000","last_fullsized":"2024-09-12T02:57:09.877007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877026+0000","last_change":"2024-09-12T02:57:04.860987+0000","last_active":"2024-09-12T02:57:09.877026+0000","last_peered":"2024-09-12T02:57:09.877026+0000","last_clean":"2024-09-12T02:57:09.877026+0000","last_became_active":"2024-09-12T02:57:04.859032+0000","last_became_peered":"2024-09-12T02:57:04.859032+0000","last_unstale":"2024-09-12T02:57:09.877026+0000","last_undegraded":"2024-09-12T02:57:09.877026+0000","last_fullsized":"2024-09-12T02:57:09.877026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346559+0000","last_change":"2024-09-12T02:57:04.881172+0000","last_active":"2024-09-12T02:57:10.346559+0000","last_peered":"2024-09-12T02:57:10.346559+0000","last_clean":"2024-09-12T02:57:10.346559+0000","last_became_active":"2024-09-12T02:57:04.880660+0000","last_became_peered":"2024-09-12T02:57:04.880660+0000","last_unstale":"2024-09-12T02:57:10.346559+0000","last_undegraded":"2024-09-12T02:57:10.346559+0000","last_fullsized":"2024-09-12T02:57:10.346559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:15.389185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871386+0000","last_change":"2024-09-12T02:57:04.876735+0000","last_active":"2024-09-12T02:57:09.871386+0000","last_peered":"2024-09-12T02:57:09.871386+0000","last_clean":"2024-09-12T02:57:09.871386+0000","last_became_active":"2024-09-12T02:57:04.876321+0000","last_became_peered":"2024-09-12T02:57:04.876321+0000","last_unstale":"2024-09-12T02:57:09.871386+0000","last_undegraded":"2024-09-12T02:57:09.871386+0000","last_fullsized":"2024-09-12T02:57:09.871386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345483+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:57:10.345483+0000","last_peered":"2024-09-12T02:57:10.345483+0000","last_clean":"2024-09-12T02:57:10.345483+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:57:10.345483+0000","last_undegraded":"2024-09-12T02:57:10.345483+0000","last_fullsized":"2024-09-12T02:57:10.345483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874829+0000","last_change":"2024-09-12T02:57:04.878277+0000","last_active":"2024-09-12T02:57:09.874829+0000","last_peered":"2024-09-12T02:57:09.874829+0000","last_clean":"2024-09-12T02:57:09.874829+0000","last_became_active":"2024-09-12T02:57:04.876816+0000","last_became_peered":"2024-09-12T02:57:04.876816+0000","last_unstale":"2024-09-12T02:57:09.874829+0000","last_undegraded":"2024-09-12T02:57:09.874829+0000","last_fullsized":"2024-09-12T02:57:09.874829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345685+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:57:10.345685+0000","last_peered":"2024-09-12T02:57:10.345685+0000","last_clean":"2024-09-12T02:57:10.345685+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:57:10.345685+0000","last_undegraded":"2024-09-12T02:57:10.345685+0000","last_fullsized":"2024-09-12T02:57:10.345685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875150+0000","last_change":"2024-09-12T02:57:04.876472+0000","last_active":"2024-09-12T02:57:09.875150+0000","last_peered":"2024-09-12T02:57:09.875150+0000","last_clean":"2024-09-12T02:57:09.875150+0000","last_became_active":"2024-09-12T02:57:04.867264+0000","last_became_peered":"2024-09-12T02:57:04.867264+0000","last_unstale":"2024-09-12T02:57:09.875150+0000","last_undegraded":"2024-09-12T02:57:09.875150+0000","last_fullsized":"2024-09-12T02:57:09.875150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885265+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:57:09.885265+0000","last_peered":"2024-09-12T02:57:09.885265+0000","last_clean":"2024-09-12T02:57:09.885265+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:57:09.885265+0000","last_undegraded":"2024-09-12T02:57:09.885265+0000","last_fullsized":"2024-09-12T02:57:09.885265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367313+0000","last_change":"2024-09-12T02:57:04.841638+0000","last_active":"2024-09-12T02:57:10.367313+0000","last_peered":"2024-09-12T02:57:10.367313+0000","last_clean":"2024-09-12T02:57:10.367313+0000","last_became_active":"2024-09-12T02:57:04.841367+0000","last_became_peered":"2024-09-12T02:57:04.841367+0000","last_unstale":"2024-09-12T02:57:10.367313+0000","last_undegraded":"2024-09-12T02:57:10.367313+0000","last_fullsized":"2024-09-12T02:57:10.367313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:24.890973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346275+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:57:10.346275+0000","last_peered":"2024-09-12T02:57:10.346275+0000","last_clean":"2024-09-12T02:57:10.346275+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:57:10.346275+0000","last_undegraded":"2024-09-12T02:57:10.346275+0000","last_fullsized":"2024-09-12T02:57:10.346275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":698324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:57:39.412 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:57:39.412 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:57:39.412 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:57:39.412 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T02:57:39.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.589+0000 7f310fe00640 1 Processor -- start 2024-09-12T02:57:39.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.589+0000 7f310fe00640 1 -- start start 2024-09-12T02:57:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310fe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3108154c90 0x7f31080c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310fe00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3108155070 con 0x7f310806ec90 2024-09-12T02:57:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310fe00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31080c8bf0 con 0x7f310815b5c0 2024-09-12T02:57:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310fe00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f310815b130 con 0x7f3108154c90 2024-09-12T02:57:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310ca00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f310806ec90 0x7f31080ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56498/0 (socket says 172.21.15.63:56498) 2024-09-12T02:57:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310ca00640 1 -- 172.21.15.63:0/186316220 learned_addr learned my addr 172.21.15.63:0/186316220 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310d400640 1 --2- 172.21.15.63:0/186316220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3108154c90 0x7f31080c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f3107e00640 1 -- 172.21.15.63:0/186316220 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3988222221 0 0) 0x7f3108155070 con 0x7f310806ec90 2024-09-12T02:57:39.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f3107e00640 1 -- 172.21.15.63:0/186316220 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30f0003530 con 0x7f310806ec90 2024-09-12T02:57:39.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f3107e00640 1 -- 172.21.15.63:0/186316220 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4106096691 0 0) 0x7f30f0003530 con 0x7f310806ec90 2024-09-12T02:57:39.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310d400640 1 -- 172.21.15.63:0/186316220 >> v1:172.21.15.119:6789/0 conn(0x7f310815b5c0 legacy=0x7f310806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310d400640 1 -- 172.21.15.63:0/186316220 >> v1:172.21.15.63:6789/0 conn(0x7f310806ec90 legacy=0x7f31080ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.593+0000 7f310d400640 1 -- 172.21.15.63:0/186316220 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31080c8ed0 con 0x7f3108154c90 2024-09-12T02:57:39.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f310d400640 1 --2- 172.21.15.63:0/186316220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3108154c90 0x7f31080c3170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0097f0 tx=0x7f30fc01c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f905b5dde7bd4ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:39.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f3107e00640 1 -- 172.21.15.63:0/186316220 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc0b0070 con 0x7f3108154c90 2024-09-12T02:57:39.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f3107e00640 1 -- 172.21.15.63:0/186316220 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30fc0ab400 con 0x7f3108154c90 2024-09-12T02:57:39.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f3107e00640 1 -- 172.21.15.63:0/186316220 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4001680 con 0x7f3108154c90 2024-09-12T02:57:39.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f310fe00640 1 -- 172.21.15.63:0/186316220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3108154c90 msgr2=0x7f31080c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f310fe00640 1 --2- 172.21.15.63:0/186316220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3108154c90 0x7f31080c3170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0097f0 tx=0x7f30fc01c340 comp rx=0 tx=0).stop 2024-09-12T02:57:39.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f310fe00640 1 -- 172.21.15.63:0/186316220 shutdown_connections 2024-09-12T02:57:39.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f310fe00640 1 --2- 172.21.15.63:0/186316220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3108154c90 0x7f31080c3170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f310fe00640 1 -- 172.21.15.63:0/186316220 >> 172.21.15.63:0/186316220 conn(0x7f310806bcc0 msgr2=0x7f310806fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:39.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f310fe00640 1 -- 172.21.15.63:0/186316220 shutdown_connections 2024-09-12T02:57:39.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f310fe00640 1 -- 172.21.15.63:0/186316220 wait complete. 2024-09-12T02:57:39.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.597+0000 7f310fe00640 1 Processor -- start 2024-09-12T02:57:39.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 -- start start 2024-09-12T02:57:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f310806ec90 0x7f3108151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108154c90 0x7f310814aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f310815b5c0 0x7f310814af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f310815aae0 con 0x7f310815b5c0 2024-09-12T02:57:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f31080c36b0 con 0x7f3108154c90 2024-09-12T02:57:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f310815adc0 con 0x7f310806ec90 2024-09-12T02:57:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f310815b5c0 0x7f310814af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f310815b5c0 0x7f310814af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39502/0 (socket says 172.21.15.63:39502) 2024-09-12T02:57:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310de00640 1 -- 172.21.15.63:0/4149045889 learned_addr learned my addr 172.21.15.63:0/4149045889 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310d400640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f310806ec90 0x7f3108151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310ca00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108154c90 0x7f310814aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310de00640 1 -- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f310806ec90 msgr2=0x7f3108151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310de00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f310806ec90 0x7f3108151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310de00640 1 -- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108154c90 msgr2=0x7f310814aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310de00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108154c90 0x7f310814aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310de00640 1 -- 172.21.15.63:0/4149045889 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3108159da0 con 0x7f310815b5c0 2024-09-12T02:57:39.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310ca00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108154c90 0x7f310814aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:39.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310de00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f310815b5c0 0x7f310814af80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f310000c0e0 tx=0x7f310000c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:39.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f3105600640 1 -- 172.21.15.63:0/4149045889 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100018030 con 0x7f310815b5c0 2024-09-12T02:57:39.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f3105600640 1 -- 172.21.15.63:0/4149045889 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3100003980 con 0x7f310815b5c0 2024-09-12T02:57:39.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f3105600640 1 -- 172.21.15.63:0/4149045889 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100003d30 con 0x7f310815b5c0 2024-09-12T02:57:39.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31081e42b0 con 0x7f310815b5c0 2024-09-12T02:57:39.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f310815a320 con 0x7f310815b5c0 2024-09-12T02:57:39.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.601+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310806c6d0 con 0x7f310815b5c0 2024-09-12T02:57:39.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.605+0000 7f3105600640 1 -- 172.21.15.63:0/4149045889 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f310001b070 con 0x7f310815b5c0 2024-09-12T02:57:39.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.605+0000 7f3105600640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30e80678c0 0x7f30e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.605+0000 7f3105600640 1 -- 172.21.15.63:0/4149045889 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3100088760 con 0x7f310815b5c0 2024-09-12T02:57:39.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.605+0000 7f310d400640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30e80678c0 0x7f30e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.605+0000 7f310d400640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30e80678c0 0x7f30e8069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0ad000 tx=0x7f30fc0a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:39.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.609+0000 7f3105600640 1 -- 172.21.15.63:0/4149045889 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3100058ec0 con 0x7f310815b5c0 2024-09-12T02:57:39.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f31080cea80 con 0x7f310815b5c0 2024-09-12T02:57:39.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f3105600640 1 -- 172.21.15.63:0/4149045889 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f31000587c0 con 0x7f310815b5c0 2024-09-12T02:57:39.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:39.812 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:57:39.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30e80678c0 msgr2=0x7f30e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30e80678c0 0x7f30e8069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0ad000 tx=0x7f30fc0a6000 comp rx=0 tx=0).stop 2024-09-12T02:57:39.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f310815b5c0 msgr2=0x7f310814af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f310815b5c0 0x7f310814af80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f310000c0e0 tx=0x7f310000c5a0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 shutdown_connections 2024-09-12T02:57:39.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f310815b5c0 0x7f310814af80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3108154c90 0x7f310814aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30e80678c0 0x7f30e8069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 --2- 172.21.15.63:0/4149045889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f310806ec90 0x7f3108151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 >> 172.21.15.63:0/4149045889 conn(0x7f310806bcc0 msgr2=0x7f31080c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:39.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 shutdown_connections 2024-09-12T02:57:39.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.809+0000 7f310fe00640 1 -- 172.21.15.63:0/4149045889 wait complete. 2024-09-12T02:57:39.832 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:57:39.832 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:57:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.969+0000 7fa5a4000640 1 Processor -- start 2024-09-12T02:57:39.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.969+0000 7fa5a4000640 1 -- start start 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a4000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa59c0cd6a0 0x7fa59c06eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a4000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa59c06f0d0 0x7fa59c165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a4000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa59c0cd0e0 con 0x7fa59c154ca0 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a4000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa59c15e8d0 con 0x7fa59c06f0d0 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a4000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa59c0cdc50 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a2000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa59c06f0d0 0x7fa59c165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a2000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa59c06f0d0 0x7fa59c165330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39510/0 (socket says 172.21.15.63:39510) 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a2000640 1 -- 172.21.15.63:0/542929398 learned_addr learned my addr 172.21.15.63:0/542929398 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a0c00640 1 --2- 172.21.15.63:0/542929398 >> v2:172.21.15.119:3300/0 conn(0x7fa59c0cd6a0 0x7fa59c06eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a2000640 1 -- 172.21.15.63:0/542929398 >> v2:172.21.15.119:3300/0 conn(0x7fa59c0cd6a0 msgr2=0x7fa59c06eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:39.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a2000640 1 --2- 172.21.15.63:0/542929398 >> v2:172.21.15.119:3300/0 conn(0x7fa59c0cd6a0 0x7fa59c06eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a2000640 1 -- 172.21.15.63:0/542929398 >> v1:172.21.15.119:6789/0 conn(0x7fa59c154ca0 legacy=0x7fa59c15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.973+0000 7fa5a2000640 1 -- 172.21.15.63:0/542929398 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c0cdf30 con 0x7fa59c06f0d0 2024-09-12T02:57:39.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a2000640 1 --2- 172.21.15.63:0/542929398 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c06f0d0 0x7fa59c165330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa59c06e080 tx=0x7fa59401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f06ebe722b8194f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:39.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa59be00640 1 -- 172.21.15.63:0/542929398 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940b4070 con 0x7fa59c06f0d0 2024-09-12T02:57:39.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa59be00640 1 -- 172.21.15.63:0/542929398 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5940af400 con 0x7fa59c06f0d0 2024-09-12T02:57:39.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa59be00640 1 -- 172.21.15.63:0/542929398 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5940af7d0 con 0x7fa59c06f0d0 2024-09-12T02:57:39.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 -- 172.21.15.63:0/542929398 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c06f0d0 msgr2=0x7fa59c165330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 --2- 172.21.15.63:0/542929398 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c06f0d0 0x7fa59c165330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa59c06e080 tx=0x7fa59401f1e0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 -- 172.21.15.63:0/542929398 shutdown_connections 2024-09-12T02:57:39.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 --2- 172.21.15.63:0/542929398 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c06f0d0 0x7fa59c165330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 --2- 172.21.15.63:0/542929398 >> v2:172.21.15.119:3300/0 conn(0x7fa59c0cd6a0 0x7fa59c06eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 -- 172.21.15.63:0/542929398 >> 172.21.15.63:0/542929398 conn(0x7fa59c072960 msgr2=0x7fa59c072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:39.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 -- 172.21.15.63:0/542929398 shutdown_connections 2024-09-12T02:57:39.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 -- 172.21.15.63:0/542929398 wait complete. 2024-09-12T02:57:39.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 Processor -- start 2024-09-12T02:57:39.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 -- start start 2024-09-12T02:57:39.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c06f0d0 0x7fa59c159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c0cd6a0 0x7fa59c0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa59c154ca0 0x7fa59c1f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c15e560 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c15e280 con 0x7fa59c06f0d0 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.977+0000 7fa5a4000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa59c15b140 con 0x7fa59c154ca0 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a0c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c0cd6a0 0x7fa59c0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a0c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c0cd6a0 0x7fa59c0c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39522/0 (socket says 172.21.15.63:39522) 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a0c00640 1 -- 172.21.15.63:0/1942393654 learned_addr learned my addr 172.21.15.63:0/1942393654 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a2000640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa59c154ca0 0x7fa59c1f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a1600640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c06f0d0 0x7fa59c159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a0c00640 1 -- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa59c154ca0 msgr2=0x7fa59c1f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a0c00640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa59c154ca0 0x7fa59c1f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a0c00640 1 -- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c06f0d0 msgr2=0x7fa59c159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a0c00640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c06f0d0 0x7fa59c159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a0c00640 1 -- 172.21.15.63:0/1942393654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c14ed10 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a1600640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c06f0d0 0x7fa59c159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a0c00640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c0cd6a0 0x7fa59c0c6910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa58800d800 tx=0x7fa58800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa599600640 1 -- 172.21.15.63:0/1942393654 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58800b660 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa599600640 1 -- 172.21.15.63:0/1942393654 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa588019070 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa599600640 1 -- 172.21.15.63:0/1942393654 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58800ba00 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59c0c6380 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59c06edf0 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa59c0c6170 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.981+0000 7fa599600640 1 -- 172.21.15.63:0/1942393654 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa58800bba0 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.985+0000 7fa599600640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa57c0678c0 0x7fa57c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:39.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.985+0000 7fa599600640 1 -- 172.21.15.63:0/1942393654 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa588086430 con 0x7fa59c0cd6a0 2024-09-12T02:57:39.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.985+0000 7fa5a1600640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa57c0678c0 0x7fa57c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:39.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.985+0000 7fa5a1600640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa57c0678c0 0x7fa57c069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa590000f70 tx=0x7fa590009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:39.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:39.989+0000 7fa599600640 1 -- 172.21.15.63:0/1942393654 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa588056c20 con 0x7fa59c0cd6a0 2024-09-12T02:57:40.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.189+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa59c0c8100 con 0x7fa59c0cd6a0 2024-09-12T02:57:40.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.189+0000 7fa599600640 1 -- 172.21.15.63:0/1942393654 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6879 (secure 0 0 0) 0x7fa588056520 con 0x7fa59c0cd6a0 2024-09-12T02:57:40.194 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:40.194 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"btime":"2024-09-12T02:57:32:959110+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:32.355543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-12T02:57:40.195 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 10 2024-09-12T02:57:40.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa57c0678c0 msgr2=0x7fa57c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa57c0678c0 0x7fa57c069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa590000f70 tx=0x7fa590009040 comp rx=0 tx=0).stop 2024-09-12T02:57:40.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c0cd6a0 msgr2=0x7fa59c0c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c0cd6a0 0x7fa59c0c6910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa58800d800 tx=0x7fa58800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 shutdown_connections 2024-09-12T02:57:40.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa57c0678c0 0x7fa57c069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa59c154ca0 0x7fa59c1f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa59c0cd6a0 0x7fa59c0c6910 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 --2- 172.21.15.63:0/1942393654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa59c06f0d0 0x7fa59c159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 >> 172.21.15.63:0/1942393654 conn(0x7fa59c072960 msgr2=0x7fa59c150990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:40.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 shutdown_connections 2024-09-12T02:57:40.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.193+0000 7fa5a4000640 1 -- 172.21.15.63:0/1942393654 wait complete. 2024-09-12T02:57:40.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:57:40.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9ea0a00640 1 Processor -- start 2024-09-12T02:57:40.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9ea0a00640 1 -- start start 2024-09-12T02:57:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9ea0a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9e9c151a80 0x7f9e9c072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9ea0a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e9c074070 0x7f9e9c073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9ea0a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e9c1580c0 con 0x7f9e9c0c2380 2024-09-12T02:57:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9ea0a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9e9c0c8500 con 0x7f9e9c151a80 2024-09-12T02:57:40.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9ea0a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9c1583a0 con 0x7f9e9c074070 2024-09-12T02:57:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e9a800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9e9c0c2380 0x7f9e9c15aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56512/0 (socket says 172.21.15.63:56512) 2024-09-12T02:57:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e9a800640 1 -- 172.21.15.63:0/936389378 learned_addr learned my addr 172.21.15.63:0/936389378 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99e00640 1 --2- 172.21.15.63:0/936389378 >> v2:172.21.15.119:3300/0 conn(0x7f9e9c151a80 0x7f9e9c072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e91400640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e9c074070 0x7f9e9c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827513867 0 0) 0x7f9e9c1580c0 con 0x7f9e9c0c2380 2024-09-12T02:57:40.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e80003530 con 0x7f9e9c0c2380 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4135642019 0 0) 0x7f9e80003530 con 0x7f9e9c0c2380 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e9c074070 msgr2=0x7f9e9c073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e9c074070 0x7f9e9c073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 >> v2:172.21.15.119:3300/0 conn(0x7f9e9c151a80 msgr2=0x7f9e9c072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 --2- 172.21.15.63:0/936389378 >> v2:172.21.15.119:3300/0 conn(0x7f9e9c151a80 0x7f9e9c072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c0cbf00 con 0x7f9e9c0c2380 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f9e94001a00 con 0x7f9e9c0c2380 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 >> v1:172.21.15.63:6789/0 conn(0x7f9e9c0c2380 legacy=0x7f9e9c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e9c074070 0x7f9e800039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e80003f40 0x7f9e80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e80004d50 0x7f9e800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c0c8500 con 0x7f9e80003f40 2024-09-12T02:57:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1583a0 con 0x7f9e80004d50 2024-09-12T02:57:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8000ba00 con 0x7f9e9c074070 2024-09-12T02:57:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e91400640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e80003f40 0x7f9e80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e99e00640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e9c074070 0x7f9e800039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.353+0000 7f9e9a800640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e80004d50 0x7f9e800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e91400640 1 -- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e9c074070 msgr2=0x7f9e800039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:40.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e91400640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e9c074070 0x7f9e800039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e91400640 1 -- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e80004d50 msgr2=0x7f9e800051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:40.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e91400640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e80004d50 0x7f9e800051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e91400640 1 -- 172.21.15.63:0/936389378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e80003530 con 0x7f9e80003f40 2024-09-12T02:57:40.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e9a800640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e80004d50 0x7f9e800051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:40.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e91400640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e80003f40 0x7f9e80004810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009ab0 tx=0x7f9e8401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6facec7ec5031482 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:40.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840b2070 con 0x7f9e80003f40 2024-09-12T02:57:40.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840a5640 con 0x7f9e80003f40 2024-09-12T02:57:40.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e99400640 1 -- 172.21.15.63:0/936389378 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840096b0 con 0x7f9e80003f40 2024-09-12T02:57:40.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9ea0a00640 1 -- 172.21.15.63:0/936389378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e80003f40 msgr2=0x7f9e80004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9ea0a00640 1 --2- 172.21.15.63:0/936389378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e80003f40 0x7f9e80004810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9e84009ab0 tx=0x7f9e8401ca50 comp rx=0 tx=0).stop 2024-09-12T02:57:40.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9e9a800640 1 -- 172.21.15.63:0/936389378 reap_dead start 2024-09-12T02:57:40.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9ea0a00640 1 -- 172.21.15.63:0/936389378 shutdown_connections 2024-09-12T02:57:40.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.357+0000 7f9ea0a00640 1 -- 172.21.15.63:0/936389378 >> 172.21.15.63:0/936389378 conn(0x7f9e9c06f3d0 msgr2=0x7f9e9c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:40.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 -- 172.21.15.63:0/936389378 shutdown_connections 2024-09-12T02:57:40.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 -- 172.21.15.63:0/936389378 wait complete. 2024-09-12T02:57:40.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 Processor -- start 2024-09-12T02:57:40.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 -- start start 2024-09-12T02:57:40.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e80003f40 0x7f9e9c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e9c157660 0x7f9e9c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e9c155a20 0x7f9e9c147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c0c81f0 con 0x7f9e9c157660 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c0cc4c0 con 0x7f9e9c155a20 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9ea0a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9c0c7cf0 con 0x7f9e80003f40 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e91400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e9c157660 0x7f9e9c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e91400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e9c157660 0x7f9e9c1554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39540/0 (socket says 172.21.15.63:39540) 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e91400640 1 -- 172.21.15.63:0/2378646396 learned_addr learned my addr 172.21.15.63:0/2378646396 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e99e00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e80003f40 0x7f9e9c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e9a800640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e9c155a20 0x7f9e9c147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e91400640 1 -- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e80003f40 msgr2=0x7f9e9c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e91400640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e80003f40 0x7f9e9c0cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e91400640 1 -- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e9c155a20 msgr2=0x7f9e9c147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e91400640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e9c155a20 0x7f9e9c147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e91400640 1 -- 172.21.15.63:0/2378646396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c14bb60 con 0x7f9e9c157660 2024-09-12T02:57:40.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e9a800640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e9c155a20 0x7f9e9c147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:40.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e91400640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e9c157660 0x7f9e9c1554e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9e8401c880 tx=0x7f9e80005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:40.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e92a00640 1 -- 172.21.15.63:0/2378646396 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840b2040 con 0x7f9e9c157660 2024-09-12T02:57:40.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.361+0000 7f9e92a00640 1 -- 172.21.15.63:0/2378646396 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840bb070 con 0x7f9e9c157660 2024-09-12T02:57:40.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.365+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9c157b30 con 0x7f9e9c157660 2024-09-12T02:57:40.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.365+0000 7f9e92a00640 1 -- 172.21.15.63:0/2378646396 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ad680 con 0x7f9e9c157660 2024-09-12T02:57:40.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.365+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9c154220 con 0x7f9e9c157660 2024-09-12T02:57:40.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.365+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9c06fef0 con 0x7f9e9c157660 2024-09-12T02:57:40.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.365+0000 7f9e92a00640 1 -- 172.21.15.63:0/2378646396 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e840ad820 con 0x7f9e9c157660 2024-09-12T02:57:40.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.365+0000 7f9e92a00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e780678f0 0x7f9e78069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.365+0000 7f9e92a00640 1 -- 172.21.15.63:0/2378646396 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9e8411fff0 con 0x7f9e9c157660 2024-09-12T02:57:40.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.365+0000 7f9e99e00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e780678f0 0x7f9e78069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.369+0000 7f9e99e00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e780678f0 0x7f9e78069db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009c60 tx=0x7f9e8c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.369+0000 7f9e92a00640 1 -- 172.21.15.63:0/2378646396 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e84016760 con 0x7f9e9c157660 2024-09-12T02:57:40.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e9c0c7fd0 con 0x7f9e9c157660 2024-09-12T02:57:40.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9e92a00640 1 -- 172.21.15.63:0/2378646396 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6879 (secure 0 0 0) 0x7f9e840f0820 con 0x7f9e9c157660 2024-09-12T02:57:40.576 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:40.576 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"btime":"2024-09-12T02:57:32:959110+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:32.355543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-12T02:57:40.577 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 10 2024-09-12T02:57:40.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e780678f0 msgr2=0x7f9e78069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e780678f0 0x7f9e78069db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009c60 tx=0x7f9e8c009190 comp rx=0 tx=0).stop 2024-09-12T02:57:40.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e9c157660 msgr2=0x7f9e9c1554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e9c157660 0x7f9e9c1554e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9e8401c880 tx=0x7f9e80005840 comp rx=0 tx=0).stop 2024-09-12T02:57:40.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 shutdown_connections 2024-09-12T02:57:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e9c155a20 0x7f9e9c147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e9c157660 0x7f9e9c1554e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9e780678f0 0x7f9e78069db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 --2- 172.21.15.63:0/2378646396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e80003f40 0x7f9e9c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 >> 172.21.15.63:0/2378646396 conn(0x7f9e9c06f3d0 msgr2=0x7f9e9c0c8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 shutdown_connections 2024-09-12T02:57:40.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.573+0000 7f9ea0a00640 1 -- 172.21.15.63:0/2378646396 wait complete. 2024-09-12T02:57:40.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:57:40.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.733+0000 7f0703600640 1 Processor -- start 2024-09-12T02:57:40.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.733+0000 7f0703600640 1 -- start start 2024-09-12T02:57:40.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.733+0000 7f0703600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 0x7f06fc0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.733+0000 7f0703600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06fc0c7a00 0x7f06fc0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.733+0000 7f0703600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06fc159520 con 0x7f06fc0c61e0 2024-09-12T02:57:40.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.733+0000 7f0703600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f06fc1589a0 con 0x7f06fc0c7a00 2024-09-12T02:57:40.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.733+0000 7f0703600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f06fc158c80 con 0x7f06fc1527e0 2024-09-12T02:57:40.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06fc0c7a00 0x7f06fc0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f0701600640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f06fc0c61e0 0x7f06fc0cc550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56524/0 (socket says 172.21.15.63:56524) 2024-09-12T02:57:40.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f06fc0c7a00 0x7f06fc0c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39542/0 (socket says 172.21.15.63:39542) 2024-09-12T02:57:40.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f0701600640 1 -- 172.21.15.63:0/895590759 learned_addr learned my addr 172.21.15.63:0/895590759 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:40.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f0700c00640 1 --2- 172.21.15.63:0/895590759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 0x7f06fc0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fbe00640 1 -- 172.21.15.63:0/895590759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 msgr2=0x7f06fc0c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:40.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fbe00640 1 --2- 172.21.15.63:0/895590759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 0x7f06fc0c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fbe00640 1 -- 172.21.15.63:0/895590759 >> v1:172.21.15.63:6789/0 conn(0x7f06fc0c61e0 legacy=0x7f06fc0cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fbe00640 1 -- 172.21.15.63:0/895590759 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc158f60 con 0x7f06fc0c7a00 2024-09-12T02:57:40.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fb400640 1 -- 172.21.15.63:0/895590759 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494396249 0 0) 0x7f06fc159520 con 0x7f06fc0c61e0 2024-09-12T02:57:40.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fbe00640 1 --2- 172.21.15.63:0/895590759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 0x7f06fc0c6eb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06e80097c0 tx=0x7f06e801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcde23850466c67d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:40.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fb400640 1 -- 172.21.15.63:0/895590759 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80a7070 con 0x7f06fc0c7a00 2024-09-12T02:57:40.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fb400640 1 -- 172.21.15.63:0/895590759 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e80b0070 con 0x7f06fc0c7a00 2024-09-12T02:57:40.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.737+0000 7f06fb400640 1 -- 172.21.15.63:0/895590759 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80ab890 con 0x7f06fc0c7a00 2024-09-12T02:57:40.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 -- 172.21.15.63:0/895590759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 msgr2=0x7f06fc0c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 --2- 172.21.15.63:0/895590759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 0x7f06fc0c6eb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f06e80097c0 tx=0x7f06e801c470 comp rx=0 tx=0).stop 2024-09-12T02:57:40.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 -- 172.21.15.63:0/895590759 shutdown_connections 2024-09-12T02:57:40.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 --2- 172.21.15.63:0/895590759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 0x7f06fc0c6eb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 --2- 172.21.15.63:0/895590759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 0x7f06fc0c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 -- 172.21.15.63:0/895590759 >> 172.21.15.63:0/895590759 conn(0x7f06fc06f3d0 msgr2=0x7f06fc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:40.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 -- 172.21.15.63:0/895590759 shutdown_connections 2024-09-12T02:57:40.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 -- 172.21.15.63:0/895590759 wait complete. 2024-09-12T02:57:40.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 Processor -- start 2024-09-12T02:57:40.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 -- start start 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06fc0c61e0 0x7f06fc0c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 0x7f06fc148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 0x7f06fc148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc1586e0 con 0x7f06fc0c7a00 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc158560 con 0x7f06fc0c61e0 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0703600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f06fc165700 con 0x7f06fc1527e0 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f06fbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 0x7f06fc148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f06fbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 0x7f06fc148840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39554/0 (socket says 172.21.15.63:39554) 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f06fbe00640 1 -- 172.21.15.63:0/1069186396 learned_addr learned my addr 172.21.15.63:0/1069186396 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:40.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0700c00640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06fc0c61e0 0x7f06fc0c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0701600640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 0x7f06fc148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f06fbe00640 1 -- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 msgr2=0x7f06fc148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f06fbe00640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 0x7f06fc148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f06fbe00640 1 -- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06fc0c61e0 msgr2=0x7f06fc0c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f06fbe00640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06fc0c61e0 0x7f06fc0c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f06fbe00640 1 -- 172.21.15.63:0/1069186396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc1f75c0 con 0x7f06fc0c7a00 2024-09-12T02:57:40.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f0700c00640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06fc0c61e0 0x7f06fc0c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:40.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.741+0000 7f06fbe00640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 0x7f06fc148840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06e80097c0 tx=0x7f06e801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:40.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f06f8c00640 1 -- 172.21.15.63:0/1069186396 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80abe60 con 0x7f06fc0c7a00 2024-09-12T02:57:40.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f06f8c00640 1 -- 172.21.15.63:0/1069186396 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e8004250 con 0x7f06fc0c7a00 2024-09-12T02:57:40.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f06f8c00640 1 -- 172.21.15.63:0/1069186396 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8003620 con 0x7f06fc0c7a00 2024-09-12T02:57:40.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06fc14a080 con 0x7f06fc0c7a00 2024-09-12T02:57:40.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06fc1f6a80 con 0x7f06fc0c7a00 2024-09-12T02:57:40.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06fc0cc550 con 0x7f06fc0c7a00 2024-09-12T02:57:40.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f06f8c00640 1 -- 172.21.15.63:0/1069186396 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06e80037c0 con 0x7f06fc0c7a00 2024-09-12T02:57:40.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f06f8c00640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06dc0678c0 0x7f06dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:40.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f06f8c00640 1 -- 172.21.15.63:0/1069186396 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f06e81204b0 con 0x7f06fc0c7a00 2024-09-12T02:57:40.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.745+0000 7f0700c00640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06dc0678c0 0x7f06dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:40.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.749+0000 7f0700c00640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06dc0678c0 0x7f06dc069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009b10 tx=0x7f06ec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:40.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.749+0000 7f06f8c00640 1 -- 172.21.15.63:0/1069186396 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f06e80c6070 con 0x7f06fc0c7a00 2024-09-12T02:57:40.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.917+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06fc06dd50 con 0x7f06fc0c7a00 2024-09-12T02:57:40.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f06f8c00640 1 -- 172.21.15.63:0/1069186396 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18598 (secure 0 0 0) 0x7f06fc14a080 con 0x7f06fc0c7a00 2024-09-12T02:57:40.926 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:40.926 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":26,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:57:09.262695+0000","last_up_change":"2024-09-12T02:56:53.715732+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6825","nonce":4151470176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6827","nonce":4151470176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6831","nonce":4151470176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":4151470176},{"type":"v1","addr":"172.21.15.119:6829","nonce":4151470176}]},"public_addr":"172.21.15.119:6825/4151470176","cluster_addr":"172.21.15.119:6827/4151470176","heartbeat_back_addr":"172.21.15.119:6831/4151470176","heartbeat_front_addr":"172.21.15.119:6829/4151470176","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:57:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06dc0678c0 msgr2=0x7f06dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06dc0678c0 0x7f06dc069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009b10 tx=0x7f06ec008040 comp rx=0 tx=0).stop 2024-09-12T02:57:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 msgr2=0x7f06fc148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 0x7f06fc148840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06e80097c0 tx=0x7f06e801acb0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 shutdown_connections 2024-09-12T02:57:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06dc0678c0 0x7f06dc069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06fc1527e0 0x7f06fc148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06fc0c7a00 0x7f06fc148840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 --2- 172.21.15.63:0/1069186396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06fc0c61e0 0x7f06fc0c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:40.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 >> 172.21.15.63:0/1069186396 conn(0x7f06fc06f3d0 msgr2=0x7f06fc071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:40.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 shutdown_connections 2024-09-12T02:57:40.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:40.921+0000 7f0703600640 1 -- 172.21.15.63:0/1069186396 wait complete. 2024-09-12T02:57:40.945 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T02:57:41.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.085+0000 7ff96fe00640 1 Processor -- start 2024-09-12T02:57:41.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.085+0000 7ff96fe00640 1 -- start start 2024-09-12T02:57:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96fe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cd6a0 0x7ff96806eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96fe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff96806f0d0 0x7ff968165330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96fe00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9680cd0e0 con 0x7ff968154ca0 2024-09-12T02:57:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96fe00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff96815e8d0 con 0x7ff96806f0d0 2024-09-12T02:57:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96fe00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff9680cdc50 con 0x7ff9680cd6a0 2024-09-12T02:57:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96de00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff96806f0d0 0x7ff968165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96ca00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cd6a0 0x7ff96806eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96d400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff968154ca0 0x7ff96815aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:40444/0 (socket says 172.21.15.63:40444) 2024-09-12T02:57:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96d400640 1 -- 172.21.15.63:0/1676578223 learned_addr learned my addr 172.21.15.63:0/1676578223 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96ca00640 1 -- 172.21.15.63:0/1676578223 >> v2:172.21.15.119:3300/0 conn(0x7ff96806f0d0 msgr2=0x7ff968165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96ca00640 1 --2- 172.21.15.63:0/1676578223 >> v2:172.21.15.119:3300/0 conn(0x7ff96806f0d0 0x7ff968165330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96ca00640 1 -- 172.21.15.63:0/1676578223 >> v1:172.21.15.119:6789/0 conn(0x7ff968154ca0 legacy=0x7ff96815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.089+0000 7ff96ca00640 1 -- 172.21.15.63:0/1676578223 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9680cdf30 con 0x7ff9680cd6a0 2024-09-12T02:57:41.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96ca00640 1 --2- 172.21.15.63:0/1676578223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cd6a0 0x7ff96806eb90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9540097c0 tx=0x7ff95401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c9082185459dc30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:41.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff967e00640 1 -- 172.21.15.63:0/1676578223 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9540b5070 con 0x7ff9680cd6a0 2024-09-12T02:57:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff967e00640 1 -- 172.21.15.63:0/1676578223 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9540a8990 con 0x7ff9680cd6a0 2024-09-12T02:57:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff967e00640 1 -- 172.21.15.63:0/1676578223 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9540a8d60 con 0x7ff9680cd6a0 2024-09-12T02:57:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 -- 172.21.15.63:0/1676578223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cd6a0 msgr2=0x7ff96806eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 --2- 172.21.15.63:0/1676578223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cd6a0 0x7ff96806eb90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9540097c0 tx=0x7ff95401ec90 comp rx=0 tx=0).stop 2024-09-12T02:57:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 -- 172.21.15.63:0/1676578223 shutdown_connections 2024-09-12T02:57:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 --2- 172.21.15.63:0/1676578223 >> v2:172.21.15.119:3300/0 conn(0x7ff96806f0d0 0x7ff968165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 --2- 172.21.15.63:0/1676578223 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cd6a0 0x7ff96806eb90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:41.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 -- 172.21.15.63:0/1676578223 >> 172.21.15.63:0/1676578223 conn(0x7ff968072960 msgr2=0x7ff968072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 -- 172.21.15.63:0/1676578223 shutdown_connections 2024-09-12T02:57:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 -- 172.21.15.63:0/1676578223 wait complete. 2024-09-12T02:57:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 Processor -- start 2024-09-12T02:57:41.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 -- start start 2024-09-12T02:57:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96806f0d0 0x7ff9681f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680cd6a0 0x7ff9680cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff968154ca0 0x7ff96815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff96815e560 con 0x7ff9680cd6a0 2024-09-12T02:57:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff96815e280 con 0x7ff968154ca0 2024-09-12T02:57:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.093+0000 7ff96fe00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff96815b140 con 0x7ff96806f0d0 2024-09-12T02:57:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680cd6a0 0x7ff9680cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:41.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680cd6a0 0x7ff9680cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39556/0 (socket says 172.21.15.63:39556) 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96ca00640 1 -- 172.21.15.63:0/3681586851 learned_addr learned my addr 172.21.15.63:0/3681586851 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96d400640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96806f0d0 0x7ff9681f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96de00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff968154ca0 0x7ff96815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96ca00640 1 -- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96806f0d0 msgr2=0x7ff9681f16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96ca00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96806f0d0 0x7ff9681f16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96ca00640 1 -- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff968154ca0 msgr2=0x7ff96815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96ca00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff968154ca0 0x7ff96815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96ca00640 1 -- 172.21.15.63:0/3681586851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff968149bc0 con 0x7ff9680cd6a0 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96d400640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96806f0d0 0x7ff9681f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96ca00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680cd6a0 0x7ff9680cc340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9540b3040 tx=0x7ff95401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:41.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff965600640 1 -- 172.21.15.63:0/3681586851 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9540bf070 con 0x7ff9680cd6a0 2024-09-12T02:57:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff965600640 1 -- 172.21.15.63:0/3681586851 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9540b07a0 con 0x7ff9680cd6a0 2024-09-12T02:57:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff965600640 1 -- 172.21.15.63:0/3681586851 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9540b5040 con 0x7ff9680cd6a0 2024-09-12T02:57:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff968149e40 con 0x7ff9680cd6a0 2024-09-12T02:57:41.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9680cbb40 con 0x7ff9680cd6a0 2024-09-12T02:57:41.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9680c8100 con 0x7ff9680cd6a0 2024-09-12T02:57:41.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff965600640 1 -- 172.21.15.63:0/3681586851 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9540b0b90 con 0x7ff9680cd6a0 2024-09-12T02:57:41.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.097+0000 7ff965600640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9480678c0 0x7ff948069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:41.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.101+0000 7ff965600640 1 -- 172.21.15.63:0/3681586851 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff954122920 con 0x7ff9680cd6a0 2024-09-12T02:57:41.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.101+0000 7ff96d400640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9480678c0 0x7ff948069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:41.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.101+0000 7ff96d400640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9480678c0 0x7ff948069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff95c005890 tx=0x7ff95c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:41.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.105+0000 7ff965600640 1 -- 172.21.15.63:0/3681586851 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff968149bc0 con 0x7ff9680cd6a0 2024-09-12T02:57:41.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.301+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9680730c0 con 0x7ff9680cd6a0 2024-09-12T02:57:41.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.301+0000 7ff965600640 1 -- 172.21.15.63:0/3681586851 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6879 (secure 0 0 0) 0x7ff9540187f0 con 0x7ff9680cd6a0 2024-09-12T02:57:41.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:41.306 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"btime":"2024-09-12T02:57:32:959110+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:32.355543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-12T02:57:41.306 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 10 2024-09-12T02:57:41.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9480678c0 msgr2=0x7ff948069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:41.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9480678c0 0x7ff948069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff95c005890 tx=0x7ff95c009040 comp rx=0 tx=0).stop 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680cd6a0 msgr2=0x7ff9680cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680cd6a0 0x7ff9680cc340 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9540b3040 tx=0x7ff95401ba30 comp rx=0 tx=0).stop 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 shutdown_connections 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff968154ca0 0x7ff96815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9680cd6a0 0x7ff9680cc340 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9480678c0 0x7ff948069d80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 --2- 172.21.15.63:0/3681586851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96806f0d0 0x7ff9681f16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 >> 172.21.15.63:0/3681586851 conn(0x7ff968072960 msgr2=0x7ff96806cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 shutdown_connections 2024-09-12T02:57:41.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:41.305+0000 7ff96fe00640 1 -- 172.21.15.63:0/3681586851 wait complete. 2024-09-12T02:57:41.931 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:57:04.183250+0000', 'modified': '2024-09-12T02:57:32.355543+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.63:6836/2556723891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6833', 'nonce': 2556723891}, {'type': 'v1', 'addr': '172.21.15.63:6836', 'nonce': 2556723891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4306, 'qdb_cluster': [4306]} 2024-09-12T02:57:41.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:57:41.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-12T02:57:42.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f039f200640 1 Processor -- start 2024-09-12T02:57:42.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f039f200640 1 -- start start 2024-09-12T02:57:42.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f039f200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03981517d0 0x7f039815de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f039f200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f039815e340 0x7f03980ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f039f200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0398070520 con 0x7f03980c9470 2024-09-12T02:57:42.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f039f200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f039806f6f0 con 0x7f039815e340 2024-09-12T02:57:42.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f039f200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f03980c8cf0 con 0x7f03981517d0 2024-09-12T02:57:42.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f039d200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f03980c9470 0x7f039815a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56534/0 (socket says 172.21.15.63:56534) 2024-09-12T02:57:42.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f039d200640 1 -- 172.21.15.63:0/1480307916 learned_addr learned my addr 172.21.15.63:0/1480307916 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:42.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f0397e00640 1 --2- 172.21.15.63:0/1480307916 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03981517d0 0x7f039815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.077+0000 7f038f400640 1 --2- 172.21.15.63:0/1480307916 >> v2:172.21.15.119:3300/0 conn(0x7f039815e340 0x7f03980ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397400640 1 -- 172.21.15.63:0/1480307916 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027977500 0 0) 0x7f0398070520 con 0x7f03980c9470 2024-09-12T02:57:42.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397400640 1 -- 172.21.15.63:0/1480307916 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f037c003530 con 0x7f03980c9470 2024-09-12T02:57:42.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397e00640 1 -- 172.21.15.63:0/1480307916 >> v2:172.21.15.119:3300/0 conn(0x7f039815e340 msgr2=0x7f03980ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397e00640 1 --2- 172.21.15.63:0/1480307916 >> v2:172.21.15.119:3300/0 conn(0x7f039815e340 0x7f03980ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397e00640 1 -- 172.21.15.63:0/1480307916 >> v1:172.21.15.63:6789/0 conn(0x7f03980c9470 legacy=0x7f039815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397e00640 1 -- 172.21.15.63:0/1480307916 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03980c9180 con 0x7f03981517d0 2024-09-12T02:57:42.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397e00640 1 --2- 172.21.15.63:0/1480307916 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03981517d0 0x7f039815de00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03880097c0 tx=0x7f038801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3abc95c37b27148f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397400640 1 -- 172.21.15.63:0/1480307916 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880b5070 con 0x7f03981517d0 2024-09-12T02:57:42.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397400640 1 -- 172.21.15.63:0/1480307916 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03880a8990 con 0x7f03981517d0 2024-09-12T02:57:42.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.081+0000 7f0397400640 1 -- 172.21.15.63:0/1480307916 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880a8d40 con 0x7f03981517d0 2024-09-12T02:57:42.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 -- 172.21.15.63:0/1480307916 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03981517d0 msgr2=0x7f039815de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 --2- 172.21.15.63:0/1480307916 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03981517d0 0x7f039815de00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03880097c0 tx=0x7f038801ec90 comp rx=0 tx=0).stop 2024-09-12T02:57:42.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 -- 172.21.15.63:0/1480307916 shutdown_connections 2024-09-12T02:57:42.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 --2- 172.21.15.63:0/1480307916 >> v2:172.21.15.119:3300/0 conn(0x7f039815e340 0x7f03980ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 --2- 172.21.15.63:0/1480307916 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03981517d0 0x7f039815de00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 -- 172.21.15.63:0/1480307916 >> 172.21.15.63:0/1480307916 conn(0x7f0398067a00 msgr2=0x7f0398067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:42.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 -- 172.21.15.63:0/1480307916 shutdown_connections 2024-09-12T02:57:42.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 -- 172.21.15.63:0/1480307916 wait complete. 2024-09-12T02:57:42.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 Processor -- start 2024-09-12T02:57:42.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 -- start start 2024-09-12T02:57:42.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03980c9470 0x7f03981e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03981517d0 0x7f03981e4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f039815e340 0x7f0398147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0398070240 con 0x7f03981517d0 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f039806ffa0 con 0x7f039815e340 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039f200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f039806fc00 con 0x7f03980c9470 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f038f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03981517d0 0x7f03981e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f038f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03981517d0 0x7f03981e4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39566/0 (socket says 172.21.15.63:39566) 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f038f400640 1 -- 172.21.15.63:0/2659795240 learned_addr learned my addr 172.21.15.63:0/2659795240 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f0397e00640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03980c9470 0x7f03981e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f039d200640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f039815e340 0x7f0398147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f038f400640 1 -- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03980c9470 msgr2=0x7f03981e3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f038f400640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03980c9470 0x7f03981e3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f038f400640 1 -- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f039815e340 msgr2=0x7f0398147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f038f400640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f039815e340 0x7f0398147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f038f400640 1 -- 172.21.15.63:0/2659795240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03980cde30 con 0x7f03981517d0 2024-09-12T02:57:42.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.085+0000 7f0397e00640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03980c9470 0x7f03981e3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:42.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f038f400640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03981517d0 0x7f03981e4910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f038000e930 tx=0x7f038000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f0394c00640 1 -- 172.21.15.63:0/2659795240 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380017070 con 0x7f03981517d0 2024-09-12T02:57:42.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f0394c00640 1 -- 172.21.15.63:0/2659795240 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038000ca00 con 0x7f03981517d0 2024-09-12T02:57:42.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f0394c00640 1 -- 172.21.15.63:0/2659795240 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038000cdd0 con 0x7f03981517d0 2024-09-12T02:57:42.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f039f200640 1 -- 172.21.15.63:0/2659795240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03981f0f70 con 0x7f03981517d0 2024-09-12T02:57:42.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f039f200640 1 -- 172.21.15.63:0/2659795240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03981f1210 con 0x7f03981517d0 2024-09-12T02:57:42.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f0394c00640 1 -- 172.21.15.63:0/2659795240 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f038001a070 con 0x7f03981517d0 2024-09-12T02:57:42.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f0394c00640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f03740678c0 0x7f0374069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f0394c00640 1 -- 172.21.15.63:0/2659795240 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0380085fd0 con 0x7f03981517d0 2024-09-12T02:57:42.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f03a25d2000 1 Processor -- start 2024-09-12T02:57:42.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f0397e00640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f03740678c0 0x7f0374069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.089+0000 7f03a25d2000 1 -- start start 2024-09-12T02:57:42.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e73f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e74283e0 0x5653e73f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e742d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5653e72d3b60 con 0x5653e7428000 2024-09-12T02:57:42.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5653e723ac70 con 0x5653e74283e0 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x5653e71e0ed0 con 0x5653e742cca0 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f03740678c0 0x7f0374069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f03880b2000 tx=0x7f03880aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e73f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e73f16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39572/0 (socket says 172.21.15.63:39572) 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 -- 172.21.15.63:0/1084244698 learned_addr learned my addr 172.21.15.63:0/1084244698 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f038f400640 1 --2- 172.21.15.63:0/1084244698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e74283e0 0x5653e73f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f039d200640 1 --2- 172.21.15.63:0/1084244698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e742d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 -- 172.21.15.63:0/1084244698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 msgr2=0x5653e742d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 --2- 172.21.15.63:0/1084244698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e742d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 -- 172.21.15.63:0/1084244698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e74283e0 msgr2=0x5653e73f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 --2- 172.21.15.63:0/1084244698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e74283e0 0x5653e73f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 -- 172.21.15.63:0/1084244698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653e71f2e50 con 0x5653e7428000 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f0397e00640 1 --2- 172.21.15.63:0/1084244698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e73f16b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f038801ecd0 tx=0x7f0388004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8855bc7ec83f8f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f038cc00640 1 -- 172.21.15.63:0/1084244698 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880b5040 con 0x5653e7428000 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f038cc00640 1 -- 172.21.15.63:0/1084244698 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03880ca070 con 0x5653e7428000 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f038cc00640 1 -- 172.21.15.63:0/1084244698 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880a8e60 con 0x5653e7428000 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 -- 172.21.15.63:0/1084244698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 msgr2=0x5653e73f16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 --2- 172.21.15.63:0/1084244698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e73f16b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f038801ecd0 tx=0x7f0388004740 comp rx=0 tx=0).stop 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 -- 172.21.15.63:0/1084244698 shutdown_connections 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 --2- 172.21.15.63:0/1084244698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e742d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 --2- 172.21.15.63:0/1084244698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e74283e0 0x5653e73f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 --2- 172.21.15.63:0/1084244698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e73f16b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 -- 172.21.15.63:0/1084244698 >> 172.21.15.63:0/1084244698 conn(0x5653e73f2350 msgr2=0x5653e742aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:42.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 -- 172.21.15.63:0/1084244698 shutdown_connections 2024-09-12T02:57:42.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 -- 172.21.15.63:0/1084244698 wait complete. 2024-09-12T02:57:42.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 -- start start 2024-09-12T02:57:42.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.093+0000 7f03a25d2000 1 Processor -- start 2024-09-12T02:57:42.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e74389d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e74283e0 0x5653e7438f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e742cca0 0x5653e7439450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5653e729cb00 con 0x5653e7428000 2024-09-12T02:57:42.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5653e7215360 con 0x5653e742cca0 2024-09-12T02:57:42.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x5653e72122d0 con 0x5653e74283e0 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 10 client.0 _ll_register_callbacks cb 0x5653e73d7820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0397e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e74389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0397e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e74389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39576/0 (socket says 172.21.15.63:39576) 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0397e00640 1 -- 172.21.15.63:0/3992893344 learned_addr learned my addr 172.21.15.63:0/3992893344 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f038f400640 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e74283e0 0x5653e7438f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f039d200640 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e742cca0 0x5653e7439450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0397e00640 1 -- 172.21.15.63:0/3992893344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e74283e0 msgr2=0x5653e7438f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0397e00640 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e74283e0 0x5653e7438f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0397e00640 1 -- 172.21.15.63:0/3992893344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e742cca0 msgr2=0x5653e7439450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0397e00640 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e742cca0 0x5653e7439450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0397e00640 1 -- 172.21.15.63:0/3992893344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653e71e1120 con 0x5653e7428000 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0397e00640 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e74389d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f03880098b0 tx=0x7f038801d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66807d2161614b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0385600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0385600640 1 -- 172.21.15.63:0/3992893344 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880b5040 con 0x5653e7428000 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0385600640 1 -- 172.21.15.63:0/3992893344 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f03880d9de0 con 0x5653e7428000 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 -- 172.21.15.63:0/3992893344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03880ca070 con 0x5653e7428000 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0385600640 1 -- 172.21.15.63:0/3992893344 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) ==== 24+0+0 (secure 0 0 0) 0x7f0388003820 con 0x5653e7428000 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 10 client.4692 fetch_fsmap learned FSMap version 10 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 -- 172.21.15.63:0/3992893344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) -- 0x5653e71da450 con 0x5653e7428000 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0385600640 1 -- 172.21.15.63:0/3992893344 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03880ca070 con 0x5653e7428000 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0385600640 1 -- 172.21.15.63:0/3992893344 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 10) ==== 4720+0+0 (secure 0 0 0) 0x7f03880039c0 con 0x5653e7428000 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 10 client.4692 fetch_fsmap finished waiting for FSMap version 10 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 10 client.4692 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T02:57:42.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 20 client.4692 populate_metadata read hostname 'smithi063' 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x5653e7440da0 0x5653e7443190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 4 client.4692 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 -- 172.21.15.63:0/3992893344 --> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653e71d4c00 con 0x5653e7440da0 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f038f400640 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x5653e7440da0 0x5653e7443190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f038f400640 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x5653e7440da0 0x5653e7443190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6377287eba56b00 server_cookie=6870ecea79e22ea9 in_seq=0 out_seq=0 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0385600640 10 client.4692 ms_handle_connect on v2:172.21.15.63:6833/2556723891 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0385600640 1 -- 172.21.15.63:0/3992893344 <== mds.0 v2:172.21.15.63:6833/2556723891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653e71d4c00 con 0x5653e7440da0 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f0385600640 10 client.4692 handle_command_reply: tid=0 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.097+0000 7f03a25d2000 1 client.4692 shutdown 2024-09-12T02:57:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 -- 172.21.15.63:0/3992893344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 msgr2=0x5653e74389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e74389d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f03880098b0 tx=0x7f038801d4d0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 -- 172.21.15.63:0/3992893344 shutdown_connections 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x5653e7440da0 0x5653e7443190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e742cca0 0x5653e7439450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e74283e0 0x5653e7438f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3992893344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e7428000 0x5653e74389d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f0385600640 0 client.4692 ms_handle_reset on v2:172.21.15.63:6833/2556723891 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 -- 172.21.15.63:0/3992893344 >> 172.21.15.63:0/3992893344 conn(0x5653e73f2350 msgr2=0x5653e742dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 -- 172.21.15.63:0/3992893344 shutdown_connections 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 1 -- 172.21.15.63:0/3992893344 wait complete. 2024-09-12T02:57:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.101+0000 7f03a25d2000 20 client.4692 trim_cache size 0 max 16384 2024-09-12T02:57:42.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.117+0000 7f03a25d2000 1 Processor -- start 2024-09-12T02:57:42.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.117+0000 7f03a25d2000 1 -- start start 2024-09-12T02:57:42.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 0x5653e73f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e7443190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e74436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f03981fca00 con 0x5653e74283e0 2024-09-12T02:57:42.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f03981fd050 con 0x5653e7428000 2024-09-12T02:57:42.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x5653e71f2ca0 con 0x5653e742cca0 2024-09-12T02:57:42.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f038f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e7443190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f038f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e7443190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39582/0 (socket says 172.21.15.63:39582) 2024-09-12T02:57:42.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f038f400640 1 -- 172.21.15.63:0/3042356570 learned_addr learned my addr 172.21.15.63:0/3042356570 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:42.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f0397e00640 1 --2- 172.21.15.63:0/3042356570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 0x5653e73f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f039d200640 1 --2- 172.21.15.63:0/3042356570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e74436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f038f400640 1 -- 172.21.15.63:0/3042356570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 msgr2=0x5653e74436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f038f400640 1 --2- 172.21.15.63:0/3042356570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e74436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f038f400640 1 -- 172.21.15.63:0/3042356570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 msgr2=0x5653e73f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f038f400640 1 --2- 172.21.15.63:0/3042356570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 0x5653e73f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f038f400640 1 -- 172.21.15.63:0/3042356570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653e71c1fd0 con 0x5653e74283e0 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f038f400640 1 --2- 172.21.15.63:0/3042356570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e7443190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0380056110 tx=0x7f0380084080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3689bd20bf9949c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f0387e00640 1 -- 172.21.15.63:0/3042356570 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380021040 con 0x5653e74283e0 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f0387e00640 1 -- 172.21.15.63:0/3042356570 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0380054480 con 0x5653e74283e0 2024-09-12T02:57:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f0387e00640 1 -- 172.21.15.63:0/3042356570 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03800527f0 con 0x5653e74283e0 2024-09-12T02:57:42.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- 172.21.15.63:0/3042356570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 msgr2=0x5653e7443190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3042356570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e7443190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0380056110 tx=0x7f0380084080 comp rx=0 tx=0).stop 2024-09-12T02:57:42.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- 172.21.15.63:0/3042356570 shutdown_connections 2024-09-12T02:57:42.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3042356570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e74436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3042356570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e7443190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3042356570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 0x5653e73f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- 172.21.15.63:0/3042356570 >> 172.21.15.63:0/3042356570 conn(0x5653e73f2350 msgr2=0x5653e73f01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:42.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- 172.21.15.63:0/3042356570 shutdown_connections 2024-09-12T02:57:42.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- 172.21.15.63:0/3042356570 wait complete. 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- start start 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 Processor -- start 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 0x5653e7446710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e74654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e74659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5653e723f2a0 con 0x5653e74283e0 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5653e7239f80 con 0x5653e7428000 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x5653e71f90f0 con 0x5653e742cca0 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.121+0000 7f03a25d2000 10 client.0 _ll_register_callbacks cb 0x7f0380052420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:57:42.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f038f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e74654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f038f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e74654a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39598/0 (socket says 172.21.15.63:39598) 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f038f400640 1 -- 172.21.15.63:0/3056644720 learned_addr learned my addr 172.21.15.63:0/3056644720 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0397e00640 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 0x5653e7446710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039d200640 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e74659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f038f400640 1 -- 172.21.15.63:0/3056644720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 msgr2=0x5653e74659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f038f400640 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e74659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f038f400640 1 -- 172.21.15.63:0/3056644720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 msgr2=0x5653e7446710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f038f400640 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 0x5653e7446710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f038f400640 1 -- 172.21.15.63:0/3056644720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653e72bd750 con 0x5653e74283e0 2024-09-12T02:57:42.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039d200640 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e74659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f038f400640 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e74654a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0380055e80 tx=0x7f038001e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1967c39b71177929 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 1 -- 172.21.15.63:0/3056644720 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380078070 con 0x5653e74283e0 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 1 -- 172.21.15.63:0/3056644720 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f038005e8d0 con 0x5653e74283e0 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 -- 172.21.15.63:0/3056644720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0380054480 con 0x5653e74283e0 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 1 -- 172.21.15.63:0/3056644720 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) ==== 24+0+0 (secure 0 0 0) 0x7f0380021030 con 0x5653e74283e0 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 10 client.4698 fetch_fsmap learned FSMap version 10 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 -- 172.21.15.63:0/3056644720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) -- 0x5653e71c8a30 con 0x5653e74283e0 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 1 -- 172.21.15.63:0/3056644720 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0380054480 con 0x5653e74283e0 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 1 -- 172.21.15.63:0/3056644720 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 10) ==== 4720+0+0 (secure 0 0 0) 0x7f038007b030 con 0x5653e74283e0 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 10 client.4698 fetch_fsmap finished waiting for FSMap version 10 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 10 client.4698 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T02:57:42.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 20 client.4698 populate_metadata read hostname 'smithi063' 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x5653e7465f20 0x5653e74a4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 4 client.4698 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 -- 172.21.15.63:0/3056644720 --> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] -- command(tid 0: {"prefix": "status"}) -- 0x5653e72483a0 con 0x5653e7465f20 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0397e00640 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x5653e7465f20 0x5653e74a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0397e00640 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x5653e7465f20 0x5653e74a4890 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b66e97a953965bd1 server_cookie=733da10f593d3b6f in_seq=0 out_seq=0 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 10 client.4698 ms_handle_connect on v2:172.21.15.63:6833/2556723891 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 1 -- 172.21.15.63:0/3056644720 <== mds.0 v2:172.21.15.63:6833/2556723891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5653e72483a0 con 0x5653e7465f20 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 10 client.4698 handle_command_reply: tid=0 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 client.4698 shutdown 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 -- 172.21.15.63:0/3056644720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 msgr2=0x5653e74654a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e74654a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0380055e80 tx=0x7f038001e040 comp rx=0 tx=0).stop 2024-09-12T02:57:42.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 -- 172.21.15.63:0/3056644720 shutdown_connections 2024-09-12T02:57:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.63:6833/2556723891,v1:172.21.15.63:6836/2556723891] conn(0x5653e7465f20 0x5653e74a4890 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5653e742cca0 0x5653e74659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5653e74283e0 0x5653e74654a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 --2- 172.21.15.63:0/3056644720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5653e7428000 0x5653e7446710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f0385600640 0 client.4698 ms_handle_reset on v2:172.21.15.63:6833/2556723891 2024-09-12T02:57:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 -- 172.21.15.63:0/3056644720 >> 172.21.15.63:0/3056644720 conn(0x5653e73f2350 msgr2=0x5653e7427690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 -- 172.21.15.63:0/3056644720 shutdown_connections 2024-09-12T02:57:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 1 -- 172.21.15.63:0/3056644720 wait complete. 2024-09-12T02:57:42.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f03a25d2000 20 client.4698 trim_cache size 0 max 16384 2024-09-12T02:57:42.137 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:42.137 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "20b0bc3b-ca7e-4b63-a9bc-3526f84b65da", 2024-09-12T02:57:42.137 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-12T02:57:42.137 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4306, 2024-09-12T02:57:42.137 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-12T02:57:42.137 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-12T02:57:42.137 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-12T02:57:42.137 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 37.284997408000002, 2024-09-12T02:57:42.137 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 10, 2024-09-12T02:57:42.138 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 26, 2024-09-12T02:57:42.138 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 26, 2024-09-12T02:57:42.138 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 42.946327521999997 2024-09-12T02:57:42.138 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039f200640 1 -- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f03740678c0 msgr2=0x7f0374069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039f200640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f03740678c0 0x7f0374069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f03880b2000 tx=0x7f03880aa070 comp rx=0 tx=0).stop 2024-09-12T02:57:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039f200640 1 -- 172.21.15.63:0/2659795240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03981517d0 msgr2=0x7f03981e4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039f200640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03981517d0 0x7f03981e4910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f038000e930 tx=0x7f038000edf0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039f200640 1 -- 172.21.15.63:0/2659795240 shutdown_connections 2024-09-12T02:57:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039f200640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f039815e340 0x7f0398147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039f200640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03981517d0 0x7f03981e4910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039f200640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f03740678c0 0x7f0374069d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.125+0000 7f039f200640 1 --2- 172.21.15.63:0/2659795240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03980c9470 0x7f03981e3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.129+0000 7f039f200640 1 -- 172.21.15.63:0/2659795240 >> 172.21.15.63:0/2659795240 conn(0x7f0398067a00 msgr2=0x7f03980ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.129+0000 7f039f200640 1 -- 172.21.15.63:0/2659795240 shutdown_connections 2024-09-12T02:57:42.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.129+0000 7f039f200640 1 -- 172.21.15.63:0/2659795240 wait complete. 2024-09-12T02:57:42.153 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:57:42.162 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:57:42.162 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:57:42.163 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:57:42.163 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T02:57:42.175 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T02:57:42.175 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T02:57:42.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:42.175 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-12T02:57:42.185 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T02:57:42.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:42.185 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:57:42.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:42.248 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-12T02:57:42.813 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-12T02:57:42.813 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:57:42.813 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:57:42.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T02:57:42.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.949+0000 7fa91e800640 1 Processor -- start 2024-09-12T02:57:42.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.949+0000 7fa91e800640 1 -- start start 2024-09-12T02:57:42.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa91e800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa918151a80 0x7fa918072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa91e800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa918074070 0x7fa918073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa91e800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9181580c0 con 0x7fa9180c2380 2024-09-12T02:57:42.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa91e800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa9180c8500 con 0x7fa918151a80 2024-09-12T02:57:42.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa91e800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa9181583a0 con 0x7fa918074070 2024-09-12T02:57:42.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa917400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa918151a80 0x7fa918072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa917400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa918151a80 0x7fa918072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39600/0 (socket says 172.21.15.63:39600) 2024-09-12T02:57:42.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa917400640 1 -- 172.21.15.63:0/4108906697 learned_addr learned my addr 172.21.15.63:0/4108906697 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:42.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa916a00640 1 --2- 172.21.15.63:0/4108906697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa918074070 0x7fa918073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa917400640 1 -- 172.21.15.63:0/4108906697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa918074070 msgr2=0x7fa918073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa917400640 1 --2- 172.21.15.63:0/4108906697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa918074070 0x7fa918073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa917400640 1 -- 172.21.15.63:0/4108906697 >> v1:172.21.15.119:6789/0 conn(0x7fa9180c2380 legacy=0x7fa91815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:42.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.953+0000 7fa917400640 1 -- 172.21.15.63:0/4108906697 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9180cbf00 con 0x7fa918151a80 2024-09-12T02:57:42.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa917400640 1 --2- 172.21.15.63:0/4108906697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 0x7fa918072e50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa9080098a0 tx=0x7fa90801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f527a37ca621c517 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa916000640 1 -- 172.21.15.63:0/4108906697 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9080b5070 con 0x7fa918151a80 2024-09-12T02:57:42.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa916000640 1 -- 172.21.15.63:0/4108906697 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9080a8a30 con 0x7fa918151a80 2024-09-12T02:57:42.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa916000640 1 -- 172.21.15.63:0/4108906697 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9080a8e00 con 0x7fa918151a80 2024-09-12T02:57:42.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 -- 172.21.15.63:0/4108906697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 msgr2=0x7fa918072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 --2- 172.21.15.63:0/4108906697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 0x7fa918072e50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa9080098a0 tx=0x7fa90801ed30 comp rx=0 tx=0).stop 2024-09-12T02:57:42.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 -- 172.21.15.63:0/4108906697 shutdown_connections 2024-09-12T02:57:42.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 --2- 172.21.15.63:0/4108906697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa918074070 0x7fa918073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 --2- 172.21.15.63:0/4108906697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 0x7fa918072e50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 -- 172.21.15.63:0/4108906697 >> 172.21.15.63:0/4108906697 conn(0x7fa91806f3d0 msgr2=0x7fa91806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:42.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 -- 172.21.15.63:0/4108906697 shutdown_connections 2024-09-12T02:57:42.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 -- 172.21.15.63:0/4108906697 wait complete. 2024-09-12T02:57:42.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 Processor -- start 2024-09-12T02:57:42.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.957+0000 7fa91e800640 1 -- start start 2024-09-12T02:57:42.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa91e800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa918074070 0x7fa918147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa91e800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9180c2380 0x7fa9181f1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa91e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 0x7fa9180c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa91e800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa9180c81f0 con 0x7fa918151a80 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa91e800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa9180cc4c0 con 0x7fa918074070 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa91e800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa9180c7cf0 con 0x7fa9180c2380 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 0x7fa9180c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 0x7fa9180c29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39616/0 (socket says 172.21.15.63:39616) 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917e00640 1 -- 172.21.15.63:0/1618220199 learned_addr learned my addr 172.21.15.63:0/1618220199 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917400640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa918074070 0x7fa918147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa916a00640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9180c2380 0x7fa9181f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917e00640 1 -- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9180c2380 msgr2=0x7fa9181f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917e00640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9180c2380 0x7fa9181f1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917e00640 1 -- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa918074070 msgr2=0x7fa918147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:42.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917e00640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa918074070 0x7fa918147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:42.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917e00640 1 -- 172.21.15.63:0/1618220199 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa918155640 con 0x7fa918151a80 2024-09-12T02:57:42.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa916a00640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9180c2380 0x7fa9181f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:42.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa917e00640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 0x7fa9180c29c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa91000c770 tx=0x7fa91000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa90f400640 1 -- 172.21.15.63:0/1618220199 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910003b80 con 0x7fa918151a80 2024-09-12T02:57:42.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa90f400640 1 -- 172.21.15.63:0/1618220199 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa910003d20 con 0x7fa918151a80 2024-09-12T02:57:42.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9181f1640 con 0x7fa918151a80 2024-09-12T02:57:42.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa90f400640 1 -- 172.21.15.63:0/1618220199 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91000aa90 con 0x7fa918151a80 2024-09-12T02:57:42.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9181f0900 con 0x7fa918151a80 2024-09-12T02:57:42.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa918155b20 con 0x7fa918151a80 2024-09-12T02:57:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.961+0000 7fa90f400640 1 -- 172.21.15.63:0/1618220199 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa91000ac30 con 0x7fa918151a80 2024-09-12T02:57:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.965+0000 7fa90f400640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8f80678c0 0x7fa8f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.965+0000 7fa90f400640 1 -- 172.21.15.63:0/1618220199 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa910085e70 con 0x7fa918151a80 2024-09-12T02:57:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.965+0000 7fa917400640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8f80678c0 0x7fa8f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:42.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.965+0000 7fa917400640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8f80678c0 0x7fa8f8069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa9080b2000 tx=0x7fa908008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:42.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:42.969+0000 7fa90f400640 1 -- 172.21.15.63:0/1618220199 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa910056660 con 0x7fa918151a80 2024-09-12T02:57:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa9181f06f0 con 0x7fa918151a80 2024-09-12T02:57:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa90f400640 1 -- 172.21.15.63:0/1618220199 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) ==== 53+0+88 (secure 0 0 0) 0x7fa910055f60 con 0x7fa918151a80 2024-09-12T02:57:43.172 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:57:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8f80678c0 msgr2=0x7fa8f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8f80678c0 0x7fa8f8069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa9080b2000 tx=0x7fa908008040 comp rx=0 tx=0).stop 2024-09-12T02:57:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 msgr2=0x7fa9180c29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 0x7fa9180c29c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa91000c770 tx=0x7fa91000cc30 comp rx=0 tx=0).stop 2024-09-12T02:57:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 shutdown_connections 2024-09-12T02:57:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa918151a80 0x7fa9180c29c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8f80678c0 0x7fa8f8069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9180c2380 0x7fa9181f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 --2- 172.21.15.63:0/1618220199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa918074070 0x7fa918147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 >> 172.21.15.63:0/1618220199 conn(0x7fa91806f3d0 msgr2=0x7fa918150210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 shutdown_connections 2024-09-12T02:57:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43.169+0000 7fa91e800640 1 -- 172.21.15.63:0/1618220199 wait complete. 2024-09-12T02:57:43.193 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:57:43.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:57:43.193 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-12T02:57:43.193 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:57:43.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T02:57:43.193 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:57:43.194 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:57:43.194 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:57:43.194 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:57:43.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:43.194 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:43.203 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 02:42:32:db:8c:43 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T02:57:43.204 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:57:43.205 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:57:43.205 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:43.206 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:43.206 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:57:43.206 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-09-12T02:57:43.206 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-09-12T02:57:43.206 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:57:43.206 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:43.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:43.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:43.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:43.362 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:57:43.381 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-12T02:57:43.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:43.384 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T02:57:43.442 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:57:43.443 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:43.443 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:43.443 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:57:43.443 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:57:43.443 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:57:43.443 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:43.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:43.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:43.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:43.582 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-12T02:57:43.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:43.592 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-09-12T02:57:43.646 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:43.647 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:43.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:57:43.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T02:57:43.647 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:43.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:43.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:43.780 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T02:57:43.780 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:43.780 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:43.780 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T02:57:43.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:57:43.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T02:57:43.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T02:57:43.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T02:57:43.781 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:43.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:43.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:43.964 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:57:43.964 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-12T02:57:43.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-09-12T02:57:43.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:57:43.964 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-12T02:57:44.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:44.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:44.051 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:57:44.052 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T02:57:44.102 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T02:57:44.103 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:57:44.103 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:57:44.154 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T02:57:44.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:44.154 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:57:44.247 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:57:44.247 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:57:44.940 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T02:57:44.940 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T02:57:44.940 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.119:3300,172.21.15.119:3301" 2024-09-12T02:57:44.940 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 0@20b0bc3b-ca7e-4b63-a9bc-3526f84b65da.cephfs=/ 2024-09-12T02:57:44.940 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.63:3300/172.21.15.119:3300/172.21.15.119:3301" will pass to kernel 2024-09-12T02:57:44.944 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:57:44.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:57:44.944 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T02:57:44.965 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:57:45.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:57:45.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:45.071 INFO:teuthology.orchestra.run.smithi063.stdout:client4707 2024-09-12T02:57:45.071 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:57:45.072 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:57:45.080 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:57:45.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:57:45.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:45.184 INFO:teuthology.orchestra.run.smithi063.stdout:client4707 2024-09-12T02:57:45.184 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:57:45.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:57:45.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:45.283 INFO:teuthology.orchestra.run.smithi063.stdout:client4707 2024-09-12T02:57:45.284 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/20b0bc3b-ca7e-4b63-a9bc-3526f84b65da.client4707/status') 2024-09-12T02:57:45.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:57:45.390 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4707 (3)192.168.0.1:0/1242324243 2024-09-12T02:57:45.390 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2024-09-12T02:57:45.390 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2024-09-12T02:57:45.390 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2024-09-12T02:57:45.390 INFO:teuthology.orchestra.run.smithi063.stderr:69 bytes copied, 5.6405e-05 s, 1.2 MB/s 2024-09-12T02:57:45.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:57:45.398 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T02:57:45.425 INFO:tasks.thrashosds:config is {'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T02:57:45.426 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'but it is still running', 'objects unfound and apparently lost', 'MDS_SLOW_METADATA_IO', 'MDS_TRIM'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}} 2024-09-12T02:57:45.426 INFO:tasks.thrashosds:config is {'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T02:57:45.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T02:57:45.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.577+0000 7f9768a00640 1 Processor -- start 2024-09-12T02:57:45.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.577+0000 7f9768a00640 1 -- start start 2024-09-12T02:57:45.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9768a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f97641518b0 0x7f97640730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9768a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f976406f9a0 0x7f9764073630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9768a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 0x7f976415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9768a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f97640741f0 con 0x7f97641518b0 2024-09-12T02:57:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9768a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f976406d910 con 0x7f976406f9a0 2024-09-12T02:57:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9768a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f976406dbf0 con 0x7f9764073c90 2024-09-12T02:57:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9762800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f97641518b0 0x7f97640730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9762800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f97641518b0 0x7f97640730f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56866/0 (socket says 172.21.15.63:56866) 2024-09-12T02:57:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9762800640 1 -- 172.21.15.63:0/3245508521 learned_addr learned my addr 172.21.15.63:0/3245508521 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f975be00640 1 --2- 172.21.15.63:0/3245508521 >> v2:172.21.15.119:3300/0 conn(0x7f976406f9a0 0x7f9764073630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9763200640 1 --2- 172.21.15.63:0/3245508521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 0x7f976415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9762800640 1 -- 172.21.15.63:0/3245508521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 msgr2=0x7f976415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9762800640 1 --2- 172.21.15.63:0/3245508521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 0x7f976415aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9762800640 1 -- 172.21.15.63:0/3245508521 >> v2:172.21.15.119:3300/0 conn(0x7f976406f9a0 msgr2=0x7f9764073630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:45.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9762800640 1 --2- 172.21.15.63:0/3245508521 >> v2:172.21.15.119:3300/0 conn(0x7f976406f9a0 0x7f9764073630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9762800640 1 -- 172.21.15.63:0/3245508521 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97640728f0 con 0x7f97641518b0 2024-09-12T02:57:45.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.581+0000 7f9762800640 1 --2- 172.21.15.63:0/3245508521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 0x7f97640730f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97641551b0 tx=0x7f975401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ead9842532c7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:45.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9761e00640 1 -- 172.21.15.63:0/3245508521 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97540b0070 con 0x7f97641518b0 2024-09-12T02:57:45.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9761e00640 1 -- 172.21.15.63:0/3245508521 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97540ab600 con 0x7f97641518b0 2024-09-12T02:57:45.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9761e00640 1 -- 172.21.15.63:0/3245508521 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97540ab9d0 con 0x7f97641518b0 2024-09-12T02:57:45.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 -- 172.21.15.63:0/3245508521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 msgr2=0x7f97640730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:45.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 --2- 172.21.15.63:0/3245508521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 0x7f97640730f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97641551b0 tx=0x7f975401c490 comp rx=0 tx=0).stop 2024-09-12T02:57:45.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 -- 172.21.15.63:0/3245508521 shutdown_connections 2024-09-12T02:57:45.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 --2- 172.21.15.63:0/3245508521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 0x7f976415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 --2- 172.21.15.63:0/3245508521 >> v2:172.21.15.119:3300/0 conn(0x7f976406f9a0 0x7f9764073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 --2- 172.21.15.63:0/3245508521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 0x7f97640730f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 -- 172.21.15.63:0/3245508521 >> 172.21.15.63:0/3245508521 conn(0x7f97640c9a80 msgr2=0x7f97640c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:45.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 -- 172.21.15.63:0/3245508521 shutdown_connections 2024-09-12T02:57:45.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 -- 172.21.15.63:0/3245508521 wait complete. 2024-09-12T02:57:45.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 Processor -- start 2024-09-12T02:57:45.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 -- start start 2024-09-12T02:57:45.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f976406f9a0 0x7f9764156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 0x7f9764146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 0x7f97641457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9764157700 con 0x7f97641518b0 2024-09-12T02:57:45.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9764157580 con 0x7f976406f9a0 2024-09-12T02:57:45.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9768a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9764157880 con 0x7f9764073c90 2024-09-12T02:57:45.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9763200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 0x7f97641457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9763200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 0x7f97641457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56872/0 (socket says 172.21.15.63:56872) 2024-09-12T02:57:45.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9763200640 1 -- 172.21.15.63:0/2926700093 learned_addr learned my addr 172.21.15.63:0/2926700093 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:45.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9762800640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f976406f9a0 0x7f9764156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f975be00640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 0x7f9764146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9763200640 1 -- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 msgr2=0x7f9764146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:45.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9763200640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 0x7f9764146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9763200640 1 -- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f976406f9a0 msgr2=0x7f9764156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:45.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9763200640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f976406f9a0 0x7f9764156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.585+0000 7f9763200640 1 -- 172.21.15.63:0/2926700093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9764157350 con 0x7f97641518b0 2024-09-12T02:57:45.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f9763200640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 0x7f97641457d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f975c007e60 tx=0x7f975c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:45.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f975aa00640 1 -- 172.21.15.63:0/2926700093 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c014620 con 0x7f97641518b0 2024-09-12T02:57:45.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f975aa00640 1 -- 172.21.15.63:0/2926700093 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f975c019070 con 0x7f97641518b0 2024-09-12T02:57:45.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f975aa00640 1 -- 172.21.15.63:0/2926700093 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c014a00 con 0x7f97641518b0 2024-09-12T02:57:45.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9764155d50 con 0x7f97641518b0 2024-09-12T02:57:45.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9764155870 con 0x7f97641518b0 2024-09-12T02:57:45.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976415aaf0 con 0x7f97641518b0 2024-09-12T02:57:45.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f975aa00640 1 -- 172.21.15.63:0/2926700093 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f975c014ba0 con 0x7f97641518b0 2024-09-12T02:57:45.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f975aa00640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f97400678c0 0x7f9740069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.589+0000 7f975aa00640 1 -- 172.21.15.63:0/2926700093 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f975c086830 con 0x7f97641518b0 2024-09-12T02:57:45.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.593+0000 7f9762800640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f97400678c0 0x7f9740069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.593+0000 7f9762800640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f97400678c0 0x7f9740069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f97540ad000 tx=0x7f9754008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:45.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.597+0000 7f975aa00640 1 -- 172.21.15.63:0/2926700093 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f975c0568b0 con 0x7f97641518b0 2024-09-12T02:57:45.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.765+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mgr_debug_aggressive_pg_num_changes}] v 0) -- 0x7f97641614e0 con 0x7f97641518b0 2024-09-12T02:57:45.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f975aa00640 1 -- 172.21.15.63:0/2926700093 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr_debug_aggressive_pg_num_changes}]=0 v10)=0 v10) ==== 136+0+0 (secure 0 0 0) 0x7f975c05abb0 con 0x7f97641518b0 2024-09-12T02:57:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f97400678c0 msgr2=0x7f9740069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f97400678c0 0x7f9740069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f97540ad000 tx=0x7f9754008040 comp rx=0 tx=0).stop 2024-09-12T02:57:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 msgr2=0x7f97641457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 0x7f97641457d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f975c007e60 tx=0x7f975c00e4b0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 shutdown_connections 2024-09-12T02:57:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97641518b0 0x7f97641457d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f97400678c0 0x7f9740069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9764073c90 0x7f9764146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 --2- 172.21.15.63:0/2926700093 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f976406f9a0 0x7f9764156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 >> 172.21.15.63:0/2926700093 conn(0x7f97640c9a80 msgr2=0x7f97640c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:45.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 shutdown_connections 2024-09-12T02:57:45.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.769+0000 7f9768a00640 1 -- 172.21.15.63:0/2926700093 wait complete. 2024-09-12T02:57:45.793 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T02:57:45.793 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:57:45.793 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:57:45.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.929+0000 7f744f800640 1 Processor -- start 2024-09-12T02:57:45.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744f800640 1 -- start start 2024-09-12T02:57:45.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744f800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 0x7f744806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744f800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74480c9670 0x7f744806f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744f800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74480cdc90 con 0x7f74481529f0 2024-09-12T02:57:45.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744f800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f744806c7f0 con 0x7f74480c9670 2024-09-12T02:57:45.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744f800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f74480c7b40 con 0x7f74480ca870 2024-09-12T02:57:45.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744d800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74480c9670 0x7f744806f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744d800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f74480c9670 0x7f744806f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56880/0 (socket says 172.21.15.63:56880) 2024-09-12T02:57:45.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744d800640 1 -- 172.21.15.63:0/4290393894 learned_addr learned my addr 172.21.15.63:0/4290393894 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:45.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f743fe00640 1 --2- 172.21.15.63:0/4290393894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 0x7f744806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744d800640 1 -- 172.21.15.63:0/4290393894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 msgr2=0x7f744806ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:45.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744d800640 1 --2- 172.21.15.63:0/4290393894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 0x7f744806ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744d800640 1 -- 172.21.15.63:0/4290393894 >> v1:172.21.15.119:6789/0 conn(0x7f74481529f0 legacy=0x7f74480c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:45.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.933+0000 7f744d800640 1 -- 172.21.15.63:0/4290393894 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74480c7e20 con 0x7f74480c9670 2024-09-12T02:57:45.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744d800640 1 --2- 172.21.15.63:0/4290393894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74480c9670 0x7f744806f010 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7440009e50 tx=0x7f744001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c24732d497bff5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:45.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f7447e00640 1 -- 172.21.15.63:0/4290393894 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74400b4070 con 0x7f74480c9670 2024-09-12T02:57:45.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f7447e00640 1 -- 172.21.15.63:0/4290393894 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74400af400 con 0x7f74480c9670 2024-09-12T02:57:45.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f7447e00640 1 -- 172.21.15.63:0/4290393894 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74400af7d0 con 0x7f74480c9670 2024-09-12T02:57:45.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 -- 172.21.15.63:0/4290393894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74480c9670 msgr2=0x7f744806f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:45.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 --2- 172.21.15.63:0/4290393894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74480c9670 0x7f744806f010 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7440009e50 tx=0x7f744001f210 comp rx=0 tx=0).stop 2024-09-12T02:57:45.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 -- 172.21.15.63:0/4290393894 shutdown_connections 2024-09-12T02:57:45.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 --2- 172.21.15.63:0/4290393894 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74480c9670 0x7f744806f010 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 --2- 172.21.15.63:0/4290393894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 0x7f744806ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 -- 172.21.15.63:0/4290393894 >> 172.21.15.63:0/4290393894 conn(0x7f7448072960 msgr2=0x7f7448072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:45.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 -- 172.21.15.63:0/4290393894 shutdown_connections 2024-09-12T02:57:45.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 -- 172.21.15.63:0/4290393894 wait complete. 2024-09-12T02:57:45.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 Processor -- start 2024-09-12T02:57:45.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.937+0000 7f744f800640 1 -- start start 2024-09-12T02:57:45.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744f800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74480c9670 0x7f74481f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744f800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 0x7f74481f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744f800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74481529f0 0x7f7448148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744f800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f74480c3f60 con 0x7f74481529f0 2024-09-12T02:57:45.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744f800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f744806ca80 con 0x7f74480c9670 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744f800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f74481e2960 con 0x7f74480ca870 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74481529f0 0x7f7448148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74481529f0 0x7f7448148930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56890/0 (socket says 172.21.15.63:56890) 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744d800640 1 -- 172.21.15.63:0/2856660023 learned_addr learned my addr 172.21.15.63:0/2856660023 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f743fe00640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 0x7f74481f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744ce00640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74480c9670 0x7f74481f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744d800640 1 -- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 msgr2=0x7f74481f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744d800640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 0x7f74481f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744d800640 1 -- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74480c9670 msgr2=0x7f74481f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744d800640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74480c9670 0x7f74481f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744d800640 1 -- 172.21.15.63:0/2856660023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744815a4f0 con 0x7f74481529f0 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744d800640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74481529f0 0x7f7448148930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f744001ce40 tx=0x7f744001bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:45.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f7445600640 1 -- 172.21.15.63:0/2856660023 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74400b4040 con 0x7f74481529f0 2024-09-12T02:57:45.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f7445600640 1 -- 172.21.15.63:0/2856660023 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74400afd00 con 0x7f74481529f0 2024-09-12T02:57:45.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744815a7d0 con 0x7f74481529f0 2024-09-12T02:57:45.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f7445600640 1 -- 172.21.15.63:0/2856660023 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7440009510 con 0x7f74481529f0 2024-09-12T02:57:45.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744815ad90 con 0x7f74481529f0 2024-09-12T02:57:45.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.941+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7448152dd0 con 0x7f74481529f0 2024-09-12T02:57:45.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.945+0000 7f7445600640 1 -- 172.21.15.63:0/2856660023 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f74400c2020 con 0x7f74481529f0 2024-09-12T02:57:45.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.945+0000 7f7445600640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f74240678f0 0x7f7424069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:45.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.945+0000 7f7445600640 1 -- 172.21.15.63:0/2856660023 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f74401238a0 con 0x7f74481529f0 2024-09-12T02:57:45.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.945+0000 7f744ce00640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f74240678f0 0x7f7424069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:45.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.945+0000 7f744ce00640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f74240678f0 0x7f7424069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7438001650 tx=0x7f7438009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:45.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:45.949+0000 7f7445600640 1 -- 172.21.15.63:0/2856660023 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f74400c9020 con 0x7f74481529f0 2024-09-12T02:57:46.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.113+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7448150c00 con 0x7f74240678f0 2024-09-12T02:57:46.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.137+0000 7f7445600640 1 -- 172.21.15.63:0/2856660023 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7f7448150c00 con 0x7f74240678f0 2024-09-12T02:57:46.144 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:46.147 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:57:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f74240678f0 msgr2=0x7f7424069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f74240678f0 0x7f7424069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7438001650 tx=0x7f7438009040 comp rx=0 tx=0).stop 2024-09-12T02:57:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74481529f0 msgr2=0x7f7448148930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74481529f0 0x7f7448148930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f744001ce40 tx=0x7f744001bfb0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 shutdown_connections 2024-09-12T02:57:46.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f74481529f0 0x7f7448148930 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f74240678f0 0x7f7424069db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74480ca870 0x7f74481f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 --2- 172.21.15.63:0/2856660023 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74480c9670 0x7f74481f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 >> 172.21.15.63:0/2856660023 conn(0x7f7448072960 msgr2=0x7f74480cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 shutdown_connections 2024-09-12T02:57:46.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.141+0000 7f744f800640 1 -- 172.21.15.63:0/2856660023 wait complete. 2024-09-12T02:57:46.164 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-09-12T02:57:45.762233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2049012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005484"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886709+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:57:09.886709+0000","last_peered":"2024-09-12T02:57:09.886709+0000","last_clean":"2024-09-12T02:57:09.886709+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:57:09.886709+0000","last_undegraded":"2024-09-12T02:57:09.886709+0000","last_fullsized":"2024-09-12T02:57:09.886709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872098+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:57:09.872098+0000","last_peered":"2024-09-12T02:57:09.872098+0000","last_clean":"2024-09-12T02:57:09.872098+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:57:09.872098+0000","last_undegraded":"2024-09-12T02:57:09.872098+0000","last_fullsized":"2024-09-12T02:57:09.872098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871428+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:57:09.871428+0000","last_peered":"2024-09-12T02:57:09.871428+0000","last_clean":"2024-09-12T02:57:09.871428+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:57:09.871428+0000","last_undegraded":"2024-09-12T02:57:09.871428+0000","last_fullsized":"2024-09-12T02:57:09.871428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872215+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:57:09.872215+0000","last_peered":"2024-09-12T02:57:09.872215+0000","last_clean":"2024-09-12T02:57:09.872215+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:57:09.872215+0000","last_undegraded":"2024-09-12T02:57:09.872215+0000","last_fullsized":"2024-09-12T02:57:09.872215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886576+0000","last_change":"2024-09-12T02:57:04.882473+0000","last_active":"2024-09-12T02:57:09.886576+0000","last_peered":"2024-09-12T02:57:09.886576+0000","last_clean":"2024-09-12T02:57:09.886576+0000","last_became_active":"2024-09-12T02:57:04.882182+0000","last_became_peered":"2024-09-12T02:57:04.882182+0000","last_unstale":"2024-09-12T02:57:09.886576+0000","last_undegraded":"2024-09-12T02:57:09.886576+0000","last_fullsized":"2024-09-12T02:57:09.886576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367426+0000","last_change":"2024-09-12T02:57:08.878799+0000","last_active":"2024-09-12T02:57:10.367426+0000","last_peered":"2024-09-12T02:57:10.367426+0000","last_clean":"2024-09-12T02:57:10.367426+0000","last_became_active":"2024-09-12T02:57:08.877274+0000","last_became_peered":"2024-09-12T02:57:08.877274+0000","last_unstale":"2024-09-12T02:57:10.367426+0000","last_undegraded":"2024-09-12T02:57:10.367426+0000","last_fullsized":"2024-09-12T02:57:10.367426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:27.611325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346487+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:57:10.346487+0000","last_peered":"2024-09-12T02:57:10.346487+0000","last_clean":"2024-09-12T02:57:10.346487+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:57:10.346487+0000","last_undegraded":"2024-09-12T02:57:10.346487+0000","last_fullsized":"2024-09-12T02:57:10.346487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875248+0000","last_change":"2024-09-12T02:57:04.875312+0000","last_active":"2024-09-12T02:57:09.875248+0000","last_peered":"2024-09-12T02:57:09.875248+0000","last_clean":"2024-09-12T02:57:09.875248+0000","last_became_active":"2024-09-12T02:57:04.863748+0000","last_became_peered":"2024-09-12T02:57:04.863748+0000","last_unstale":"2024-09-12T02:57:09.875248+0000","last_undegraded":"2024-09-12T02:57:09.875248+0000","last_fullsized":"2024-09-12T02:57:09.875248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:39.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368200+0000","last_change":"2024-09-12T02:57:08.888677+0000","last_active":"2024-09-12T02:57:10.368200+0000","last_peered":"2024-09-12T02:57:10.368200+0000","last_clean":"2024-09-12T02:57:10.368200+0000","last_became_active":"2024-09-12T02:57:08.875948+0000","last_became_peered":"2024-09-12T02:57:08.875948+0000","last_unstale":"2024-09-12T02:57:10.368200+0000","last_undegraded":"2024-09-12T02:57:10.368200+0000","last_fullsized":"2024-09-12T02:57:10.368200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.194444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345910+0000","last_change":"2024-09-12T02:57:03.832933+0000","last_active":"2024-09-12T02:57:10.345910+0000","last_peered":"2024-09-12T02:57:10.345910+0000","last_clean":"2024-09-12T02:57:10.345910+0000","last_became_active":"2024-09-12T02:57:03.832253+0000","last_became_peered":"2024-09-12T02:57:03.832253+0000","last_unstale":"2024-09-12T02:57:10.345910+0000","last_undegraded":"2024-09-12T02:57:10.345910+0000","last_fullsized":"2024-09-12T02:57:10.345910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877844+0000","last_change":"2024-09-12T02:57:04.880036+0000","last_active":"2024-09-12T02:57:09.877844+0000","last_peered":"2024-09-12T02:57:09.877844+0000","last_clean":"2024-09-12T02:57:09.877844+0000","last_became_active":"2024-09-12T02:57:04.879490+0000","last_became_peered":"2024-09-12T02:57:04.879490+0000","last_unstale":"2024-09-12T02:57:09.877844+0000","last_undegraded":"2024-09-12T02:57:09.877844+0000","last_fullsized":"2024-09-12T02:57:09.877844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.579939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367568+0000","last_change":"2024-09-12T02:57:08.890508+0000","last_active":"2024-09-12T02:57:10.367568+0000","last_peered":"2024-09-12T02:57:10.367568+0000","last_clean":"2024-09-12T02:57:10.367568+0000","last_became_active":"2024-09-12T02:57:08.886515+0000","last_became_peered":"2024-09-12T02:57:08.886515+0000","last_unstale":"2024-09-12T02:57:10.367568+0000","last_undegraded":"2024-09-12T02:57:10.367568+0000","last_fullsized":"2024-09-12T02:57:10.367568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:28.963220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875670+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:57:09.875670+0000","last_peered":"2024-09-12T02:57:09.875670+0000","last_clean":"2024-09-12T02:57:09.875670+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:57:09.875670+0000","last_undegraded":"2024-09-12T02:57:09.875670+0000","last_fullsized":"2024-09-12T02:57:09.875670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346531+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:57:10.346531+0000","last_peered":"2024-09-12T02:57:10.346531+0000","last_clean":"2024-09-12T02:57:10.346531+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:57:10.346531+0000","last_undegraded":"2024-09-12T02:57:10.346531+0000","last_fullsized":"2024-09-12T02:57:10.346531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368605+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:57:10.368605+0000","last_peered":"2024-09-12T02:57:10.368605+0000","last_clean":"2024-09-12T02:57:10.368605+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:57:10.368605+0000","last_undegraded":"2024-09-12T02:57:10.368605+0000","last_fullsized":"2024-09-12T02:57:10.368605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871686+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:57:09.871686+0000","last_peered":"2024-09-12T02:57:09.871686+0000","last_clean":"2024-09-12T02:57:09.871686+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:57:09.871686+0000","last_undegraded":"2024-09-12T02:57:09.871686+0000","last_fullsized":"2024-09-12T02:57:09.871686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366516+0000","last_change":"2024-09-12T02:57:03.790544+0000","last_active":"2024-09-12T02:57:10.366516+0000","last_peered":"2024-09-12T02:57:10.366516+0000","last_clean":"2024-09-12T02:57:10.366516+0000","last_became_active":"2024-09-12T02:57:03.790195+0000","last_became_peered":"2024-09-12T02:57:03.790195+0000","last_unstale":"2024-09-12T02:57:10.366516+0000","last_undegraded":"2024-09-12T02:57:10.366516+0000","last_fullsized":"2024-09-12T02:57:10.366516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368276+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:57:10.368276+0000","last_peered":"2024-09-12T02:57:10.368276+0000","last_clean":"2024-09-12T02:57:10.368276+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:57:10.368276+0000","last_undegraded":"2024-09-12T02:57:10.368276+0000","last_fullsized":"2024-09-12T02:57:10.368276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871830+0000","last_change":"2024-09-12T02:57:04.835949+0000","last_active":"2024-09-12T02:57:09.871830+0000","last_peered":"2024-09-12T02:57:09.871830+0000","last_clean":"2024-09-12T02:57:09.871830+0000","last_became_active":"2024-09-12T02:57:04.835628+0000","last_became_peered":"2024-09-12T02:57:04.835628+0000","last_unstale":"2024-09-12T02:57:09.871830+0000","last_undegraded":"2024-09-12T02:57:09.871830+0000","last_fullsized":"2024-09-12T02:57:09.871830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366134+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:57:10.366134+0000","last_peered":"2024-09-12T02:57:10.366134+0000","last_clean":"2024-09-12T02:57:10.366134+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:57:10.366134+0000","last_undegraded":"2024-09-12T02:57:10.366134+0000","last_fullsized":"2024-09-12T02:57:10.366134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367370+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:57:10.367370+0000","last_peered":"2024-09-12T02:57:10.367370+0000","last_clean":"2024-09-12T02:57:10.367370+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:57:10.367370+0000","last_undegraded":"2024-09-12T02:57:10.367370+0000","last_fullsized":"2024-09-12T02:57:10.367370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367963+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:57:10.367963+0000","last_peered":"2024-09-12T02:57:10.367963+0000","last_clean":"2024-09-12T02:57:10.367963+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:57:10.367963+0000","last_undegraded":"2024-09-12T02:57:10.367963+0000","last_fullsized":"2024-09-12T02:57:10.367963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345073+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:57:10.345073+0000","last_peered":"2024-09-12T02:57:10.345073+0000","last_clean":"2024-09-12T02:57:10.345073+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:57:10.345073+0000","last_undegraded":"2024-09-12T02:57:10.345073+0000","last_fullsized":"2024-09-12T02:57:10.345073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368760+0000","last_change":"2024-09-12T02:57:08.881925+0000","last_active":"2024-09-12T02:57:10.368760+0000","last_peered":"2024-09-12T02:57:10.368760+0000","last_clean":"2024-09-12T02:57:10.368760+0000","last_became_active":"2024-09-12T02:57:08.880913+0000","last_became_peered":"2024-09-12T02:57:08.880913+0000","last_unstale":"2024-09-12T02:57:10.368760+0000","last_undegraded":"2024-09-12T02:57:10.368760+0000","last_fullsized":"2024-09-12T02:57:10.368760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:48.637854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885883+0000","last_change":"2024-09-12T02:57:04.837566+0000","last_active":"2024-09-12T02:57:09.885883+0000","last_peered":"2024-09-12T02:57:09.885883+0000","last_clean":"2024-09-12T02:57:09.885883+0000","last_became_active":"2024-09-12T02:57:04.837281+0000","last_became_peered":"2024-09-12T02:57:04.837281+0000","last_unstale":"2024-09-12T02:57:09.885883+0000","last_undegraded":"2024-09-12T02:57:09.885883+0000","last_fullsized":"2024-09-12T02:57:09.885883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:23.664487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.878159+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:57:09.878159+0000","last_peered":"2024-09-12T02:57:09.878159+0000","last_clean":"2024-09-12T02:57:09.878159+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:57:09.878159+0000","last_undegraded":"2024-09-12T02:57:09.878159+0000","last_fullsized":"2024-09-12T02:57:09.878159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367595+0000","last_change":"2024-09-12T02:57:09.038564+0000","last_active":"2024-09-12T02:57:10.367595+0000","last_peered":"2024-09-12T02:57:10.367595+0000","last_clean":"2024-09-12T02:57:10.367595+0000","last_became_active":"2024-09-12T02:57:09.036310+0000","last_became_peered":"2024-09-12T02:57:09.036310+0000","last_unstale":"2024-09-12T02:57:10.367595+0000","last_undegraded":"2024-09-12T02:57:10.367595+0000","last_fullsized":"2024-09-12T02:57:10.367595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.627698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872469+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:57:09.872469+0000","last_peered":"2024-09-12T02:57:09.872469+0000","last_clean":"2024-09-12T02:57:09.872469+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:57:09.872469+0000","last_undegraded":"2024-09-12T02:57:09.872469+0000","last_fullsized":"2024-09-12T02:57:09.872469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367376+0000","last_change":"2024-09-12T02:57:03.809884+0000","last_active":"2024-09-12T02:57:10.367376+0000","last_peered":"2024-09-12T02:57:10.367376+0000","last_clean":"2024-09-12T02:57:10.367376+0000","last_became_active":"2024-09-12T02:57:03.809610+0000","last_became_peered":"2024-09-12T02:57:03.809610+0000","last_unstale":"2024-09-12T02:57:10.367376+0000","last_undegraded":"2024-09-12T02:57:10.367376+0000","last_fullsized":"2024-09-12T02:57:10.367376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871306+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:57:09.871306+0000","last_peered":"2024-09-12T02:57:09.871306+0000","last_clean":"2024-09-12T02:57:09.871306+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:57:09.871306+0000","last_undegraded":"2024-09-12T02:57:09.871306+0000","last_fullsized":"2024-09-12T02:57:09.871306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366942+0000","last_change":"2024-09-12T02:57:04.837330+0000","last_active":"2024-09-12T02:57:10.366942+0000","last_peered":"2024-09-12T02:57:10.366942+0000","last_clean":"2024-09-12T02:57:10.366942+0000","last_became_active":"2024-09-12T02:57:04.836984+0000","last_became_peered":"2024-09-12T02:57:04.836984+0000","last_unstale":"2024-09-12T02:57:10.366942+0000","last_undegraded":"2024-09-12T02:57:10.366942+0000","last_fullsized":"2024-09-12T02:57:10.366942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346664+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:57:10.346664+0000","last_peered":"2024-09-12T02:57:10.346664+0000","last_clean":"2024-09-12T02:57:10.346664+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:57:10.346664+0000","last_undegraded":"2024-09-12T02:57:10.346664+0000","last_fullsized":"2024-09-12T02:57:10.346664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885339+0000","last_change":"2024-09-12T02:57:09.025446+0000","last_active":"2024-09-12T02:57:09.885339+0000","last_peered":"2024-09-12T02:57:09.885339+0000","last_clean":"2024-09-12T02:57:09.885339+0000","last_became_active":"2024-09-12T02:57:09.025008+0000","last_became_peered":"2024-09-12T02:57:09.025008+0000","last_unstale":"2024-09-12T02:57:09.885339+0000","last_undegraded":"2024-09-12T02:57:09.885339+0000","last_fullsized":"2024-09-12T02:57:09.885339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877996+0000","last_change":"2024-09-12T02:57:04.861898+0000","last_active":"2024-09-12T02:57:09.877996+0000","last_peered":"2024-09-12T02:57:09.877996+0000","last_clean":"2024-09-12T02:57:09.877996+0000","last_became_active":"2024-09-12T02:57:04.858339+0000","last_became_peered":"2024-09-12T02:57:04.858339+0000","last_unstale":"2024-09-12T02:57:09.877996+0000","last_undegraded":"2024-09-12T02:57:09.877996+0000","last_fullsized":"2024-09-12T02:57:09.877996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367038+0000","last_change":"2024-09-12T02:57:03.796368+0000","last_active":"2024-09-12T02:57:10.367038+0000","last_peered":"2024-09-12T02:57:10.367038+0000","last_clean":"2024-09-12T02:57:10.367038+0000","last_became_active":"2024-09-12T02:57:03.796016+0000","last_became_peered":"2024-09-12T02:57:03.796016+0000","last_unstale":"2024-09-12T02:57:10.367038+0000","last_undegraded":"2024-09-12T02:57:10.367038+0000","last_fullsized":"2024-09-12T02:57:10.367038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:27.840978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366160+0000","last_change":"2024-09-12T02:57:08.877519+0000","last_active":"2024-09-12T02:57:10.366160+0000","last_peered":"2024-09-12T02:57:10.366160+0000","last_clean":"2024-09-12T02:57:10.366160+0000","last_became_active":"2024-09-12T02:57:08.872329+0000","last_became_peered":"2024-09-12T02:57:08.872329+0000","last_unstale":"2024-09-12T02:57:10.366160+0000","last_undegraded":"2024-09-12T02:57:10.366160+0000","last_fullsized":"2024-09-12T02:57:10.366160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.661785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368703+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:57:10.368703+0000","last_peered":"2024-09-12T02:57:10.368703+0000","last_clean":"2024-09-12T02:57:10.368703+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:57:10.368703+0000","last_undegraded":"2024-09-12T02:57:10.368703+0000","last_fullsized":"2024-09-12T02:57:10.368703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875332+0000","last_change":"2024-09-12T02:57:03.802797+0000","last_active":"2024-09-12T02:57:09.875332+0000","last_peered":"2024-09-12T02:57:09.875332+0000","last_clean":"2024-09-12T02:57:09.875332+0000","last_became_active":"2024-09-12T02:57:03.798969+0000","last_became_peered":"2024-09-12T02:57:03.798969+0000","last_unstale":"2024-09-12T02:57:09.875332+0000","last_undegraded":"2024-09-12T02:57:09.875332+0000","last_fullsized":"2024-09-12T02:57:09.875332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.025589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367036+0000","last_change":"2024-09-12T02:57:08.883289+0000","last_active":"2024-09-12T02:57:10.367036+0000","last_peered":"2024-09-12T02:57:10.367036+0000","last_clean":"2024-09-12T02:57:10.367036+0000","last_became_active":"2024-09-12T02:57:08.880476+0000","last_became_peered":"2024-09-12T02:57:08.880476+0000","last_unstale":"2024-09-12T02:57:10.367036+0000","last_undegraded":"2024-09-12T02:57:10.367036+0000","last_fullsized":"2024-09-12T02:57:10.367036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:04.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366058+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:57:10.366058+0000","last_peered":"2024-09-12T02:57:10.366058+0000","last_clean":"2024-09-12T02:57:10.366058+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:57:10.366058+0000","last_undegraded":"2024-09-12T02:57:10.366058+0000","last_fullsized":"2024-09-12T02:57:10.366058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366630+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:57:10.366630+0000","last_peered":"2024-09-12T02:57:10.366630+0000","last_clean":"2024-09-12T02:57:10.366630+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:57:10.366630+0000","last_undegraded":"2024-09-12T02:57:10.366630+0000","last_fullsized":"2024-09-12T02:57:10.366630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367404+0000","last_change":"2024-09-12T02:57:08.872506+0000","last_active":"2024-09-12T02:57:10.367404+0000","last_peered":"2024-09-12T02:57:10.367404+0000","last_clean":"2024-09-12T02:57:10.367404+0000","last_became_active":"2024-09-12T02:57:08.872127+0000","last_became_peered":"2024-09-12T02:57:08.872127+0000","last_unstale":"2024-09-12T02:57:10.367404+0000","last_undegraded":"2024-09-12T02:57:10.367404+0000","last_fullsized":"2024-09-12T02:57:10.367404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:19.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885022+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:57:09.885022+0000","last_peered":"2024-09-12T02:57:09.885022+0000","last_clean":"2024-09-12T02:57:09.885022+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:57:09.885022+0000","last_undegraded":"2024-09-12T02:57:09.885022+0000","last_fullsized":"2024-09-12T02:57:09.885022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345274+0000","last_change":"2024-09-12T02:57:03.827694+0000","last_active":"2024-09-12T02:57:10.345274+0000","last_peered":"2024-09-12T02:57:10.345274+0000","last_clean":"2024-09-12T02:57:10.345274+0000","last_became_active":"2024-09-12T02:57:03.827099+0000","last_became_peered":"2024-09-12T02:57:03.827099+0000","last_unstale":"2024-09-12T02:57:10.345274+0000","last_undegraded":"2024-09-12T02:57:10.345274+0000","last_fullsized":"2024-09-12T02:57:10.345274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885728+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:57:09.885728+0000","last_peered":"2024-09-12T02:57:09.885728+0000","last_clean":"2024-09-12T02:57:09.885728+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:57:09.885728+0000","last_undegraded":"2024-09-12T02:57:09.885728+0000","last_fullsized":"2024-09-12T02:57:09.885728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871567+0000","last_change":"2024-09-12T02:57:04.882517+0000","last_active":"2024-09-12T02:57:09.871567+0000","last_peered":"2024-09-12T02:57:09.871567+0000","last_clean":"2024-09-12T02:57:09.871567+0000","last_became_active":"2024-09-12T02:57:04.882159+0000","last_became_peered":"2024-09-12T02:57:04.882159+0000","last_unstale":"2024-09-12T02:57:09.871567+0000","last_undegraded":"2024-09-12T02:57:09.871567+0000","last_fullsized":"2024-09-12T02:57:09.871567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876576+0000","last_change":"2024-09-12T02:57:03.798773+0000","last_active":"2024-09-12T02:57:09.876576+0000","last_peered":"2024-09-12T02:57:09.876576+0000","last_clean":"2024-09-12T02:57:09.876576+0000","last_became_active":"2024-09-12T02:57:03.797799+0000","last_became_peered":"2024-09-12T02:57:03.797799+0000","last_unstale":"2024-09-12T02:57:09.876576+0000","last_undegraded":"2024-09-12T02:57:09.876576+0000","last_fullsized":"2024-09-12T02:57:09.876576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345357+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:57:10.345357+0000","last_peered":"2024-09-12T02:57:10.345357+0000","last_clean":"2024-09-12T02:57:10.345357+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:57:10.345357+0000","last_undegraded":"2024-09-12T02:57:10.345357+0000","last_fullsized":"2024-09-12T02:57:10.345357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876527+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:57:09.876527+0000","last_peered":"2024-09-12T02:57:09.876527+0000","last_clean":"2024-09-12T02:57:09.876527+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:57:09.876527+0000","last_undegraded":"2024-09-12T02:57:09.876527+0000","last_fullsized":"2024-09-12T02:57:09.876527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346026+0000","last_change":"2024-09-12T02:57:04.879076+0000","last_active":"2024-09-12T02:57:10.346026+0000","last_peered":"2024-09-12T02:57:10.346026+0000","last_clean":"2024-09-12T02:57:10.346026+0000","last_became_active":"2024-09-12T02:57:04.878160+0000","last_became_peered":"2024-09-12T02:57:04.878160+0000","last_unstale":"2024-09-12T02:57:10.346026+0000","last_undegraded":"2024-09-12T02:57:10.346026+0000","last_fullsized":"2024-09-12T02:57:10.346026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.589537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366400+0000","last_change":"2024-09-12T02:57:03.798239+0000","last_active":"2024-09-12T02:57:10.366400+0000","last_peered":"2024-09-12T02:57:10.366400+0000","last_clean":"2024-09-12T02:57:10.366400+0000","last_became_active":"2024-09-12T02:57:03.797935+0000","last_became_peered":"2024-09-12T02:57:03.797935+0000","last_unstale":"2024-09-12T02:57:10.366400+0000","last_undegraded":"2024-09-12T02:57:10.366400+0000","last_fullsized":"2024-09-12T02:57:10.366400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875409+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:57:09.875409+0000","last_peered":"2024-09-12T02:57:09.875409+0000","last_clean":"2024-09-12T02:57:09.875409+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:57:09.875409+0000","last_undegraded":"2024-09-12T02:57:09.875409+0000","last_fullsized":"2024-09-12T02:57:09.875409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875411+0000","last_change":"2024-09-12T02:57:04.858809+0000","last_active":"2024-09-12T02:57:09.875411+0000","last_peered":"2024-09-12T02:57:09.875411+0000","last_clean":"2024-09-12T02:57:09.875411+0000","last_became_active":"2024-09-12T02:57:04.858048+0000","last_became_peered":"2024-09-12T02:57:04.858048+0000","last_unstale":"2024-09-12T02:57:09.875411+0000","last_undegraded":"2024-09-12T02:57:09.875411+0000","last_fullsized":"2024-09-12T02:57:09.875411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:59.698440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367203+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:57:10.367203+0000","last_peered":"2024-09-12T02:57:10.367203+0000","last_clean":"2024-09-12T02:57:10.367203+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:57:10.367203+0000","last_undegraded":"2024-09-12T02:57:10.367203+0000","last_fullsized":"2024-09-12T02:57:10.367203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885593+0000","last_change":"2024-09-12T02:57:08.874656+0000","last_active":"2024-09-12T02:57:09.885593+0000","last_peered":"2024-09-12T02:57:09.885593+0000","last_clean":"2024-09-12T02:57:09.885593+0000","last_became_active":"2024-09-12T02:57:08.874202+0000","last_became_peered":"2024-09-12T02:57:08.874202+0000","last_unstale":"2024-09-12T02:57:09.885593+0000","last_undegraded":"2024-09-12T02:57:09.885593+0000","last_fullsized":"2024-09-12T02:57:09.885593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.794828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346615+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:57:10.346615+0000","last_peered":"2024-09-12T02:57:10.346615+0000","last_clean":"2024-09-12T02:57:10.346615+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:57:10.346615+0000","last_undegraded":"2024-09-12T02:57:10.346615+0000","last_fullsized":"2024-09-12T02:57:10.346615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366863+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:57:10.366863+0000","last_peered":"2024-09-12T02:57:10.366863+0000","last_clean":"2024-09-12T02:57:10.366863+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:57:10.366863+0000","last_undegraded":"2024-09-12T02:57:10.366863+0000","last_fullsized":"2024-09-12T02:57:10.366863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874320+0000","last_change":"2024-09-12T02:57:09.030839+0000","last_active":"2024-09-12T02:57:09.874320+0000","last_peered":"2024-09-12T02:57:09.874320+0000","last_clean":"2024-09-12T02:57:09.874320+0000","last_became_active":"2024-09-12T02:57:09.029808+0000","last_became_peered":"2024-09-12T02:57:09.029808+0000","last_unstale":"2024-09-12T02:57:09.874320+0000","last_undegraded":"2024-09-12T02:57:09.874320+0000","last_fullsized":"2024-09-12T02:57:09.874320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346464+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:57:10.346464+0000","last_peered":"2024-09-12T02:57:10.346464+0000","last_clean":"2024-09-12T02:57:10.346464+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:57:10.346464+0000","last_undegraded":"2024-09-12T02:57:10.346464+0000","last_fullsized":"2024-09-12T02:57:10.346464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368984+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:57:10.368984+0000","last_peered":"2024-09-12T02:57:10.368984+0000","last_clean":"2024-09-12T02:57:10.368984+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:57:10.368984+0000","last_undegraded":"2024-09-12T02:57:10.368984+0000","last_fullsized":"2024-09-12T02:57:10.368984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367280+0000","last_change":"2024-09-12T02:57:08.896161+0000","last_active":"2024-09-12T02:57:10.367280+0000","last_peered":"2024-09-12T02:57:10.367280+0000","last_clean":"2024-09-12T02:57:10.367280+0000","last_became_active":"2024-09-12T02:57:08.895379+0000","last_became_peered":"2024-09-12T02:57:08.895379+0000","last_unstale":"2024-09-12T02:57:10.367280+0000","last_undegraded":"2024-09-12T02:57:10.367280+0000","last_fullsized":"2024-09-12T02:57:10.367280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:34.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345587+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:57:10.345587+0000","last_peered":"2024-09-12T02:57:10.345587+0000","last_clean":"2024-09-12T02:57:10.345587+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:57:10.345587+0000","last_undegraded":"2024-09-12T02:57:10.345587+0000","last_fullsized":"2024-09-12T02:57:10.345587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366369+0000","last_change":"2024-09-12T02:57:03.788301+0000","last_active":"2024-09-12T02:57:10.366369+0000","last_peered":"2024-09-12T02:57:10.366369+0000","last_clean":"2024-09-12T02:57:10.366369+0000","last_became_active":"2024-09-12T02:57:03.788002+0000","last_became_peered":"2024-09-12T02:57:03.788002+0000","last_unstale":"2024-09-12T02:57:10.366369+0000","last_undegraded":"2024-09-12T02:57:10.366369+0000","last_fullsized":"2024-09-12T02:57:10.366369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885578+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:57:09.885578+0000","last_peered":"2024-09-12T02:57:09.885578+0000","last_clean":"2024-09-12T02:57:09.885578+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:57:09.885578+0000","last_undegraded":"2024-09-12T02:57:09.885578+0000","last_fullsized":"2024-09-12T02:57:09.885578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875635+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:57:09.875635+0000","last_peered":"2024-09-12T02:57:09.875635+0000","last_clean":"2024-09-12T02:57:09.875635+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:57:09.875635+0000","last_undegraded":"2024-09-12T02:57:09.875635+0000","last_fullsized":"2024-09-12T02:57:09.875635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876542+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:57:09.876542+0000","last_peered":"2024-09-12T02:57:09.876542+0000","last_clean":"2024-09-12T02:57:09.876542+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:57:09.876542+0000","last_undegraded":"2024-09-12T02:57:09.876542+0000","last_fullsized":"2024-09-12T02:57:09.876542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872348+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:57:09.872348+0000","last_peered":"2024-09-12T02:57:09.872348+0000","last_clean":"2024-09-12T02:57:09.872348+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:57:09.872348+0000","last_undegraded":"2024-09-12T02:57:09.872348+0000","last_fullsized":"2024-09-12T02:57:09.872348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346216+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:57:10.346216+0000","last_peered":"2024-09-12T02:57:10.346216+0000","last_clean":"2024-09-12T02:57:10.346216+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:57:10.346216+0000","last_undegraded":"2024-09-12T02:57:10.346216+0000","last_fullsized":"2024-09-12T02:57:10.346216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875168+0000","last_change":"2024-09-12T02:57:03.802047+0000","last_active":"2024-09-12T02:57:09.875168+0000","last_peered":"2024-09-12T02:57:09.875168+0000","last_clean":"2024-09-12T02:57:09.875168+0000","last_became_active":"2024-09-12T02:57:03.797936+0000","last_became_peered":"2024-09-12T02:57:03.797936+0000","last_unstale":"2024-09-12T02:57:09.875168+0000","last_undegraded":"2024-09-12T02:57:09.875168+0000","last_fullsized":"2024-09-12T02:57:09.875168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:10.176640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872067+0000","last_change":"2024-09-12T02:57:09.030826+0000","last_active":"2024-09-12T02:57:09.872067+0000","last_peered":"2024-09-12T02:57:09.872067+0000","last_clean":"2024-09-12T02:57:09.872067+0000","last_became_active":"2024-09-12T02:57:09.029437+0000","last_became_peered":"2024-09-12T02:57:09.029437+0000","last_unstale":"2024-09-12T02:57:09.872067+0000","last_undegraded":"2024-09-12T02:57:09.872067+0000","last_fullsized":"2024-09-12T02:57:09.872067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:15.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886359+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:57:09.886359+0000","last_peered":"2024-09-12T02:57:09.886359+0000","last_clean":"2024-09-12T02:57:09.886359+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:57:09.886359+0000","last_undegraded":"2024-09-12T02:57:09.886359+0000","last_fullsized":"2024-09-12T02:57:09.886359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885915+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:57:09.885915+0000","last_peered":"2024-09-12T02:57:09.885915+0000","last_clean":"2024-09-12T02:57:09.885915+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:57:09.885915+0000","last_undegraded":"2024-09-12T02:57:09.885915+0000","last_fullsized":"2024-09-12T02:57:09.885915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877662+0000","last_change":"2024-09-12T02:57:09.031080+0000","last_active":"2024-09-12T02:57:09.877662+0000","last_peered":"2024-09-12T02:57:09.877662+0000","last_clean":"2024-09-12T02:57:09.877662+0000","last_became_active":"2024-09-12T02:57:09.029892+0000","last_became_peered":"2024-09-12T02:57:09.029892+0000","last_unstale":"2024-09-12T02:57:09.877662+0000","last_undegraded":"2024-09-12T02:57:09.877662+0000","last_fullsized":"2024-09-12T02:57:09.877662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345803+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:57:10.345803+0000","last_peered":"2024-09-12T02:57:10.345803+0000","last_clean":"2024-09-12T02:57:10.345803+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:57:10.345803+0000","last_undegraded":"2024-09-12T02:57:10.345803+0000","last_fullsized":"2024-09-12T02:57:10.345803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:22.371934+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:57:22.371934+0000","last_peered":"2024-09-12T02:57:22.371934+0000","last_clean":"2024-09-12T02:57:22.371934+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:57:22.371934+0000","last_undegraded":"2024-09-12T02:57:22.371934+0000","last_fullsized":"2024-09-12T02:57:22.371934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366364+0000","last_change":"2024-09-12T02:57:08.884030+0000","last_active":"2024-09-12T02:57:10.366364+0000","last_peered":"2024-09-12T02:57:10.366364+0000","last_clean":"2024-09-12T02:57:10.366364+0000","last_became_active":"2024-09-12T02:57:08.880332+0000","last_became_peered":"2024-09-12T02:57:08.880332+0000","last_unstale":"2024-09-12T02:57:10.366364+0000","last_undegraded":"2024-09-12T02:57:10.366364+0000","last_fullsized":"2024-09-12T02:57:10.366364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:25.232846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368553+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:57:10.368553+0000","last_peered":"2024-09-12T02:57:10.368553+0000","last_clean":"2024-09-12T02:57:10.368553+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:57:10.368553+0000","last_undegraded":"2024-09-12T02:57:10.368553+0000","last_fullsized":"2024-09-12T02:57:10.368553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367151+0000","last_change":"2024-09-12T02:57:03.798009+0000","last_active":"2024-09-12T02:57:10.367151+0000","last_peered":"2024-09-12T02:57:10.367151+0000","last_clean":"2024-09-12T02:57:10.367151+0000","last_became_active":"2024-09-12T02:57:03.797749+0000","last_became_peered":"2024-09-12T02:57:03.797749+0000","last_unstale":"2024-09-12T02:57:10.367151+0000","last_undegraded":"2024-09-12T02:57:10.367151+0000","last_fullsized":"2024-09-12T02:57:10.367151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.058712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367936+0000","last_change":"2024-09-12T02:57:08.885401+0000","last_active":"2024-09-12T02:57:10.367936+0000","last_peered":"2024-09-12T02:57:10.367936+0000","last_clean":"2024-09-12T02:57:10.367936+0000","last_became_active":"2024-09-12T02:57:08.883296+0000","last_became_peered":"2024-09-12T02:57:08.883296+0000","last_unstale":"2024-09-12T02:57:10.367936+0000","last_undegraded":"2024-09-12T02:57:10.367936+0000","last_fullsized":"2024-09-12T02:57:10.367936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:24.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886680+0000","last_change":"2024-09-12T02:57:04.882349+0000","last_active":"2024-09-12T02:57:09.886680+0000","last_peered":"2024-09-12T02:57:09.886680+0000","last_clean":"2024-09-12T02:57:09.886680+0000","last_became_active":"2024-09-12T02:57:04.882060+0000","last_became_peered":"2024-09-12T02:57:04.882060+0000","last_unstale":"2024-09-12T02:57:09.886680+0000","last_undegraded":"2024-09-12T02:57:09.886680+0000","last_fullsized":"2024-09-12T02:57:09.886680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876076+0000","last_change":"2024-09-12T02:57:03.811429+0000","last_active":"2024-09-12T02:57:09.876076+0000","last_peered":"2024-09-12T02:57:09.876076+0000","last_clean":"2024-09-12T02:57:09.876076+0000","last_became_active":"2024-09-12T02:57:03.810672+0000","last_became_peered":"2024-09-12T02:57:03.810672+0000","last_unstale":"2024-09-12T02:57:09.876076+0000","last_undegraded":"2024-09-12T02:57:09.876076+0000","last_fullsized":"2024-09-12T02:57:09.876076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871687+0000","last_change":"2024-09-12T02:57:08.875903+0000","last_active":"2024-09-12T02:57:09.871687+0000","last_peered":"2024-09-12T02:57:09.871687+0000","last_clean":"2024-09-12T02:57:09.871687+0000","last_became_active":"2024-09-12T02:57:08.875270+0000","last_became_peered":"2024-09-12T02:57:08.875270+0000","last_unstale":"2024-09-12T02:57:09.871687+0000","last_undegraded":"2024-09-12T02:57:09.871687+0000","last_fullsized":"2024-09-12T02:57:09.871687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875836+0000","last_change":"2024-09-12T02:57:04.864904+0000","last_active":"2024-09-12T02:57:09.875836+0000","last_peered":"2024-09-12T02:57:09.875836+0000","last_clean":"2024-09-12T02:57:09.875836+0000","last_became_active":"2024-09-12T02:57:04.861650+0000","last_became_peered":"2024-09-12T02:57:04.861650+0000","last_unstale":"2024-09-12T02:57:09.875836+0000","last_undegraded":"2024-09-12T02:57:09.875836+0000","last_fullsized":"2024-09-12T02:57:09.875836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:31.529412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877718+0000","last_change":"2024-09-12T02:57:03.812106+0000","last_active":"2024-09-12T02:57:09.877718+0000","last_peered":"2024-09-12T02:57:09.877718+0000","last_clean":"2024-09-12T02:57:09.877718+0000","last_became_active":"2024-09-12T02:57:03.810041+0000","last_became_peered":"2024-09-12T02:57:03.810041+0000","last_unstale":"2024-09-12T02:57:09.877718+0000","last_undegraded":"2024-09-12T02:57:09.877718+0000","last_fullsized":"2024-09-12T02:57:09.877718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871655+0000","last_change":"2024-09-12T02:57:09.030507+0000","last_active":"2024-09-12T02:57:09.871655+0000","last_peered":"2024-09-12T02:57:09.871655+0000","last_clean":"2024-09-12T02:57:09.871655+0000","last_became_active":"2024-09-12T02:57:09.029459+0000","last_became_peered":"2024-09-12T02:57:09.029459+0000","last_unstale":"2024-09-12T02:57:09.871655+0000","last_undegraded":"2024-09-12T02:57:09.871655+0000","last_fullsized":"2024-09-12T02:57:09.871655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:26.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885411+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:57:09.885411+0000","last_peered":"2024-09-12T02:57:09.885411+0000","last_clean":"2024-09-12T02:57:09.885411+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:57:09.885411+0000","last_undegraded":"2024-09-12T02:57:09.885411+0000","last_fullsized":"2024-09-12T02:57:09.885411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.365943+0000","last_change":"2024-09-12T02:57:04.834192+0000","last_active":"2024-09-12T02:57:10.365943+0000","last_peered":"2024-09-12T02:57:10.365943+0000","last_clean":"2024-09-12T02:57:10.365943+0000","last_became_active":"2024-09-12T02:57:04.833901+0000","last_became_peered":"2024-09-12T02:57:04.833901+0000","last_unstale":"2024-09-12T02:57:10.365943+0000","last_undegraded":"2024-09-12T02:57:10.365943+0000","last_fullsized":"2024-09-12T02:57:10.365943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:51:30.019270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874853+0000","last_change":"2024-09-12T02:57:03.807210+0000","last_active":"2024-09-12T02:57:09.874853+0000","last_peered":"2024-09-12T02:57:09.874853+0000","last_clean":"2024-09-12T02:57:09.874853+0000","last_became_active":"2024-09-12T02:57:03.805335+0000","last_became_peered":"2024-09-12T02:57:03.805335+0000","last_unstale":"2024-09-12T02:57:09.874853+0000","last_undegraded":"2024-09-12T02:57:09.874853+0000","last_fullsized":"2024-09-12T02:57:09.874853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876801+0000","last_change":"2024-09-12T02:57:08.895753+0000","last_active":"2024-09-12T02:57:09.876801+0000","last_peered":"2024-09-12T02:57:09.876801+0000","last_clean":"2024-09-12T02:57:09.876801+0000","last_became_active":"2024-09-12T02:57:08.894542+0000","last_became_peered":"2024-09-12T02:57:08.894542+0000","last_unstale":"2024-09-12T02:57:09.876801+0000","last_undegraded":"2024-09-12T02:57:09.876801+0000","last_fullsized":"2024-09-12T02:57:09.876801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871791+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:57:09.871791+0000","last_peered":"2024-09-12T02:57:09.871791+0000","last_clean":"2024-09-12T02:57:09.871791+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:57:09.871791+0000","last_undegraded":"2024-09-12T02:57:09.871791+0000","last_fullsized":"2024-09-12T02:57:09.871791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871652+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:57:09.871652+0000","last_peered":"2024-09-12T02:57:09.871652+0000","last_clean":"2024-09-12T02:57:09.871652+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:57:09.871652+0000","last_undegraded":"2024-09-12T02:57:09.871652+0000","last_fullsized":"2024-09-12T02:57:09.871652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875973+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:57:09.875973+0000","last_peered":"2024-09-12T02:57:09.875973+0000","last_clean":"2024-09-12T02:57:09.875973+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:57:09.875973+0000","last_undegraded":"2024-09-12T02:57:09.875973+0000","last_fullsized":"2024-09-12T02:57:09.875973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885802+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:57:09.885802+0000","last_peered":"2024-09-12T02:57:09.885802+0000","last_clean":"2024-09-12T02:57:09.885802+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:57:09.885802+0000","last_undegraded":"2024-09-12T02:57:09.885802+0000","last_fullsized":"2024-09-12T02:57:09.885802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366287+0000","last_change":"2024-09-12T02:57:08.873190+0000","last_active":"2024-09-12T02:57:10.366287+0000","last_peered":"2024-09-12T02:57:10.366287+0000","last_clean":"2024-09-12T02:57:10.366287+0000","last_became_active":"2024-09-12T02:57:08.872526+0000","last_became_peered":"2024-09-12T02:57:08.872526+0000","last_unstale":"2024-09-12T02:57:10.366287+0000","last_undegraded":"2024-09-12T02:57:10.366287+0000","last_fullsized":"2024-09-12T02:57:10.366287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:15.257391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871819+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:57:09.871819+0000","last_peered":"2024-09-12T02:57:09.871819+0000","last_clean":"2024-09-12T02:57:09.871819+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:57:09.871819+0000","last_undegraded":"2024-09-12T02:57:09.871819+0000","last_fullsized":"2024-09-12T02:57:09.871819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367905+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:57:10.367905+0000","last_peered":"2024-09-12T02:57:10.367905+0000","last_clean":"2024-09-12T02:57:10.367905+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:57:10.367905+0000","last_undegraded":"2024-09-12T02:57:10.367905+0000","last_fullsized":"2024-09-12T02:57:10.367905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872056+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:57:09.872056+0000","last_peered":"2024-09-12T02:57:09.872056+0000","last_clean":"2024-09-12T02:57:09.872056+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:57:09.872056+0000","last_undegraded":"2024-09-12T02:57:09.872056+0000","last_fullsized":"2024-09-12T02:57:09.872056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875137+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:57:09.875137+0000","last_peered":"2024-09-12T02:57:09.875137+0000","last_clean":"2024-09-12T02:57:09.875137+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:57:09.875137+0000","last_undegraded":"2024-09-12T02:57:09.875137+0000","last_fullsized":"2024-09-12T02:57:09.875137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366549+0000","last_change":"2024-09-12T02:57:04.841244+0000","last_active":"2024-09-12T02:57:10.366549+0000","last_peered":"2024-09-12T02:57:10.366549+0000","last_clean":"2024-09-12T02:57:10.366549+0000","last_became_active":"2024-09-12T02:57:04.837935+0000","last_became_peered":"2024-09-12T02:57:04.837935+0000","last_unstale":"2024-09-12T02:57:10.366549+0000","last_undegraded":"2024-09-12T02:57:10.366549+0000","last_fullsized":"2024-09-12T02:57:10.366549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:50.023694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875090+0000","last_change":"2024-09-12T02:57:04.874054+0000","last_active":"2024-09-12T02:57:09.875090+0000","last_peered":"2024-09-12T02:57:09.875090+0000","last_clean":"2024-09-12T02:57:09.875090+0000","last_became_active":"2024-09-12T02:57:04.867372+0000","last_became_peered":"2024-09-12T02:57:04.867372+0000","last_unstale":"2024-09-12T02:57:09.875090+0000","last_undegraded":"2024-09-12T02:57:09.875090+0000","last_fullsized":"2024-09-12T02:57:09.875090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:06.010582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885676+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:57:09.885676+0000","last_peered":"2024-09-12T02:57:09.885676+0000","last_clean":"2024-09-12T02:57:09.885676+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:57:09.885676+0000","last_undegraded":"2024-09-12T02:57:09.885676+0000","last_fullsized":"2024-09-12T02:57:09.885676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872206+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:57:09.872206+0000","last_peered":"2024-09-12T02:57:09.872206+0000","last_clean":"2024-09-12T02:57:09.872206+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:57:09.872206+0000","last_undegraded":"2024-09-12T02:57:09.872206+0000","last_fullsized":"2024-09-12T02:57:09.872206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367050+0000","last_change":"2024-09-12T02:57:04.836873+0000","last_active":"2024-09-12T02:57:10.367050+0000","last_peered":"2024-09-12T02:57:10.367050+0000","last_clean":"2024-09-12T02:57:10.367050+0000","last_became_active":"2024-09-12T02:57:04.836564+0000","last_became_peered":"2024-09-12T02:57:04.836564+0000","last_unstale":"2024-09-12T02:57:10.367050+0000","last_undegraded":"2024-09-12T02:57:10.367050+0000","last_fullsized":"2024-09-12T02:57:10.367050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.539077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877094+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:57:09.877094+0000","last_peered":"2024-09-12T02:57:09.877094+0000","last_clean":"2024-09-12T02:57:09.877094+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:57:09.877094+0000","last_undegraded":"2024-09-12T02:57:09.877094+0000","last_fullsized":"2024-09-12T02:57:09.877094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872473+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:57:09.872473+0000","last_peered":"2024-09-12T02:57:09.872473+0000","last_clean":"2024-09-12T02:57:09.872473+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:57:09.872473+0000","last_undegraded":"2024-09-12T02:57:09.872473+0000","last_fullsized":"2024-09-12T02:57:09.872473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874601+0000","last_change":"2024-09-12T02:57:04.874760+0000","last_active":"2024-09-12T02:57:09.874601+0000","last_peered":"2024-09-12T02:57:09.874601+0000","last_clean":"2024-09-12T02:57:09.874601+0000","last_became_active":"2024-09-12T02:57:04.861196+0000","last_became_peered":"2024-09-12T02:57:04.861196+0000","last_unstale":"2024-09-12T02:57:09.874601+0000","last_undegraded":"2024-09-12T02:57:09.874601+0000","last_fullsized":"2024-09-12T02:57:09.874601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871359+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:57:09.871359+0000","last_peered":"2024-09-12T02:57:09.871359+0000","last_clean":"2024-09-12T02:57:09.871359+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:57:09.871359+0000","last_undegraded":"2024-09-12T02:57:09.871359+0000","last_fullsized":"2024-09-12T02:57:09.871359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874921+0000","last_change":"2024-09-12T02:57:04.879052+0000","last_active":"2024-09-12T02:57:09.874921+0000","last_peered":"2024-09-12T02:57:09.874921+0000","last_clean":"2024-09-12T02:57:09.874921+0000","last_became_active":"2024-09-12T02:57:04.877672+0000","last_became_peered":"2024-09-12T02:57:04.877672+0000","last_unstale":"2024-09-12T02:57:09.874921+0000","last_undegraded":"2024-09-12T02:57:09.874921+0000","last_fullsized":"2024-09-12T02:57:09.874921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885442+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:57:09.885442+0000","last_peered":"2024-09-12T02:57:09.885442+0000","last_clean":"2024-09-12T02:57:09.885442+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:57:09.885442+0000","last_undegraded":"2024-09-12T02:57:09.885442+0000","last_fullsized":"2024-09-12T02:57:09.885442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876589+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:57:09.876589+0000","last_peered":"2024-09-12T02:57:09.876589+0000","last_clean":"2024-09-12T02:57:09.876589+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:57:09.876589+0000","last_undegraded":"2024-09-12T02:57:09.876589+0000","last_fullsized":"2024-09-12T02:57:09.876589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346360+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:57:10.346360+0000","last_peered":"2024-09-12T02:57:10.346360+0000","last_clean":"2024-09-12T02:57:10.346360+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:57:10.346360+0000","last_undegraded":"2024-09-12T02:57:10.346360+0000","last_fullsized":"2024-09-12T02:57:10.346360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366832+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:57:10.366832+0000","last_peered":"2024-09-12T02:57:10.366832+0000","last_clean":"2024-09-12T02:57:10.366832+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:57:10.366832+0000","last_undegraded":"2024-09-12T02:57:10.366832+0000","last_fullsized":"2024-09-12T02:57:10.366832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877276+0000","last_change":"2024-09-12T02:57:04.867799+0000","last_active":"2024-09-12T02:57:09.877276+0000","last_peered":"2024-09-12T02:57:09.877276+0000","last_clean":"2024-09-12T02:57:09.877276+0000","last_became_active":"2024-09-12T02:57:04.863800+0000","last_became_peered":"2024-09-12T02:57:04.863800+0000","last_unstale":"2024-09-12T02:57:09.877276+0000","last_undegraded":"2024-09-12T02:57:09.877276+0000","last_fullsized":"2024-09-12T02:57:09.877276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874304+0000","last_change":"2024-09-12T02:57:04.864906+0000","last_active":"2024-09-12T02:57:09.874304+0000","last_peered":"2024-09-12T02:57:09.874304+0000","last_clean":"2024-09-12T02:57:09.874304+0000","last_became_active":"2024-09-12T02:57:04.863556+0000","last_became_peered":"2024-09-12T02:57:04.863556+0000","last_unstale":"2024-09-12T02:57:09.874304+0000","last_undegraded":"2024-09-12T02:57:09.874304+0000","last_fullsized":"2024-09-12T02:57:09.874304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366044+0000","last_change":"2024-09-12T02:57:04.826304+0000","last_active":"2024-09-12T02:57:10.366044+0000","last_peered":"2024-09-12T02:57:10.366044+0000","last_clean":"2024-09-12T02:57:10.366044+0000","last_became_active":"2024-09-12T02:57:04.825998+0000","last_became_peered":"2024-09-12T02:57:04.825998+0000","last_unstale":"2024-09-12T02:57:10.366044+0000","last_undegraded":"2024-09-12T02:57:10.366044+0000","last_fullsized":"2024-09-12T02:57:10.366044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:35.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886270+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:57:09.886270+0000","last_peered":"2024-09-12T02:57:09.886270+0000","last_clean":"2024-09-12T02:57:09.886270+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:57:09.886270+0000","last_undegraded":"2024-09-12T02:57:09.886270+0000","last_fullsized":"2024-09-12T02:57:09.886270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871588+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:57:09.871588+0000","last_peered":"2024-09-12T02:57:09.871588+0000","last_clean":"2024-09-12T02:57:09.871588+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:57:09.871588+0000","last_undegraded":"2024-09-12T02:57:09.871588+0000","last_fullsized":"2024-09-12T02:57:09.871588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368395+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:57:10.368395+0000","last_peered":"2024-09-12T02:57:10.368395+0000","last_clean":"2024-09-12T02:57:10.368395+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:57:10.368395+0000","last_undegraded":"2024-09-12T02:57:10.368395+0000","last_fullsized":"2024-09-12T02:57:10.368395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877007+0000","last_change":"2024-09-12T02:57:04.864295+0000","last_active":"2024-09-12T02:57:09.877007+0000","last_peered":"2024-09-12T02:57:09.877007+0000","last_clean":"2024-09-12T02:57:09.877007+0000","last_became_active":"2024-09-12T02:57:04.863563+0000","last_became_peered":"2024-09-12T02:57:04.863563+0000","last_unstale":"2024-09-12T02:57:09.877007+0000","last_undegraded":"2024-09-12T02:57:09.877007+0000","last_fullsized":"2024-09-12T02:57:09.877007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877026+0000","last_change":"2024-09-12T02:57:04.860987+0000","last_active":"2024-09-12T02:57:09.877026+0000","last_peered":"2024-09-12T02:57:09.877026+0000","last_clean":"2024-09-12T02:57:09.877026+0000","last_became_active":"2024-09-12T02:57:04.859032+0000","last_became_peered":"2024-09-12T02:57:04.859032+0000","last_unstale":"2024-09-12T02:57:09.877026+0000","last_undegraded":"2024-09-12T02:57:09.877026+0000","last_fullsized":"2024-09-12T02:57:09.877026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346559+0000","last_change":"2024-09-12T02:57:04.881172+0000","last_active":"2024-09-12T02:57:10.346559+0000","last_peered":"2024-09-12T02:57:10.346559+0000","last_clean":"2024-09-12T02:57:10.346559+0000","last_became_active":"2024-09-12T02:57:04.880660+0000","last_became_peered":"2024-09-12T02:57:04.880660+0000","last_unstale":"2024-09-12T02:57:10.346559+0000","last_undegraded":"2024-09-12T02:57:10.346559+0000","last_fullsized":"2024-09-12T02:57:10.346559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:15.389185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871386+0000","last_change":"2024-09-12T02:57:04.876735+0000","last_active":"2024-09-12T02:57:09.871386+0000","last_peered":"2024-09-12T02:57:09.871386+0000","last_clean":"2024-09-12T02:57:09.871386+0000","last_became_active":"2024-09-12T02:57:04.876321+0000","last_became_peered":"2024-09-12T02:57:04.876321+0000","last_unstale":"2024-09-12T02:57:09.871386+0000","last_undegraded":"2024-09-12T02:57:09.871386+0000","last_fullsized":"2024-09-12T02:57:09.871386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345483+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:57:10.345483+0000","last_peered":"2024-09-12T02:57:10.345483+0000","last_clean":"2024-09-12T02:57:10.345483+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:57:10.345483+0000","last_undegraded":"2024-09-12T02:57:10.345483+0000","last_fullsized":"2024-09-12T02:57:10.345483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874829+0000","last_change":"2024-09-12T02:57:04.878277+0000","last_active":"2024-09-12T02:57:09.874829+0000","last_peered":"2024-09-12T02:57:09.874829+0000","last_clean":"2024-09-12T02:57:09.874829+0000","last_became_active":"2024-09-12T02:57:04.876816+0000","last_became_peered":"2024-09-12T02:57:04.876816+0000","last_unstale":"2024-09-12T02:57:09.874829+0000","last_undegraded":"2024-09-12T02:57:09.874829+0000","last_fullsized":"2024-09-12T02:57:09.874829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345685+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:57:10.345685+0000","last_peered":"2024-09-12T02:57:10.345685+0000","last_clean":"2024-09-12T02:57:10.345685+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:57:10.345685+0000","last_undegraded":"2024-09-12T02:57:10.345685+0000","last_fullsized":"2024-09-12T02:57:10.345685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875150+0000","last_change":"2024-09-12T02:57:04.876472+0000","last_active":"2024-09-12T02:57:09.875150+0000","last_peered":"2024-09-12T02:57:09.875150+0000","last_clean":"2024-09-12T02:57:09.875150+0000","last_became_active":"2024-09-12T02:57:04.867264+0000","last_became_peered":"2024-09-12T02:57:04.867264+0000","last_unstale":"2024-09-12T02:57:09.875150+0000","last_undegraded":"2024-09-12T02:57:09.875150+0000","last_fullsized":"2024-09-12T02:57:09.875150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885265+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:57:09.885265+0000","last_peered":"2024-09-12T02:57:09.885265+0000","last_clean":"2024-09-12T02:57:09.885265+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:57:09.885265+0000","last_undegraded":"2024-09-12T02:57:09.885265+0000","last_fullsized":"2024-09-12T02:57:09.885265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367313+0000","last_change":"2024-09-12T02:57:04.841638+0000","last_active":"2024-09-12T02:57:10.367313+0000","last_peered":"2024-09-12T02:57:10.367313+0000","last_clean":"2024-09-12T02:57:10.367313+0000","last_became_active":"2024-09-12T02:57:04.841367+0000","last_became_peered":"2024-09-12T02:57:04.841367+0000","last_unstale":"2024-09-12T02:57:10.367313+0000","last_undegraded":"2024-09-12T02:57:10.367313+0000","last_fullsized":"2024-09-12T02:57:10.367313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:24.890973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346275+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:57:10.346275+0000","last_peered":"2024-09-12T02:57:10.346275+0000","last_clean":"2024-09-12T02:57:10.346275+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:57:10.346275+0000","last_undegraded":"2024-09-12T02:57:10.346275+0000","last_fullsized":"2024-09-12T02:57:10.346275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":698324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:57:46.172 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:57:46.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705a00640 1 Processor -- start 2024-09-12T02:57:46.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705a00640 1 -- start start 2024-09-12T02:57:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5700152790 0x7f57000cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f57000c8b00 0x7f5700158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f57001590f0 0x7f5700071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f570015ba70 con 0x7f57001590f0 2024-09-12T02:57:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5700158720 con 0x7f57000c8b00 2024-09-12T02:57:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f57000cbb40 con 0x7f5700152790 2024-09-12T02:57:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f57001590f0 0x7f5700071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f57001590f0 0x7f5700071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56892/0 (socket says 172.21.15.63:56892) 2024-09-12T02:57:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705000640 1 -- 172.21.15.63:0/831471373 learned_addr learned my addr 172.21.15.63:0/831471373 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f56f7400640 1 --2- 172.21.15.63:0/831471373 >> v2:172.21.15.119:3300/0 conn(0x7f57000c8b00 0x7f5700158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f56ffe00640 1 --2- 172.21.15.63:0/831471373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5700152790 0x7f57000cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705000640 1 -- 172.21.15.63:0/831471373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5700152790 msgr2=0x7f57000cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705000640 1 --2- 172.21.15.63:0/831471373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5700152790 0x7f57000cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705000640 1 -- 172.21.15.63:0/831471373 >> v2:172.21.15.119:3300/0 conn(0x7f57000c8b00 msgr2=0x7f5700158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705000640 1 --2- 172.21.15.63:0/831471373 >> v2:172.21.15.119:3300/0 conn(0x7f57000c8b00 0x7f5700158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.345+0000 7f5705000640 1 -- 172.21.15.63:0/831471373 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57000b1260 con 0x7f57001590f0 2024-09-12T02:57:46.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705000640 1 --2- 172.21.15.63:0/831471373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57001590f0 0x7f5700071450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f57000c4780 tx=0x7f56f801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d743318d9bde646 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f56ff400640 1 -- 172.21.15.63:0/831471373 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f80b4070 con 0x7f57001590f0 2024-09-12T02:57:46.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f56ff400640 1 -- 172.21.15.63:0/831471373 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f80af400 con 0x7f57001590f0 2024-09-12T02:57:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f56ff400640 1 -- 172.21.15.63:0/831471373 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f80af7d0 con 0x7f57001590f0 2024-09-12T02:57:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705a00640 1 -- 172.21.15.63:0/831471373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57001590f0 msgr2=0x7f5700071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705a00640 1 --2- 172.21.15.63:0/831471373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57001590f0 0x7f5700071450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f57000c4780 tx=0x7f56f801f1e0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705a00640 1 -- 172.21.15.63:0/831471373 shutdown_connections 2024-09-12T02:57:46.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705a00640 1 --2- 172.21.15.63:0/831471373 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57001590f0 0x7f5700071450 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705a00640 1 --2- 172.21.15.63:0/831471373 >> v2:172.21.15.119:3300/0 conn(0x7f57000c8b00 0x7f5700158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705a00640 1 --2- 172.21.15.63:0/831471373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5700152790 0x7f57000cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705a00640 1 -- 172.21.15.63:0/831471373 >> 172.21.15.63:0/831471373 conn(0x7f570006f6e0 msgr2=0x7f570006faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705a00640 1 -- 172.21.15.63:0/831471373 shutdown_connections 2024-09-12T02:57:46.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.349+0000 7f5705a00640 1 -- 172.21.15.63:0/831471373 wait complete. 2024-09-12T02:57:46.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 Processor -- start 2024-09-12T02:57:46.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 -- start start 2024-09-12T02:57:46.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57000c8b00 0x7f570015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5700152790 0x7f57000c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57001590f0 0x7f57001f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f57000b0f80 con 0x7f5700152790 2024-09-12T02:57:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f57000b0ca0 con 0x7f57001590f0 2024-09-12T02:57:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5700152b70 con 0x7f57000c8b00 2024-09-12T02:57:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56f7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5700152790 0x7f57000c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56f7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5700152790 0x7f57000c7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56904/0 (socket says 172.21.15.63:56904) 2024-09-12T02:57:46.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56f7400640 1 -- 172.21.15.63:0/1865610235 learned_addr learned my addr 172.21.15.63:0/1865610235 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56ffe00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57000c8b00 0x7f570015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705000640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57001590f0 0x7f57001f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56f7400640 1 -- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57000c8b00 msgr2=0x7f570015a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56f7400640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57000c8b00 0x7f570015a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56f7400640 1 -- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57001590f0 msgr2=0x7f57001f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56f7400640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57001590f0 0x7f57001f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56f7400640 1 -- 172.21.15.63:0/1865610235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57000c83e0 con 0x7f5700152790 2024-09-12T02:57:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56ffe00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57000c8b00 0x7f570015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56f7400640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5700152790 0x7f57000c7050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f56e800d620 tx=0x7f56e800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56fcc00640 1 -- 172.21.15.63:0/1865610235 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8004240 con 0x7f5700152790 2024-09-12T02:57:46.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56fcc00640 1 -- 172.21.15.63:0/1865610235 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e80043e0 con 0x7f5700152790 2024-09-12T02:57:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f56fcc00640 1 -- 172.21.15.63:0/1865610235 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8003620 con 0x7f5700152790 2024-09-12T02:57:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57000c7db0 con 0x7f5700152790 2024-09-12T02:57:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.353+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5700157470 con 0x7f5700152790 2024-09-12T02:57:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.357+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57000c91e0 con 0x7f5700152790 2024-09-12T02:57:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.357+0000 7f56fcc00640 1 -- 172.21.15.63:0/1865610235 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56e801b020 con 0x7f5700152790 2024-09-12T02:57:46.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.357+0000 7f56fcc00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f56dc0678c0 0x7f56dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.357+0000 7f56fcc00640 1 -- 172.21.15.63:0/1865610235 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f56e8085cd0 con 0x7f5700152790 2024-09-12T02:57:46.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.357+0000 7f56ffe00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f56dc0678c0 0x7f56dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.357+0000 7f56ffe00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f56dc0678c0 0x7f56dc069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f56f0007a70 tx=0x7f56f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:46.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.361+0000 7f56fcc00640 1 -- 172.21.15.63:0/1865610235 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f56e8056430 con 0x7f5700152790 2024-09-12T02:57:46.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.525+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57001f3b00 con 0x7f56dc0678c0 2024-09-12T02:57:46.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.549+0000 7f56fcc00640 1 -- 172.21.15.63:0/1865610235 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7f57001f3b00 con 0x7f56dc0678c0 2024-09-12T02:57:46.553 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:46.556 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:57:46.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f56dc0678c0 msgr2=0x7f56dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f56dc0678c0 0x7f56dc069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f56f0007a70 tx=0x7f56f0008040 comp rx=0 tx=0).stop 2024-09-12T02:57:46.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5700152790 msgr2=0x7f57000c7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5700152790 0x7f57000c7050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f56e800d620 tx=0x7f56e800dae0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 shutdown_connections 2024-09-12T02:57:46.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57001590f0 0x7f57001f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5700152790 0x7f57000c7050 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f56dc0678c0 0x7f56dc069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 --2- 172.21.15.63:0/1865610235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57000c8b00 0x7f570015a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 >> 172.21.15.63:0/1865610235 conn(0x7f570006f6e0 msgr2=0x7f5700071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:46.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 shutdown_connections 2024-09-12T02:57:46.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.553+0000 7f5705a00640 1 -- 172.21.15.63:0/1865610235 wait complete. 2024-09-12T02:57:46.576 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-09-12T02:57:45.762233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3336,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3416064,"data_stored":2049012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005484"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886709+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:57:09.886709+0000","last_peered":"2024-09-12T02:57:09.886709+0000","last_clean":"2024-09-12T02:57:09.886709+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:57:09.886709+0000","last_undegraded":"2024-09-12T02:57:09.886709+0000","last_fullsized":"2024-09-12T02:57:09.886709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872098+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:57:09.872098+0000","last_peered":"2024-09-12T02:57:09.872098+0000","last_clean":"2024-09-12T02:57:09.872098+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:57:09.872098+0000","last_undegraded":"2024-09-12T02:57:09.872098+0000","last_fullsized":"2024-09-12T02:57:09.872098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871428+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:57:09.871428+0000","last_peered":"2024-09-12T02:57:09.871428+0000","last_clean":"2024-09-12T02:57:09.871428+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:57:09.871428+0000","last_undegraded":"2024-09-12T02:57:09.871428+0000","last_fullsized":"2024-09-12T02:57:09.871428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872215+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:57:09.872215+0000","last_peered":"2024-09-12T02:57:09.872215+0000","last_clean":"2024-09-12T02:57:09.872215+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:57:09.872215+0000","last_undegraded":"2024-09-12T02:57:09.872215+0000","last_fullsized":"2024-09-12T02:57:09.872215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886576+0000","last_change":"2024-09-12T02:57:04.882473+0000","last_active":"2024-09-12T02:57:09.886576+0000","last_peered":"2024-09-12T02:57:09.886576+0000","last_clean":"2024-09-12T02:57:09.886576+0000","last_became_active":"2024-09-12T02:57:04.882182+0000","last_became_peered":"2024-09-12T02:57:04.882182+0000","last_unstale":"2024-09-12T02:57:09.886576+0000","last_undegraded":"2024-09-12T02:57:09.886576+0000","last_fullsized":"2024-09-12T02:57:09.886576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367426+0000","last_change":"2024-09-12T02:57:08.878799+0000","last_active":"2024-09-12T02:57:10.367426+0000","last_peered":"2024-09-12T02:57:10.367426+0000","last_clean":"2024-09-12T02:57:10.367426+0000","last_became_active":"2024-09-12T02:57:08.877274+0000","last_became_peered":"2024-09-12T02:57:08.877274+0000","last_unstale":"2024-09-12T02:57:10.367426+0000","last_undegraded":"2024-09-12T02:57:10.367426+0000","last_fullsized":"2024-09-12T02:57:10.367426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:27.611325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346487+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:57:10.346487+0000","last_peered":"2024-09-12T02:57:10.346487+0000","last_clean":"2024-09-12T02:57:10.346487+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:57:10.346487+0000","last_undegraded":"2024-09-12T02:57:10.346487+0000","last_fullsized":"2024-09-12T02:57:10.346487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875248+0000","last_change":"2024-09-12T02:57:04.875312+0000","last_active":"2024-09-12T02:57:09.875248+0000","last_peered":"2024-09-12T02:57:09.875248+0000","last_clean":"2024-09-12T02:57:09.875248+0000","last_became_active":"2024-09-12T02:57:04.863748+0000","last_became_peered":"2024-09-12T02:57:04.863748+0000","last_unstale":"2024-09-12T02:57:09.875248+0000","last_undegraded":"2024-09-12T02:57:09.875248+0000","last_fullsized":"2024-09-12T02:57:09.875248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:39.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368200+0000","last_change":"2024-09-12T02:57:08.888677+0000","last_active":"2024-09-12T02:57:10.368200+0000","last_peered":"2024-09-12T02:57:10.368200+0000","last_clean":"2024-09-12T02:57:10.368200+0000","last_became_active":"2024-09-12T02:57:08.875948+0000","last_became_peered":"2024-09-12T02:57:08.875948+0000","last_unstale":"2024-09-12T02:57:10.368200+0000","last_undegraded":"2024-09-12T02:57:10.368200+0000","last_fullsized":"2024-09-12T02:57:10.368200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.194444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345910+0000","last_change":"2024-09-12T02:57:03.832933+0000","last_active":"2024-09-12T02:57:10.345910+0000","last_peered":"2024-09-12T02:57:10.345910+0000","last_clean":"2024-09-12T02:57:10.345910+0000","last_became_active":"2024-09-12T02:57:03.832253+0000","last_became_peered":"2024-09-12T02:57:03.832253+0000","last_unstale":"2024-09-12T02:57:10.345910+0000","last_undegraded":"2024-09-12T02:57:10.345910+0000","last_fullsized":"2024-09-12T02:57:10.345910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877844+0000","last_change":"2024-09-12T02:57:04.880036+0000","last_active":"2024-09-12T02:57:09.877844+0000","last_peered":"2024-09-12T02:57:09.877844+0000","last_clean":"2024-09-12T02:57:09.877844+0000","last_became_active":"2024-09-12T02:57:04.879490+0000","last_became_peered":"2024-09-12T02:57:04.879490+0000","last_unstale":"2024-09-12T02:57:09.877844+0000","last_undegraded":"2024-09-12T02:57:09.877844+0000","last_fullsized":"2024-09-12T02:57:09.877844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.579939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367568+0000","last_change":"2024-09-12T02:57:08.890508+0000","last_active":"2024-09-12T02:57:10.367568+0000","last_peered":"2024-09-12T02:57:10.367568+0000","last_clean":"2024-09-12T02:57:10.367568+0000","last_became_active":"2024-09-12T02:57:08.886515+0000","last_became_peered":"2024-09-12T02:57:08.886515+0000","last_unstale":"2024-09-12T02:57:10.367568+0000","last_undegraded":"2024-09-12T02:57:10.367568+0000","last_fullsized":"2024-09-12T02:57:10.367568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:28.963220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875670+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:57:09.875670+0000","last_peered":"2024-09-12T02:57:09.875670+0000","last_clean":"2024-09-12T02:57:09.875670+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:57:09.875670+0000","last_undegraded":"2024-09-12T02:57:09.875670+0000","last_fullsized":"2024-09-12T02:57:09.875670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346531+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:57:10.346531+0000","last_peered":"2024-09-12T02:57:10.346531+0000","last_clean":"2024-09-12T02:57:10.346531+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:57:10.346531+0000","last_undegraded":"2024-09-12T02:57:10.346531+0000","last_fullsized":"2024-09-12T02:57:10.346531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368605+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:57:10.368605+0000","last_peered":"2024-09-12T02:57:10.368605+0000","last_clean":"2024-09-12T02:57:10.368605+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:57:10.368605+0000","last_undegraded":"2024-09-12T02:57:10.368605+0000","last_fullsized":"2024-09-12T02:57:10.368605+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871686+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:57:09.871686+0000","last_peered":"2024-09-12T02:57:09.871686+0000","last_clean":"2024-09-12T02:57:09.871686+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:57:09.871686+0000","last_undegraded":"2024-09-12T02:57:09.871686+0000","last_fullsized":"2024-09-12T02:57:09.871686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366516+0000","last_change":"2024-09-12T02:57:03.790544+0000","last_active":"2024-09-12T02:57:10.366516+0000","last_peered":"2024-09-12T02:57:10.366516+0000","last_clean":"2024-09-12T02:57:10.366516+0000","last_became_active":"2024-09-12T02:57:03.790195+0000","last_became_peered":"2024-09-12T02:57:03.790195+0000","last_unstale":"2024-09-12T02:57:10.366516+0000","last_undegraded":"2024-09-12T02:57:10.366516+0000","last_fullsized":"2024-09-12T02:57:10.366516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368276+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:57:10.368276+0000","last_peered":"2024-09-12T02:57:10.368276+0000","last_clean":"2024-09-12T02:57:10.368276+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:57:10.368276+0000","last_undegraded":"2024-09-12T02:57:10.368276+0000","last_fullsized":"2024-09-12T02:57:10.368276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871830+0000","last_change":"2024-09-12T02:57:04.835949+0000","last_active":"2024-09-12T02:57:09.871830+0000","last_peered":"2024-09-12T02:57:09.871830+0000","last_clean":"2024-09-12T02:57:09.871830+0000","last_became_active":"2024-09-12T02:57:04.835628+0000","last_became_peered":"2024-09-12T02:57:04.835628+0000","last_unstale":"2024-09-12T02:57:09.871830+0000","last_undegraded":"2024-09-12T02:57:09.871830+0000","last_fullsized":"2024-09-12T02:57:09.871830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366134+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:57:10.366134+0000","last_peered":"2024-09-12T02:57:10.366134+0000","last_clean":"2024-09-12T02:57:10.366134+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:57:10.366134+0000","last_undegraded":"2024-09-12T02:57:10.366134+0000","last_fullsized":"2024-09-12T02:57:10.366134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367370+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:57:10.367370+0000","last_peered":"2024-09-12T02:57:10.367370+0000","last_clean":"2024-09-12T02:57:10.367370+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:57:10.367370+0000","last_undegraded":"2024-09-12T02:57:10.367370+0000","last_fullsized":"2024-09-12T02:57:10.367370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367963+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:57:10.367963+0000","last_peered":"2024-09-12T02:57:10.367963+0000","last_clean":"2024-09-12T02:57:10.367963+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:57:10.367963+0000","last_undegraded":"2024-09-12T02:57:10.367963+0000","last_fullsized":"2024-09-12T02:57:10.367963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345073+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:57:10.345073+0000","last_peered":"2024-09-12T02:57:10.345073+0000","last_clean":"2024-09-12T02:57:10.345073+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:57:10.345073+0000","last_undegraded":"2024-09-12T02:57:10.345073+0000","last_fullsized":"2024-09-12T02:57:10.345073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368760+0000","last_change":"2024-09-12T02:57:08.881925+0000","last_active":"2024-09-12T02:57:10.368760+0000","last_peered":"2024-09-12T02:57:10.368760+0000","last_clean":"2024-09-12T02:57:10.368760+0000","last_became_active":"2024-09-12T02:57:08.880913+0000","last_became_peered":"2024-09-12T02:57:08.880913+0000","last_unstale":"2024-09-12T02:57:10.368760+0000","last_undegraded":"2024-09-12T02:57:10.368760+0000","last_fullsized":"2024-09-12T02:57:10.368760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:48.637854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885883+0000","last_change":"2024-09-12T02:57:04.837566+0000","last_active":"2024-09-12T02:57:09.885883+0000","last_peered":"2024-09-12T02:57:09.885883+0000","last_clean":"2024-09-12T02:57:09.885883+0000","last_became_active":"2024-09-12T02:57:04.837281+0000","last_became_peered":"2024-09-12T02:57:04.837281+0000","last_unstale":"2024-09-12T02:57:09.885883+0000","last_undegraded":"2024-09-12T02:57:09.885883+0000","last_fullsized":"2024-09-12T02:57:09.885883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:23.664487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.878159+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:57:09.878159+0000","last_peered":"2024-09-12T02:57:09.878159+0000","last_clean":"2024-09-12T02:57:09.878159+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:57:09.878159+0000","last_undegraded":"2024-09-12T02:57:09.878159+0000","last_fullsized":"2024-09-12T02:57:09.878159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367595+0000","last_change":"2024-09-12T02:57:09.038564+0000","last_active":"2024-09-12T02:57:10.367595+0000","last_peered":"2024-09-12T02:57:10.367595+0000","last_clean":"2024-09-12T02:57:10.367595+0000","last_became_active":"2024-09-12T02:57:09.036310+0000","last_became_peered":"2024-09-12T02:57:09.036310+0000","last_unstale":"2024-09-12T02:57:10.367595+0000","last_undegraded":"2024-09-12T02:57:10.367595+0000","last_fullsized":"2024-09-12T02:57:10.367595+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.627698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872469+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:57:09.872469+0000","last_peered":"2024-09-12T02:57:09.872469+0000","last_clean":"2024-09-12T02:57:09.872469+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:57:09.872469+0000","last_undegraded":"2024-09-12T02:57:09.872469+0000","last_fullsized":"2024-09-12T02:57:09.872469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367376+0000","last_change":"2024-09-12T02:57:03.809884+0000","last_active":"2024-09-12T02:57:10.367376+0000","last_peered":"2024-09-12T02:57:10.367376+0000","last_clean":"2024-09-12T02:57:10.367376+0000","last_became_active":"2024-09-12T02:57:03.809610+0000","last_became_peered":"2024-09-12T02:57:03.809610+0000","last_unstale":"2024-09-12T02:57:10.367376+0000","last_undegraded":"2024-09-12T02:57:10.367376+0000","last_fullsized":"2024-09-12T02:57:10.367376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871306+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:57:09.871306+0000","last_peered":"2024-09-12T02:57:09.871306+0000","last_clean":"2024-09-12T02:57:09.871306+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:57:09.871306+0000","last_undegraded":"2024-09-12T02:57:09.871306+0000","last_fullsized":"2024-09-12T02:57:09.871306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366942+0000","last_change":"2024-09-12T02:57:04.837330+0000","last_active":"2024-09-12T02:57:10.366942+0000","last_peered":"2024-09-12T02:57:10.366942+0000","last_clean":"2024-09-12T02:57:10.366942+0000","last_became_active":"2024-09-12T02:57:04.836984+0000","last_became_peered":"2024-09-12T02:57:04.836984+0000","last_unstale":"2024-09-12T02:57:10.366942+0000","last_undegraded":"2024-09-12T02:57:10.366942+0000","last_fullsized":"2024-09-12T02:57:10.366942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346664+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:57:10.346664+0000","last_peered":"2024-09-12T02:57:10.346664+0000","last_clean":"2024-09-12T02:57:10.346664+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:57:10.346664+0000","last_undegraded":"2024-09-12T02:57:10.346664+0000","last_fullsized":"2024-09-12T02:57:10.346664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885339+0000","last_change":"2024-09-12T02:57:09.025446+0000","last_active":"2024-09-12T02:57:09.885339+0000","last_peered":"2024-09-12T02:57:09.885339+0000","last_clean":"2024-09-12T02:57:09.885339+0000","last_became_active":"2024-09-12T02:57:09.025008+0000","last_became_peered":"2024-09-12T02:57:09.025008+0000","last_unstale":"2024-09-12T02:57:09.885339+0000","last_undegraded":"2024-09-12T02:57:09.885339+0000","last_fullsized":"2024-09-12T02:57:09.885339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877996+0000","last_change":"2024-09-12T02:57:04.861898+0000","last_active":"2024-09-12T02:57:09.877996+0000","last_peered":"2024-09-12T02:57:09.877996+0000","last_clean":"2024-09-12T02:57:09.877996+0000","last_became_active":"2024-09-12T02:57:04.858339+0000","last_became_peered":"2024-09-12T02:57:04.858339+0000","last_unstale":"2024-09-12T02:57:09.877996+0000","last_undegraded":"2024-09-12T02:57:09.877996+0000","last_fullsized":"2024-09-12T02:57:09.877996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367038+0000","last_change":"2024-09-12T02:57:03.796368+0000","last_active":"2024-09-12T02:57:10.367038+0000","last_peered":"2024-09-12T02:57:10.367038+0000","last_clean":"2024-09-12T02:57:10.367038+0000","last_became_active":"2024-09-12T02:57:03.796016+0000","last_became_peered":"2024-09-12T02:57:03.796016+0000","last_unstale":"2024-09-12T02:57:10.367038+0000","last_undegraded":"2024-09-12T02:57:10.367038+0000","last_fullsized":"2024-09-12T02:57:10.367038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:27.840978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366160+0000","last_change":"2024-09-12T02:57:08.877519+0000","last_active":"2024-09-12T02:57:10.366160+0000","last_peered":"2024-09-12T02:57:10.366160+0000","last_clean":"2024-09-12T02:57:10.366160+0000","last_became_active":"2024-09-12T02:57:08.872329+0000","last_became_peered":"2024-09-12T02:57:08.872329+0000","last_unstale":"2024-09-12T02:57:10.366160+0000","last_undegraded":"2024-09-12T02:57:10.366160+0000","last_fullsized":"2024-09-12T02:57:10.366160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.661785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368703+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:57:10.368703+0000","last_peered":"2024-09-12T02:57:10.368703+0000","last_clean":"2024-09-12T02:57:10.368703+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:57:10.368703+0000","last_undegraded":"2024-09-12T02:57:10.368703+0000","last_fullsized":"2024-09-12T02:57:10.368703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875332+0000","last_change":"2024-09-12T02:57:03.802797+0000","last_active":"2024-09-12T02:57:09.875332+0000","last_peered":"2024-09-12T02:57:09.875332+0000","last_clean":"2024-09-12T02:57:09.875332+0000","last_became_active":"2024-09-12T02:57:03.798969+0000","last_became_peered":"2024-09-12T02:57:03.798969+0000","last_unstale":"2024-09-12T02:57:09.875332+0000","last_undegraded":"2024-09-12T02:57:09.875332+0000","last_fullsized":"2024-09-12T02:57:09.875332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.025589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367036+0000","last_change":"2024-09-12T02:57:08.883289+0000","last_active":"2024-09-12T02:57:10.367036+0000","last_peered":"2024-09-12T02:57:10.367036+0000","last_clean":"2024-09-12T02:57:10.367036+0000","last_became_active":"2024-09-12T02:57:08.880476+0000","last_became_peered":"2024-09-12T02:57:08.880476+0000","last_unstale":"2024-09-12T02:57:10.367036+0000","last_undegraded":"2024-09-12T02:57:10.367036+0000","last_fullsized":"2024-09-12T02:57:10.367036+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:04.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366058+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:57:10.366058+0000","last_peered":"2024-09-12T02:57:10.366058+0000","last_clean":"2024-09-12T02:57:10.366058+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:57:10.366058+0000","last_undegraded":"2024-09-12T02:57:10.366058+0000","last_fullsized":"2024-09-12T02:57:10.366058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366630+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:57:10.366630+0000","last_peered":"2024-09-12T02:57:10.366630+0000","last_clean":"2024-09-12T02:57:10.366630+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:57:10.366630+0000","last_undegraded":"2024-09-12T02:57:10.366630+0000","last_fullsized":"2024-09-12T02:57:10.366630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367404+0000","last_change":"2024-09-12T02:57:08.872506+0000","last_active":"2024-09-12T02:57:10.367404+0000","last_peered":"2024-09-12T02:57:10.367404+0000","last_clean":"2024-09-12T02:57:10.367404+0000","last_became_active":"2024-09-12T02:57:08.872127+0000","last_became_peered":"2024-09-12T02:57:08.872127+0000","last_unstale":"2024-09-12T02:57:10.367404+0000","last_undegraded":"2024-09-12T02:57:10.367404+0000","last_fullsized":"2024-09-12T02:57:10.367404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:19.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885022+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:57:09.885022+0000","last_peered":"2024-09-12T02:57:09.885022+0000","last_clean":"2024-09-12T02:57:09.885022+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:57:09.885022+0000","last_undegraded":"2024-09-12T02:57:09.885022+0000","last_fullsized":"2024-09-12T02:57:09.885022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345274+0000","last_change":"2024-09-12T02:57:03.827694+0000","last_active":"2024-09-12T02:57:10.345274+0000","last_peered":"2024-09-12T02:57:10.345274+0000","last_clean":"2024-09-12T02:57:10.345274+0000","last_became_active":"2024-09-12T02:57:03.827099+0000","last_became_peered":"2024-09-12T02:57:03.827099+0000","last_unstale":"2024-09-12T02:57:10.345274+0000","last_undegraded":"2024-09-12T02:57:10.345274+0000","last_fullsized":"2024-09-12T02:57:10.345274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885728+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:57:09.885728+0000","last_peered":"2024-09-12T02:57:09.885728+0000","last_clean":"2024-09-12T02:57:09.885728+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:57:09.885728+0000","last_undegraded":"2024-09-12T02:57:09.885728+0000","last_fullsized":"2024-09-12T02:57:09.885728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871567+0000","last_change":"2024-09-12T02:57:04.882517+0000","last_active":"2024-09-12T02:57:09.871567+0000","last_peered":"2024-09-12T02:57:09.871567+0000","last_clean":"2024-09-12T02:57:09.871567+0000","last_became_active":"2024-09-12T02:57:04.882159+0000","last_became_peered":"2024-09-12T02:57:04.882159+0000","last_unstale":"2024-09-12T02:57:09.871567+0000","last_undegraded":"2024-09-12T02:57:09.871567+0000","last_fullsized":"2024-09-12T02:57:09.871567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876576+0000","last_change":"2024-09-12T02:57:03.798773+0000","last_active":"2024-09-12T02:57:09.876576+0000","last_peered":"2024-09-12T02:57:09.876576+0000","last_clean":"2024-09-12T02:57:09.876576+0000","last_became_active":"2024-09-12T02:57:03.797799+0000","last_became_peered":"2024-09-12T02:57:03.797799+0000","last_unstale":"2024-09-12T02:57:09.876576+0000","last_undegraded":"2024-09-12T02:57:09.876576+0000","last_fullsized":"2024-09-12T02:57:09.876576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345357+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:57:10.345357+0000","last_peered":"2024-09-12T02:57:10.345357+0000","last_clean":"2024-09-12T02:57:10.345357+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:57:10.345357+0000","last_undegraded":"2024-09-12T02:57:10.345357+0000","last_fullsized":"2024-09-12T02:57:10.345357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876527+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:57:09.876527+0000","last_peered":"2024-09-12T02:57:09.876527+0000","last_clean":"2024-09-12T02:57:09.876527+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:57:09.876527+0000","last_undegraded":"2024-09-12T02:57:09.876527+0000","last_fullsized":"2024-09-12T02:57:09.876527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346026+0000","last_change":"2024-09-12T02:57:04.879076+0000","last_active":"2024-09-12T02:57:10.346026+0000","last_peered":"2024-09-12T02:57:10.346026+0000","last_clean":"2024-09-12T02:57:10.346026+0000","last_became_active":"2024-09-12T02:57:04.878160+0000","last_became_peered":"2024-09-12T02:57:04.878160+0000","last_unstale":"2024-09-12T02:57:10.346026+0000","last_undegraded":"2024-09-12T02:57:10.346026+0000","last_fullsized":"2024-09-12T02:57:10.346026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.589537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366400+0000","last_change":"2024-09-12T02:57:03.798239+0000","last_active":"2024-09-12T02:57:10.366400+0000","last_peered":"2024-09-12T02:57:10.366400+0000","last_clean":"2024-09-12T02:57:10.366400+0000","last_became_active":"2024-09-12T02:57:03.797935+0000","last_became_peered":"2024-09-12T02:57:03.797935+0000","last_unstale":"2024-09-12T02:57:10.366400+0000","last_undegraded":"2024-09-12T02:57:10.366400+0000","last_fullsized":"2024-09-12T02:57:10.366400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875409+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:57:09.875409+0000","last_peered":"2024-09-12T02:57:09.875409+0000","last_clean":"2024-09-12T02:57:09.875409+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:57:09.875409+0000","last_undegraded":"2024-09-12T02:57:09.875409+0000","last_fullsized":"2024-09-12T02:57:09.875409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875411+0000","last_change":"2024-09-12T02:57:04.858809+0000","last_active":"2024-09-12T02:57:09.875411+0000","last_peered":"2024-09-12T02:57:09.875411+0000","last_clean":"2024-09-12T02:57:09.875411+0000","last_became_active":"2024-09-12T02:57:04.858048+0000","last_became_peered":"2024-09-12T02:57:04.858048+0000","last_unstale":"2024-09-12T02:57:09.875411+0000","last_undegraded":"2024-09-12T02:57:09.875411+0000","last_fullsized":"2024-09-12T02:57:09.875411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:59.698440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367203+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:57:10.367203+0000","last_peered":"2024-09-12T02:57:10.367203+0000","last_clean":"2024-09-12T02:57:10.367203+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:57:10.367203+0000","last_undegraded":"2024-09-12T02:57:10.367203+0000","last_fullsized":"2024-09-12T02:57:10.367203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885593+0000","last_change":"2024-09-12T02:57:08.874656+0000","last_active":"2024-09-12T02:57:09.885593+0000","last_peered":"2024-09-12T02:57:09.885593+0000","last_clean":"2024-09-12T02:57:09.885593+0000","last_became_active":"2024-09-12T02:57:08.874202+0000","last_became_peered":"2024-09-12T02:57:08.874202+0000","last_unstale":"2024-09-12T02:57:09.885593+0000","last_undegraded":"2024-09-12T02:57:09.885593+0000","last_fullsized":"2024-09-12T02:57:09.885593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.794828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346615+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:57:10.346615+0000","last_peered":"2024-09-12T02:57:10.346615+0000","last_clean":"2024-09-12T02:57:10.346615+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:57:10.346615+0000","last_undegraded":"2024-09-12T02:57:10.346615+0000","last_fullsized":"2024-09-12T02:57:10.346615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366863+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:57:10.366863+0000","last_peered":"2024-09-12T02:57:10.366863+0000","last_clean":"2024-09-12T02:57:10.366863+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:57:10.366863+0000","last_undegraded":"2024-09-12T02:57:10.366863+0000","last_fullsized":"2024-09-12T02:57:10.366863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874320+0000","last_change":"2024-09-12T02:57:09.030839+0000","last_active":"2024-09-12T02:57:09.874320+0000","last_peered":"2024-09-12T02:57:09.874320+0000","last_clean":"2024-09-12T02:57:09.874320+0000","last_became_active":"2024-09-12T02:57:09.029808+0000","last_became_peered":"2024-09-12T02:57:09.029808+0000","last_unstale":"2024-09-12T02:57:09.874320+0000","last_undegraded":"2024-09-12T02:57:09.874320+0000","last_fullsized":"2024-09-12T02:57:09.874320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346464+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:57:10.346464+0000","last_peered":"2024-09-12T02:57:10.346464+0000","last_clean":"2024-09-12T02:57:10.346464+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:57:10.346464+0000","last_undegraded":"2024-09-12T02:57:10.346464+0000","last_fullsized":"2024-09-12T02:57:10.346464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368984+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:57:10.368984+0000","last_peered":"2024-09-12T02:57:10.368984+0000","last_clean":"2024-09-12T02:57:10.368984+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:57:10.368984+0000","last_undegraded":"2024-09-12T02:57:10.368984+0000","last_fullsized":"2024-09-12T02:57:10.368984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367280+0000","last_change":"2024-09-12T02:57:08.896161+0000","last_active":"2024-09-12T02:57:10.367280+0000","last_peered":"2024-09-12T02:57:10.367280+0000","last_clean":"2024-09-12T02:57:10.367280+0000","last_became_active":"2024-09-12T02:57:08.895379+0000","last_became_peered":"2024-09-12T02:57:08.895379+0000","last_unstale":"2024-09-12T02:57:10.367280+0000","last_undegraded":"2024-09-12T02:57:10.367280+0000","last_fullsized":"2024-09-12T02:57:10.367280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:34.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345587+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:57:10.345587+0000","last_peered":"2024-09-12T02:57:10.345587+0000","last_clean":"2024-09-12T02:57:10.345587+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:57:10.345587+0000","last_undegraded":"2024-09-12T02:57:10.345587+0000","last_fullsized":"2024-09-12T02:57:10.345587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366369+0000","last_change":"2024-09-12T02:57:03.788301+0000","last_active":"2024-09-12T02:57:10.366369+0000","last_peered":"2024-09-12T02:57:10.366369+0000","last_clean":"2024-09-12T02:57:10.366369+0000","last_became_active":"2024-09-12T02:57:03.788002+0000","last_became_peered":"2024-09-12T02:57:03.788002+0000","last_unstale":"2024-09-12T02:57:10.366369+0000","last_undegraded":"2024-09-12T02:57:10.366369+0000","last_fullsized":"2024-09-12T02:57:10.366369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885578+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:57:09.885578+0000","last_peered":"2024-09-12T02:57:09.885578+0000","last_clean":"2024-09-12T02:57:09.885578+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:57:09.885578+0000","last_undegraded":"2024-09-12T02:57:09.885578+0000","last_fullsized":"2024-09-12T02:57:09.885578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875635+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:57:09.875635+0000","last_peered":"2024-09-12T02:57:09.875635+0000","last_clean":"2024-09-12T02:57:09.875635+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:57:09.875635+0000","last_undegraded":"2024-09-12T02:57:09.875635+0000","last_fullsized":"2024-09-12T02:57:09.875635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876542+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:57:09.876542+0000","last_peered":"2024-09-12T02:57:09.876542+0000","last_clean":"2024-09-12T02:57:09.876542+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:57:09.876542+0000","last_undegraded":"2024-09-12T02:57:09.876542+0000","last_fullsized":"2024-09-12T02:57:09.876542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872348+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:57:09.872348+0000","last_peered":"2024-09-12T02:57:09.872348+0000","last_clean":"2024-09-12T02:57:09.872348+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:57:09.872348+0000","last_undegraded":"2024-09-12T02:57:09.872348+0000","last_fullsized":"2024-09-12T02:57:09.872348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346216+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:57:10.346216+0000","last_peered":"2024-09-12T02:57:10.346216+0000","last_clean":"2024-09-12T02:57:10.346216+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:57:10.346216+0000","last_undegraded":"2024-09-12T02:57:10.346216+0000","last_fullsized":"2024-09-12T02:57:10.346216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875168+0000","last_change":"2024-09-12T02:57:03.802047+0000","last_active":"2024-09-12T02:57:09.875168+0000","last_peered":"2024-09-12T02:57:09.875168+0000","last_clean":"2024-09-12T02:57:09.875168+0000","last_became_active":"2024-09-12T02:57:03.797936+0000","last_became_peered":"2024-09-12T02:57:03.797936+0000","last_unstale":"2024-09-12T02:57:09.875168+0000","last_undegraded":"2024-09-12T02:57:09.875168+0000","last_fullsized":"2024-09-12T02:57:09.875168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:10.176640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872067+0000","last_change":"2024-09-12T02:57:09.030826+0000","last_active":"2024-09-12T02:57:09.872067+0000","last_peered":"2024-09-12T02:57:09.872067+0000","last_clean":"2024-09-12T02:57:09.872067+0000","last_became_active":"2024-09-12T02:57:09.029437+0000","last_became_peered":"2024-09-12T02:57:09.029437+0000","last_unstale":"2024-09-12T02:57:09.872067+0000","last_undegraded":"2024-09-12T02:57:09.872067+0000","last_fullsized":"2024-09-12T02:57:09.872067+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:15.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886359+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:57:09.886359+0000","last_peered":"2024-09-12T02:57:09.886359+0000","last_clean":"2024-09-12T02:57:09.886359+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:57:09.886359+0000","last_undegraded":"2024-09-12T02:57:09.886359+0000","last_fullsized":"2024-09-12T02:57:09.886359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885915+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:57:09.885915+0000","last_peered":"2024-09-12T02:57:09.885915+0000","last_clean":"2024-09-12T02:57:09.885915+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:57:09.885915+0000","last_undegraded":"2024-09-12T02:57:09.885915+0000","last_fullsized":"2024-09-12T02:57:09.885915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877662+0000","last_change":"2024-09-12T02:57:09.031080+0000","last_active":"2024-09-12T02:57:09.877662+0000","last_peered":"2024-09-12T02:57:09.877662+0000","last_clean":"2024-09-12T02:57:09.877662+0000","last_became_active":"2024-09-12T02:57:09.029892+0000","last_became_peered":"2024-09-12T02:57:09.029892+0000","last_unstale":"2024-09-12T02:57:09.877662+0000","last_undegraded":"2024-09-12T02:57:09.877662+0000","last_fullsized":"2024-09-12T02:57:09.877662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345803+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:57:10.345803+0000","last_peered":"2024-09-12T02:57:10.345803+0000","last_clean":"2024-09-12T02:57:10.345803+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:57:10.345803+0000","last_undegraded":"2024-09-12T02:57:10.345803+0000","last_fullsized":"2024-09-12T02:57:10.345803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:22.371934+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:57:22.371934+0000","last_peered":"2024-09-12T02:57:22.371934+0000","last_clean":"2024-09-12T02:57:22.371934+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:57:22.371934+0000","last_undegraded":"2024-09-12T02:57:22.371934+0000","last_fullsized":"2024-09-12T02:57:22.371934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366364+0000","last_change":"2024-09-12T02:57:08.884030+0000","last_active":"2024-09-12T02:57:10.366364+0000","last_peered":"2024-09-12T02:57:10.366364+0000","last_clean":"2024-09-12T02:57:10.366364+0000","last_became_active":"2024-09-12T02:57:08.880332+0000","last_became_peered":"2024-09-12T02:57:08.880332+0000","last_unstale":"2024-09-12T02:57:10.366364+0000","last_undegraded":"2024-09-12T02:57:10.366364+0000","last_fullsized":"2024-09-12T02:57:10.366364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:25.232846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368553+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:57:10.368553+0000","last_peered":"2024-09-12T02:57:10.368553+0000","last_clean":"2024-09-12T02:57:10.368553+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:57:10.368553+0000","last_undegraded":"2024-09-12T02:57:10.368553+0000","last_fullsized":"2024-09-12T02:57:10.368553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367151+0000","last_change":"2024-09-12T02:57:03.798009+0000","last_active":"2024-09-12T02:57:10.367151+0000","last_peered":"2024-09-12T02:57:10.367151+0000","last_clean":"2024-09-12T02:57:10.367151+0000","last_became_active":"2024-09-12T02:57:03.797749+0000","last_became_peered":"2024-09-12T02:57:03.797749+0000","last_unstale":"2024-09-12T02:57:10.367151+0000","last_undegraded":"2024-09-12T02:57:10.367151+0000","last_fullsized":"2024-09-12T02:57:10.367151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.058712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367936+0000","last_change":"2024-09-12T02:57:08.885401+0000","last_active":"2024-09-12T02:57:10.367936+0000","last_peered":"2024-09-12T02:57:10.367936+0000","last_clean":"2024-09-12T02:57:10.367936+0000","last_became_active":"2024-09-12T02:57:08.883296+0000","last_became_peered":"2024-09-12T02:57:08.883296+0000","last_unstale":"2024-09-12T02:57:10.367936+0000","last_undegraded":"2024-09-12T02:57:10.367936+0000","last_fullsized":"2024-09-12T02:57:10.367936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:24.419611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886680+0000","last_change":"2024-09-12T02:57:04.882349+0000","last_active":"2024-09-12T02:57:09.886680+0000","last_peered":"2024-09-12T02:57:09.886680+0000","last_clean":"2024-09-12T02:57:09.886680+0000","last_became_active":"2024-09-12T02:57:04.882060+0000","last_became_peered":"2024-09-12T02:57:04.882060+0000","last_unstale":"2024-09-12T02:57:09.886680+0000","last_undegraded":"2024-09-12T02:57:09.886680+0000","last_fullsized":"2024-09-12T02:57:09.886680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876076+0000","last_change":"2024-09-12T02:57:03.811429+0000","last_active":"2024-09-12T02:57:09.876076+0000","last_peered":"2024-09-12T02:57:09.876076+0000","last_clean":"2024-09-12T02:57:09.876076+0000","last_became_active":"2024-09-12T02:57:03.810672+0000","last_became_peered":"2024-09-12T02:57:03.810672+0000","last_unstale":"2024-09-12T02:57:09.876076+0000","last_undegraded":"2024-09-12T02:57:09.876076+0000","last_fullsized":"2024-09-12T02:57:09.876076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871687+0000","last_change":"2024-09-12T02:57:08.875903+0000","last_active":"2024-09-12T02:57:09.871687+0000","last_peered":"2024-09-12T02:57:09.871687+0000","last_clean":"2024-09-12T02:57:09.871687+0000","last_became_active":"2024-09-12T02:57:08.875270+0000","last_became_peered":"2024-09-12T02:57:08.875270+0000","last_unstale":"2024-09-12T02:57:09.871687+0000","last_undegraded":"2024-09-12T02:57:09.871687+0000","last_fullsized":"2024-09-12T02:57:09.871687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875836+0000","last_change":"2024-09-12T02:57:04.864904+0000","last_active":"2024-09-12T02:57:09.875836+0000","last_peered":"2024-09-12T02:57:09.875836+0000","last_clean":"2024-09-12T02:57:09.875836+0000","last_became_active":"2024-09-12T02:57:04.861650+0000","last_became_peered":"2024-09-12T02:57:04.861650+0000","last_unstale":"2024-09-12T02:57:09.875836+0000","last_undegraded":"2024-09-12T02:57:09.875836+0000","last_fullsized":"2024-09-12T02:57:09.875836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:31.529412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877718+0000","last_change":"2024-09-12T02:57:03.812106+0000","last_active":"2024-09-12T02:57:09.877718+0000","last_peered":"2024-09-12T02:57:09.877718+0000","last_clean":"2024-09-12T02:57:09.877718+0000","last_became_active":"2024-09-12T02:57:03.810041+0000","last_became_peered":"2024-09-12T02:57:03.810041+0000","last_unstale":"2024-09-12T02:57:09.877718+0000","last_undegraded":"2024-09-12T02:57:09.877718+0000","last_fullsized":"2024-09-12T02:57:09.877718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871655+0000","last_change":"2024-09-12T02:57:09.030507+0000","last_active":"2024-09-12T02:57:09.871655+0000","last_peered":"2024-09-12T02:57:09.871655+0000","last_clean":"2024-09-12T02:57:09.871655+0000","last_became_active":"2024-09-12T02:57:09.029459+0000","last_became_peered":"2024-09-12T02:57:09.029459+0000","last_unstale":"2024-09-12T02:57:09.871655+0000","last_undegraded":"2024-09-12T02:57:09.871655+0000","last_fullsized":"2024-09-12T02:57:09.871655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:26.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885411+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:57:09.885411+0000","last_peered":"2024-09-12T02:57:09.885411+0000","last_clean":"2024-09-12T02:57:09.885411+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:57:09.885411+0000","last_undegraded":"2024-09-12T02:57:09.885411+0000","last_fullsized":"2024-09-12T02:57:09.885411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.365943+0000","last_change":"2024-09-12T02:57:04.834192+0000","last_active":"2024-09-12T02:57:10.365943+0000","last_peered":"2024-09-12T02:57:10.365943+0000","last_clean":"2024-09-12T02:57:10.365943+0000","last_became_active":"2024-09-12T02:57:04.833901+0000","last_became_peered":"2024-09-12T02:57:04.833901+0000","last_unstale":"2024-09-12T02:57:10.365943+0000","last_undegraded":"2024-09-12T02:57:10.365943+0000","last_fullsized":"2024-09-12T02:57:10.365943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:51:30.019270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874853+0000","last_change":"2024-09-12T02:57:03.807210+0000","last_active":"2024-09-12T02:57:09.874853+0000","last_peered":"2024-09-12T02:57:09.874853+0000","last_clean":"2024-09-12T02:57:09.874853+0000","last_became_active":"2024-09-12T02:57:03.805335+0000","last_became_peered":"2024-09-12T02:57:03.805335+0000","last_unstale":"2024-09-12T02:57:09.874853+0000","last_undegraded":"2024-09-12T02:57:09.874853+0000","last_fullsized":"2024-09-12T02:57:09.874853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876801+0000","last_change":"2024-09-12T02:57:08.895753+0000","last_active":"2024-09-12T02:57:09.876801+0000","last_peered":"2024-09-12T02:57:09.876801+0000","last_clean":"2024-09-12T02:57:09.876801+0000","last_became_active":"2024-09-12T02:57:08.894542+0000","last_became_peered":"2024-09-12T02:57:08.894542+0000","last_unstale":"2024-09-12T02:57:09.876801+0000","last_undegraded":"2024-09-12T02:57:09.876801+0000","last_fullsized":"2024-09-12T02:57:09.876801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871791+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:57:09.871791+0000","last_peered":"2024-09-12T02:57:09.871791+0000","last_clean":"2024-09-12T02:57:09.871791+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:57:09.871791+0000","last_undegraded":"2024-09-12T02:57:09.871791+0000","last_fullsized":"2024-09-12T02:57:09.871791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871652+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:57:09.871652+0000","last_peered":"2024-09-12T02:57:09.871652+0000","last_clean":"2024-09-12T02:57:09.871652+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:57:09.871652+0000","last_undegraded":"2024-09-12T02:57:09.871652+0000","last_fullsized":"2024-09-12T02:57:09.871652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875973+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:57:09.875973+0000","last_peered":"2024-09-12T02:57:09.875973+0000","last_clean":"2024-09-12T02:57:09.875973+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:57:09.875973+0000","last_undegraded":"2024-09-12T02:57:09.875973+0000","last_fullsized":"2024-09-12T02:57:09.875973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885802+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:57:09.885802+0000","last_peered":"2024-09-12T02:57:09.885802+0000","last_clean":"2024-09-12T02:57:09.885802+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:57:09.885802+0000","last_undegraded":"2024-09-12T02:57:09.885802+0000","last_fullsized":"2024-09-12T02:57:09.885802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366287+0000","last_change":"2024-09-12T02:57:08.873190+0000","last_active":"2024-09-12T02:57:10.366287+0000","last_peered":"2024-09-12T02:57:10.366287+0000","last_clean":"2024-09-12T02:57:10.366287+0000","last_became_active":"2024-09-12T02:57:08.872526+0000","last_became_peered":"2024-09-12T02:57:08.872526+0000","last_unstale":"2024-09-12T02:57:10.366287+0000","last_undegraded":"2024-09-12T02:57:10.366287+0000","last_fullsized":"2024-09-12T02:57:10.366287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:15.257391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871819+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:57:09.871819+0000","last_peered":"2024-09-12T02:57:09.871819+0000","last_clean":"2024-09-12T02:57:09.871819+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:57:09.871819+0000","last_undegraded":"2024-09-12T02:57:09.871819+0000","last_fullsized":"2024-09-12T02:57:09.871819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367905+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:57:10.367905+0000","last_peered":"2024-09-12T02:57:10.367905+0000","last_clean":"2024-09-12T02:57:10.367905+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:57:10.367905+0000","last_undegraded":"2024-09-12T02:57:10.367905+0000","last_fullsized":"2024-09-12T02:57:10.367905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872056+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:57:09.872056+0000","last_peered":"2024-09-12T02:57:09.872056+0000","last_clean":"2024-09-12T02:57:09.872056+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:57:09.872056+0000","last_undegraded":"2024-09-12T02:57:09.872056+0000","last_fullsized":"2024-09-12T02:57:09.872056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875137+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:57:09.875137+0000","last_peered":"2024-09-12T02:57:09.875137+0000","last_clean":"2024-09-12T02:57:09.875137+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:57:09.875137+0000","last_undegraded":"2024-09-12T02:57:09.875137+0000","last_fullsized":"2024-09-12T02:57:09.875137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366549+0000","last_change":"2024-09-12T02:57:04.841244+0000","last_active":"2024-09-12T02:57:10.366549+0000","last_peered":"2024-09-12T02:57:10.366549+0000","last_clean":"2024-09-12T02:57:10.366549+0000","last_became_active":"2024-09-12T02:57:04.837935+0000","last_became_peered":"2024-09-12T02:57:04.837935+0000","last_unstale":"2024-09-12T02:57:10.366549+0000","last_undegraded":"2024-09-12T02:57:10.366549+0000","last_fullsized":"2024-09-12T02:57:10.366549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:50.023694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875090+0000","last_change":"2024-09-12T02:57:04.874054+0000","last_active":"2024-09-12T02:57:09.875090+0000","last_peered":"2024-09-12T02:57:09.875090+0000","last_clean":"2024-09-12T02:57:09.875090+0000","last_became_active":"2024-09-12T02:57:04.867372+0000","last_became_peered":"2024-09-12T02:57:04.867372+0000","last_unstale":"2024-09-12T02:57:09.875090+0000","last_undegraded":"2024-09-12T02:57:09.875090+0000","last_fullsized":"2024-09-12T02:57:09.875090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:06.010582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885676+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:57:09.885676+0000","last_peered":"2024-09-12T02:57:09.885676+0000","last_clean":"2024-09-12T02:57:09.885676+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:57:09.885676+0000","last_undegraded":"2024-09-12T02:57:09.885676+0000","last_fullsized":"2024-09-12T02:57:09.885676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872206+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:57:09.872206+0000","last_peered":"2024-09-12T02:57:09.872206+0000","last_clean":"2024-09-12T02:57:09.872206+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:57:09.872206+0000","last_undegraded":"2024-09-12T02:57:09.872206+0000","last_fullsized":"2024-09-12T02:57:09.872206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367050+0000","last_change":"2024-09-12T02:57:04.836873+0000","last_active":"2024-09-12T02:57:10.367050+0000","last_peered":"2024-09-12T02:57:10.367050+0000","last_clean":"2024-09-12T02:57:10.367050+0000","last_became_active":"2024-09-12T02:57:04.836564+0000","last_became_peered":"2024-09-12T02:57:04.836564+0000","last_unstale":"2024-09-12T02:57:10.367050+0000","last_undegraded":"2024-09-12T02:57:10.367050+0000","last_fullsized":"2024-09-12T02:57:10.367050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.539077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877094+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:57:09.877094+0000","last_peered":"2024-09-12T02:57:09.877094+0000","last_clean":"2024-09-12T02:57:09.877094+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:57:09.877094+0000","last_undegraded":"2024-09-12T02:57:09.877094+0000","last_fullsized":"2024-09-12T02:57:09.877094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.872473+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:57:09.872473+0000","last_peered":"2024-09-12T02:57:09.872473+0000","last_clean":"2024-09-12T02:57:09.872473+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:57:09.872473+0000","last_undegraded":"2024-09-12T02:57:09.872473+0000","last_fullsized":"2024-09-12T02:57:09.872473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874601+0000","last_change":"2024-09-12T02:57:04.874760+0000","last_active":"2024-09-12T02:57:09.874601+0000","last_peered":"2024-09-12T02:57:09.874601+0000","last_clean":"2024-09-12T02:57:09.874601+0000","last_became_active":"2024-09-12T02:57:04.861196+0000","last_became_peered":"2024-09-12T02:57:04.861196+0000","last_unstale":"2024-09-12T02:57:09.874601+0000","last_undegraded":"2024-09-12T02:57:09.874601+0000","last_fullsized":"2024-09-12T02:57:09.874601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871359+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:57:09.871359+0000","last_peered":"2024-09-12T02:57:09.871359+0000","last_clean":"2024-09-12T02:57:09.871359+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:57:09.871359+0000","last_undegraded":"2024-09-12T02:57:09.871359+0000","last_fullsized":"2024-09-12T02:57:09.871359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874921+0000","last_change":"2024-09-12T02:57:04.879052+0000","last_active":"2024-09-12T02:57:09.874921+0000","last_peered":"2024-09-12T02:57:09.874921+0000","last_clean":"2024-09-12T02:57:09.874921+0000","last_became_active":"2024-09-12T02:57:04.877672+0000","last_became_peered":"2024-09-12T02:57:04.877672+0000","last_unstale":"2024-09-12T02:57:09.874921+0000","last_undegraded":"2024-09-12T02:57:09.874921+0000","last_fullsized":"2024-09-12T02:57:09.874921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885442+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:57:09.885442+0000","last_peered":"2024-09-12T02:57:09.885442+0000","last_clean":"2024-09-12T02:57:09.885442+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:57:09.885442+0000","last_undegraded":"2024-09-12T02:57:09.885442+0000","last_fullsized":"2024-09-12T02:57:09.885442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.876589+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:57:09.876589+0000","last_peered":"2024-09-12T02:57:09.876589+0000","last_clean":"2024-09-12T02:57:09.876589+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:57:09.876589+0000","last_undegraded":"2024-09-12T02:57:09.876589+0000","last_fullsized":"2024-09-12T02:57:09.876589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346360+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:57:10.346360+0000","last_peered":"2024-09-12T02:57:10.346360+0000","last_clean":"2024-09-12T02:57:10.346360+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:57:10.346360+0000","last_undegraded":"2024-09-12T02:57:10.346360+0000","last_fullsized":"2024-09-12T02:57:10.346360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366832+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:57:10.366832+0000","last_peered":"2024-09-12T02:57:10.366832+0000","last_clean":"2024-09-12T02:57:10.366832+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:57:10.366832+0000","last_undegraded":"2024-09-12T02:57:10.366832+0000","last_fullsized":"2024-09-12T02:57:10.366832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877276+0000","last_change":"2024-09-12T02:57:04.867799+0000","last_active":"2024-09-12T02:57:09.877276+0000","last_peered":"2024-09-12T02:57:09.877276+0000","last_clean":"2024-09-12T02:57:09.877276+0000","last_became_active":"2024-09-12T02:57:04.863800+0000","last_became_peered":"2024-09-12T02:57:04.863800+0000","last_unstale":"2024-09-12T02:57:09.877276+0000","last_undegraded":"2024-09-12T02:57:09.877276+0000","last_fullsized":"2024-09-12T02:57:09.877276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874304+0000","last_change":"2024-09-12T02:57:04.864906+0000","last_active":"2024-09-12T02:57:09.874304+0000","last_peered":"2024-09-12T02:57:09.874304+0000","last_clean":"2024-09-12T02:57:09.874304+0000","last_became_active":"2024-09-12T02:57:04.863556+0000","last_became_peered":"2024-09-12T02:57:04.863556+0000","last_unstale":"2024-09-12T02:57:09.874304+0000","last_undegraded":"2024-09-12T02:57:09.874304+0000","last_fullsized":"2024-09-12T02:57:09.874304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.366044+0000","last_change":"2024-09-12T02:57:04.826304+0000","last_active":"2024-09-12T02:57:10.366044+0000","last_peered":"2024-09-12T02:57:10.366044+0000","last_clean":"2024-09-12T02:57:10.366044+0000","last_became_active":"2024-09-12T02:57:04.825998+0000","last_became_peered":"2024-09-12T02:57:04.825998+0000","last_unstale":"2024-09-12T02:57:10.366044+0000","last_undegraded":"2024-09-12T02:57:10.366044+0000","last_fullsized":"2024-09-12T02:57:10.366044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:35.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.886270+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:57:09.886270+0000","last_peered":"2024-09-12T02:57:09.886270+0000","last_clean":"2024-09-12T02:57:09.886270+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:57:09.886270+0000","last_undegraded":"2024-09-12T02:57:09.886270+0000","last_fullsized":"2024-09-12T02:57:09.886270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871588+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:57:09.871588+0000","last_peered":"2024-09-12T02:57:09.871588+0000","last_clean":"2024-09-12T02:57:09.871588+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:57:09.871588+0000","last_undegraded":"2024-09-12T02:57:09.871588+0000","last_fullsized":"2024-09-12T02:57:09.871588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.368395+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:57:10.368395+0000","last_peered":"2024-09-12T02:57:10.368395+0000","last_clean":"2024-09-12T02:57:10.368395+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:57:10.368395+0000","last_undegraded":"2024-09-12T02:57:10.368395+0000","last_fullsized":"2024-09-12T02:57:10.368395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877007+0000","last_change":"2024-09-12T02:57:04.864295+0000","last_active":"2024-09-12T02:57:09.877007+0000","last_peered":"2024-09-12T02:57:09.877007+0000","last_clean":"2024-09-12T02:57:09.877007+0000","last_became_active":"2024-09-12T02:57:04.863563+0000","last_became_peered":"2024-09-12T02:57:04.863563+0000","last_unstale":"2024-09-12T02:57:09.877007+0000","last_undegraded":"2024-09-12T02:57:09.877007+0000","last_fullsized":"2024-09-12T02:57:09.877007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.877026+0000","last_change":"2024-09-12T02:57:04.860987+0000","last_active":"2024-09-12T02:57:09.877026+0000","last_peered":"2024-09-12T02:57:09.877026+0000","last_clean":"2024-09-12T02:57:09.877026+0000","last_became_active":"2024-09-12T02:57:04.859032+0000","last_became_peered":"2024-09-12T02:57:04.859032+0000","last_unstale":"2024-09-12T02:57:09.877026+0000","last_undegraded":"2024-09-12T02:57:09.877026+0000","last_fullsized":"2024-09-12T02:57:09.877026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346559+0000","last_change":"2024-09-12T02:57:04.881172+0000","last_active":"2024-09-12T02:57:10.346559+0000","last_peered":"2024-09-12T02:57:10.346559+0000","last_clean":"2024-09-12T02:57:10.346559+0000","last_became_active":"2024-09-12T02:57:04.880660+0000","last_became_peered":"2024-09-12T02:57:04.880660+0000","last_unstale":"2024-09-12T02:57:10.346559+0000","last_undegraded":"2024-09-12T02:57:10.346559+0000","last_fullsized":"2024-09-12T02:57:10.346559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:15.389185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.871386+0000","last_change":"2024-09-12T02:57:04.876735+0000","last_active":"2024-09-12T02:57:09.871386+0000","last_peered":"2024-09-12T02:57:09.871386+0000","last_clean":"2024-09-12T02:57:09.871386+0000","last_became_active":"2024-09-12T02:57:04.876321+0000","last_became_peered":"2024-09-12T02:57:04.876321+0000","last_unstale":"2024-09-12T02:57:09.871386+0000","last_undegraded":"2024-09-12T02:57:09.871386+0000","last_fullsized":"2024-09-12T02:57:09.871386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345483+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:57:10.345483+0000","last_peered":"2024-09-12T02:57:10.345483+0000","last_clean":"2024-09-12T02:57:10.345483+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:57:10.345483+0000","last_undegraded":"2024-09-12T02:57:10.345483+0000","last_fullsized":"2024-09-12T02:57:10.345483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.874829+0000","last_change":"2024-09-12T02:57:04.878277+0000","last_active":"2024-09-12T02:57:09.874829+0000","last_peered":"2024-09-12T02:57:09.874829+0000","last_clean":"2024-09-12T02:57:09.874829+0000","last_became_active":"2024-09-12T02:57:04.876816+0000","last_became_peered":"2024-09-12T02:57:04.876816+0000","last_unstale":"2024-09-12T02:57:09.874829+0000","last_undegraded":"2024-09-12T02:57:09.874829+0000","last_fullsized":"2024-09-12T02:57:09.874829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.345685+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:57:10.345685+0000","last_peered":"2024-09-12T02:57:10.345685+0000","last_clean":"2024-09-12T02:57:10.345685+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:57:10.345685+0000","last_undegraded":"2024-09-12T02:57:10.345685+0000","last_fullsized":"2024-09-12T02:57:10.345685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.875150+0000","last_change":"2024-09-12T02:57:04.876472+0000","last_active":"2024-09-12T02:57:09.875150+0000","last_peered":"2024-09-12T02:57:09.875150+0000","last_clean":"2024-09-12T02:57:09.875150+0000","last_became_active":"2024-09-12T02:57:04.867264+0000","last_became_peered":"2024-09-12T02:57:04.867264+0000","last_unstale":"2024-09-12T02:57:09.875150+0000","last_undegraded":"2024-09-12T02:57:09.875150+0000","last_fullsized":"2024-09-12T02:57:09.875150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:09.885265+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:57:09.885265+0000","last_peered":"2024-09-12T02:57:09.885265+0000","last_clean":"2024-09-12T02:57:09.885265+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:57:09.885265+0000","last_undegraded":"2024-09-12T02:57:09.885265+0000","last_fullsized":"2024-09-12T02:57:09.885265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.367313+0000","last_change":"2024-09-12T02:57:04.841638+0000","last_active":"2024-09-12T02:57:10.367313+0000","last_peered":"2024-09-12T02:57:10.367313+0000","last_clean":"2024-09-12T02:57:10.367313+0000","last_became_active":"2024-09-12T02:57:04.841367+0000","last_became_peered":"2024-09-12T02:57:04.841367+0000","last_unstale":"2024-09-12T02:57:10.367313+0000","last_undegraded":"2024-09-12T02:57:10.367313+0000","last_fullsized":"2024-09-12T02:57:10.367313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:24.890973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-12T02:57:10.346275+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:57:10.346275+0000","last_peered":"2024-09-12T02:57:10.346275+0000","last_clean":"2024-09-12T02:57:10.346275+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:57:10.346275+0000","last_undegraded":"2024-09-12T02:57:10.346275+0000","last_fullsized":"2024-09-12T02:57:10.346275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":698380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":698324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":274432,"data_stored":107464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542157,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":107534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:57:46.582 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:57:46.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T02:57:46.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.753+0000 7f3145800640 1 Processor -- start 2024-09-12T02:57:46.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.753+0000 7f3145800640 1 -- start start 2024-09-12T02:57:46.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3145800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31400cb670 0x7f3140071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3145800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3140071990 0x7f314015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3145800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31400c8e40 con 0x7f31401549e0 2024-09-12T02:57:46.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3145800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f314006e940 con 0x7f3140071990 2024-09-12T02:57:46.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3145800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f31400cba50 con 0x7f31400cb670 2024-09-12T02:57:46.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3144e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3140071990 0x7f314015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3144e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3140071990 0x7f314015ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56906/0 (socket says 172.21.15.63:56906) 2024-09-12T02:57:46.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3144e00640 1 -- 172.21.15.63:0/2662816101 learned_addr learned my addr 172.21.15.63:0/2662816101 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:46.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3137400640 1 --2- 172.21.15.63:0/2662816101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31400cb670 0x7f3140071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3144e00640 1 -- 172.21.15.63:0/2662816101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31400cb670 msgr2=0x7f3140071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:46.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3144e00640 1 --2- 172.21.15.63:0/2662816101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31400cb670 0x7f3140071450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3144e00640 1 -- 172.21.15.63:0/2662816101 >> v1:172.21.15.119:6789/0 conn(0x7f31401549e0 legacy=0x7f31400c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3144e00640 1 -- 172.21.15.63:0/2662816101 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314015de10 con 0x7f3140071990 2024-09-12T02:57:46.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.757+0000 7f3137400640 1 --2- 172.21.15.63:0/2662816101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31400cb670 0x7f3140071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:46.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3144e00640 1 --2- 172.21.15.63:0/2662816101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3140071990 0x7f314015ab50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3138009e50 tx=0x7f313801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8c9960e9246abb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:46.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f313f400640 1 -- 172.21.15.63:0/2662816101 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31380a57f0 con 0x7f3140071990 2024-09-12T02:57:46.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f313f400640 1 -- 172.21.15.63:0/2662816101 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31380a5990 con 0x7f3140071990 2024-09-12T02:57:46.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f313f400640 1 -- 172.21.15.63:0/2662816101 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31380a5d60 con 0x7f3140071990 2024-09-12T02:57:46.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 -- 172.21.15.63:0/2662816101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3140071990 msgr2=0x7f314015ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 --2- 172.21.15.63:0/2662816101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3140071990 0x7f314015ab50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3138009e50 tx=0x7f313801ca30 comp rx=0 tx=0).stop 2024-09-12T02:57:46.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 -- 172.21.15.63:0/2662816101 shutdown_connections 2024-09-12T02:57:46.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 --2- 172.21.15.63:0/2662816101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3140071990 0x7f314015ab50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 --2- 172.21.15.63:0/2662816101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31400cb670 0x7f3140071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 -- 172.21.15.63:0/2662816101 >> 172.21.15.63:0/2662816101 conn(0x7f314006f6e0 msgr2=0x7f314006faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:46.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 -- 172.21.15.63:0/2662816101 shutdown_connections 2024-09-12T02:57:46.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 -- 172.21.15.63:0/2662816101 wait complete. 2024-09-12T02:57:46.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 Processor -- start 2024-09-12T02:57:46.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 -- start start 2024-09-12T02:57:46.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3140071990 0x7f31401f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31400cb670 0x7f3140156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31401549e0 0x7f3140156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f314015b4a0 con 0x7f31400cb670 2024-09-12T02:57:46.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f314015e990 con 0x7f3140071990 2024-09-12T02:57:46.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.761+0000 7f3145800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f3140154dc0 con 0x7f31401549e0 2024-09-12T02:57:46.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3137400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31400cb670 0x7f3140156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3137400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31400cb670 0x7f3140156890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56920/0 (socket says 172.21.15.63:56920) 2024-09-12T02:57:46.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3137400640 1 -- 172.21.15.63:0/1305986405 learned_addr learned my addr 172.21.15.63:0/1305986405 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:46.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f313fe00640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3140071990 0x7f31401f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3144e00640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31401549e0 0x7f3140156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3137400640 1 -- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31401549e0 msgr2=0x7f3140156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3137400640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31401549e0 0x7f3140156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3137400640 1 -- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3140071990 msgr2=0x7f31401f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3137400640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3140071990 0x7f31401f7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3137400640 1 -- 172.21.15.63:0/1305986405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314014e3e0 con 0x7f31400cb670 2024-09-12T02:57:46.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3144e00640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31401549e0 0x7f3140156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:46.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3137400640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31400cb670 0x7f3140156890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f312800e840 tx=0x7f312800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:46.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f313cc00640 1 -- 172.21.15.63:0/1305986405 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3128017070 con 0x7f31400cb670 2024-09-12T02:57:46.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f313cc00640 1 -- 172.21.15.63:0/1305986405 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f312800c8d0 con 0x7f31400cb670 2024-09-12T02:57:46.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31401f8000 con 0x7f31400cb670 2024-09-12T02:57:46.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f313cc00640 1 -- 172.21.15.63:0/1305986405 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312800f040 con 0x7f31400cb670 2024-09-12T02:57:46.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3140156090 con 0x7f31400cb670 2024-09-12T02:57:46.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3140150c20 con 0x7f31400cb670 2024-09-12T02:57:46.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f313cc00640 1 -- 172.21.15.63:0/1305986405 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f312801a070 con 0x7f31400cb670 2024-09-12T02:57:46.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.765+0000 7f313cc00640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f311c0678c0 0x7f311c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:46.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.769+0000 7f313cc00640 1 -- 172.21.15.63:0/1305986405 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3128085c20 con 0x7f31400cb670 2024-09-12T02:57:46.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.769+0000 7f313fe00640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f311c0678c0 0x7f311c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:46.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.769+0000 7f313fe00640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f311c0678c0 0x7f311c069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f31401f4e70 tx=0x7f3130009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:46.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.773+0000 7f313cc00640 1 -- 172.21.15.63:0/1305986405 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f314014e3e0 con 0x7f31400cb670 2024-09-12T02:57:46.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.945+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f314015ab50 con 0x7f31400cb670 2024-09-12T02:57:46.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.945+0000 7f313cc00640 1 -- 172.21.15.63:0/1305986405 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v27) ==== 56+0+3693 (secure 0 0 0) 0x7f3128055d30 con 0x7f31400cb670 2024-09-12T02:57:46.948 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 27 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 20b0bc3b-ca7e-4b63-a9bc-3526f84b65da 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-12T02:56:41.049401+0000 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:modified 2024-09-12T02:57:46.770235+0000 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:crush_version 6 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:full_ratio 0.95 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:backfillfull_ratio 0.9 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:nearfull_ratio 0.85 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:require_min_compat_client luminous 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:min_compat_client luminous 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:require_osd_release squid 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:stretch_mode_enabled false 2024-09-12T02:57:46.949 INFO:teuthology.orchestra.run.smithi063.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:pool 2 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.50 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:pool 3 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.38 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 26 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:max_osd 8 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] [v2:172.21.15.63:6826/3662141659,v1:172.21.15.63:6827/3662141659] exists,up 5c33857f-3772-4c5f-9025-2157ac056da1 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 up in weight 1 up_from 13 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] [v2:172.21.15.63:6802/866448188,v1:172.21.15.63:6803/866448188] exists,up 9a1b1d8b-fd3f-4b94-8135-941da7cb2797 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] [v2:172.21.15.63:6818/4130213561,v1:172.21.15.63:6819/4130213561] exists,up f23c8af2-7fa2-4e43-99de-7bf2670b72ce 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] [v2:172.21.15.63:6810/2574114576,v1:172.21.15.63:6811/2574114576] exists,up 0b6a2786-33e7-4286-92f4-e8d25573149a 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] [v2:172.21.15.119:6810/946317737,v1:172.21.15.119:6811/946317737] exists,up cdd5dfe1-3893-42ee-8706-50ef5c92ac9f 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] [v2:172.21.15.119:6826/4151470176,v1:172.21.15.119:6827/4151470176] exists,up 442157e7-0a20-45b7-a3b6-f4a930643516 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] [v2:172.21.15.119:6818/2029574290,v1:172.21.15.119:6819/2029574290] exists,up 0f1cd9bc-aafa-4004-b7e5-6ea6e409d398 2024-09-12T02:57:46.950 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7 up in weight 1 up_from 14 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] [v2:172.21.15.119:6802/3494373582,v1:172.21.15.119:6803/3494373582] exists,up ac41ac05-d082-43f8-93ec-ba27bf53fd08 2024-09-12T02:57:46.951 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.d [7,1] 2024-09-12T02:57:46.951 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.16 [5,2] 2024-09-12T02:57:46.951 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.19 [3,2] 2024-09-12T02:57:46.951 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 3.36 [5,2] 2024-09-12T02:57:46.951 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 4.3 [1,2] 2024-09-12T02:57:46.951 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 4.13 [1,2] 2024-09-12T02:57:46.951 INFO:teuthology.orchestra.run.smithi063.stdout:pg_upmap_items 4.18 [1,2] 2024-09-12T02:57:46.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f311c0678c0 msgr2=0x7f311c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f311c0678c0 0x7f311c069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f31401f4e70 tx=0x7f3130009040 comp rx=0 tx=0).stop 2024-09-12T02:57:46.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31400cb670 msgr2=0x7f3140156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:46.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31400cb670 0x7f3140156890 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f312800e840 tx=0x7f312800ed00 comp rx=0 tx=0).stop 2024-09-12T02:57:46.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 shutdown_connections 2024-09-12T02:57:46.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f311c0678c0 0x7f311c069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31401549e0 0x7f3140156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31400cb670 0x7f3140156890 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 --2- 172.21.15.63:0/1305986405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3140071990 0x7f31401f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:46.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 >> 172.21.15.63:0/1305986405 conn(0x7f314006f6e0 msgr2=0x7f314006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:46.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 shutdown_connections 2024-09-12T02:57:46.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:46.949+0000 7f3145800640 1 -- 172.21.15.63:0/1305986405 wait complete. 2024-09-12T02:57:46.970 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] [v2:172.21.15.63:6826/3662141659,v1:172.21.15.63:6827/3662141659] exists,up 5c33857f-3772-4c5f-9025-2157ac056da1', 'osd.1 up in weight 1 up_from 13 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] [v2:172.21.15.63:6802/866448188,v1:172.21.15.63:6803/866448188] exists,up 9a1b1d8b-fd3f-4b94-8135-941da7cb2797', 'osd.2 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] [v2:172.21.15.63:6818/4130213561,v1:172.21.15.63:6819/4130213561] exists,up f23c8af2-7fa2-4e43-99de-7bf2670b72ce', 'osd.3 up in weight 1 up_from 15 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] [v2:172.21.15.63:6810/2574114576,v1:172.21.15.63:6811/2574114576] exists,up 0b6a2786-33e7-4286-92f4-e8d25573149a', 'osd.4 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] [v2:172.21.15.119:6810/946317737,v1:172.21.15.119:6811/946317737] exists,up cdd5dfe1-3893-42ee-8706-50ef5c92ac9f', 'osd.5 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] [v2:172.21.15.119:6826/4151470176,v1:172.21.15.119:6827/4151470176] exists,up 442157e7-0a20-45b7-a3b6-f4a930643516', 'osd.6 up in weight 1 up_from 14 up_thru 24 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] [v2:172.21.15.119:6818/2029574290,v1:172.21.15.119:6819/2029574290] exists,up 0f1cd9bc-aafa-4004-b7e5-6ea6e409d398', 'osd.7 up in weight 1 up_from 14 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] [v2:172.21.15.119:6802/3494373582,v1:172.21.15.119:6803/3494373582] exists,up ac41ac05-d082-43f8-93ec-ba27bf53fd08'] 2024-09-12T02:57:46.970 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T02:57:47.110 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:47.110 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "mon.a", 2024-09-12T02:57:47.110 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster": "ceph", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "admin_socket_mode": "", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_client_required": "cephx, none", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_cluster_required": "cephx", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_debug": "true", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_service_required": "cephx", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_supported": "cephx", 2024-09-12T02:57:47.111 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio": "true", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_aio_reap_max": "16", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_async_discard": "false", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_block_size": "4096", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_aio": "false", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_enable_discard": "false", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_flock_retry": "3", 2024-09-12T02:57:47.112 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_inject_crash": "0", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_ioring": "false", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_ioring_hipri": "false", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bdev_type": "", 2024-09-12T02:57:47.113 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T02:57:47.114 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_allocator": "hybrid", 2024-09-12T02:57:47.114 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_buffered_io": "true", 2024-09-12T02:57:47.114 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T02:57:47.114 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T02:57:47.114 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T02:57:47.114 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T02:57:47.114 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T02:57:47.114 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_replay_recovery": "false", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluefs_sync_write": "false", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T02:57:47.115 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_allocator": "hybrid", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T02:57:47.116 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_create": "true", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_db_create": "false", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_db_path": "", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_db_size": "0", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_path": "", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_size": "107374182400", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_wal_create": "false", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_wal_path": "", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs": "true", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T02:57:47.117 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_autotune": "true", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T02:57:47.118 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_size": "0", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cache_type": "2q", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_clone_cow": "true", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T02:57:47.119 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_mode": "none", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_freelist": "false", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T02:57:47.120 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T02:57:47.121 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fail_eio": "false", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T02:57:47.122 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T02:57:47.123 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_blob_size": "0", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T02:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T02:57:47.125 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_spdk_mem": "512", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_tracing": "false", 2024-09-12T02:57:47.126 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T02:57:47.127 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_cluster_require_version": "2", 2024-09-12T02:57:47.128 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_require_signatures": "false", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_require_version": "2", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_service_require_signatures": "false", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_service_require_version": "2", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "cephx_sign_messages": "true", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "chdir": "", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_acl_type": "", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_asio_thread_count": "2", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_cache_mid": "0.750000", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_cache_size": "16384", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_caps_release_delay": "5", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_check_pool_perm": "true", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T02:57:47.129 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_force_sync_read": "false", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_getattr_caps": "false", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_inject_features": "", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_die_on_failed_remount": "false", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_dirsize_rbytes": "true", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_force_lazyio": "false", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_fs": "", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_inject_release_failure": "false", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_max_inline_size": "4096", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T02:57:47.130 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mds_namespace": "", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_metadata": "", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mount_gid": "-1", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mount_timeout": "300", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mount_uid": "-1", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_mountpoint": "/", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_notify_timeout": "10", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc": "true", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_max_objects": "1000", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_size": "209715200", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T02:57:47.131 INFO:teuthology.orchestra.run.smithi063.stdout: "client_permissions": "true", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_quota": "true", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_quota_df": "true", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_readahead_max_bytes": "0", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_readahead_max_periods": "4", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_readahead_min": "131072", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_reconnect_stale": "false", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_shutdown_timeout": "30", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_snapdir": ".snap", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_tick_interval": "1", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_trace": "", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_use_faked_inos": "false", 2024-09-12T02:57:47.132 INFO:teuthology.orchestra.run.smithi063.stdout: "client_use_random_mds": "false", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_graylog": "false", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_graylog_port": "12201", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_monitors": "default=true", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_syslog": "false", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "clog_to_syslog_level": "info", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "-", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_network": "", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_network_interface": "", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zlib_isal": "false", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zlib_level": "5", 2024-09-12T02:57:47.133 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "compressor_zstd_level": "1", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_location": "", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_location_hook": "", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_location_hook_timeout": "10", 2024-09-12T02:57:47.134 INFO:teuthology.orchestra.run.smithi063.stdout: "daemonize": "false", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "daos_pool": "tank", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_alienstore": "0/5", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_asok": "1/5", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_asok_assert_abort": "false", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_auth": "20/20", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_bdev": "1/3", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_bluefs": "1/5", 2024-09-12T02:57:47.135 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_bluestore": "1/5", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_buffer": "0/1", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_cephsqlite": "0/5", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_client": "0/5", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_compressor": "1/5", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_context": "0/1", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_crush": "1/1", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_crypto": "1/5", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_cyanstore": "0/5", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T02:57:47.136 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_dpdk": "1/5", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_eventtrace": "1/5", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_filer": "0/1", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_filestore": "1/3", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_finisher": "1/1", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_fuse": "1/5", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_javaclient": "1/5", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_journal": "1/3", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_journaler": "0/5", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_kstore": "1/5", 2024-09-12T02:57:47.137 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_lockdep": "0/1", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mclock": "1/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds": "1/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_balancer": "1/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_locker": "1/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_log": "1/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_migrator": "1/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_memstore": "1/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mgr": "2/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mgrc": "1/5", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_mon": "20/20", 2024-09-12T02:57:47.138 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_monc": "0/10", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_ms": "1/1", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_none": "0/5", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_objclass": "0/5", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_objectcacher": "0/5", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_objecter": "0/1", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_optracker": "0/5", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_osd": "1/5", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_paxos": "20/20", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_perfcounter": "1/5", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_prioritycache": "1/5", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rados": "0/5", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd": "0/5", 2024-09-12T02:57:47.139 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rbd_replay": "0/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_refs": "0/0", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_reserver": "1/1", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw": "1/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_access": "1/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_flight": "1/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rgw_sync": "1/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_rocksdb": "4/5", 2024-09-12T02:57:47.140 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_backref": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_cache": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_device": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_epm": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_journal": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_lba": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_odata": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_omap": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_onode": "0/5", 2024-09-12T02:57:47.141 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_t": "0/5", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_seastore_tm": "0/5", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_striper": "0/1", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_test": "0/5", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_throttle": "1/1", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_timer": "0/1", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_tp": "0/5", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "debug_trace": "1/5", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "device_failure_prediction_mode": "none", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_graylog": "false", 2024-09-12T02:57:47.142 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_journald": "false", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_stderr": "true", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "err_to_syslog": "false", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event_tracing": "false", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_http_port": "9926", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_prio_limit": "5", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_sort_metrics": "true", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "exporter_stats_period": "5", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "fake_statfs_for_testing": "0", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "fatal_signal_handlers": "true", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "filer_max_purge_ops": "10", 2024-09-12T02:57:47.143 INFO:teuthology.orchestra.run.smithi063.stdout: "filer_max_truncate_ops": "128", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_blackhole": "false", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_btrfs_snap": "true", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_caller_concurrency": "10", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_omap_check": "false", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_debug_verify_split": "false", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_dump_file": "", 2024-09-12T02:57:47.144 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fadvise": "true", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fail_eio": "true", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fd_cache_size": "128", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fiemap": "false", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_inject_stall": "0", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_journal_parallel": "false", 2024-09-12T02:57:47.145 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_journal_trailing": "false", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_journal_writeahead": "false", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_kill_at": "0", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T02:57:47.146 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_merge_threshold": "-10", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_odsync_write": "false", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_omap_backend_path": "", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T02:57:47.147 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_op_threads": "2", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_punch_hole": "false", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_queue_max_ops": "50", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T02:57:47.148 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_seek_data_hole": "false", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_sloppy_crc": "false", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_splice": "false", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_split_multiple": "2", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_split_rand_factor": "20", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_update_to": "1000", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T02:57:47.149 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_xfs_extsize": "false", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "filestore_zfs_snap": "false", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "fio_dir": "/tmp/fio", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "20b0bc3b-ca7e-4b63-a9bc-3526f84b65da", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_allow_other": "true", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_big_writes": "true", 2024-09-12T02:57:47.150 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_debug": "false", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_default_permissions": "false", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_disable_pagecache": "false", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_max_write": "0", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_multithreaded": "true", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_require_active_mds": "true", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_set_user_groups": "true", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_splice_move": "true", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_splice_read": "true", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_splice_write": "true", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T02:57:47.151 INFO:teuthology.orchestra.run.smithi063.stdout: "gss_target_name": "ceph", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_file": "", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_inject_failure": "0", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_interval": "5", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "host": "smithi063", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T02:57:47.152 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "inject_early_sigterm": "false", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "jaeger_agent_port": "6799", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "jaeger_tracing_enable": "false", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_aio": "true", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_align_min_size": "65536", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_block_align": "true", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_block_size": "4096", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_dio": "true", 2024-09-12T02:57:47.153 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_discard": "false", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_force_aio": "false", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_ignore_corruption": "false", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_max_write_entries": "100", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_replay_from": "0", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_write_header_frequency": "0", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journal_zero_on_create": "false", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journaler_prefetch_periods": "10", 2024-09-12T02:57:47.154 INFO:teuthology.orchestra.run.smithi063.stdout: "journaler_prezero_periods": "5", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "journaler_write_head_interval": "15", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "keyfile": "", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_backend": "rocksdb", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_max_bytes": "67108864", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_max_ops": "512", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_onode_map_size": "1024", 2024-09-12T02:57:47.155 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "kstore_sync_transaction": "false", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "librados_thread_count": "2", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "lockdep": "false", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "lockdep_force_backtrace": "false", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "log_coarse_timestamps": "true", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "log_flush_on_exit": "false", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "log_graylog_port": "12201", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "log_max_new": "1000", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "log_max_recent": "10000", 2024-09-12T02:57:47.156 INFO:teuthology.orchestra.run.smithi063.stdout: "log_stderr_prefix": "", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_file": "true", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_graylog": "false", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_journald": "false", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_stderr": "false", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "log_to_syslog": "false", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_action_on_write_error": "1", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_alternate_name_max": "8192", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_asio_thread_count": "2", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_export_pin": "true", 2024-09-12T02:57:47.157 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_interval": "10", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_max": "-1", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_max_until": "-1", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_merge_size": "50", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T02:57:47.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_mode": "0", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_bits": "3", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_size": "10000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T02:57:47.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_mid": "0.700000", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T02:57:47.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_trim_interval": "1", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_auth_pins": "false", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_frag": "false", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_scatterstat": "false", 2024-09-12T02:57:47.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_debug_subtrees": "false", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_default_dir_hash": "2", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_defer_session_stale": "true", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_max_entries": "0", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dir_prefetch": "true", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T02:57:47.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_early_reply": "true", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_enable_op_tracker": "true", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_enforce_unique_name": "true", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T02:57:47.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_health_dummy": "false", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_join_fs": "", 2024-09-12T02:57:47.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_journal_format": "1", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_create_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_export_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_import_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_journal_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_link_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_openc_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_rename_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T02:57:47.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_max_events": "-1", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_max_segments": "128", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_pause": "false", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_segment_size": "0", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_trim_threshold": "128", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T02:57:47.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_completed_requests": "100000", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_export_size": "20971520", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_file_recover": "32", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_files": "64", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_ops": "8192", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_metrics_update_interval": "2", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_min_caps_per_client": "100", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T02:57:47.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_numa_node": "-1", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_duration": "600", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_size": "20", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_op_log_threshold": "5", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_ping_grace": "15", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_ping_interval": "5", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_max_caps": "30000", 2024-09-12T02:57:47.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_replay_interval": "1.000000", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_root_ino_gid": "0", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_root_ino_uid": "0", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T02:57:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_shutdown_check": "0", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_skip_ino": "0", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_snap_min_uid": "0", 2024-09-12T02:57:47.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_snap_rstat": "false", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_symlink_recovery": "true", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_thrash_exports": "0", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_thrash_fragments": "0", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_tick_interval": "5.000000", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_valgrind_exit": "false", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_verify_backtrace": "1", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_verify_scatter": "false", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_wipe_sessions": "false", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mempool_debug": "false", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T02:57:47.171 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_page_set": "false", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "memstore_page_size": "65536", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_client_bytes": "134217728", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_client_messages": "512", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_disabled_modules": "", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T02:57:47.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mds_messages": "128", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_mon_messages": "128", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_history_duration": "600", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_history_size": "20", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_op_log_threshold": "5", 2024-09-12T02:57:47.173 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_osd_messages": "8192", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_pool": "true", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_standby_modules": "true", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_stats_period": "5", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_stats_threshold": "5", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_tick_period": "2", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_allow_pool_delete": "true", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T02:57:47.174 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_bytes": "104857600", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T02:57:47.175 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_client_target_rank": "-1", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_file_level": "debug", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T02:57:47.176 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_compact_on_start": "false", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_compact_on_trim": "true", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_cpu_threads": "4", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data_avail_crit": "5", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data_avail_warn": "5", 2024-09-12T02:57:47.177 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_dump_json": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_extra_checks": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T02:57:47.178 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_down_mkfs_grace": "300", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_down_uptime_grace": "60", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_election_default_strategy": "1", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_election_timeout": "5.000000", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_enable_op_tracker": "true", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_fake_pool_delete": "false", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_force_quorum_join": "false", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T02:57:47.179 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_log_update_period": "5", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_max_detail": "50", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_to_clog": "true", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_host": "172.21.15.63,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_host_override": "", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_initial_members": "", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T02:57:47.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_lease": "5.000000", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_log_full_interval": "50", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_log_max": "10000", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_log_max_summary": "50", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_log_epochs": "500", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_osd": "10000", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T02:57:47.181 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_memory_autotune": "true", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_memory_target": "2147483648", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_digest_period": "5", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T02:57:47.182 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_complaint_time": "120", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_duration": "600", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_size": "20", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_op_log_threshold": "5", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_cache_size": "500", 2024-09-12T02:57:47.183 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T02:57:47.184 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_report_timeout": "900", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T02:57:47.185 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T02:57:47.186 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_max_osds": "4", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_interval": "86400", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_max_keys": "100", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_scrub_timeout": "300", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_session_timeout": "300", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_smart_report_timeout": "5", 2024-09-12T02:57:47.187 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_pool_size": "4", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_debug": "false", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T02:57:47.188 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_tick_interval": "5", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T02:57:47.189 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_older_version": "true", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "monmap": "", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T02:57:47.190 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "motr_tracing_enabled": "false", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_op_threads": "3", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_cm": "false", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_device_name": "", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T02:57:47.191 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_sl": "3", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_rdma_type": "ib", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_async_reap_threshold": "5", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_before_connect": "false", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_ipv4": "true", 2024-09-12T02:57:47.192 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_ipv6": "false", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_msgr1": "true", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_msgr2": "true", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_port_max": "7568", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_port_min": "6800", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_retry_count": "3", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_bind_retry_delay": "5", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_client": "false", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_mds": "false", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_mgr": "false", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_mon": "false", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_blackhole_osd": "false", 2024-09-12T02:57:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_client_mode": "crc secure", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_cluster_type": "", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_compress_secure": "false", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_crc_data": "true", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_crc_header": "true", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_bug": "true", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_old_message": "true", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T02:57:47.194 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_hugepages": "", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_lro": "true", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_pmd": "", 2024-09-12T02:57:47.195 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_port_id": "0", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_dump_on_send": "false", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_delay_type": "", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_network_congestion": "0", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_inject_socket_failures": "0", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_max_accept_failures": "4", 2024-09-12T02:57:47.196 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_max_backoff": "15.000000", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_osd_compress_mode": "none", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_pq_min_cost": "65536", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_public_type": "", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_service_mode": "crc secure", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_nodelay": "true", 2024-09-12T02:57:47.197 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "ms_type": "async+posix", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "no_config_file": "false", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_inflight_ops": "1024", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objecter_timeout": "10.000000", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objectstore_blackhole": "false", 2024-09-12T02:57:47.198 INFO:teuthology.orchestra.run.smithi063.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "openssl_engine_opts": "", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_max_ops": "4", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_agent_slop": "0.020000", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_asio_thread_count": "2", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T02:57:47.199 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backfill_scan_max": "512", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backfill_scan_min": "64", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backoff_on_peering": "false", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_beacon_report_interval": "300", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_duration": "30", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_blkin_trace_all": "false", 2024-09-12T02:57:47.200 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_class_update_on_start": "true", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_message_cap": "256", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_op_priority": "63", 2024-09-12T02:57:47.201 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_client_watch_timeout": "30", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_command_max_records": "256", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_compact_on_start": "false", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_update_on_start": "true", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T02:57:47.202 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_op_order": "false", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_shutdown": "false", 2024-09-12T02:57:47.203 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_trim_objects": "false", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T02:57:47.204 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_default_notify_timeout": "30", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_enable_op_tracker": "true", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T02:57:47.205 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_info": "true", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_shutdown": "true", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_function_tracing": "false", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_grace": "20", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_interval": "6", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T02:57:47.206 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_stale": "600", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_journal_size": "5120", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_kill_backfill_at": "0", 2024-09-12T02:57:47.207 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_cache_size": "50", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_dedup": "true", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_message_max": "40", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_attr_name_len": "100", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_attr_size": "0", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_backfills": "1", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_markdown_count": "5", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_markdown_period": "600", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_object_name_len": "2048", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T02:57:47.208 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_object_size": "134217728", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_pgls": "1024", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_push_cost": "8388608", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_push_objects": "10", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_scrubs": "3", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T02:57:47.209 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_max_write_size": "90", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_profile": "balanced", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T02:57:47.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_base": "805306368", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_target": "4294967296", 2024-09-12T02:57:47.211 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_target_autotune": "false", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_min_recovery_priority": "0", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_report_interval": "5", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_num_cache_shards": "32", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_numa_node": "-1", 2024-09-12T02:57:47.212 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objecter_finishers": "1", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objectstore": "bluestore", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objectstore_fuse": "false", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_objectstore_tracing": "false", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_duration": "600", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_size": "20", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_log_threshold": "5", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_shards": "0", 2024-09-12T02:57:47.213 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_op_thread_timeout": "15", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_open_classes_on_start": "true", 2024-09-12T02:57:47.214 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_os_flags": "0", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_peering_op_priority": "255", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_delete_priority": "5", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T02:57:47.215 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_crimson": "false", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T02:57:47.216 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_flags": "0", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_min_size": "0", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_size": "2", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_default_type": "replicated", 2024-09-12T02:57:47.217 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_cost": "20971520", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_active": "0", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T02:57:47.218 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_op_priority": "3", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_priority": "5", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_repair_during_recovery": "false", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T02:57:47.219 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_cost": "52428800", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_end_hour": "0", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T02:57:47.220 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_priority": "5", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T02:57:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_skip_data_digest": "false", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_smart_report_timeout": "5", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_priority": "5", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_target_transaction_size": "30", 2024-09-12T02:57:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_tracing": "false", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_use_stale_snap": "false", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T02:57:47.223 INFO:teuthology.orchestra.run.smithi063.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_kill_at": "0", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_max_join_drift": "10", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_min": "500", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_min_wait": "0.050000", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_service_trim_max": "500", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_service_trim_min": "250", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_stash_full_interval": "25", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_trim_max": "500", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "paxos_trim_min": "250", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "perf": "true", 2024-09-12T02:57:47.224 INFO:teuthology.orchestra.run.smithi063.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "-", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrv": "", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "public_bind_addr": "-", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "public_network": "", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "public_network_interface": "", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "qat_compressor_enabled": "false", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "rados_mon_op_timeout": "0", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "rados_osd_op_timeout": "0", 2024-09-12T02:57:47.225 INFO:teuthology.orchestra.run.smithi063.stdout: "rados_tracing": "false", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_atime_update_interval": "60", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache": "true", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T02:57:47.226 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_policy": "writearound", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_size": "33554432", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_compression_hint": "none", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_clone_format": "auto", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_data_pool": "", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_features": "61", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_format": "2", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_map_options": "", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_order": "22", 2024-09-12T02:57:47.227 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_pool": "rbd", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_stripe_count": "0", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_io_scheduler": "simple", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T02:57:47.228 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_order": "24", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_pool": "", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_journal_splay_width": "4", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T02:57:47.229 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T02:57:47.230 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T02:57:47.231 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_op_threads": "1", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T02:57:47.232 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_plugins": "", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T02:57:47.233 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T02:57:47.234 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_tracing": "false", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_validate_names": "true", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rbd_validate_pool": "true", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "restapi_base_url": "", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "restapi_log_level": "", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_admin_entry": "admin", 2024-09-12T02:57:47.235 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_backend_store": "rados", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_barbican_url": "", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_beast_enable_async": "true", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T02:57:47.236 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cache_enabled": "true", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_config_store": "rados", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_content_length_compat": "false", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_cross_domain_policy": "", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T02:57:47.237 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T02:57:47.238 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T02:57:47.239 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T02:57:47.240 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_d4n_port": "6379", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_log_window": "30", 2024-09-12T02:57:47.241 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T02:57:47.242 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dns_name": "", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dns_s3website_name": "", 2024-09-12T02:57:47.243 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_ops_log": "false", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_static_website": "false", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enable_usage_log": "false", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_expose_bucket": "false", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_extended_http_attrs": "", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_filter": "none", 2024-09-12T02:57:47.244 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_objs": "32", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T02:57:47.245 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_init_timeout": "300", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_password": "", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T02:57:47.246 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_project": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_token": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_admin_user": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_api_version": "2", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T02:57:47.247 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_url": "", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_objs": "32", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_worker": "3", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T02:57:47.248 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ldap_uri": "", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_http_headers": "", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T02:57:47.249 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_attr_size": "0", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_listing_results": "1000", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_notify_retries": "10", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T02:57:47.250 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T02:57:47.251 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_num_control_oids": "8", 2024-09-12T02:57:47.252 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_numa_node": "-1", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_op_tracing": "false", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_opa_token": "", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_opa_url": "", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T02:57:47.253 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_rados": "false", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T02:57:47.254 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_print_continue": "true", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rados_tracing": "false", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_realm": "", 2024-09-12T02:57:47.255 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_realm_id": "", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_region": "", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_request_uri": "", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T02:57:47.256 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_resolve_cname": "false", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_run_sync_thread": "true", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T02:57:47.257 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_script_uri": "", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_service_provider_name": "", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_client_id": "", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_client_secret": "", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_entry": "sts", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_key": "sts", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T02:57:47.258 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_auth_url": "", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_custom_header": "", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_need_stats": "true", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_tenant_name": "", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_url": "", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_lease_period": "120", 2024-09-12T02:57:47.259 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_thread_pool_size": "512", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T02:57:47.260 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T02:57:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_comment": "", 2024-09-12T02:57:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_createby": "", 2024-09-12T02:57:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_encoding": "", 2024-09-12T02:57:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_flag": "false", 2024-09-12T02:57:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T02:57:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_origin": "", 2024-09-12T02:57:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T02:57:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_torrent_tracker": "", 2024-09-12T02:57:47.261 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T02:57:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T02:57:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T02:57:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_max_shards": "32", 2024-09-12T02:57:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T02:57:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_use_opa_authz": "false", 2024-09-12T02:57:47.264 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_counters_cache": "false", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_user_unique_email": "true", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_verify_ssl": "true", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T02:57:47.265 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zone": "", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zone_id": "", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zonegroup": "", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zonegroup_id": "", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_block_size": "4096", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T02:57:47.266 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T02:57:47.267 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_partition_filters": "false", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_perf": "false", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "run_dir": "/var/run/ceph", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_block_create": "true", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_device_size": "53687091200", 2024-09-12T02:57:47.268 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_full_integrity_check": "false", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_main_device_type": "SSD", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T02:57:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "seastore_segment_size": "67108864", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "set_keepcaps": "false", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "setgroup": "", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "setuser": "", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "setuser_match_path": "", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "thp": "false", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "threadpool_default_timeout": "60", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout: "throttler_perf_counter": "true" 2024-09-12T02:57:47.270 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:47.272 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T02:57:47.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f9401800640 1 Processor -- start 2024-09-12T02:57:47.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f9401800640 1 -- start start 2024-09-12T02:57:47.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f9401800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f93fc0c9470 0x7f93fc0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f9401800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93fc070520 con 0x7f93fc0c9970 2024-09-12T02:57:47.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f9401800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93fc0c9180 con 0x7f93fc1517d0 2024-09-12T02:57:47.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f9401800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f93fc06f6f0 con 0x7f93fc0c9470 2024-09-12T02:57:47.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f93f3e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f93fc0c9470 0x7f93fc0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f93fb400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f93fc0c9970 0x7f93fc165190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40176/0 (socket says 172.21.15.63:40176) 2024-09-12T02:57:47.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f93fb400640 1 -- 172.21.15.63:0/1479627782 learned_addr learned my addr 172.21.15.63:0/1479627782 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:47.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f93f3e00640 1 -- 172.21.15.63:0/1479627782 >> v1:172.21.15.119:6789/0 conn(0x7f93fc1517d0 legacy=0x7f93fc15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f93f3e00640 1 -- 172.21.15.63:0/1479627782 >> v1:172.21.15.63:6789/0 conn(0x7f93fc0c9970 legacy=0x7f93fc165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f93fa000640 1 -- 172.21.15.63:0/1479627782 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237386467 0 0) 0x7f93fc070520 con 0x7f93fc0c9970 2024-09-12T02:57:47.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.409+0000 7f93f3e00640 1 -- 172.21.15.63:0/1479627782 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc06ffa0 con 0x7f93fc0c9470 2024-09-12T02:57:47.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f93f3e00640 1 --2- 172.21.15.63:0/1479627782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9470 0x7f93fc0ce080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93e40097c0 tx=0x7f93e401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ce836fb0f7b927 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f93fa000640 1 -- 172.21.15.63:0/1479627782 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e40b5070 con 0x7f93fc0c9470 2024-09-12T02:57:47.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f93fa000640 1 -- 172.21.15.63:0/1479627782 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e40a8990 con 0x7f93fc0c9470 2024-09-12T02:57:47.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f93fa000640 1 -- 172.21.15.63:0/1479627782 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e40a8d60 con 0x7f93fc0c9470 2024-09-12T02:57:47.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f9401800640 1 -- 172.21.15.63:0/1479627782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9470 msgr2=0x7f93fc0ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f9401800640 1 --2- 172.21.15.63:0/1479627782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9470 0x7f93fc0ce080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f93e40097c0 tx=0x7f93e401ec90 comp rx=0 tx=0).stop 2024-09-12T02:57:47.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f9401800640 1 -- 172.21.15.63:0/1479627782 shutdown_connections 2024-09-12T02:57:47.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f9401800640 1 --2- 172.21.15.63:0/1479627782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9470 0x7f93fc0ce080 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f9401800640 1 -- 172.21.15.63:0/1479627782 >> 172.21.15.63:0/1479627782 conn(0x7f93fc067a00 msgr2=0x7f93fc067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f9401800640 1 -- 172.21.15.63:0/1479627782 shutdown_connections 2024-09-12T02:57:47.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f9401800640 1 -- 172.21.15.63:0/1479627782 wait complete. 2024-09-12T02:57:47.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f9401800640 1 Processor -- start 2024-09-12T02:57:47.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.413+0000 7f9401800640 1 -- start start 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f9401800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc0c9470 0x7f93fc0ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f9401800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9970 0x7f93fc0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f9401800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc1517d0 0x7f93fc156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f9401800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc070240 con 0x7f93fc0c9970 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f9401800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0c8cf0 con 0x7f93fc1517d0 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f9401800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f93fc06fc00 con 0x7f93fc0c9470 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9970 0x7f93fc0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9970 0x7f93fc0cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56950/0 (socket says 172.21.15.63:56950) 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f3e00640 1 -- 172.21.15.63:0/3082974218 learned_addr learned my addr 172.21.15.63:0/3082974218 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc1517d0 0x7f93fc156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93faa00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc0c9470 0x7f93fc0ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f3e00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc0c9470 msgr2=0x7f93fc0ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f3e00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc0c9470 0x7f93fc0ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f3e00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc1517d0 msgr2=0x7f93fc156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f3e00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc1517d0 0x7f93fc156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f3e00640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc1f0860 con 0x7f93fc0c9970 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93faa00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc0c9470 0x7f93fc0ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f3e00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9970 0x7f93fc0cd3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93e401b8a0 tx=0x7f93e401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e40bd020 con 0x7f93fc0c9970 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e40b0820 con 0x7f93fc0c9970 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e40b5040 con 0x7f93fc0c9970 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc1f0b40 con 0x7f93fc0c9970 2024-09-12T02:57:47.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc1f1100 con 0x7f93fc0c9970 2024-09-12T02:57:47.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.417+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f93fc06ec50 con 0x7f93fc0c9970 2024-09-12T02:57:47.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93e40c0020 con 0x7f93fc0c9970 2024-09-12T02:57:47.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93d80678c0 0x7f93d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f93e4123990 con 0x7f93fc0c9970 2024-09-12T02:57:47.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7f93e40c7030 con 0x7f93fc0c9970 2024-09-12T02:57:47.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93faa00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93d80678c0 0x7f93d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f9401800640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc15e940 0x7f93fc1f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0c4ed0 con 0x7f93fc15e940 2024-09-12T02:57:47.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc15e940 0x7f93fc1f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93fb400640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 2: {"prefix": "get_command_descriptions"}) -- 0x7f93fc0c3be0 con 0x7f93fc15e940 2024-09-12T02:57:47.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93faa00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93d80678c0 0x7f93d8069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93ec000f70 tx=0x7f93ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc15e940 0x7f93fc1f12d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93fc157930 tx=0x7f93f4001ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f400e780 con 0x7f93fc15e940 2024-09-12T02:57:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f93f4018070 con 0x7f93fc15e940 2024-09-12T02:57:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc15e940 msgr2=0x7f93fc1f12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc15e940 0x7f93fc1f12d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f93fc157930 tx=0x7f93f4001ea0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc15e940 msgr2=0x7f93fc1f12d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:57:47.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.421+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc15e940 0x7f93fc1f12d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f9401800640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc157cd0 0x7f93fc156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0cc2d0 con 0x7f93fc157cd0 2024-09-12T02:57:47.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc157cd0 0x7f93fc156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f93fb400640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 3: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=0"]}) -- 0x7f93fc0c3ff0 con 0x7f93fc157cd0 2024-09-12T02:57:47.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc157cd0 0x7f93fc156f80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93f4017000 tx=0x7f93f4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4013620 con 0x7f93fc157cd0 2024-09-12T02:57:47.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.0 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 3: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7f93f40136e0 con 0x7f93fc157cd0 2024-09-12T02:57:47.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc157cd0 msgr2=0x7f93fc156f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc157cd0 0x7f93fc156f80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93f4017000 tx=0x7f93f4001260 comp rx=0 tx=0).stop 2024-09-12T02:57:47.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc157cd0 msgr2=0x7f93fc156f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:57:47.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc157cd0 0x7f93fc156f80 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f93f4017000 tx=0x7f93f4001260 comp rx=0 tx=0).stop 2024-09-12T02:57:47.434 INFO:teuthology.orchestra.run.smithi063.stdout:mon.a: {} 2024-09-12T02:57:47.435 INFO:teuthology.orchestra.run.smithi063.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T02:57:47.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f9401800640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc14f9f0 0x7f93fc14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.429+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0755c0 con 0x7f93fc14f9f0 2024-09-12T02:57:47.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc14f9f0 0x7f93fc14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93fb400640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- command(tid 4: {"prefix": "get_command_descriptions"}) -- 0x7f93fc1566a0 con 0x7f93fc14f9f0 2024-09-12T02:57:47.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc14f9f0 0x7f93fc14fe00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93f4002240 tx=0x7f93f400a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4037070 con 0x7f93fc14f9f0 2024-09-12T02:57:47.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.1 v2:172.21.15.119:3300/0 2 ==== command_reply(tid 4: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f93f40323f0 con 0x7f93fc14f9f0 2024-09-12T02:57:47.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc14f9f0 msgr2=0x7f93fc14fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc14f9f0 0x7f93fc14fe00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93f4002240 tx=0x7f93f400a000 comp rx=0 tx=0).stop 2024-09-12T02:57:47.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc14f9f0 msgr2=0x7f93fc14fe00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:57:47.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc14f9f0 0x7f93fc14fe00 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93f4002240 tx=0x7f93f400a000 comp rx=0 tx=0).stop 2024-09-12T02:57:47.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.433+0000 7f93fb400640 1 -- 172.21.15.63:0/3082974218 reap_dead start 2024-09-12T02:57:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.441+0000 7f9401800640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc0ae950 0x7f93fc156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.441+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc150340 con 0x7f93fc0ae950 2024-09-12T02:57:47.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.441+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc0ae950 0x7f93fc156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.441+0000 7f93fb400640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- command(tid 5: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=0"]}) -- 0x7f93fc0cd900 con 0x7f93fc0ae950 2024-09-12T02:57:47.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.441+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc0ae950 0x7f93fc156a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93f4001340 tx=0x7f93f4001ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.441+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f403d030 con 0x7f93fc0ae950 2024-09-12T02:57:47.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.445+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.1 v2:172.21.15.119:3300/0 2 ==== command_reply(tid 5: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7f93f40327d0 con 0x7f93fc0ae950 2024-09-12T02:57:47.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.445+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc0ae950 msgr2=0x7f93fc156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.448 INFO:teuthology.orchestra.run.smithi063.stdout:mon.b: {} 2024-09-12T02:57:47.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.445+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc0ae950 0x7f93fc156a40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93f4001340 tx=0x7f93f4001ea0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.445+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc0ae950 msgr2=0x7f93fc156a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:57:47.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.445+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93fc0ae950 0x7f93fc156a40 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93f4001340 tx=0x7f93f4001ea0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.449 INFO:teuthology.orchestra.run.smithi063.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T02:57:47.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.445+0000 7f9401800640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f3c50 0x7f93fc1f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.445+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f93fc1504c0 con 0x7f93fc1f3c50 2024-09-12T02:57:47.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.445+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f3c50 0x7f93fc1f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.445+0000 7f93fb400640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- command(tid 6: {"prefix": "get_command_descriptions"}) -- 0x7f93fc1f4570 con 0x7f93fc1f3c50 2024-09-12T02:57:47.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.449+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f3c50 0x7f93fc1f4030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93f40017b0 tx=0x7f93f4029040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.449+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4050020 con 0x7f93fc1f3c50 2024-09-12T02:57:47.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.449+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.2 v2:172.21.15.119:3301/0 2 ==== command_reply(tid 6: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f93f4046040 con 0x7f93fc1f3c50 2024-09-12T02:57:47.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.449+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f3c50 msgr2=0x7f93fc1f4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.449+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f3c50 0x7f93fc1f4030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93f40017b0 tx=0x7f93f4029040 comp rx=0 tx=0).stop 2024-09-12T02:57:47.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.449+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f3c50 msgr2=0x7f93fc1f4030 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:57:47.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.449+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f3c50 0x7f93fc1f4030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.453+0000 7f9401800640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f4780 0x7f93fc1e3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.453+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f93fc202fc0 con 0x7f93fc1f4780 2024-09-12T02:57:47.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.457+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f4780 0x7f93fc1e3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.457+0000 7f93fb400640 1 -- 172.21.15.63:0/3082974218 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- command(tid 7: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=0"]}) -- 0x7f93fc203190 con 0x7f93fc1f4780 2024-09-12T02:57:47.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.457+0000 7f93fb400640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f4780 0x7f93fc1e3e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005ee0 tx=0x7f93f4041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.457+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4050040 con 0x7f93fc1f4780 2024-09-12T02:57:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 <== mon.2 v2:172.21.15.119:3301/0 2 ==== command_reply(tid 7: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7f93f4046040 con 0x7f93fc1f4780 2024-09-12T02:57:47.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f4780 msgr2=0x7f93fc1e3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f4780 0x7f93fc1e3e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005ee0 tx=0x7f93f4041000 comp rx=0 tx=0).stop 2024-09-12T02:57:47.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f93f2a00640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f4780 msgr2=0x7f93fc1e3e70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:57:47.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f93f2a00640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93fc1f4780 0x7f93fc1e3e70 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005ee0 tx=0x7f93f4041000 comp rx=0 tx=0).stop 2024-09-12T02:57:47.464 INFO:teuthology.orchestra.run.smithi063.stdout:mon.c: {} 2024-09-12T02:57:47.465 INFO:teuthology.orchestra.run.smithi063.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T02:57:47.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93d80678c0 msgr2=0x7f93d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f9401800640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93d80678c0 0x7f93d8069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f93ec000f70 tx=0x7f93ec009040 comp rx=0 tx=0).stop 2024-09-12T02:57:47.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9970 msgr2=0x7f93fc0cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f9401800640 1 --2- 172.21.15.63:0/3082974218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93fc0c9970 0x7f93fc0cd3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f93e401b8a0 tx=0x7f93e401ba30 comp rx=0 tx=0).stop 2024-09-12T02:57:47.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f93fb400640 1 -- 172.21.15.63:0/3082974218 reap_dead start 2024-09-12T02:57:47.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 shutdown_connections 2024-09-12T02:57:47.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 >> 172.21.15.63:0/3082974218 conn(0x7f93fc067a00 msgr2=0x7f93fc0cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 shutdown_connections 2024-09-12T02:57:47.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.461+0000 7f9401800640 1 -- 172.21.15.63:0/3082974218 wait complete. 2024-09-12T02:57:47.482 DEBUG:teuthology.orchestra.run.smithi119:> type ceph-objectstore-tool 2024-09-12T02:57:47.487 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T02:57:47.488 DEBUG:teuthology.orchestra.run.smithi063:> type ceph-objectstore-tool 2024-09-12T02:57:47.495 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T02:57:47.495 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T02:57:47.509 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:57:47.509 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T02:57:47.509 INFO:tasks.workunit:timeout=3h 2024-09-12T02:57:47.509 INFO:tasks.workunit:cleanup=True 2024-09-12T02:57:47.510 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T02:57:47.510 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T02:57:47.510 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T02:57:47.510 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T02:57:47.510 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-12T02:57:47.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T02:57:47.511 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T02:57:47.511 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T02:57:47.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:57:47.512 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T02:57:47.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:57:47.512 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T02:57:47.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T02:57:47.539 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:47.537+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:47.553 INFO:teuthology.orchestra.run.smithi063.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T02:57:47.553 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T02:57:47.553 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-09-12T02:57:47.553 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:57:47.553 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T02:57:47.553 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-12 02:57:09.847086742 +0000 2024-09-12T02:57:47.553 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-12 02:57:22.369080310 +0000 2024-09-12T02:57:47.553 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-12 02:57:09.847086742 +0000 2024-09-12T02:57:47.554 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T02:57:47.554 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T02:57:47.614 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:57:47.611+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:57:47.636 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T02:57:47.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.681+0000 7fa073200640 1 Processor -- start 2024-09-12T02:57:47.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa073200640 1 -- start start 2024-09-12T02:57:47.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa073200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa07406da00 0x7fa074070c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa073200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0741575e0 con 0x7fa074151480 2024-09-12T02:57:47.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa073200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0741578c0 con 0x7fa07406e0d0 2024-09-12T02:57:47.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa073200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa07406ce60 con 0x7fa07406da00 2024-09-12T02:57:47.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa071400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa07406e0d0 0x7fa07406d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:38974/0 (socket says 172.21.15.63:38974) 2024-09-12T02:57:47.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa071400640 1 -- 172.21.15.63:0/381738073 learned_addr learned my addr 172.21.15.63:0/381738073 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:47.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa072800640 1 --2- 172.21.15.63:0/381738073 >> v2:172.21.15.63:3300/0 conn(0x7fa07406da00 0x7fa074070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa072800640 1 -- 172.21.15.63:0/381738073 >> v1:172.21.15.119:6789/0 conn(0x7fa07406e0d0 legacy=0x7fa07406d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa072800640 1 -- 172.21.15.63:0/381738073 >> v1:172.21.15.63:6789/0 conn(0x7fa074151480 legacy=0x7fa0740c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.685+0000 7fa072800640 1 -- 172.21.15.63:0/381738073 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074157ba0 con 0x7fa07406da00 2024-09-12T02:57:47.691 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T02:57:47.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa072800640 1 --2- 172.21.15.63:0/381738073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406da00 0x7fa074070c70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009d90 tx=0x7fa06c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69453fbfdda561ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa070a00640 1 -- 172.21.15.63:0/381738073 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0b2070 con 0x7fa07406da00 2024-09-12T02:57:47.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa070a00640 1 -- 172.21.15.63:0/381738073 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa06c0a5830 con 0x7fa07406da00 2024-09-12T02:57:47.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa070a00640 1 -- 172.21.15.63:0/381738073 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0a5c00 con 0x7fa07406da00 2024-09-12T02:57:47.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa073200640 1 -- 172.21.15.63:0/381738073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406da00 msgr2=0x7fa074070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa073200640 1 --2- 172.21.15.63:0/381738073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406da00 0x7fa074070c70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009d90 tx=0x7fa06c01c970 comp rx=0 tx=0).stop 2024-09-12T02:57:47.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa073200640 1 -- 172.21.15.63:0/381738073 shutdown_connections 2024-09-12T02:57:47.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa073200640 1 --2- 172.21.15.63:0/381738073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406da00 0x7fa074070c70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa073200640 1 -- 172.21.15.63:0/381738073 >> 172.21.15.63:0/381738073 conn(0x7fa074070180 msgr2=0x7fa074070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa073200640 1 -- 172.21.15.63:0/381738073 shutdown_connections 2024-09-12T02:57:47.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.689+0000 7fa073200640 1 -- 172.21.15.63:0/381738073 wait complete. 2024-09-12T02:57:47.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 Processor -- start 2024-09-12T02:57:47.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 -- start start 2024-09-12T02:57:47.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07406da00 0x7fa07414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406e0d0 0x7fa074156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa074151480 0x7fa0741f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa0741519e0 con 0x7fa07406e0d0 2024-09-12T02:57:47.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa074151860 con 0x7fa07406da00 2024-09-12T02:57:47.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa0740c3130 con 0x7fa074151480 2024-09-12T02:57:47.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406e0d0 0x7fa074156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07406da00 0x7fa07414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406e0d0 0x7fa074156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56986/0 (socket says 172.21.15.63:56986) 2024-09-12T02:57:47.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071400640 1 -- 172.21.15.63:0/283608443 learned_addr learned my addr 172.21.15.63:0/283608443 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:47.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa072800640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa074151480 0x7fa0741f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071400640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa074151480 msgr2=0x7fa0741f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071400640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa074151480 0x7fa0741f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071400640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07406da00 msgr2=0x7fa07414ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071400640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa07406da00 0x7fa07414ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071400640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07415b6d0 con 0x7fa07406e0d0 2024-09-12T02:57:47.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa071400640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406e0d0 0x7fa074156720 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c3a0 tx=0x7fa06000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060017070 con 0x7fa07406e0d0 2024-09-12T02:57:47.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa060005cf0 con 0x7fa07406e0d0 2024-09-12T02:57:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600072f0 con 0x7fa07406e0d0 2024-09-12T02:57:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0740cc990 con 0x7fa07406e0d0 2024-09-12T02:57:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7f5d6f000640 1 Processor -- start 2024-09-12T02:57:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.693+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0741f69d0 con 0x7fa07406e0d0 2024-09-12T02:57:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d6f000640 1 -- start start 2024-09-12T02:57:47.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fa074070c70 con 0x7fa07406e0d0 2024-09-12T02:57:47.700 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:57:47.700 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:57:47.700 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:47.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d6f000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d681560c0 0x7f5d680c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d6f000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d680b1a60 con 0x7f5d680c3cb0 2024-09-12T02:57:47.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d6f000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d68070d90 con 0x7f5d680b38c0 2024-09-12T02:57:47.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d6f000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6815c830 con 0x7f5d681560c0 2024-09-12T02:57:47.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa06001a070 con 0x7fa07406e0d0 2024-09-12T02:57:47.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d67e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d681560c0 0x7f5d680c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d67e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d681560c0 0x7f5d680c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:56658/0 (socket says 172.21.15.63:56658) 2024-09-12T02:57:47.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d6d000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5d680c3cb0 0x7f5d681630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40184/0 (socket says 172.21.15.63:40184) 2024-09-12T02:57:47.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d67e00640 1 -- 172.21.15.63:0/2838399133 learned_addr learned my addr 172.21.15.63:0/2838399133 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:47.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d67e00640 1 -- 172.21.15.63:0/2838399133 >> v1:172.21.15.119:6789/0 conn(0x7f5d680b38c0 legacy=0x7f5d68158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d67e00640 1 -- 172.21.15.63:0/2838399133 >> v1:172.21.15.63:6789/0 conn(0x7f5d680c3cb0 legacy=0x7f5d681630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7f5d67e00640 1 -- 172.21.15.63:0/2838399133 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6815cb10 con 0x7f5d681560c0 2024-09-12T02:57:47.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7fa06a000640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa0540678f0 0x7fa054069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa060085340 con 0x7fa07406e0d0 2024-09-12T02:57:47.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7fa071e00640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa0540678f0 0x7fa054069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.697+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v27) ==== 54+0+16 (secure 0 0 0) 0x7fa060055420 con 0x7fa07406e0d0 2024-09-12T02:57:47.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa0741f3520 0x7fa0741f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa074073a00 con 0x7fa0741f3520 2024-09-12T02:57:47.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fa072800640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa0741f3520 0x7fa0741f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fa071e00640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa0540678f0 0x7fa054069db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa064001810 tx=0x7fa064009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbab4e00640 1 Processor -- start 2024-09-12T02:57:47.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fa072800640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa0741f3520 0x7fa0741f6c10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbab4e00640 1 -- start start 2024-09-12T02:57:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa074073a00 con 0x7fa0741f3520 2024-09-12T02:57:47.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbab4e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab01527e0 0x7fbab00c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbab4e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbab00c61e0 0x7fbab00c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbab4e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbab0159520 con 0x7fbab00c7a00 2024-09-12T02:57:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbab4e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fbab01589a0 con 0x7fbab00c61e0 2024-09-12T02:57:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbab4e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbab0158c80 con 0x7fbab01527e0 2024-09-12T02:57:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbaade00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab01527e0 0x7fbab00c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbaade00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab01527e0 0x7fbab00c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:56666/0 (socket says 172.21.15.63:56666) 2024-09-12T02:57:47.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.701+0000 7fbaade00640 1 -- 172.21.15.63:0/1081711060 learned_addr learned my addr 172.21.15.63:0/1081711060 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7fbaae800640 1 --2- 172.21.15.63:0/1081711060 >> v2:172.21.15.63:3300/0 conn(0x7fbab00c61e0 0x7fbab00c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d67e00640 1 --2- 172.21.15.63:0/2838399133 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d681560c0 0x7f5d680c32a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5d580098a0 tx=0x7f5d5801ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f9f5b8ab03086 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7fbaade00640 1 -- 172.21.15.63:0/1081711060 >> v2:172.21.15.63:3300/0 conn(0x7fbab00c61e0 msgr2=0x7fbab00c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:47.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d66a00640 1 -- 172.21.15.63:0/2838399133 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d580b5070 con 0x7f5d681560c0 2024-09-12T02:57:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d66a00640 1 -- 172.21.15.63:0/2838399133 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d580a8a70 con 0x7f5d681560c0 2024-09-12T02:57:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d66a00640 1 -- 172.21.15.63:0/2838399133 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d580a8e40 con 0x7f5d681560c0 2024-09-12T02:57:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d6f000640 1 -- 172.21.15.63:0/2838399133 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d681560c0 msgr2=0x7f5d680c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d6f000640 1 --2- 172.21.15.63:0/2838399133 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d681560c0 0x7f5d680c32a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5d580098a0 tx=0x7f5d5801ed70 comp rx=0 tx=0).stop 2024-09-12T02:57:47.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d6f000640 1 -- 172.21.15.63:0/2838399133 shutdown_connections 2024-09-12T02:57:47.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d6f000640 1 --2- 172.21.15.63:0/2838399133 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d681560c0 0x7f5d680c32a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d6f000640 1 -- 172.21.15.63:0/2838399133 >> 172.21.15.63:0/2838399133 conn(0x7f5d68071670 msgr2=0x7f5d68071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d6f000640 1 -- 172.21.15.63:0/2838399133 shutdown_connections 2024-09-12T02:57:47.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7f5d6f000640 1 -- 172.21.15.63:0/2838399133 wait complete. 2024-09-12T02:57:47.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7fbaade00640 1 --2- 172.21.15.63:0/1081711060 >> v2:172.21.15.63:3300/0 conn(0x7fbab00c61e0 0x7fbab00c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7fbaade00640 1 -- 172.21.15.63:0/1081711060 >> v1:172.21.15.119:6789/0 conn(0x7fbab00c7a00 legacy=0x7fbab00cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7fbaade00640 1 -- 172.21.15.63:0/1081711060 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab0158f60 con 0x7fbab01527e0 2024-09-12T02:57:47.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.705+0000 7fbaae800640 1 --2- 172.21.15.63:0/1081711060 >> v2:172.21.15.63:3300/0 conn(0x7fbab00c61e0 0x7fbab00c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:47.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d6f000640 1 Processor -- start 2024-09-12T02:57:47.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbaade00640 1 --2- 172.21.15.63:0/1081711060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab01527e0 0x7fbab00c6970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009870 tx=0x7fbaa001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d43083a12964d9ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d6f000640 1 -- start start 2024-09-12T02:57:47.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbaaca00640 1 -- 172.21.15.63:0/1081711060 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00a95f0 con 0x7fbab01527e0 2024-09-12T02:57:47.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbaaca00640 1 -- 172.21.15.63:0/1081711060 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa00a9790 con 0x7fbab01527e0 2024-09-12T02:57:47.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbaaca00640 1 -- 172.21.15.63:0/1081711060 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00a9b60 con 0x7fbab01527e0 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d6f000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d680b38c0 0x7f5d680ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d6f000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d680c3cb0 0x7f5d681f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d6f000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d681560c0 0x7f5d681f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d6f000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5d68071070 con 0x7f5d680b38c0 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d6f000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d680c9030 con 0x7f5d681560c0 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d6f000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5d680c8c80 con 0x7f5d680c3cb0 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbab4e00640 1 -- 172.21.15.63:0/1081711060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab01527e0 msgr2=0x7fbab00c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbab4e00640 1 --2- 172.21.15.63:0/1081711060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab01527e0 0x7fbab00c6970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009870 tx=0x7fbaa001c530 comp rx=0 tx=0).stop 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbab4e00640 1 -- 172.21.15.63:0/1081711060 shutdown_connections 2024-09-12T02:57:47.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbab4e00640 1 --2- 172.21.15.63:0/1081711060 >> v2:172.21.15.63:3300/0 conn(0x7fbab00c61e0 0x7fbab00c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbab4e00640 1 --2- 172.21.15.63:0/1081711060 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab01527e0 0x7fbab00c6970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7fbab4e00640 1 -- 172.21.15.63:0/1081711060 >> 172.21.15.63:0/1081711060 conn(0x7fbab006f3d0 msgr2=0x7fbab006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:47.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d67400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d680c3cb0 0x7f5d681f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d67400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d680c3cb0 0x7f5d681f5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:56672/0 (socket says 172.21.15.63:56672) 2024-09-12T02:57:47.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d67400640 1 -- 172.21.15.63:0/3930095777 learned_addr learned my addr 172.21.15.63:0/3930095777 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:47.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d67e00640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d680b38c0 0x7f5d680ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d6d000640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d681560c0 0x7f5d681f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d67400640 1 -- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d681560c0 msgr2=0x7f5d681f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d67400640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d681560c0 0x7f5d681f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d67400640 1 -- 172.21.15.63:0/3930095777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d680b38c0 msgr2=0x7f5d680ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d67400640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d680b38c0 0x7f5d680ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.709+0000 7f5d67400640 1 -- 172.21.15.63:0/3930095777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d681f90e0 con 0x7f5d680c3cb0 2024-09-12T02:57:47.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 -- 172.21.15.63:0/1081711060 shutdown_connections 2024-09-12T02:57:47.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 -- 172.21.15.63:0/1081711060 wait complete. 2024-09-12T02:57:47.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7f5d67400640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d680c3cb0 0x7f5d681f5160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400c460 tx=0x7f5d5400c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7f5d5fe00640 1 -- 172.21.15.63:0/3930095777 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d540052d0 con 0x7f5d680c3cb0 2024-09-12T02:57:47.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7f5d5fe00640 1 -- 172.21.15.63:0/3930095777 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d540054b0 con 0x7f5d680c3cb0 2024-09-12T02:57:47.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7f5d5fe00640 1 -- 172.21.15.63:0/3930095777 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54012870 con 0x7f5d680c3cb0 2024-09-12T02:57:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d6815c470 con 0x7f5d680c3cb0 2024-09-12T02:57:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d680c5820 con 0x7f5d680c3cb0 2024-09-12T02:57:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 Processor -- start 2024-09-12T02:57:47.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d680c32a0 con 0x7f5d680c3cb0 2024-09-12T02:57:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 -- start start 2024-09-12T02:57:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab00c61e0 0x7fbab01f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab00c7a00 0x7fbab0151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbab01527e0 0x7fbab00c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.718 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:47.713+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:47.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbab01586e0 con 0x7fbab01527e0 2024-09-12T02:57:47.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbab0158560 con 0x7fbab00c61e0 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbab4e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbab0165700 con 0x7fbab00c7a00 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbaae800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbab01527e0 0x7fbab00c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbaade00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab00c61e0 0x7fbab01f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbaad400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab00c7a00 0x7fbab0151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbaade00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab00c61e0 0x7fbab01f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:40988/0 (socket says 172.21.15.63:40988) 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.713+0000 7fbaade00640 1 -- 172.21.15.63:0/3702248208 learned_addr learned my addr 172.21.15.63:0/3702248208 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaae800640 1 -- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab00c7a00 msgr2=0x7fbab0151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaae800640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab00c7a00 0x7fbab0151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaae800640 1 -- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab00c61e0 msgr2=0x7fbab01f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaae800640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab00c61e0 0x7fbab01f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaae800640 1 -- 172.21.15.63:0/3702248208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab01f77d0 con 0x7fbab01527e0 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaade00640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab00c61e0 0x7fbab01f8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:47.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaae800640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbab01527e0 0x7fbab00c4a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800ef90 tx=0x7fbaa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7f5d5fe00640 1 -- 172.21.15.63:0/3930095777 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d54012a10 con 0x7f5d680c3cb0 2024-09-12T02:57:47.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaa6000640 1 -- 172.21.15.63:0/3702248208 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8018030 con 0x7fbab01527e0 2024-09-12T02:57:47.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaa6000640 1 -- 172.21.15.63:0/3702248208 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa800cd30 con 0x7fbab01527e0 2024-09-12T02:57:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbaa6000640 1 -- 172.21.15.63:0/3702248208 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8003bc0 con 0x7fbab01527e0 2024-09-12T02:57:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab00c3290 con 0x7fbab01527e0 2024-09-12T02:57:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab00c3850 con 0x7fbab01527e0 2024-09-12T02:57:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7f5d5fe00640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d48067910 0x7f5d48069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7f5d5fe00640 1 -- 172.21.15.63:0/3930095777 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5d54086670 con 0x7f5d680c3cb0 2024-09-12T02:57:47.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.717+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab00cc550 con 0x7fbab01527e0 2024-09-12T02:57:47.723 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:57:47.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.721+0000 7f5d67e00640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d48067910 0x7f5d48069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.721+0000 7fbaa6000640 1 -- 172.21.15.63:0/3702248208 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbaa801b070 con 0x7fbab01527e0 2024-09-12T02:57:47.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.721+0000 7f5d67e00640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d48067910 0x7f5d48069dd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d580b2000 tx=0x7f5d580aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.721+0000 7fbaa6000640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba90067940 0x7fba90069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.721+0000 7fbaa6000640 1 -- 172.21.15.63:0/3702248208 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbaa8086870 con 0x7fbab01527e0 2024-09-12T02:57:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.721+0000 7fbaade00640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba90067940 0x7fba90069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.721+0000 7fbaade00640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba90067940 0x7fba90069e00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009870 tx=0x7fbaa00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.721+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa074073720 con 0x7fa0741f3520 2024-09-12T02:57:47.729 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:57:47.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.725+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa074073720 con 0x7fa0741f3520 2024-09-12T02:57:47.729 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:57:47.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.725+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa074137e00 0x7fa0741381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.725+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fa074138720 con 0x7fa074137e00 2024-09-12T02:57:47.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.725+0000 7fa071e00640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa074137e00 0x7fa0741381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.725+0000 7fa071e00640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa074137e00 0x7fa0741381e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.725+0000 7fbaa6000640 1 -- 172.21.15.63:0/3702248208 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbaa8022070 con 0x7fbab01527e0 2024-09-12T02:57:47.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.725+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa074138720 con 0x7fa074137e00 2024-09-12T02:57:47.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.729+0000 7f5d5fe00640 1 -- 172.21.15.63:0/3930095777 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5d54056740 con 0x7f5d680c3cb0 2024-09-12T02:57:47.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.757+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa0740cc570 con 0x7fa074137e00 2024-09-12T02:57:47.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.757+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa0740cc570 con 0x7fa074137e00 2024-09-12T02:57:47.760 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:57:47.761 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:57:47.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.757+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa0741505d0 0x7fa0740626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.757+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fa0740cc720 con 0x7fa0741505d0 2024-09-12T02:57:47.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.757+0000 7fa071400640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa0741505d0 0x7fa0740626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.757+0000 7fa071400640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa0741505d0 0x7fa0740626e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.757+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0740cc720 con 0x7fa0741505d0 2024-09-12T02:57:47.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.773+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa0740cc720 con 0x7fa0741505d0 2024-09-12T02:57:47.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.773+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa0740cc720 con 0x7fa0741505d0 2024-09-12T02:57:47.778 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:57:47.779 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:57:47.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.777+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa0740caca0 0x7fa0740cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.777+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fa0740cc720 con 0x7fa0740caca0 2024-09-12T02:57:47.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.777+0000 7fa072800640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa0740caca0 0x7fa0740cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.777+0000 7fa072800640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa0740caca0 0x7fa0740cb0e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.777+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0740cc720 con 0x7fa0740caca0 2024-09-12T02:57:47.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.801+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa0740cc720 con 0x7fa0740caca0 2024-09-12T02:57:47.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.805+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa0740cc720 con 0x7fa0740caca0 2024-09-12T02:57:47.807 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:57:47.808 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:57:47.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.805+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa07402c650 0x7fa07402ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.805+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fa0740cc720 con 0x7fa07402c650 2024-09-12T02:57:47.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.805+0000 7fa071e00640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa07402c650 0x7fa07402ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.805+0000 7fa071e00640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa07402c650 0x7fa07402ca90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.809+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0740cc720 con 0x7fa07402c650 2024-09-12T02:57:47.818 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:47.815+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:47.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.833+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa0740cc720 con 0x7fa07402c650 2024-09-12T02:57:47.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.841+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa0740cc720 con 0x7fa07402c650 2024-09-12T02:57:47.842 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:57:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:57:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.841+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa07402d4e0 0x7fa0742098e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.841+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fa07402d990 con 0x7fa07402d4e0 2024-09-12T02:57:47.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.841+0000 7fa071400640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa07402d4e0 0x7fa0742098e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.841+0000 7fa071400640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa07402d4e0 0x7fa0742098e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.841+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa07402d990 con 0x7fa07402d4e0 2024-09-12T02:57:47.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.873+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa07402dba0 con 0x7fa07402d4e0 2024-09-12T02:57:47.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.877+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa0600834e0 con 0x7fa07402d4e0 2024-09-12T02:57:47.880 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:57:47.880 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:57:47.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.877+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa07420a330 0x7fa07420c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.877+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fa07420f680 con 0x7fa07420a330 2024-09-12T02:57:47.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.877+0000 7fa072800640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa07420a330 0x7fa07420c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.877+0000 7fa072800640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa07420a330 0x7fa07420c720 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.881+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa07420f680 con 0x7fa07420a330 2024-09-12T02:57:47.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.913+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa07420f650 con 0x7fa07420a330 2024-09-12T02:57:47.919 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:47.917+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:47.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.917+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa07420f650 con 0x7fa07420a330 2024-09-12T02:57:47.920 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:57:47.920 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:57:47.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.917+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa07420e8b0 0x7fa07420ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:47.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.917+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fa074212a50 con 0x7fa07420e8b0 2024-09-12T02:57:47.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.917+0000 7fa071e00640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa07420e8b0 0x7fa07420ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:47.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.917+0000 7fa071e00640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa07420e8b0 0x7fa07420ed10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:47.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.921+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa074212a50 con 0x7fa07420e8b0 2024-09-12T02:57:47.933 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:47.933 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:47.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.945+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fbab00755c0 con 0x7fbab01527e0 2024-09-12T02:57:47.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.945+0000 7fbaa6000640 1 -- 172.21.15.63:0/3702248208 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v28) ==== 81+0+38798 (secure 0 0 0) 0x7fbab01f77d0 con 0x7fbab01527e0 2024-09-12T02:57:47.949 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:57:47.949 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:47.949 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 28, 2024-09-12T02:57:47.949 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "20b0bc3b-ca7e-4b63-a9bc-3526f84b65da", 2024-09-12T02:57:47.949 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2024-09-12T02:56:41.049401+0000", 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2024-09-12T02:57:47.782438+0000", 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2024-09-12T02:56:53.715732+0000", 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2024-09-12T02:56:43.361756+0000", 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5799936, 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 6, 2024-09-12T02:57:47.950 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 4, 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "luminous", 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "squid", 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_crimson": false, 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2024-09-12T02:57:47.951 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": ".mgr", 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:56:53.830004+0000", 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:57:47.952 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:57:47.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:57:47.954 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:57:47.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:57:47.956 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_max": 32, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": {} 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 8, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 8, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.25, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 2, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 2, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-12T02:57:47.957 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:57:02.599829+0000", 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-12T02:57:47.958 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:57:47.959 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "21", 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:57:47.960 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:57:47.961 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:57:47.962 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5, 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5, 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.5, 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.5, 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:57:03.211064+0000", 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:57:47.965 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 64, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 64, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 64, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 64, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 64, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:57:47.966 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "22", 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:57:47.967 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:57:47.968 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-12T02:57:47.969 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.05000000074505806 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.3799999952316284, 2024-09-12T02:57:47.970 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.3799999952316284, 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 4, 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data_ec", 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:57:06.889005+0000", 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 5, 2024-09-12T02:57:47.971 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 3, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 4, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 3, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 1, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-12T02:57:47.972 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "26", 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:57:47.973 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:57:47.974 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:57:47.975 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 8192, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:57:47.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "5c33857f-3772-4c5f-9025-2157ac056da1", 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:57:47.977 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 15, 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 27, 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:57:47.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:57:47.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2024-09-12T02:57:47.980 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2024-09-12T02:57:47.981 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6825/3662141659", 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/3662141659", 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/3662141659", 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/3662141659", 2024-09-12T02:57:47.982 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "9a1b1d8b-fd3f-4b94-8135-941da7cb2797", 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:57:47.983 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 27, 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.984 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2024-09-12T02:57:47.985 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2024-09-12T02:57:47.986 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.987 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/866448188", 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/866448188", 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/866448188", 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/866448188", 2024-09-12T02:57:47.988 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f23c8af2-7fa2-4e43-99de-7bf2670b72ce", 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:57:47.989 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 15, 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 27, 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.990 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.991 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2024-09-12T02:57:47.993 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6817/4130213561", 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/4130213561", 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6823/4130213561", 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/4130213561", 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:57:47.994 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0b6a2786-33e7-4286-92f4-e8d25573149a", 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 15, 2024-09-12T02:57:47.995 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 24, 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2024-09-12T02:57:47.996 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2024-09-12T02:57:47.997 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.998 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:47.999 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/2574114576", 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/2574114576", 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6815/2574114576", 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/2574114576", 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "cdd5dfe1-3893-42ee-8706-50ef5c92ac9f", 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 27, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:57:48.001 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6808", 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6809", 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:57:48.002 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6810", 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6811", 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.003 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6814", 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6815", 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6812", 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6813", 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.005 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6809/946317737", 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6811/946317737", 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6815/946317737", 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6813/946317737", 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "442157e7-0a20-45b7-a3b6-f4a930643516", 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:57:48.006 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 24, 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6824", 2024-09-12T02:57:48.007 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6825", 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6826", 2024-09-12T02:57:48.008 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6827", 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6830", 2024-09-12T02:57:48.009 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6831", 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6828", 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:57:48.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6829", 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6825/4151470176", 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6827/4151470176", 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6831/4151470176", 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6829/4151470176", 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:57:48.011 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0f1cd9bc-aafa-4004-b7e5-6ea6e409d398", 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 27, 2024-09-12T02:57:48.012 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6816", 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6817", 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6818", 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6819", 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6822", 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6823", 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.015 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6820", 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6821", 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.016 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6817/2029574290", 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6819/2029574290", 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6823/2029574290", 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6821/2029574290", 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ac41ac05-d082-43f8-93ec-ba27bf53fd08", 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:57:48.017 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 20, 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6800", 2024-09-12T02:57:48.018 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6801", 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6802", 2024-09-12T02:57:48.019 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6803", 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.020 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6806", 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6807", 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.021 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6804", 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6805", 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6801/3494373582", 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6803/3494373582", 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6807/3494373582", 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6805/3494373582", 2024-09-12T02:57:48.022 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:57:48.023 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.481445+0000", 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.975485+0000", 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.024 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.719623+0000", 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:57:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.227734+0000", 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:57:48.026 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:49.777737+0000", 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.183864+0000", 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.027 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.071981+0000", 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:57:48.028 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:49.830810+0000", 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [ 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.d", 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 7, 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 1 2024-09-12T02:57:48.029 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.16", 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 5, 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.19", 2024-09-12T02:57:48.030 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 3, 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.36", 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 5, 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.031 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "4.3", 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 1, 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "4.13", 2024-09-12T02:57:48.032 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 1, 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "4.18", 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 1, 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.033 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_primaries": [], 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklist": {}, 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "range_blocklist": {}, 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_data_ec": { 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-device-class": "", 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-num-failure-domains": "0", 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-osds-per-failure-domain": "0", 2024-09-12T02:57:48.034 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-root": "default", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "2", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "w": "8" 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2024-09-12T02:57:48.035 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {}, 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode": { 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_enabled": false, 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_bucket_count": 0, 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_bucket": 0 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:48.036 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:48.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.945+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa0742118d0 con 0x7fa07420e8b0 2024-09-12T02:57:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba90067940 msgr2=0x7fba90069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba90067940 0x7fba90069e00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009870 tx=0x7fbaa00a7000 comp rx=0 tx=0).stop 2024-09-12T02:57:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbab01527e0 msgr2=0x7fbab00c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbab01527e0 0x7fbab00c4a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800ef90 tx=0x7fbaa800c490 comp rx=0 tx=0).stop 2024-09-12T02:57:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 shutdown_connections 2024-09-12T02:57:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbab01527e0 0x7fbab00c4a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba90067940 0x7fba90069e00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbab00c7a00 0x7fbab0151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 --2- 172.21.15.63:0/3702248208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbab00c61e0 0x7fbab01f8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 >> 172.21.15.63:0/3702248208 conn(0x7fbab006f3d0 msgr2=0x7fbab01613d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:48.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:57:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 shutdown_connections 2024-09-12T02:57:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.949+0000 7fbab4e00640 1 -- 172.21.15.63:0/3702248208 wait complete. 2024-09-12T02:57:48.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa06a000640 1 -- 172.21.15.63:0/283608443 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa0742118d0 con 0x7fa07420e8b0 2024-09-12T02:57:48.041 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:57:48.042 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:57:48.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa0741f3520 msgr2=0x7fa0741f6c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa0741f3520 0x7fa0741f6c10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa074137e00 msgr2=0x7fa0741381e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa074137e00 0x7fa0741381e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa0741505d0 msgr2=0x7fa0740626e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa0741505d0 0x7fa0740626e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa0740caca0 msgr2=0x7fa0740cb0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa0740caca0 0x7fa0740cb0e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa07402c650 msgr2=0x7fa07402ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa07402c650 0x7fa07402ca90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa07402d4e0 msgr2=0x7fa0742098e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa07402d4e0 0x7fa0742098e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa07420a330 msgr2=0x7fa07420c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa07420a330 0x7fa07420c720 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa07420e8b0 msgr2=0x7fa07420ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa072800640 1 -- 172.21.15.63:0/283608443 reap_dead start 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa07420e8b0 0x7fa07420ed10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa072800640 1 -- 172.21.15.63:0/283608443 reap_dead start 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa072800640 1 -- 172.21.15.63:0/283608443 reap_dead start 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa072800640 1 -- 172.21.15.63:0/283608443 reap_dead start 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa0540678f0 msgr2=0x7fa054069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa0540678f0 0x7fa054069db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa064001810 tx=0x7fa064009040 comp rx=0 tx=0).stop 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406e0d0 msgr2=0x7fa074156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406e0d0 0x7fa074156720 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c3a0 tx=0x7fa06000c860 comp rx=0 tx=0).stop 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 shutdown_connections 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa0540678f0 0x7fa054069db0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07406e0d0 0x7fa074156720 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 --2- 172.21.15.63:0/283608443 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa07420e8b0 0x7fa07420ed10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 >> 172.21.15.63:0/283608443 conn(0x7fa074070180 msgr2=0x7fa07406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:48.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 shutdown_connections 2024-09-12T02:57:48.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.953+0000 7fa073200640 1 -- 172.21.15.63:0/283608443 wait complete. 2024-09-12T02:57:48.046 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': '20b0bc3b-ca7e-4b63-a9bc-3526f84b65da', 'created': '2024-09-12T02:56:41.049401+0000', 'modified': '2024-09-12T02:57:47.782438+0000', 'last_up_change': '2024-09-12T02:56:53.715732+0000', 'last_in_change': '2024-09-12T02:56:43.361756+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:56:53.830004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:57:02.599829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:57:03.211064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T02:57:06.889005+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': '5c33857f-3772-4c5f-9025-2157ac056da1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6824', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6825', 'nonce': 3662141659}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6826', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6827', 'nonce': 3662141659}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6830', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6831', 'nonce': 3662141659}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6828', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6829', 'nonce': 3662141659}]}, 'public_addr': '172.21.15.63:6825/3662141659', 'cluster_addr': '172.21.15.63:6827/3662141659', 'heartbeat_back_addr': '172.21.15.63:6831/3662141659', 'heartbeat_front_addr': '172.21.15.63:6829/3662141659', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '9a1b1d8b-fd3f-4b94-8135-941da7cb2797', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6800', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6801', 'nonce': 866448188}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6802', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6803', 'nonce': 866448188}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6806', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6807', 'nonce': 866448188}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6804', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6805', 'nonce': 866448188}]}, 'public_addr': '172.21.15.63:6801/866448188', 'cluster_addr': '172.21.15.63:6803/866448188', 'heartbeat_back_addr': '172.21.15.63:6807/866448188', 'heartbeat_front_addr': '172.21.15.63:6805/866448188', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f23c8af2-7fa2-4e43-99de-7bf2670b72ce', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6816', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6817', 'nonce': 4130213561}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6818', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6819', 'nonce': 4130213561}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6822', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6823', 'nonce': 4130213561}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6820', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6821', 'nonce': 4130213561}]}, 'public_addr': '172.21.15.63:6817/4130213561', 'cluster_addr': '172.21.15.63:6819/4130213561', 'heartbeat_back_addr': '172.21.15.63:6823/4130213561', 'heartbeat_front_addr': '172.21.15.63:6821/4130213561', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b6a2786-33e7-4286-92f4-e8d25573149a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6808', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6809', 'nonce': 2574114576}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6810', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6811', 'nonce': 2574114576}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6814', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6815', 'nonce': 2574114576}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6812', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6813', 'nonce': 2574114576}]}, 'public_addr': '172.21.15.63:6809/2574114576', 'cluster_addr': '172.21.15.63:6811/2574114576', 'heartbeat_back_addr': '172.21.15.63:6815/2574114576', 'heartbeat_front_addr': '172.21.15.63:6813/2574114576', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cdd5dfe1-3893-42ee-8706-50ef5c92ac9f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6808', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6809', 'nonce': 946317737}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6810', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6811', 'nonce': 946317737}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6814', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6815', 'nonce': 946317737}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6812', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6813', 'nonce': 946317737}]}, 'public_addr': '172.21.15.119:6809/946317737', 'cluster_addr': '172.21.15.119:6811/946317737', 'heartbeat_back_addr': '172.21.15.119:6815/946317737', 'heartbeat_front_addr': '172.21.15.119:6813/946317737', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '442157e7-0a20-45b7-a3b6-f4a930643516', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6824', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6825', 'nonce': 4151470176}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6826', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6827', 'nonce': 4151470176}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6830', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6831', 'nonce': 4151470176}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6828', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6829', 'nonce': 4151470176}]}, 'public_addr': '172.21.15.119:6825/4151470176', 'cluster_addr': '172.21.15.119:6827/4151470176', 'heartbeat_back_addr': '172.21.15.119:6831/4151470176', 'heartbeat_front_addr': '172.21.15.119:6829/4151470176', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0f1cd9bc-aafa-4004-b7e5-6ea6e409d398', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6816', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6817', 'nonce': 2029574290}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6818', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6819', 'nonce': 2029574290}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6822', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6823', 'nonce': 2029574290}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6820', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6821', 'nonce': 2029574290}]}, 'public_addr': '172.21.15.119:6817/2029574290', 'cluster_addr': '172.21.15.119:6819/2029574290', 'heartbeat_back_addr': '172.21.15.119:6823/2029574290', 'heartbeat_front_addr': '172.21.15.119:6821/2029574290', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'ac41ac05-d082-43f8-93ec-ba27bf53fd08', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 20, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6800', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6801', 'nonce': 3494373582}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6802', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6803', 'nonce': 3494373582}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6806', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6807', 'nonce': 3494373582}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6804', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6805', 'nonce': 3494373582}]}, 'public_addr': '172.21.15.119:6801/3494373582', 'cluster_addr': '172.21.15.119:6803/3494373582', 'heartbeat_back_addr': '172.21.15.119:6807/3494373582', 'heartbeat_front_addr': '172.21.15.119:6805/3494373582', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.481445+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.975485+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.719623+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.227734+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:49.777737+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.183864+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.071981+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:49.830810+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.d', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '3.16', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.19', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '3.36', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '4.3', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.13', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.18', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T02:57:48.046 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.16 2024-09-12T02:57:48.046 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.16 2024-09-12T02:57:48.047 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:47.985+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7f5d680c51c0 con 0x7f5d680c3cb0 2024-09-12T02:57:48.047 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:48.035+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:48.139 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:48.135+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:48.232 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:48.232 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:48.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7dde00640 1 Processor -- start 2024-09-12T02:57:48.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7dde00640 1 -- start start 2024-09-12T02:57:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7dde00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7d80c9f00 0x7fa7d80c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7dde00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa7d806ccd0 0x7fa7d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7dde00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d806d990 con 0x7fa7d8152a20 2024-09-12T02:57:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7dde00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d815cbf0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7dde00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d80c8710 con 0x7fa7d80c9f00 2024-09-12T02:57:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7d6a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa7d8152a20 0x7fa7d80c6540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40190/0 (socket says 172.21.15.63:40190) 2024-09-12T02:57:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7d6a00640 1 -- 172.21.15.63:0/3612974357 learned_addr learned my addr 172.21.15.63:0/3612974357 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7d7400640 1 --2- 172.21.15.63:0/3612974357 >> v2:172.21.15.63:3300/0 conn(0x7fa7d806ccd0 0x7fa7d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.233+0000 7fa7ce000640 1 --2- 172.21.15.63:0/3612974357 >> v2:172.21.15.119:3300/0 conn(0x7fa7d80c9f00 0x7fa7d80c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d6000640 1 -- 172.21.15.63:0/3612974357 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999407689 0 0) 0x7fa7d806d990 con 0x7fa7d8152a20 2024-09-12T02:57:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d6000640 1 -- 172.21.15.63:0/3612974357 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7bc003530 con 0x7fa7d8152a20 2024-09-12T02:57:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d7400640 1 -- 172.21.15.63:0/3612974357 >> v2:172.21.15.119:3300/0 conn(0x7fa7d80c9f00 msgr2=0x7fa7d80c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d7400640 1 --2- 172.21.15.63:0/3612974357 >> v2:172.21.15.119:3300/0 conn(0x7fa7d80c9f00 0x7fa7d80c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d7400640 1 -- 172.21.15.63:0/3612974357 >> v1:172.21.15.63:6789/0 conn(0x7fa7d8152a20 legacy=0x7fa7d80c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d7400640 1 -- 172.21.15.63:0/3612974357 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d8067aa0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.240 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:48.237+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:48.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d7400640 1 --2- 172.21.15.63:0/3612974357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 0x7fa7d806d0f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80c3cb0 tx=0x7fa7d001f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e358853603dec57 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:48.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d6000640 1 -- 172.21.15.63:0/3612974357 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00b4070 con 0x7fa7d806ccd0 2024-09-12T02:57:48.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d6000640 1 -- 172.21.15.63:0/3612974357 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d00af600 con 0x7fa7d806ccd0 2024-09-12T02:57:48.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.237+0000 7fa7d6000640 1 -- 172.21.15.63:0/3612974357 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00af9b0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 -- 172.21.15.63:0/3612974357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 msgr2=0x7fa7d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 --2- 172.21.15.63:0/3612974357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 0x7fa7d806d0f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80c3cb0 tx=0x7fa7d001f110 comp rx=0 tx=0).stop 2024-09-12T02:57:48.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 -- 172.21.15.63:0/3612974357 shutdown_connections 2024-09-12T02:57:48.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 --2- 172.21.15.63:0/3612974357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 0x7fa7d806d0f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 --2- 172.21.15.63:0/3612974357 >> v2:172.21.15.119:3300/0 conn(0x7fa7d80c9f00 0x7fa7d80c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 -- 172.21.15.63:0/3612974357 >> 172.21.15.63:0/3612974357 conn(0x7fa7d80c93e0 msgr2=0x7fa7d80c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:48.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 -- 172.21.15.63:0/3612974357 shutdown_connections 2024-09-12T02:57:48.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 -- 172.21.15.63:0/3612974357 wait complete. 2024-09-12T02:57:48.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 Processor -- start 2024-09-12T02:57:48.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 -- start start 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 0x7fa7d8154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80c9f00 0x7fa7d815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7d8152a20 0x7fa7d815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8072240 con 0x7fa7d806ccd0 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d80720c0 con 0x7fa7d80c9f00 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7dde00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d815c810 con 0x7fa7d8152a20 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7d6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 0x7fa7d8154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7d6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 0x7fa7d8154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57046/0 (socket says 172.21.15.63:57046) 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7d6a00640 1 -- 172.21.15.63:0/1796503306 learned_addr learned my addr 172.21.15.63:0/1796503306 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7d7400640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7d8152a20 0x7fa7d815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:48.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7ce000640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80c9f00 0x7fa7d815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:48.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7d6a00640 1 -- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7d8152a20 msgr2=0x7fa7d815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7d6a00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7d8152a20 0x7fa7d815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7d6a00640 1 -- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80c9f00 msgr2=0x7fa7d815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.241+0000 7fa7d6a00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80c9f00 0x7fa7d815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7d6a00640 1 -- 172.21.15.63:0/1796503306 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d814f2f0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7d6a00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 0x7fa7d8154b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c3c0 tx=0x7fa7c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:48.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7cfe00640 1 -- 172.21.15.63:0/1796503306 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8017070 con 0x7fa7d806ccd0 2024-09-12T02:57:48.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7cfe00640 1 -- 172.21.15.63:0/1796503306 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c8005cf0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7cfe00640 1 -- 172.21.15.63:0/1796503306 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80072f0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d8155530 con 0x7fa7d806ccd0 2024-09-12T02:57:48.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d8155ab0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d8152e00 con 0x7fa7d806ccd0 2024-09-12T02:57:48.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7cfe00640 1 -- 172.21.15.63:0/1796503306 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7c801a070 con 0x7fa7d806ccd0 2024-09-12T02:57:48.250 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:57:48.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7cfe00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa7b40678c0 0x7fa7b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:48.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.245+0000 7fa7cfe00640 1 -- 172.21.15.63:0/1796503306 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa7c80853f0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.249+0000 7fa7ce000640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa7b40678c0 0x7fa7b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:48.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.249+0000 7fa7ce000640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa7b40678c0 0x7fa7b4069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7d81598b0 tx=0x7fa7c0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:48.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.253+0000 7fa7cfe00640 1 -- 172.21.15.63:0/1796503306 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa7d814f2f0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.341 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:48.337+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:48.400 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:48.400 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:48.416 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:57:48.441 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:48.439+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:48.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.513+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd rm-pg-upmap-items", "pgid": "3.16"} v 0) -- 0x7fa7d8156280 con 0x7fa7d806ccd0 2024-09-12T02:57:48.542 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:48.539+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:48.606 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:48.606 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:48.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:57:48.667 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:48.665+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:48.745 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:57:48.739+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:57:48.769 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:48.769 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:48.784 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:57:48.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.801+0000 7fa7cfe00640 1 -- 172.21.15.63:0/1796503306 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd rm-pg-upmap-items", "pgid": "3.16"}]=0 clear 3.16 pg_upmap_items mapping v29) ==== 118+0+0 (secure 0 0 0) 0x7fa7c80554e0 con 0x7fa7d806ccd0 2024-09-12T02:57:48.804 INFO:teuthology.orchestra.run.smithi063.stderr:clear 3.16 pg_upmap_items mapping 2024-09-12T02:57:48.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.801+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa7b40678c0 msgr2=0x7fa7b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.801+0000 7fa7dde00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa7b40678c0 0x7fa7b4069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7d81598b0 tx=0x7fa7c0009190 comp rx=0 tx=0).stop 2024-09-12T02:57:48.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.801+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 msgr2=0x7fa7d8154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.801+0000 7fa7dde00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 0x7fa7d8154b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800c3c0 tx=0x7fa7c800c880 comp rx=0 tx=0).stop 2024-09-12T02:57:48.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.805+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 shutdown_connections 2024-09-12T02:57:48.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.805+0000 7fa7dde00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa7b40678c0 0x7fa7b4069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.805+0000 7fa7dde00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7d8152a20 0x7fa7d815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.805+0000 7fa7dde00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7d80c9f00 0x7fa7d815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.805+0000 7fa7dde00640 1 --2- 172.21.15.63:0/1796503306 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7d806ccd0 0x7fa7d8154b90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.805+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 >> 172.21.15.63:0/1796503306 conn(0x7fa7d80c93e0 msgr2=0x7fa7d8150e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:48.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.805+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 shutdown_connections 2024-09-12T02:57:48.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.805+0000 7fa7dde00640 1 -- 172.21.15.63:0/1796503306 wait complete. 2024-09-12T02:57:48.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.805+0000 7f5d5fe00640 1 -- 172.21.15.63:0/3930095777 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v29) ==== 87+0+0 (secure 0 0 0) 0x7f5d5405aa40 con 0x7f5d680c3cb0 2024-09-12T02:57:48.810 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-12T02:57:48.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d48067910 msgr2=0x7f5d48069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d48067910 0x7f5d48069dd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d580b2000 tx=0x7f5d580aa070 comp rx=0 tx=0).stop 2024-09-12T02:57:48.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d680c3cb0 msgr2=0x7f5d681f5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:48.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d680c3cb0 0x7f5d681f5160 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400c460 tx=0x7f5d5400c920 comp rx=0 tx=0).stop 2024-09-12T02:57:48.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 shutdown_connections 2024-09-12T02:57:48.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d681560c0 0x7f5d681f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d48067910 0x7f5d48069dd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d680c3cb0 0x7f5d681f5160 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 --2- 172.21.15.63:0/3930095777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d680b38c0 0x7f5d680ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:48.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 >> 172.21.15.63:0/3930095777 conn(0x7f5d68071670 msgr2=0x7f5d681519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:48.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 shutdown_connections 2024-09-12T02:57:48.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:48.809+0000 7f5d6f000640 1 -- 172.21.15.63:0/3930095777 wait complete. 2024-09-12T02:57:48.879 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:48.877+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:48.946 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:48.943+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:48.968 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:48.968 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:48.983 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:57:49.079 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:49.077+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:49.148 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:49.145+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:49.179 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:49.180 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:49.195 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:57:49.250 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:49.247+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:49.351 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:49.349+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:49.387 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:49.387 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:49.402 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:57:49.490 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:49.489+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:49.553 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:49.549+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:49.591 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:49.591 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:49.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:57:49.654 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:49.649+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:49.755 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:49.753+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:49.795 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:49.795 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:49.811 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:57:49.857 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:49.853+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:49.957 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:57:49.955+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:57:50.001 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:50.001 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:50.017 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:57:50.046 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:57:50.061 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:50.059+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:50.146 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:50.147 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:50.159 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:50.157+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:50.160 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:57:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.181+0000 7f5b2ca00640 1 Processor -- start 2024-09-12T02:57:50.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.181+0000 7f5b2ca00640 1 -- start start 2024-09-12T02:57:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.181+0000 7f5b2ca00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b281527e0 0x7f5b280c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.181+0000 7f5b2ca00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b280c9720 con 0x7f5b280c4ff0 2024-09-12T02:57:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.181+0000 7f5b2ca00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b280c9a00 con 0x7f5b280ce080 2024-09-12T02:57:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.181+0000 7f5b2ca00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5b28070570 con 0x7f5b281527e0 2024-09-12T02:57:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.181+0000 7f5b25400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5b280c4ff0 0x7f5b2806fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40204/0 (socket says 172.21.15.63:40204) 2024-09-12T02:57:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.181+0000 7f5b25400640 1 -- 172.21.15.63:0/3765529884 learned_addr learned my addr 172.21.15.63:0/3765529884 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:50.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b25e00640 1 --2- 172.21.15.63:0/3765529884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b281527e0 0x7f5b280c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b24a00640 1 -- 172.21.15.63:0/3765529884 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046948738 0 0) 0x7f5b280c9720 con 0x7f5b280c4ff0 2024-09-12T02:57:50.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b24a00640 1 -- 172.21.15.63:0/3765529884 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b0c003530 con 0x7f5b280c4ff0 2024-09-12T02:57:50.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b25e00640 1 -- 172.21.15.63:0/3765529884 >> v1:172.21.15.119:6789/0 conn(0x7f5b280ce080 legacy=0x7f5b28162ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b25e00640 1 -- 172.21.15.63:0/3765529884 >> v1:172.21.15.63:6789/0 conn(0x7f5b280c4ff0 legacy=0x7f5b2806fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b25e00640 1 -- 172.21.15.63:0/3765529884 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b280c9ce0 con 0x7f5b281527e0 2024-09-12T02:57:50.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b25e00640 1 --2- 172.21.15.63:0/3765529884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b281527e0 0x7f5b280c82a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b180097f0 tx=0x7f5b1801ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfbe6be95e467fde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b24a00640 1 -- 172.21.15.63:0/3765529884 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180b5070 con 0x7f5b281527e0 2024-09-12T02:57:50.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b24a00640 1 -- 172.21.15.63:0/3765529884 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b180a89d0 con 0x7f5b281527e0 2024-09-12T02:57:50.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.185+0000 7f5b24a00640 1 -- 172.21.15.63:0/3765529884 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180a8d80 con 0x7f5b281527e0 2024-09-12T02:57:50.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 -- 172.21.15.63:0/3765529884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b281527e0 msgr2=0x7f5b280c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/3765529884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b281527e0 0x7f5b280c82a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b180097f0 tx=0x7f5b1801ecd0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 -- 172.21.15.63:0/3765529884 shutdown_connections 2024-09-12T02:57:50.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/3765529884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b281527e0 0x7f5b280c82a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 -- 172.21.15.63:0/3765529884 >> 172.21.15.63:0/3765529884 conn(0x7f5b28067a00 msgr2=0x7f5b28067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:50.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 -- 172.21.15.63:0/3765529884 shutdown_connections 2024-09-12T02:57:50.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 -- 172.21.15.63:0/3765529884 wait complete. 2024-09-12T02:57:50.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 Processor -- start 2024-09-12T02:57:50.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 -- start start 2024-09-12T02:57:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b280c4ff0 0x7f5b2814be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b280ce080 0x7f5b281ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b281527e0 0x7f5b2815ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2806f9d0 con 0x7f5b280c4ff0 2024-09-12T02:57:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2806f6f0 con 0x7f5b281527e0 2024-09-12T02:57:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b2ca00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5b280c93e0 con 0x7f5b280ce080 2024-09-12T02:57:50.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b25e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b280c4ff0 0x7f5b2814be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b25e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b280c4ff0 0x7f5b2814be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57048/0 (socket says 172.21.15.63:57048) 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b25e00640 1 -- 172.21.15.63:0/2507363750 learned_addr learned my addr 172.21.15.63:0/2507363750 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b25400640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b280ce080 0x7f5b281ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b26800640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b281527e0 0x7f5b2815ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b25e00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b280ce080 msgr2=0x7f5b281ef1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b25e00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b280ce080 0x7f5b281ef1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b25e00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b281527e0 msgr2=0x7f5b2815ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b25e00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b281527e0 0x7f5b2815ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.189+0000 7f5b25e00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b280c7a50 con 0x7f5b280c4ff0 2024-09-12T02:57:50.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b25e00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b280c4ff0 0x7f5b2814be80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b180097f0 tx=0x7f5b1801ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180b5040 con 0x7f5b280c4ff0 2024-09-12T02:57:50.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b180c0070 con 0x7f5b280c4ff0 2024-09-12T02:57:50.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18003620 con 0x7f5b280c4ff0 2024-09-12T02:57:50.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b28159810 con 0x7f5b280c4ff0 2024-09-12T02:57:50.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b28151580 con 0x7f5b280c4ff0 2024-09-12T02:57:50.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f5b280b3660 con 0x7f5b280c4ff0 2024-09-12T02:57:50.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b180037c0 con 0x7f5b280c4ff0 2024-09-12T02:57:50.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b1e000640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b080678f0 0x7f5b08069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6706+0+0 (secure 0 0 0) 0x7f5b181233d0 con 0x7f5b280c4ff0 2024-09-12T02:57:50.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b25400640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b080678f0 0x7f5b08069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v30) ==== 54+0+16 (secure 0 0 0) 0x7f5b18018830 con 0x7f5b280c4ff0 2024-09-12T02:57:50.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5b2814b860 0x7f5b280c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.193+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b28151e00 con 0x7f5b2814b860 2024-09-12T02:57:50.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.197+0000 7f5b25400640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b080678f0 0x7f5b08069db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b2814eb60 tx=0x7f5b14007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.197+0000 7f5b26800640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5b2814b860 0x7f5b280c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.197+0000 7f5b26800640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5b2814b860 0x7f5b280c81c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.197+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b20002050 con 0x7f5b2814b860 2024-09-12T02:57:50.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.213+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5b28151840 con 0x7f5b2814b860 2024-09-12T02:57:50.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.213+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5b28151840 con 0x7f5b2814b860 2024-09-12T02:57:50.216 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:57:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:57:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.213+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5b2815b940 0x7f5b28158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.213+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f5b28151b20 con 0x7f5b2815b940 2024-09-12T02:57:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.213+0000 7f5b25e00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5b2815b940 0x7f5b28158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.213+0000 7f5b25e00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5b2815b940 0x7f5b28158360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.213+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b28151b20 con 0x7f5b2815b940 2024-09-12T02:57:50.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.229+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5b28150ec0 con 0x7f5b2815b940 2024-09-12T02:57:50.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.229+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5b28150ec0 con 0x7f5b2815b940 2024-09-12T02:57:50.233 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:57:50.233 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:57:50.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.229+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5b281f1ca0 0x7f5b281f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.229+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f5b28158db0 con 0x7f5b281f1ca0 2024-09-12T02:57:50.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.229+0000 7f5b25400640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5b281f1ca0 0x7f5b281f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.229+0000 7f5b25400640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5b281f1ca0 0x7f5b281f20c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.233+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b14005860 con 0x7f5b281f1ca0 2024-09-12T02:57:50.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.245+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5b281f28d0 con 0x7f5b281f1ca0 2024-09-12T02:57:50.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.245+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5b281f28d0 con 0x7f5b281f1ca0 2024-09-12T02:57:50.249 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:57:50.250 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:57:50.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.245+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5b28062fb0 0x7f5b2814eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.245+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f5b281f2ae0 con 0x7f5b28062fb0 2024-09-12T02:57:50.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.245+0000 7f5b26800640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5b28062fb0 0x7f5b2814eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.245+0000 7f5b26800640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5b28062fb0 0x7f5b2814eee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.249+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b281f2ae0 con 0x7f5b28062fb0 2024-09-12T02:57:50.259 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:50.257+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:50.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.261+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5b281f2ae0 con 0x7f5b28062fb0 2024-09-12T02:57:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.261+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5b281f2ae0 con 0x7f5b28062fb0 2024-09-12T02:57:50.265 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:57:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:57:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.261+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5b2814f930 0x7f5b2802c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.261+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f5b2815a310 con 0x7f5b2814f930 2024-09-12T02:57:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.261+0000 7f5b25e00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5b2814f930 0x7f5b2802c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.265+0000 7f5b25e00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5b2814f930 0x7f5b2802c650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.265+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b2815a310 con 0x7f5b2814f930 2024-09-12T02:57:50.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.277+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5b2815a310 con 0x7f5b2814f930 2024-09-12T02:57:50.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.281+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5b2815a310 con 0x7f5b2814f930 2024-09-12T02:57:50.282 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:57:50.283 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:57:50.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.281+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5b2802d0a0 0x7f5b2802d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.281+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f5b2802da60 con 0x7f5b2802d0a0 2024-09-12T02:57:50.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.281+0000 7f5b25400640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5b2802d0a0 0x7f5b2802d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.281+0000 7f5b25400640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5b2802d0a0 0x7f5b2802d520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.281+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b2802da60 con 0x7f5b2802d0a0 2024-09-12T02:57:50.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.297+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5b2802da60 con 0x7f5b2802d0a0 2024-09-12T02:57:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.301+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5b2802da60 con 0x7f5b2802d0a0 2024-09-12T02:57:50.303 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:57:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:57:50.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.301+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5b28205540 0x7f5b28207930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.301+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f5b280634c0 con 0x7f5b28205540 2024-09-12T02:57:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.301+0000 7f5b26800640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5b28205540 0x7f5b28207930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.301+0000 7f5b26800640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5b28205540 0x7f5b28207930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.301+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b280634c0 con 0x7f5b28205540 2024-09-12T02:57:50.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.317+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5b280634c0 con 0x7f5b28205540 2024-09-12T02:57:50.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.321+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5b280634c0 con 0x7f5b28205540 2024-09-12T02:57:50.323 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:57:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:57:50.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.321+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5b28208380 0x7f5b282087a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.321+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f5b2820d8f0 con 0x7f5b28208380 2024-09-12T02:57:50.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.321+0000 7f5b25e00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5b28208380 0x7f5b282087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.324 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:50.324 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:50.324 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:57:50.324 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:57:50.325 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:50.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.321+0000 7f5b25e00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5b28208380 0x7f5b282087a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.321+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b2820d8f0 con 0x7f5b28208380 2024-09-12T02:57:50.338 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:57:50.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.337+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5b28208df0 con 0x7f5b28208380 2024-09-12T02:57:50.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.337+0000 7f5b1e000640 1 -- 172.21.15.63:0/2507363750 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5b28208df0 con 0x7f5b28208380 2024-09-12T02:57:50.342 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:57:50.343 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:57:50.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5b2814b860 msgr2=0x7f5b280c81c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5b2814b860 0x7f5b280c81c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5b2815b940 msgr2=0x7f5b28158360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5b2815b940 0x7f5b28158360 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5b281f1ca0 msgr2=0x7f5b281f20c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5b281f1ca0 0x7f5b281f20c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5b28062fb0 msgr2=0x7f5b2814eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5b28062fb0 0x7f5b2814eee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5b2814f930 msgr2=0x7f5b2802c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5b2814f930 0x7f5b2802c650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5b2802d0a0 msgr2=0x7f5b2802d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5b2802d0a0 0x7f5b2802d520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5b28205540 msgr2=0x7f5b28207930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5b28205540 0x7f5b28207930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5b28208380 msgr2=0x7f5b282087a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5b28208380 0x7f5b282087a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b26800640 1 -- 172.21.15.63:0/2507363750 reap_dead start 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b26800640 1 -- 172.21.15.63:0/2507363750 reap_dead start 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b26800640 1 -- 172.21.15.63:0/2507363750 reap_dead start 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b26800640 1 -- 172.21.15.63:0/2507363750 reap_dead start 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b26800640 1 -- 172.21.15.63:0/2507363750 reap_dead start 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b080678f0 msgr2=0x7f5b08069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b080678f0 0x7f5b08069db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b2814eb60 tx=0x7f5b14007d40 comp rx=0 tx=0).stop 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b280c4ff0 msgr2=0x7f5b2814be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b280c4ff0 0x7f5b2814be80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b180097f0 tx=0x7f5b1801ba70 comp rx=0 tx=0).stop 2024-09-12T02:57:50.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 shutdown_connections 2024-09-12T02:57:50.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5b080678f0 0x7f5b08069db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 --2- 172.21.15.63:0/2507363750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b280c4ff0 0x7f5b2814be80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 >> 172.21.15.63:0/2507363750 conn(0x7f5b28067a00 msgr2=0x7f5b280cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:50.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 shutdown_connections 2024-09-12T02:57:50.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.341+0000 7f5b2ca00640 1 -- 172.21.15.63:0/2507363750 wait complete. 2024-09-12T02:57:50.360 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:50.357+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:50.461 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:50.459+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:50.462 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 40.60927264, 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:57:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:57:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:57:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 40.604511862000003, 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:57:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 40.604374, 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:57:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:57:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:57:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:57:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 40.604287882999998, 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:57:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 40.603564050999999, 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:57:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:57:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:57:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 40.603405184000003, 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:57:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 40.602951566000002, 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:57:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:57:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 40.599717572000003, 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:57:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:57:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:50.500 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:50.501 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:57:50.590 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:50.587+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:50.664 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:50.659+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:50.668 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:50.668 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:50.668 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:57:50.668 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:50.681 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T02:57:50.769 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:50.767+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:50.836 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T02:57:50.851 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:50.851 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:50.851 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:57:50.851 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:57:50.851 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:50.865 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T02:57:50.886 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:50.885+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:50.966 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:50.963+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbab2c00640 1 Processor -- start 2024-09-12T02:57:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbab2c00640 1 -- start start 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbab2c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbaac06edf0 0x7fbaac0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbab2c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbaac06f1d0 0x7fbaac1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbab2c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac0cdbb0 0x7fbaac154df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbab2c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fbaac15ef40 con 0x7fbaac06f1d0 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbab2c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fbaac15e090 con 0x7fbaac06edf0 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbab2c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbaac15e330 con 0x7fbaac0cdbb0 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbaa3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbaac06f1d0 0x7fbaac1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbaa3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbaac06f1d0 0x7fbaac1548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57060/0 (socket says 172.21.15.63:57060) 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbaa3400640 1 -- 172.21.15.63:0/3443573768 learned_addr learned my addr 172.21.15.63:0/3443573768 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbaabe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbaac06edf0 0x7fbaac0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbab0c00640 1 --2- 172.21.15.63:0/3443573768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac0cdbb0 0x7fbaac154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbaa3400640 1 -- 172.21.15.63:0/3443573768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac0cdbb0 msgr2=0x7fbaac154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbaa3400640 1 --2- 172.21.15.63:0/3443573768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac0cdbb0 0x7fbaac154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbaa3400640 1 -- 172.21.15.63:0/3443573768 >> v2:172.21.15.119:3300/0 conn(0x7fbaac06edf0 msgr2=0x7fbaac0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbaa3400640 1 --2- 172.21.15.63:0/3443573768 >> v2:172.21.15.119:3300/0 conn(0x7fbaac06edf0 0x7fbaac0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.977+0000 7fbaa3400640 1 -- 172.21.15.63:0/3443573768 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac15e610 con 0x7fbaac06f1d0 2024-09-12T02:57:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbaa3400640 1 --2- 172.21.15.63:0/3443573768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 0x7fbaac1548b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0c9da0 tx=0x7fba9401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277084d97a825f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbaab400640 1 -- 172.21.15.63:0/3443573768 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940b1070 con 0x7fbaac06f1d0 2024-09-12T02:57:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbaab400640 1 -- 172.21.15.63:0/3443573768 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba940ac630 con 0x7fbaac06f1d0 2024-09-12T02:57:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbaab400640 1 -- 172.21.15.63:0/3443573768 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940a8050 con 0x7fbaac06f1d0 2024-09-12T02:57:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbab2c00640 1 -- 172.21.15.63:0/3443573768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 msgr2=0x7fbaac1548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbab2c00640 1 --2- 172.21.15.63:0/3443573768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 0x7fbaac1548b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0c9da0 tx=0x7fba9401c520 comp rx=0 tx=0).stop 2024-09-12T02:57:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbab2c00640 1 -- 172.21.15.63:0/3443573768 shutdown_connections 2024-09-12T02:57:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbab2c00640 1 --2- 172.21.15.63:0/3443573768 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 0x7fbaac1548b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbab2c00640 1 --2- 172.21.15.63:0/3443573768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac0cdbb0 0x7fbaac154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbab2c00640 1 --2- 172.21.15.63:0/3443573768 >> v2:172.21.15.119:3300/0 conn(0x7fbaac06edf0 0x7fbaac0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbab2c00640 1 -- 172.21.15.63:0/3443573768 >> 172.21.15.63:0/3443573768 conn(0x7fbaac072960 msgr2=0x7fbaac072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbab2c00640 1 -- 172.21.15.63:0/3443573768 shutdown_connections 2024-09-12T02:57:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.981+0000 7fbab2c00640 1 -- 172.21.15.63:0/3443573768 wait complete. 2024-09-12T02:57:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 Processor -- start 2024-09-12T02:57:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 -- start start 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac06edf0 0x7fbaac157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 0x7fbaac156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cdbb0 0x7fbaac155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac0c9040 con 0x7fbaac06f1d0 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac0c8ec0 con 0x7fbaac0cdbb0 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbaac070520 con 0x7fbaac06edf0 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaabe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac06edf0 0x7fbaac157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 0x7fbaac156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaabe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac06edf0 0x7fbaac157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:56720/0 (socket says 172.21.15.63:56720) 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaabe00640 1 -- 172.21.15.63:0/440639247 learned_addr learned my addr 172.21.15.63:0/440639247 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:50.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab0c00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cdbb0 0x7fbaac155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa3400640 1 -- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac06edf0 msgr2=0x7fbaac157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa3400640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac06edf0 0x7fbaac157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa3400640 1 -- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cdbb0 msgr2=0x7fbaac155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa3400640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cdbb0 0x7fbaac155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa3400640 1 -- 172.21.15.63:0/440639247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac1f3c40 con 0x7fbaac06f1d0 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaabe00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac06edf0 0x7fbaac157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa3400640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 0x7fbaac156e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0ce1c0 tx=0x7fba940192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa8c00640 1 -- 172.21.15.63:0/440639247 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940bc070 con 0x7fbaac06f1d0 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa8c00640 1 -- 172.21.15.63:0/440639247 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba940acd10 con 0x7fbaac06f1d0 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbaa8c00640 1 -- 172.21.15.63:0/440639247 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba940b1070 con 0x7fbaac06f1d0 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaac1f4190 con 0x7fbaac06f1d0 2024-09-12T02:57:50.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.985+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaac1f3eb0 con 0x7fbaac06f1d0 2024-09-12T02:57:50.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.989+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaac158c10 con 0x7fbaac06f1d0 2024-09-12T02:57:50.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.989+0000 7fbaa8c00640 1 -- 172.21.15.63:0/440639247 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba940b63e0 con 0x7fbaac06f1d0 2024-09-12T02:57:50.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.989+0000 7fbaa8c00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba880678c0 0x7fba88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.989+0000 7fbaa8c00640 1 -- 172.21.15.63:0/440639247 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6706+0+0 (secure 0 0 0) 0x7fba9411f510 con 0x7fbaac06f1d0 2024-09-12T02:57:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.989+0000 7fbaabe00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba880678c0 0x7fba88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:50.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.989+0000 7fbaabe00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba880678c0 0x7fba88069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009f90 tx=0x7fba9c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:50.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:50.993+0000 7fbaa8c00640 1 -- 172.21.15.63:0/440639247 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fba94016110 con 0x7fbaac06f1d0 2024-09-12T02:57:51.034 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:51.034 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:57:51.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:57:51.034 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:57:51.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.034 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:51.034 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:57:51.034 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.179431055000002, 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00551893, 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:57:51.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853808+0000", 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4959999999999999e-06 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853827+0000", 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8675999999999999e-05 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853869+0000", 2024-09-12T02:57:51.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2347e-05 2024-09-12T02:57:51.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853889+0000", 2024-09-12T02:57:51.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0248999999999999e-05 2024-09-12T02:57:51.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854115+0000", 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022562600000000001 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854168+0000", 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3476000000000001e-05 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859207+0000", 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050389550000000003 2024-09-12T02:57:51.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859324+0000", 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117105 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.178228316999999, 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077810020000000004, 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.039 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855011+0000", 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3259999999999998e-06 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855026+0000", 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5023e-05 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855055+0000", 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9298e-05 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0525000000000001e-05 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855570+0000", 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000494539 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855624+0000", 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3656999999999998e-05 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862687+0000", 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007063593 2024-09-12T02:57:51.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862789+0000", 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010204099999999999 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.178106708000001, 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077503839999999999, 2024-09-12T02:57:51.044 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855131+0000", 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5230000000000001e-06 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855143+0000", 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1412e-05 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:57:51.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0043000000000001e-05 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855176+0000", 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3429e-05 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856069+0000", 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00089251 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856116+0000", 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6826999999999997e-05 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862797+0000", 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066810050000000003 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862880+0000", 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3634999999999995e-05 2024-09-12T02:57:51.048 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.177001423999997, 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065292639999999999, 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856237+0000", 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.103e-06 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856252+0000", 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4813e-05 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856279+0000", 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7254e-05 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856297+0000", 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7929000000000001e-05 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856462+0000", 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016488700000000001 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856508+0000", 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5787000000000001e-05 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862657+0000", 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061494210000000004 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862764+0000", 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010707 2024-09-12T02:57:51.053 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.176254157999999, 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005857943, 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856984+0000", 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3799999999999999e-06 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856997+0000", 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2896e-05 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857022+0000", 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5554999999999998e-05 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857043+0000", 2024-09-12T02:57:51.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0919000000000001e-05 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857162+0000", 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118526 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857225+0000", 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3578999999999996e-05 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862772+0000", 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055470789999999999 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862840+0000", 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8009000000000006e-05 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.058 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:51.059 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:57:51.066 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:51.061+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:51.167 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:51.163+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:51.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.169+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7fbaac0cd670 con 0x7fbaac06f1d0 2024-09-12T02:57:51.224 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:51.224 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:51.224 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:57:51.224 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:51.238 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:57:51.281 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:51.279+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:51.369 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:51.363+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:51.403 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:51.404 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:51.404 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:57:51.404 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:57:51.404 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:51.417 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:57:51.470 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:51.469+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:51.571 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:51.569+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:51.590 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:51.590 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.734167968999998, 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:57:51.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.597 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.734034760999997, 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:57:51.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:57:51.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:57:51.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.604 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.733930010999998, 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:57:51.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:57:51.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:57:51.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:57:51.611 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.733784192999998, 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:57:51.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:57:51.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.733711010999997, 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.618 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:57:51.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:57:51.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.624 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.733651025, 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:57:51.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:57:51.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:57:51.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:51.631 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.733588679, 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:57:51.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.733531163000002, 2024-09-12T02:57:51.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:57:51.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:57:51.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:57:51.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:57:51.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:57:51.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:57:51.641 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.731363537999997, 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:57:51.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:57:51.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.646 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.728205023000001, 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.647 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:57:51.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing_reply(2.14 epoch 25/19 rep_tid 7 lcod 25'5)", 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.721744078, 2024-09-12T02:57:51.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010494969999999999, 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.653 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864695+0000", 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7300000000000001e-07 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864699+0000", 2024-09-12T02:57:51.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.33e-06 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864715+0000", 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6116e-05 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864727+0000", 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1759e-05 2024-09-12T02:57:51.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865572+0000", 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00084520699999999995 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865744+0000", 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000171612 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.656 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.720496150000002, 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:57:51.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.663 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 32.701607199000001, 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.664 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.666 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.666 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:57:51.666 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:57:51.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.666 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.666 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.666 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:57:51.666 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:57:51.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 30.973205393000001, 2024-09-12T02:57:51.669 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.670 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:57:51.671 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:57:51.672 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.673 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:57:51.674 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:57:51.675 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.217368811, 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.676 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.677 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.678 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:57:51.679 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:57:51.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:57:51.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.682 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.682 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.682 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:57:51.682 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:57:51.682 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.682 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.682 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 28.335279846999999, 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.683 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:57:51.684 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:57:51.685 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.686 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:57:51.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:51.689 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 6.6513222340000002, 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.690 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.693 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:57:51.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:57:51.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:57:51.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:57:51.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:57:51.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:57:51.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:57:51.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:57:51.696 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.696 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 6.6512169429999997, 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.697 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:57:51.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:57:51.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.701 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:57:51.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:57:51.703 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.9586537929999999, 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:57:51.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:57:51.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:46 2.6 e28/19 2:654134d2:::mds0_openfiles.0:head v 28'2, mlcod=0'0)", 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 3.6984598960000001, 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015286869999999999, 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:51.710 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887979+0000", 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4000000000000002e-07 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887986+0000", 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1999999999999997e-06 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:51.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888007+0000", 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1075999999999999e-05 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888022+0000", 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5316e-05 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888142+0000", 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011911100000000001 2024-09-12T02:57:51.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888187+0000", 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5225000000000002e-05 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889432+0000", 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012450709999999999 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:51.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889507+0000", 2024-09-12T02:57:51.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5148000000000006e-05 2024-09-12T02:57:51.715 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.715 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.715 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.715 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:51.715 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:51.715 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:51.717 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:57:51.717 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:51.713+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:51.818 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:51.813+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:51.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbaa8c00640 1 -- 172.21.15.63:0/440639247 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v31) ==== 97+0+0 (secure 0 0 0) 0x7fba940ef610 con 0x7fbaac06f1d0 2024-09-12T02:57:51.819 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-12T02:57:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba880678c0 msgr2=0x7fba88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbab2c00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba880678c0 0x7fba88069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009f90 tx=0x7fba9c009190 comp rx=0 tx=0).stop 2024-09-12T02:57:51.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 msgr2=0x7fbaac156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:51.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbab2c00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 0x7fbaac156e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0ce1c0 tx=0x7fba940192c0 comp rx=0 tx=0).stop 2024-09-12T02:57:51.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 shutdown_connections 2024-09-12T02:57:51.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbab2c00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbaac0cdbb0 0x7fbaac155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:51.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbab2c00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbaac06f1d0 0x7fbaac156e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:51.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbab2c00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fba880678c0 0x7fba88069d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:51.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.817+0000 7fbab2c00640 1 --2- 172.21.15.63:0/440639247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbaac06edf0 0x7fbaac157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:51.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.821+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 >> 172.21.15.63:0/440639247 conn(0x7fbaac072960 msgr2=0x7fbaac0cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:51.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.821+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 shutdown_connections 2024-09-12T02:57:51.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:51.821+0000 7fbab2c00640 1 -- 172.21.15.63:0/440639247 wait complete. 2024-09-12T02:57:51.851 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:51.851 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:51.851 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:57:51.851 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:51.865 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:57:51.918 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:51.915+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:51.989 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:51.990 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:51.990 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:57:51.990 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:57:51.990 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:52.000 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:57:52.019 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:52.017+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:52.120 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:52.117+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:52.166 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:52.166 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 56.416044988000003, 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.167 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:57:52.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:57:52.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 56.272849649999998, 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.174 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:57:52.179 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 56.272829123999998, 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.180 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:57:52.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:57:52.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.186 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 56.272718310999998, 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:57:52.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:57:52.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:57:52.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:57:52.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 56.272696785000001, 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:57:52.193 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:57:52.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:57:52.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 56.207710139, 2024-09-12T02:57:52.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:57:52.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:57:52.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.205 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.985606615999998, 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:57:52.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:57:52.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.985469625, 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:57:52.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.217 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.984352422999997, 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.218 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:57:52.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:57:52.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:57:52.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.984280310000003, 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.224 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.226 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:57:52.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:57:52.230 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.984056326000001, 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:57:52.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:57:52.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:57:52.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.236 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.983986342999998, 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:57:52.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.242 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.983880706000001, 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:57:52.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.246 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:57:52.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.983690609, 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:57:52.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:57:52.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:57:52.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.983623821999998, 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:57:52.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:57:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:57:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:57:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:57:52.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:57:52.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.408274225, 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.261 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:57:52.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:57:52.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:57:52.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:57:52.266 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 42.309574791000003, 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:57:52.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:57:52.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:57:52.272 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 42.309489548999998, 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:57:52.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:57:52.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.278 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 42.309352435000001, 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:57:52.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:57:52.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 42.309182536000002, 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:57:52.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:57:52.288 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.289 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.289 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.289 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:52.289 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:52.289 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:52.290 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:57:52.291 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:52.289+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:52.362 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:57:52.391 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:57:52.387+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:57:52.449 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:52.449 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:57:52.450 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:57:52.450 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:52.466 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:57:52.492 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:52.491+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:52.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.501+0000 7f4f82c00640 1 Processor -- start 2024-09-12T02:57:52.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.501+0000 7f4f82c00640 1 -- start start 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f82c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4f7c1517d0 0x7f4f7c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f82c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4f7c0c9470 0x7f4f7c165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f82c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c070520 con 0x7f4f7c15e340 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f82c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7c06f6f0 con 0x7f4f7c0c9470 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f82c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7c0c8cf0 con 0x7f4f7c1517d0 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f80c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4f7c0c9470 0x7f4f7c165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f80c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4f7c0c9470 0x7f4f7c165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57068/0 (socket says 172.21.15.63:57068) 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f80c00640 1 -- 172.21.15.63:0/2958934796 learned_addr learned my addr 172.21.15.63:0/2958934796 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f73400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4f7c15e340 0x7f4f7c0ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40216/0 (socket says 172.21.15.63:40216) 2024-09-12T02:57:52.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f7be00640 1 --2- 172.21.15.63:0/2958934796 >> v2:172.21.15.119:3300/0 conn(0x7f4f7c1517d0 0x7f4f7c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f80c00640 1 -- 172.21.15.63:0/2958934796 >> v2:172.21.15.119:3300/0 conn(0x7f4f7c1517d0 msgr2=0x7f4f7c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:52.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f80c00640 1 --2- 172.21.15.63:0/2958934796 >> v2:172.21.15.119:3300/0 conn(0x7f4f7c1517d0 0x7f4f7c15de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f80c00640 1 -- 172.21.15.63:0/2958934796 >> v1:172.21.15.63:6789/0 conn(0x7f4f7c15e340 legacy=0x7f4f7c0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.505+0000 7f4f80c00640 1 -- 172.21.15.63:0/2958934796 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c0c9180 con 0x7f4f7c0c9470 2024-09-12T02:57:52.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f80c00640 1 --2- 172.21.15.63:0/2958934796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 0x7f4f7c165190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c06f680 tx=0x7f4f7401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d06dee7e80f93ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f7b400640 1 -- 172.21.15.63:0/2958934796 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f740b4070 con 0x7f4f7c0c9470 2024-09-12T02:57:52.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f7b400640 1 -- 172.21.15.63:0/2958934796 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f740af400 con 0x7f4f7c0c9470 2024-09-12T02:57:52.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f7b400640 1 -- 172.21.15.63:0/2958934796 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f740af7d0 con 0x7f4f7c0c9470 2024-09-12T02:57:52.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 -- 172.21.15.63:0/2958934796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 msgr2=0x7f4f7c165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 --2- 172.21.15.63:0/2958934796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 0x7f4f7c165190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c06f680 tx=0x7f4f7401f1e0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 -- 172.21.15.63:0/2958934796 shutdown_connections 2024-09-12T02:57:52.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 --2- 172.21.15.63:0/2958934796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 0x7f4f7c165190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 --2- 172.21.15.63:0/2958934796 >> v2:172.21.15.119:3300/0 conn(0x7f4f7c1517d0 0x7f4f7c15de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 -- 172.21.15.63:0/2958934796 >> 172.21.15.63:0/2958934796 conn(0x7f4f7c067a00 msgr2=0x7f4f7c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:52.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 -- 172.21.15.63:0/2958934796 shutdown_connections 2024-09-12T02:57:52.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 -- 172.21.15.63:0/2958934796 wait complete. 2024-09-12T02:57:52.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 Processor -- start 2024-09-12T02:57:52.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.509+0000 7f4f82c00640 1 -- start start 2024-09-12T02:57:52.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f82c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 0x7f4f7c1f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f82c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f7c1517d0 0x7f4f7c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f82c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f7c15e340 0x7f4f7c14b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f82c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c070240 con 0x7f4f7c0c9470 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f82c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c06ffa0 con 0x7f4f7c1517d0 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f82c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c06fc00 con 0x7f4f7c15e340 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f7be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 0x7f4f7c1f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f7be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 0x7f4f7c1f1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57084/0 (socket says 172.21.15.63:57084) 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f7be00640 1 -- 172.21.15.63:0/3953157343 learned_addr learned my addr 172.21.15.63:0/3953157343 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f73400640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f7c1517d0 0x7f4f7c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f80c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f7c15e340 0x7f4f7c14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f7be00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f7c15e340 msgr2=0x7f4f7c14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f7be00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f7c15e340 0x7f4f7c14b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f7be00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f7c1517d0 msgr2=0x7f4f7c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f7be00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f7c1517d0 0x7f4f7c0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f7be00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c0c5f70 con 0x7f4f7c0c9470 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f7be00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 0x7f4f7c1f1380 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d800 tx=0x7f4f6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00b6c0 con 0x7f4f7c0c9470 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6c019070 con 0x7f4f7c0c9470 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00ba60 con 0x7f4f7c0c9470 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c156a20 con 0x7f4f7c0c9470 2024-09-12T02:57:52.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c14d3e0 con 0x7f4f7c0c9470 2024-09-12T02:57:52.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.513+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f4f7c06ec50 con 0x7f4f7c0c9470 2024-09-12T02:57:52.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f6c00bc00 con 0x7f4f7c0c9470 2024-09-12T02:57:52.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f78c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f580678c0 0x7f4f58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6706+0+0 (secure 0 0 0) 0x7f4f6c086590 con 0x7f4f7c0c9470 2024-09-12T02:57:52.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v31) ==== 54+0+16 (secure 0 0 0) 0x7f4f6c088b30 con 0x7f4f7c0c9470 2024-09-12T02:57:52.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f73400640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f580678c0 0x7f4f58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f4f7c14b8a0 0x7f4f7c0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f7c0c4ed0 con 0x7f4f7c14b8a0 2024-09-12T02:57:52.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f80c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f4f7c14b8a0 0x7f4f7c0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f73400640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f580678c0 0x7f4f58069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c14cd30 tx=0x7f4f64007cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f80c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f4f7c14b8a0 0x7f4f7c0ca8e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.517+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f7c0c4ed0 con 0x7f4f7c14b8a0 2024-09-12T02:57:52.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.533+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4f7c0ca0e0 con 0x7f4f7c14b8a0 2024-09-12T02:57:52.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.533+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4f7c0ca0e0 con 0x7f4f7c14b8a0 2024-09-12T02:57:52.538 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:57:52.538 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:57:52.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.537+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f4f7c157380 0x7f4f7c157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.537+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f4f7c0c9b20 con 0x7f4f7c157380 2024-09-12T02:57:52.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.537+0000 7f4f7be00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f4f7c157380 0x7f4f7c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.537+0000 7f4f7be00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f4f7c157380 0x7f4f7c157780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.537+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f6c074e50 con 0x7f4f7c157380 2024-09-12T02:57:52.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.549+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4f7c14aed0 con 0x7f4f7c157380 2024-09-12T02:57:52.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.553+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4f7c14aed0 con 0x7f4f7c157380 2024-09-12T02:57:52.555 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:57:52.556 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:57:52.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.553+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f4f7c1f4380 0x7f4f7c1f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.553+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f4f7c157f00 con 0x7f4f7c1f4380 2024-09-12T02:57:52.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.553+0000 7f4f73400640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f4f7c1f4380 0x7f4f7c1f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.553+0000 7f4f73400640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f4f7c1f4380 0x7f4f7c1f47a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.553+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f7c157f00 con 0x7f4f7c1f4380 2024-09-12T02:57:52.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.565+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4f7c0629b0 con 0x7f4f7c1f4380 2024-09-12T02:57:52.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.569+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4f7c0629b0 con 0x7f4f7c1f4380 2024-09-12T02:57:52.572 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:57:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:57:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.569+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4f7c1e3e70 0x7f4f7c1e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.569+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f4f7c063490 con 0x7f4f7c1e3e70 2024-09-12T02:57:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.569+0000 7f4f80c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4f7c1e3e70 0x7f4f7c1e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.569+0000 7f4f80c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4f7c1e3e70 0x7f4f7c1e42d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.569+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f7c063490 con 0x7f4f7c1e3e70 2024-09-12T02:57:52.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.585+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4f7c1e4ae0 con 0x7f4f7c1e3e70 2024-09-12T02:57:52.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.585+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4f7c1e4ae0 con 0x7f4f7c1e3e70 2024-09-12T02:57:52.588 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:57:52.589 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:57:52.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.585+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f4f7c02cb60 0x7f4f7c02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.585+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f4f7c0636a0 con 0x7f4f7c02cb60 2024-09-12T02:57:52.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.585+0000 7f4f7be00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f4f7c02cb60 0x7f4f7c02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.585+0000 7f4f7be00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f4f7c02cb60 0x7f4f7c02cfc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.589+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f7c0c9b20 con 0x7f4f7c02cb60 2024-09-12T02:57:52.593 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:52.587+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:52.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.601+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4f7c0c9b20 con 0x7f4f7c02cb60 2024-09-12T02:57:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.605+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4f7c0c9b20 con 0x7f4f7c02cb60 2024-09-12T02:57:52.609 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:57:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:57:52.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.605+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f4f7c1e4810 0x7f4f7c207200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.605+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f4f7c0c9b20 con 0x7f4f7c1e4810 2024-09-12T02:57:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.605+0000 7f4f73400640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f4f7c1e4810 0x7f4f7c207200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.605+0000 7f4f73400640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f4f7c1e4810 0x7f4f7c207200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.609+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f7c0c9b20 con 0x7f4f7c1e4810 2024-09-12T02:57:52.614 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:52.615 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:52.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.621+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4f7c0c9b20 con 0x7f4f7c1e4810 2024-09-12T02:57:52.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.625+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4f7c0c9b20 con 0x7f4f7c1e4810 2024-09-12T02:57:52.629 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:57:52.630 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:57:52.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.625+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4f7c207c50 0x7f4f7c20a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.625+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f4f7c20ce10 con 0x7f4f7c207c50 2024-09-12T02:57:52.631 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:57:52.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.625+0000 7f4f80c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4f7c207c50 0x7f4f7c20a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.629+0000 7f4f80c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4f7c207c50 0x7f4f7c20a040 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.629+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f7c20ce10 con 0x7f4f7c207c50 2024-09-12T02:57:52.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.641+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4f7c20a580 con 0x7f4f7c207c50 2024-09-12T02:57:52.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.645+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4f7c20a580 con 0x7f4f7c207c50 2024-09-12T02:57:52.650 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:57:52.650 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:57:52.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.645+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f4f7c20ac00 0x7f4f7c20cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:52.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.645+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f4f7c20ffa0 con 0x7f4f7c20ac00 2024-09-12T02:57:52.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.649+0000 7f4f7be00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f4f7c20ac00 0x7f4f7c20cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:52.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.649+0000 7f4f7be00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f4f7c20ac00 0x7f4f7c20cff0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:52.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.649+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f7c20ffa0 con 0x7f4f7c20ac00 2024-09-12T02:57:52.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.661+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f4f7c1e4d30 con 0x7f4f7c20ac00 2024-09-12T02:57:52.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.665+0000 7f4f78c00640 1 -- 172.21.15.63:0/3953157343 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4f7c1e4d30 con 0x7f4f7c20ac00 2024-09-12T02:57:52.670 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f4f7c14b8a0 msgr2=0x7f4f7c0ca8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f4f7c14b8a0 0x7f4f7c0ca8e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f4f7c157380 msgr2=0x7f4f7c157780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f4f7c157380 0x7f4f7c157780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f4f7c1f4380 msgr2=0x7f4f7c1f47a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f4f7c1f4380 0x7f4f7c1f47a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4f7c1e3e70 msgr2=0x7f4f7c1e42d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4f7c1e3e70 0x7f4f7c1e42d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f4f7c02cb60 msgr2=0x7f4f7c02cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f4f7c02cb60 0x7f4f7c02cfc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f4f7c1e4810 msgr2=0x7f4f7c207200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f4f7c1e4810 0x7f4f7c207200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4f7c207c50 msgr2=0x7f4f7c20a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4f7c207c50 0x7f4f7c20a040 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f4f7c20ac00 msgr2=0x7f4f7c20cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f4f7c20ac00 0x7f4f7c20cff0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f80c00640 1 -- 172.21.15.63:0/3953157343 reap_dead start 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f80c00640 1 -- 172.21.15.63:0/3953157343 reap_dead start 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f80c00640 1 -- 172.21.15.63:0/3953157343 reap_dead start 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f80c00640 1 -- 172.21.15.63:0/3953157343 reap_dead start 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f80c00640 1 -- 172.21.15.63:0/3953157343 reap_dead start 2024-09-12T02:57:52.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f580678c0 msgr2=0x7f4f58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f580678c0 0x7f4f58069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c14cd30 tx=0x7f4f64007cf0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 msgr2=0x7f4f7c1f1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 0x7f4f7c1f1380 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d800 tx=0x7f4f6c00dcc0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 shutdown_connections 2024-09-12T02:57:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f580678c0 0x7f4f58069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 --2- 172.21.15.63:0/3953157343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f7c0c9470 0x7f4f7c1f1380 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 >> 172.21.15.63:0/3953157343 conn(0x7f4f7c067a00 msgr2=0x7f4f7c0c3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 shutdown_connections 2024-09-12T02:57:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:52.669+0000 7f4f82c00640 1 -- 172.21.15.63:0/3953157343 wait complete. 2024-09-12T02:57:52.735 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:52.733+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:52.778 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:52.778 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:52.793 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:57:52.835 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:52.833+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:52.895 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:52.891+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:52.982 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:52.982 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:52.996 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:52.993+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:52.997 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:57:53.097 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:53.095+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:53.185 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:53.185 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:53.198 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:53.193+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:53.200 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:57:53.299 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:53.297+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:53.385 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:53.386 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:53.400 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:53.395+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:53.401 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:57:53.501 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:53.497+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:53.587 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:53.587 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:53.602 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:53.597+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:53.603 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:57:53.702 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:53.701+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:53.790 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:53.790 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:53.803 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:53.801+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:53.805 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:57:53.833 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T02:57:53.833 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T02:57:53.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T02:57:53.904 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:53.901+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.989+0000 7f6cc8c00640 1 Processor -- start 2024-09-12T02:57:53.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.989+0000 7f6cc8c00640 1 -- start start 2024-09-12T02:57:53.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb249400640 1 Processor -- start 2024-09-12T02:57:53.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb249400640 1 -- start start 2024-09-12T02:57:53.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc8c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40c9110 0x7f6cc4163fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:53.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc8c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc40c6970 con 0x7f6cc41590b0 2024-09-12T02:57:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc8c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc4159500 con 0x7f6cc4152640 2024-09-12T02:57:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc8c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc4071f60 con 0x7f6cc40c9110 2024-09-12T02:57:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc1400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6cc41590b0 0x7f6cc40c8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35742/0 (socket says 172.21.15.63:35742) 2024-09-12T02:57:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc1400640 1 -- 172.21.15.63:0/548421743 learned_addr learned my addr 172.21.15.63:0/548421743 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc2800640 1 --2- 172.21.15.63:0/548421743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40c9110 0x7f6cc4163fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc0a00640 1 -- 172.21.15.63:0/548421743 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007742895 0 0) 0x7f6cc40c6970 con 0x7f6cc41590b0 2024-09-12T02:57:53.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc0a00640 1 -- 172.21.15.63:0/548421743 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca8003530 con 0x7f6cc41590b0 2024-09-12T02:57:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc0a00640 1 -- 172.21.15.63:0/548421743 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184851958 0 0) 0x7f6cc4159500 con 0x7f6cc4152640 2024-09-12T02:57:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc0a00640 1 -- 172.21.15.63:0/548421743 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cc40c6970 con 0x7f6cc4152640 2024-09-12T02:57:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc0a00640 1 -- 172.21.15.63:0/548421743 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2798329343 0 0) 0x7f6ca8003530 con 0x7f6cc41590b0 2024-09-12T02:57:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc2800640 1 -- 172.21.15.63:0/548421743 >> v1:172.21.15.119:6789/0 conn(0x7f6cc4152640 legacy=0x7f6cc4071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc2800640 1 -- 172.21.15.63:0/548421743 >> v1:172.21.15.63:6789/0 conn(0x7f6cc41590b0 legacy=0x7f6cc40c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:53.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7f6cc2800640 1 -- 172.21.15.63:0/548421743 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc40c6c30 con 0x7f6cc40c9110 2024-09-12T02:57:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb249400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2440c21a0 0x7fb24415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb249400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2440c79f0 0x7fb2440c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb249400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb244155010 con 0x7fb244154c30 2024-09-12T02:57:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb249400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fb24415b500 con 0x7fb2440c79f0 2024-09-12T02:57:53.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb249400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb2440c1d10 con 0x7fb2440c21a0 2024-09-12T02:57:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb243200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2440c79f0 0x7fb2440c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb243200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb2440c79f0 0x7fb2440c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47976/0 (socket says 172.21.15.63:47976) 2024-09-12T02:57:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb242800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb244154c30 0x7fb24415a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35754/0 (socket says 172.21.15.63:35754) 2024-09-12T02:57:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb243200640 1 -- 172.21.15.63:0/3515800311 learned_addr learned my addr 172.21.15.63:0/3515800311 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb23be00640 1 --2- 172.21.15.63:0/3515800311 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2440c21a0 0x7fb24415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb243200640 1 -- 172.21.15.63:0/3515800311 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2440c21a0 msgr2=0x7fb24415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb243200640 1 --2- 172.21.15.63:0/3515800311 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2440c21a0 0x7fb24415afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb243200640 1 -- 172.21.15.63:0/3515800311 >> v1:172.21.15.63:6789/0 conn(0x7fb244154c30 legacy=0x7fb24415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.993+0000 7fb243200640 1 -- 172.21.15.63:0/3515800311 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24415b720 con 0x7fb2440c79f0 2024-09-12T02:57:54.001 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:54.001 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:54.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb243200640 1 --2- 172.21.15.63:0/3515800311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 0x7fb2440c7e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009e50 tx=0x7fb23c01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8584211137c248 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb241e00640 1 -- 172.21.15.63:0/3515800311 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0b4070 con 0x7fb2440c79f0 2024-09-12T02:57:54.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb241e00640 1 -- 172.21.15.63:0/3515800311 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23c0af400 con 0x7fb2440c79f0 2024-09-12T02:57:54.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb241e00640 1 -- 172.21.15.63:0/3515800311 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0af7d0 con 0x7fb2440c79f0 2024-09-12T02:57:54.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7f6cc2800640 1 --2- 172.21.15.63:0/548421743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40c9110 0x7f6cc4163fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009dc0 tx=0x7f6cbc01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b93ee16eb9a5ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb249400640 1 -- 172.21.15.63:0/3515800311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 msgr2=0x7fb2440c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb249400640 1 --2- 172.21.15.63:0/3515800311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 0x7fb2440c7e60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009e50 tx=0x7fb23c01f210 comp rx=0 tx=0).stop 2024-09-12T02:57:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7f6cc0a00640 1 -- 172.21.15.63:0/548421743 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0001680 con 0x7f6cc40c9110 2024-09-12T02:57:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7f6cc0a00640 1 -- 172.21.15.63:0/548421743 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cbc0a6500 con 0x7f6cc40c9110 2024-09-12T02:57:54.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7f6cc0a00640 1 -- 172.21.15.63:0/548421743 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0a68d0 con 0x7f6cc40c9110 2024-09-12T02:57:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb249400640 1 -- 172.21.15.63:0/3515800311 shutdown_connections 2024-09-12T02:57:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb249400640 1 --2- 172.21.15.63:0/3515800311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 0x7fb2440c7e60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb249400640 1 --2- 172.21.15.63:0/3515800311 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2440c21a0 0x7fb24415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb249400640 1 -- 172.21.15.63:0/3515800311 >> 172.21.15.63:0/3515800311 conn(0x7fb24406bcc0 msgr2=0x7fb24406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb249400640 1 -- 172.21.15.63:0/3515800311 shutdown_connections 2024-09-12T02:57:54.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:53.997+0000 7fb249400640 1 -- 172.21.15.63:0/3515800311 wait complete. 2024-09-12T02:57:54.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 -- 172.21.15.63:0/548421743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40c9110 msgr2=0x7f6cc4163fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 --2- 172.21.15.63:0/548421743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40c9110 0x7f6cc4163fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009dc0 tx=0x7f6cbc01c8b0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 -- 172.21.15.63:0/548421743 shutdown_connections 2024-09-12T02:57:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 --2- 172.21.15.63:0/548421743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40c9110 0x7f6cc4163fc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 -- 172.21.15.63:0/548421743 >> 172.21.15.63:0/548421743 conn(0x7f6cc406f3d0 msgr2=0x7f6cc406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 -- 172.21.15.63:0/548421743 shutdown_connections 2024-09-12T02:57:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 -- 172.21.15.63:0/548421743 wait complete. 2024-09-12T02:57:54.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 Processor -- start 2024-09-12T02:57:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7fb249400640 1 Processor -- start 2024-09-12T02:57:54.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 -- start start 2024-09-12T02:57:54.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7fb249400640 1 -- start start 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40c9110 0x7f6cc414acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4152640 0x7f6cc41f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc41590b0 0x7f6cc41f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4152a20 con 0x7f6cc4152640 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4074290 con 0x7f6cc40c9110 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc8c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc40c85d0 con 0x7f6cc41590b0 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4152640 0x7f6cc41f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4152640 0x7f6cc41f49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47992/0 (socket says 172.21.15.63:47992) 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc1400640 1 -- 172.21.15.63:0/2758753650 learned_addr learned my addr 172.21.15.63:0/2758753650 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc1e00640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40c9110 0x7f6cc414acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7f6cc2800640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc41590b0 0x7f6cc41f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7fb249400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2440c21a0 0x7fb24414af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7fb249400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 0x7fb24414c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7fb249400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb244154c30 0x7fb2440b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7fb249400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440c16c0 con 0x7fb2440c79f0 2024-09-12T02:57:54.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7fb249400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb2440c13e0 con 0x7fb2440c21a0 2024-09-12T02:57:54.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.001+0000 7fb249400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb2440c19a0 con 0x7fb244154c30 2024-09-12T02:57:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cc1400640 1 -- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc41590b0 msgr2=0x7f6cc41f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cc1400640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc41590b0 0x7f6cc41f4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cc1400640 1 -- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40c9110 msgr2=0x7f6cc414acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cc1400640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40c9110 0x7f6cc414acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cc1400640 1 -- 172.21.15.63:0/2758753650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc4158e30 con 0x7f6cc4152640 2024-09-12T02:57:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb242800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2440c21a0 0x7fb24414af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 0x7fb24414c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb242800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2440c21a0 0x7fb24414af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:39524/0 (socket says 172.21.15.63:39524) 2024-09-12T02:57:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb242800640 1 -- 172.21.15.63:0/2647677892 learned_addr learned my addr 172.21.15.63:0/2647677892 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb243200640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb244154c30 0x7fb2440b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cc1400640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4152640 0x7f6cc41f49f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c630 tx=0x7f6cb000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cba000640 1 -- 172.21.15.63:0/2758753650 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0017070 con 0x7f6cc4152640 2024-09-12T02:57:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cba000640 1 -- 172.21.15.63:0/2758753650 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb0005cf0 con 0x7f6cc4152640 2024-09-12T02:57:54.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cba000640 1 -- 172.21.15.63:0/2758753650 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00072b0 con 0x7f6cc4152640 2024-09-12T02:57:54.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23be00640 1 -- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb244154c30 msgr2=0x7fb2440b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23be00640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb244154c30 0x7fb2440b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23be00640 1 -- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2440c21a0 msgr2=0x7fb24414af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23be00640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2440c21a0 0x7fb24414af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23be00640 1 -- 172.21.15.63:0/2647677892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24414dc80 con 0x7fb2440c79f0 2024-09-12T02:57:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23be00640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 0x7fb24414c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00e880 tx=0x7fb22c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23aa00640 1 -- 172.21.15.63:0/2647677892 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c017070 con 0x7fb2440c79f0 2024-09-12T02:57:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23aa00640 1 -- 172.21.15.63:0/2647677892 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c00c940 con 0x7fb2440c79f0 2024-09-12T02:57:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb23aa00640 1 -- 172.21.15.63:0/2647677892 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00ccf0 con 0x7fb2440c79f0 2024-09-12T02:57:54.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24414d480 con 0x7fb2440c79f0 2024-09-12T02:57:54.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc4154d30 con 0x7f6cc4152640 2024-09-12T02:57:54.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc41552f0 con 0x7f6cc4152640 2024-09-12T02:57:54.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24414b460 con 0x7fb2440c79f0 2024-09-12T02:57:54.016 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:54.005+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:54.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc4071850 con 0x7f6cc4152640 2024-09-12T02:57:54.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.005+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2440c6c90 con 0x7fb2440c79f0 2024-09-12T02:57:54.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7fb23aa00640 1 -- 172.21.15.63:0/2647677892 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb22c01a070 con 0x7fb2440c79f0 2024-09-12T02:57:54.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7f6cba000640 1 -- 172.21.15.63:0/2758753650 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6cb001a070 con 0x7f6cc4152640 2024-09-12T02:57:54.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7fb23aa00640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb2200678c0 0x7fb220069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7fb23aa00640 1 -- 172.21.15.63:0/2647677892 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6706+0+0 (secure 0 0 0) 0x7fb22c086060 con 0x7fb2440c79f0 2024-09-12T02:57:54.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7fb242800640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb2200678c0 0x7fb220069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7f6cba000640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ca40678c0 0x7f6ca4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7f6cba000640 1 -- 172.21.15.63:0/2758753650 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6706+0+0 (secure 0 0 0) 0x7f6cb0085930 con 0x7f6cc4152640 2024-09-12T02:57:54.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7f6cc1e00640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ca40678c0 0x7f6ca4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7fb242800640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb2200678c0 0x7fb220069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb234007fd0 tx=0x7fb234007f20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.009+0000 7f6cc1e00640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ca40678c0 0x7f6ca4069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40011f0 tx=0x7f6cb4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.013+0000 7f6cba000640 1 -- 172.21.15.63:0/2758753650 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6cb0021020 con 0x7f6cc4152640 2024-09-12T02:57:54.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:57:54.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.021+0000 7fb23aa00640 1 -- 172.21.15.63:0/2647677892 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb22c0560c0 con 0x7fb2440c79f0 2024-09-12T02:57:54.109 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:54.103+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:54.170 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:54.170 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:54.185 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:57:54.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.193+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7f6cc40c53b0 con 0x7f6cc4152640 2024-09-12T02:57:54.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.201+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 0, "weight": 1.0} v 0) -- 0x7fb2440ae9e0 con 0x7fb2440c79f0 2024-09-12T02:57:54.209 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:57:54.205+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:57:54.311 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:54.309+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:54.331 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:54.331 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:54.347 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:57:54.411 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:54.407+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:54.512 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:54.509+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:54.534 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:54.534 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:54.550 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:57:54.613 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:57:54.611+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:57:54.682 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:54.683 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:54.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:57:54.696 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:57:54.738 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:54.735+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:54.816 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:54.811+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:54.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.825+0000 7f6cba000640 1 -- 172.21.15.63:0/2758753650 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v32) ==== 91+0+0 (secure 0 0 0) 0x7f6cb0055aa0 con 0x7f6cc4152640 2024-09-12T02:57:54.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.825+0000 7fb23aa00640 1 -- 172.21.15.63:0/2647677892 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 0, "weight": 1.0}]=0 reweighted osd.0 to 1 (10000) v32) ==== 113+0+0 (secure 0 0 0) 0x7fb22c05a3c0 con 0x7fb2440c79f0 2024-09-12T02:57:54.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.825+0000 7fb62b200640 1 Processor -- start 2024-09-12T02:57:54.831 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-12T02:57:54.831 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T02:57:54.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.825+0000 7fb62b200640 1 -- start start 2024-09-12T02:57:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb2200678c0 msgr2=0x7fb220069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb2200678c0 0x7fb220069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb234007fd0 tx=0x7fb234007f20 comp rx=0 tx=0).stop 2024-09-12T02:57:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 msgr2=0x7fb24414c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 0x7fb24414c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00e880 tx=0x7fb22c00ed40 comp rx=0 tx=0).stop 2024-09-12T02:57:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ca40678c0 msgr2=0x7f6ca4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ca40678c0 0x7f6ca4069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40011f0 tx=0x7f6cb4009040 comp rx=0 tx=0).stop 2024-09-12T02:57:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4152640 msgr2=0x7f6cc41f49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4152640 0x7f6cc41f49f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000c630 tx=0x7f6cb000caf0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb62b200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6240c82a0 0x7fb624163f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb62b200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6240c9720 con 0x7fb6241527e0 2024-09-12T02:57:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb62b200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6240c9a00 con 0x7fb6240c4ff0 2024-09-12T02:57:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb62b200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb624070570 con 0x7fb6240c82a0 2024-09-12T02:57:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb629200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6240c82a0 0x7fb624163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb629200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6240c82a0 0x7fb624163f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:38102/0 (socket says 172.21.15.63:38102) 2024-09-12T02:57:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb629200640 1 -- 172.21.15.63:0/3745654445 learned_addr learned my addr 172.21.15.63:0/3745654445 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 shutdown_connections 2024-09-12T02:57:54.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ca40678c0 0x7f6ca4069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc41590b0 0x7f6cc41f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cc4152640 0x7f6cc41f49f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 --2- 172.21.15.63:0/2758753650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40c9110 0x7f6cc414acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 >> 172.21.15.63:0/2758753650 conn(0x7f6cc406f3d0 msgr2=0x7f6cc406d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 shutdown_connections 2024-09-12T02:57:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb2200678c0 0x7fb220069d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb244154c30 0x7fb2440b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb2440c79f0 0x7fb24414c5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 --2- 172.21.15.63:0/2647677892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2440c21a0 0x7fb24414af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 >> 172.21.15.63:0/2647677892 conn(0x7fb24406bcc0 msgr2=0x7fb24415aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 shutdown_connections 2024-09-12T02:57:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7f6cc8c00640 1 -- 172.21.15.63:0/2758753650 wait complete. 2024-09-12T02:57:54.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 shutdown_connections 2024-09-12T02:57:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb622a00640 1 -- 172.21.15.63:0/3745654445 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32623437 0 0) 0x7fb6240c9720 con 0x7fb6241527e0 2024-09-12T02:57:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb629200640 1 -- 172.21.15.63:0/3745654445 >> v1:172.21.15.119:6789/0 conn(0x7fb6240c4ff0 legacy=0x7fb6240ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb629200640 1 -- 172.21.15.63:0/3745654445 >> v1:172.21.15.63:6789/0 conn(0x7fb6241527e0 legacy=0x7fb62406fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb629200640 1 -- 172.21.15.63:0/3745654445 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6240c9ce0 con 0x7fb6240c82a0 2024-09-12T02:57:54.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.829+0000 7fb249400640 1 -- 172.21.15.63:0/2647677892 wait complete. 2024-09-12T02:57:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.833+0000 7fb629200640 1 --2- 172.21.15.63:0/3745654445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6240c82a0 0x7fb624163f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb61c014a30 tx=0x7fb61c027d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef8edb8d59ac3e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.833+0000 7fb622a00640 1 -- 172.21.15.63:0/3745654445 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0b1b90 con 0x7fb6240c82a0 2024-09-12T02:57:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.833+0000 7fb622a00640 1 -- 172.21.15.63:0/3745654445 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb61c0b1d30 con 0x7fb6240c82a0 2024-09-12T02:57:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb622a00640 1 -- 172.21.15.63:0/3745654445 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0112f0 con 0x7fb6240c82a0 2024-09-12T02:57:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb62b200640 1 -- 172.21.15.63:0/3745654445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6240c82a0 msgr2=0x7fb624163f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb62b200640 1 --2- 172.21.15.63:0/3745654445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6240c82a0 0x7fb624163f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb61c014a30 tx=0x7fb61c027d80 comp rx=0 tx=0).stop 2024-09-12T02:57:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb62b200640 1 -- 172.21.15.63:0/3745654445 shutdown_connections 2024-09-12T02:57:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb62b200640 1 --2- 172.21.15.63:0/3745654445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6240c82a0 0x7fb624163f00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb62b200640 1 -- 172.21.15.63:0/3745654445 >> 172.21.15.63:0/3745654445 conn(0x7fb624067a00 msgr2=0x7fb624067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb62b200640 1 -- 172.21.15.63:0/3745654445 shutdown_connections 2024-09-12T02:57:54.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb62b200640 1 -- 172.21.15.63:0/3745654445 wait complete. 2024-09-12T02:57:54.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb62b200640 1 Processor -- start 2024-09-12T02:57:54.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.837+0000 7fb62b200640 1 -- start start 2024-09-12T02:57:54.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb62b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6240c4ff0 0x7fb6241eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb62b200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6240c82a0 0x7fb624157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb62b200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6241527e0 0x7fb624152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb62b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb62406f9d0 con 0x7fb6240c4ff0 2024-09-12T02:57:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb62b200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb62406f6f0 con 0x7fb6240c82a0 2024-09-12T02:57:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb62b200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb6240c93e0 con 0x7fb6241527e0 2024-09-12T02:57:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6240c4ff0 0x7fb6241eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6240c4ff0 0x7fb6241eed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48004/0 (socket says 172.21.15.63:48004) 2024-09-12T02:57:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623e00640 1 -- 172.21.15.63:0/585347432 learned_addr learned my addr 172.21.15.63:0/585347432 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623400640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6240c82a0 0x7fb624157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb629200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6241527e0 0x7fb624152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623e00640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6241527e0 msgr2=0x7fb624152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623e00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6241527e0 0x7fb624152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623e00640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6240c82a0 msgr2=0x7fb624157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623e00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6240c82a0 0x7fb624157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:54.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623e00640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb624157950 con 0x7fb6240c4ff0 2024-09-12T02:57:54.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb623e00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6240c4ff0 0x7fb6241eed80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c4d0 tx=0x7fb61400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614017070 con 0x7fb6240c4ff0 2024-09-12T02:57:54.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb614005480 con 0x7fb6240c4ff0 2024-09-12T02:57:54.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb614003840 con 0x7fb6240c4ff0 2024-09-12T02:57:54.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb624159090 con 0x7fb6240c4ff0 2024-09-12T02:57:54.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb624158d50 con 0x7fb6240c4ff0 2024-09-12T02:57:54.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.841+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fb624158b40 con 0x7fb6240c4ff0 2024-09-12T02:57:54.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb61401a070 con 0x7fb6240c4ff0 2024-09-12T02:57:54.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb61be00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb6040678f0 0x7fb604069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6706+0+0 (secure 0 0 0) 0x7fb614085500 con 0x7fb6240c4ff0 2024-09-12T02:57:54.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb623400640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb6040678f0 0x7fb604069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v32) ==== 54+0+16 (secure 0 0 0) 0x7fb614087aa0 con 0x7fb6240c4ff0 2024-09-12T02:57:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fb6241564f0 0x7fb624153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb62415bb60 con 0x7fb6241564f0 2024-09-12T02:57:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb629200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fb6241564f0 0x7fb624153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb623400640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb6040678f0 0x7fb604069db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb6241e6150 tx=0x7fb610009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.845+0000 7fb629200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fb6241564f0 0x7fb624153460 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.849+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb62415bb60 con 0x7fb6241564f0 2024-09-12T02:57:54.864 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T02:57:54.867 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:54.867 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:54.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.869+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb6241ef2c0 con 0x7fb6241564f0 2024-09-12T02:57:54.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.869+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb6241ef2c0 con 0x7fb6241564f0 2024-09-12T02:57:54.874 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:57:54.874 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:57:54.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.873+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fb624151570 0x7fb624151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.873+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fb6241e1ed0 con 0x7fb624151570 2024-09-12T02:57:54.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.873+0000 7fb623e00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fb624151570 0x7fb624151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.873+0000 7fb623e00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fb624151570 0x7fb624151990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.873+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb6241e1ed0 con 0x7fb624151570 2024-09-12T02:57:54.882 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:57:54.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.885+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb6240c7380 con 0x7fb624151570 2024-09-12T02:57:54.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.889+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb6240c7380 con 0x7fb624151570 2024-09-12T02:57:54.892 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:57:54.893 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:57:54.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.889+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb6240626e0 0x7fb624062ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.889+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fb6241542b0 con 0x7fb6240626e0 2024-09-12T02:57:54.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.889+0000 7fb623400640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb6240626e0 0x7fb624062ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.889+0000 7fb623400640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb6240626e0 0x7fb624062ae0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.889+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb6241542b0 con 0x7fb6240626e0 2024-09-12T02:57:54.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.905+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb624063270 con 0x7fb6240626e0 2024-09-12T02:57:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.905+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb624063270 con 0x7fb6240626e0 2024-09-12T02:57:54.909 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:57:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:57:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.905+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fb6241e2dc0 0x7fb6241e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.905+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fb624063270 con 0x7fb6241e2dc0 2024-09-12T02:57:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.905+0000 7fb629200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fb6241e2dc0 0x7fb6241e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.909+0000 7fb629200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fb6241e2dc0 0x7fb6241e31c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.909+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb624063270 con 0x7fb6241e2dc0 2024-09-12T02:57:54.916 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:54.913+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:54.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.921+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb624063270 con 0x7fb6241e2dc0 2024-09-12T02:57:54.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.925+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb624063270 con 0x7fb6241e2dc0 2024-09-12T02:57:54.926 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:57:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:57:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.925+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fb62402cb60 0x7fb62402cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.925+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fb624063270 con 0x7fb62402cb60 2024-09-12T02:57:54.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.925+0000 7fb623e00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fb62402cb60 0x7fb62402cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.925+0000 7fb623e00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fb62402cb60 0x7fb62402cfc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.925+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb624063270 con 0x7fb62402cb60 2024-09-12T02:57:54.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.937+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb624063270 con 0x7fb62402cb60 2024-09-12T02:57:54.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.941+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb624063270 con 0x7fb62402cb60 2024-09-12T02:57:54.944 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:57:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:57:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.941+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fb624200310 0x7fb624202700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.941+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fb624063270 con 0x7fb624200310 2024-09-12T02:57:54.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.941+0000 7fb623400640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fb624200310 0x7fb624202700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.941+0000 7fb623400640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fb624200310 0x7fb624202700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.945+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb624063270 con 0x7fb624200310 2024-09-12T02:57:54.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.957+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb624063270 con 0x7fb624200310 2024-09-12T02:57:54.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.961+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb624063270 con 0x7fb624200310 2024-09-12T02:57:54.962 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:57:54.963 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:57:54.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.961+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fb624203150 0x7fb624205540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.961+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fb624208310 con 0x7fb624203150 2024-09-12T02:57:54.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.961+0000 7fb629200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fb624203150 0x7fb624205540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.961+0000 7fb629200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fb624203150 0x7fb624205540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.961+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb624208310 con 0x7fb624203150 2024-09-12T02:57:54.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.977+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb624205a80 con 0x7fb624203150 2024-09-12T02:57:54.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.977+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb624205a80 con 0x7fb624203150 2024-09-12T02:57:54.981 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:57:54.982 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:57:54.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.977+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fb624206100 0x7fb6242084f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:54.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.977+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fb62420b4a0 con 0x7fb624206100 2024-09-12T02:57:54.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.977+0000 7fb623e00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fb624206100 0x7fb6242084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:54.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.981+0000 7fb623e00640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fb624206100 0x7fb6242084f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:54.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.981+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb62420b4a0 con 0x7fb624206100 2024-09-12T02:57:54.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.993+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fb62420a1c0 con 0x7fb624206100 2024-09-12T02:57:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb61be00640 1 -- 172.21.15.63:0/585347432 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fb62420a1c0 con 0x7fb624206100 2024-09-12T02:57:54.999 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fb6241564f0 msgr2=0x7fb624153460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fb6241564f0 0x7fb624153460 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fb624151570 msgr2=0x7fb624151990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fb624151570 0x7fb624151990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb6240626e0 msgr2=0x7fb624062ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fb6240626e0 0x7fb624062ae0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fb6241e2dc0 msgr2=0x7fb6241e31c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fb6241e2dc0 0x7fb6241e31c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fb62402cb60 msgr2=0x7fb62402cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fb62402cb60 0x7fb62402cfc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fb624200310 msgr2=0x7fb624202700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fb624200310 0x7fb624202700 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fb624203150 msgr2=0x7fb624205540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fb624203150 0x7fb624205540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fb624206100 msgr2=0x7fb6242084f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fb624206100 0x7fb6242084f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb629200640 1 -- 172.21.15.63:0/585347432 reap_dead start 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb629200640 1 -- 172.21.15.63:0/585347432 reap_dead start 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb629200640 1 -- 172.21.15.63:0/585347432 reap_dead start 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb629200640 1 -- 172.21.15.63:0/585347432 reap_dead start 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb629200640 1 -- 172.21.15.63:0/585347432 reap_dead start 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb6040678f0 msgr2=0x7fb604069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb6040678f0 0x7fb604069db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb6241e6150 tx=0x7fb610009040 comp rx=0 tx=0).stop 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6240c4ff0 msgr2=0x7fb6241eed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6240c4ff0 0x7fb6241eed80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb61400c4d0 tx=0x7fb61400c990 comp rx=0 tx=0).stop 2024-09-12T02:57:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 shutdown_connections 2024-09-12T02:57:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb6040678f0 0x7fb604069db0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 --2- 172.21.15.63:0/585347432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6240c4ff0 0x7fb6241eed80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 >> 172.21.15.63:0/585347432 conn(0x7fb624067a00 msgr2=0x7fb62406d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 shutdown_connections 2024-09-12T02:57:55.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:54.997+0000 7fb62b200640 1 -- 172.21.15.63:0/585347432 wait complete. 2024-09-12T02:57:55.018 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:55.013+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc744e00640 1 Processor -- start 2024-09-12T02:57:55.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc744e00640 1 -- start start 2024-09-12T02:57:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc744e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc7400ce9e0 0x7fc7400cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:55.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc744e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc7400c4f50 0x7fc7400cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc744e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7400ceeb0 con 0x7fc740152870 2024-09-12T02:57:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc744e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fc7400ce1d0 con 0x7fc7400c4f50 2024-09-12T02:57:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc744e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc7400cdb50 con 0x7fc7400ce9e0 2024-09-12T02:57:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc73de00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc740152870 0x7fc7400714b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35764/0 (socket says 172.21.15.63:35764) 2024-09-12T02:57:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc73de00640 1 -- 172.21.15.63:0/3146246738 learned_addr learned my addr 172.21.15.63:0/3146246738 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc73e800640 1 --2- 172.21.15.63:0/3146246738 >> v2:172.21.15.63:3300/0 conn(0x7fc7400c4f50 0x7fc7400cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:55.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc73d400640 1 --2- 172.21.15.63:0/3146246738 >> v2:172.21.15.119:3300/0 conn(0x7fc7400ce9e0 0x7fc7400cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc73ca00640 1 -- 172.21.15.63:0/3146246738 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676975199 0 0) 0x7fc7400ceeb0 con 0x7fc740152870 2024-09-12T02:57:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc73ca00640 1 -- 172.21.15.63:0/3146246738 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc724003530 con 0x7fc740152870 2024-09-12T02:57:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc73e800640 1 -- 172.21.15.63:0/3146246738 >> v2:172.21.15.119:3300/0 conn(0x7fc7400ce9e0 msgr2=0x7fc7400cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc73e800640 1 --2- 172.21.15.63:0/3146246738 >> v2:172.21.15.119:3300/0 conn(0x7fc7400ce9e0 0x7fc7400cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.017+0000 7fc73e800640 1 -- 172.21.15.63:0/3146246738 >> v1:172.21.15.63:6789/0 conn(0x7fc740152870 legacy=0x7fc7400714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc73e800640 1 -- 172.21.15.63:0/3146246738 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7400ce420 con 0x7fc7400c4f50 2024-09-12T02:57:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc73e800640 1 --2- 172.21.15.63:0/3146246738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400c4f50 0x7fc7400cc800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7400b4630 tx=0x7fc73801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d2caba04ae28e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc73ca00640 1 -- 172.21.15.63:0/3146246738 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7380b4070 con 0x7fc7400c4f50 2024-09-12T02:57:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc73ca00640 1 -- 172.21.15.63:0/3146246738 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7380af600 con 0x7fc7400c4f50 2024-09-12T02:57:55.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc73ca00640 1 -- 172.21.15.63:0/3146246738 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7380af9b0 con 0x7fc7400c4f50 2024-09-12T02:57:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc744e00640 1 -- 172.21.15.63:0/3146246738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400c4f50 msgr2=0x7fc7400cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc744e00640 1 --2- 172.21.15.63:0/3146246738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400c4f50 0x7fc7400cc800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7400b4630 tx=0x7fc73801f110 comp rx=0 tx=0).stop 2024-09-12T02:57:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc744e00640 1 -- 172.21.15.63:0/3146246738 shutdown_connections 2024-09-12T02:57:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc744e00640 1 --2- 172.21.15.63:0/3146246738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400c4f50 0x7fc7400cc800 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc744e00640 1 --2- 172.21.15.63:0/3146246738 >> v2:172.21.15.119:3300/0 conn(0x7fc7400ce9e0 0x7fc7400cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc744e00640 1 -- 172.21.15.63:0/3146246738 >> 172.21.15.63:0/3146246738 conn(0x7fc74006bcc0 msgr2=0x7fc74006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc744e00640 1 -- 172.21.15.63:0/3146246738 shutdown_connections 2024-09-12T02:57:55.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.021+0000 7fc744e00640 1 -- 172.21.15.63:0/3146246738 wait complete. 2024-09-12T02:57:55.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 Processor -- start 2024-09-12T02:57:55.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 -- start start 2024-09-12T02:57:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7400c4f50 0x7fc74014d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400ce9e0 0x7fc740067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc740152870 0x7fc74014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:55.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc740152c50 con 0x7fc7400ce9e0 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc7400cd7e0 con 0x7fc7400c4f50 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc740152dd0 con 0x7fc740152870 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400ce9e0 0x7fc740067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73e800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc740152870 0x7fc74014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73de00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7400c4f50 0x7fc74014d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73e800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc740152870 0x7fc74014a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:38118/0 (socket says 172.21.15.63:38118) 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73e800640 1 -- 172.21.15.63:0/1894778596 learned_addr learned my addr 172.21.15.63:0/1894778596 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73d400640 1 -- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc740152870 msgr2=0x7fc74014a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73d400640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc740152870 0x7fc74014a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73d400640 1 -- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7400c4f50 msgr2=0x7fc74014d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73d400640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7400c4f50 0x7fc74014d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73d400640 1 -- 172.21.15.63:0/1894778596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7400ca2f0 con 0x7fc7400ce9e0 2024-09-12T02:57:55.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc73d400640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400ce9e0 0x7fc740067c60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00e840 tx=0x7fc72c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:55.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc736000640 1 -- 172.21.15.63:0/1894778596 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c017070 con 0x7fc7400ce9e0 2024-09-12T02:57:55.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc736000640 1 -- 172.21.15.63:0/1894778596 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72c00c8e0 con 0x7fc7400ce9e0 2024-09-12T02:57:55.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc740154fe0 con 0x7fc7400ce9e0 2024-09-12T02:57:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc736000640 1 -- 172.21.15.63:0/1894778596 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00cc90 con 0x7fc7400ce9e0 2024-09-12T02:57:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.025+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc740155280 con 0x7fc7400ce9e0 2024-09-12T02:57:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.029+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7400cbee0 con 0x7fc7400ce9e0 2024-09-12T02:57:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.029+0000 7fc736000640 1 -- 172.21.15.63:0/1894778596 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc72c01a070 con 0x7fc7400ce9e0 2024-09-12T02:57:55.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.029+0000 7fc736000640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc7200678c0 0x7fc720069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:55.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.029+0000 7fc736000640 1 -- 172.21.15.63:0/1894778596 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6706+0+0 (secure 0 0 0) 0x7fc72c085f90 con 0x7fc7400ce9e0 2024-09-12T02:57:55.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.029+0000 7fc73de00640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc7200678c0 0x7fc720069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:55.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.029+0000 7fc73de00640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc7200678c0 0x7fc720069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc730007fd0 tx=0x7fc730009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:55.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.033+0000 7fc736000640 1 -- 172.21.15.63:0/1894778596 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc72c055ff0 con 0x7fc7400ce9e0 2024-09-12T02:57:55.052 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.199299009000001, 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:57:55.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:57:55.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:57:55.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:57:55.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:55.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.194538231000003, 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.059 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.060 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.060 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:57:55.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:57:55.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.194400369, 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.064 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:57:55.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:57:55.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:57:55.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:57:55.069 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.069 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.069 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.069 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:57:55.069 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:57:55.069 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.194314251999998, 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:57:55.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:57:55.073 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.19359042, 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:57:55.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:57:55.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.193431553000003, 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:57:55.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.082 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.192977935000002, 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:57:55.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:57:55.086 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.189743941000003, 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:57:55.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.090 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.091 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.091 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:55.092 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:57:55.138 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:55.135+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:55.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.209+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 1, "weight": 1.0} v 0) -- 0x7fc7400755c0 con 0x7fc7400ce9e0 2024-09-12T02:57:55.216 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:55.216 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:57:55.216 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:55.219 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:55.215+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:55.230 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T02:57:55.319 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:55.317+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:55.396 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:55.396 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:55.396 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:57:55.396 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:57:55.396 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:55.410 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T02:57:55.420 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:55.417+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:55.521 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:55.515+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:55.533 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:55.533 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:57:55.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:57:55.533 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:57:55.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.533 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.678513469999999, 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00551893, 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853808+0000", 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4959999999999999e-06 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853827+0000", 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8675999999999999e-05 2024-09-12T02:57:55.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853869+0000", 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2347e-05 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853889+0000", 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0248999999999999e-05 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854115+0000", 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022562600000000001 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854168+0000", 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3476000000000001e-05 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859207+0000", 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050389550000000003 2024-09-12T02:57:55.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859324+0000", 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117105 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.677310732000002, 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077810020000000004, 2024-09-12T02:57:55.538 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855011+0000", 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3259999999999998e-06 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855026+0000", 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5023e-05 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855055+0000", 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9298e-05 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0525000000000001e-05 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855570+0000", 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000494539 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855624+0000", 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3656999999999998e-05 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862687+0000", 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007063593 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862789+0000", 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010204099999999999 2024-09-12T02:57:55.542 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.677189122999998, 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077503839999999999, 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855131+0000", 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5230000000000001e-06 2024-09-12T02:57:55.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855143+0000", 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1412e-05 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0043000000000001e-05 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855176+0000", 2024-09-12T02:57:55.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3429e-05 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856069+0000", 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00089251 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856116+0000", 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6826999999999997e-05 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862797+0000", 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066810050000000003 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862880+0000", 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3634999999999995e-05 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:57:55.547 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.676083839, 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065292639999999999, 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856237+0000", 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.103e-06 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856252+0000", 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4813e-05 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856279+0000", 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7254e-05 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856297+0000", 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7929000000000001e-05 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856462+0000", 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016488700000000001 2024-09-12T02:57:55.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856508+0000", 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5787000000000001e-05 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862657+0000", 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061494210000000004 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862764+0000", 2024-09-12T02:57:55.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010707 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.675336573000003, 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005857943, 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:55.552 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856984+0000", 2024-09-12T02:57:55.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3799999999999999e-06 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856997+0000", 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2896e-05 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857022+0000", 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5554999999999998e-05 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857043+0000", 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0919000000000001e-05 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857162+0000", 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118526 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857225+0000", 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3578999999999996e-05 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862772+0000", 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055470789999999999 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862840+0000", 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8009000000000006e-05 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:55.556 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:55.557 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:55.558 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:57:55.621 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:55.617+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:55.722 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:55.721+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:55.725 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:55.725 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:55.725 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:57:55.725 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:55.739 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:57:55.824 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:55.821+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:55.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.829+0000 7fc736000640 1 -- 172.21.15.63:0/1894778596 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 1, "weight": 1.0}]=0 reweighted osd.1 to 1 (10000) v33) ==== 113+0+0 (secure 0 0 0) 0x7fc72c05a2f0 con 0x7fc7400ce9e0 2024-09-12T02:57:55.831 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T02:57:55.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc7200678c0 msgr2=0x7fc720069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc7200678c0 0x7fc720069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc730007fd0 tx=0x7fc730009040 comp rx=0 tx=0).stop 2024-09-12T02:57:55.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400ce9e0 msgr2=0x7fc740067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:55.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400ce9e0 0x7fc740067c60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00e840 tx=0x7fc72c00ed00 comp rx=0 tx=0).stop 2024-09-12T02:57:55.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 shutdown_connections 2024-09-12T02:57:55.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc7200678c0 0x7fc720069d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc740152870 0x7fc74014a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc7400ce9e0 0x7fc740067c60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 --2- 172.21.15.63:0/1894778596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7400c4f50 0x7fc74014d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:55.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 >> 172.21.15.63:0/1894778596 conn(0x7fc74006bcc0 msgr2=0x7fc740150380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:55.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 shutdown_connections 2024-09-12T02:57:55.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:55.833+0000 7fc744e00640 1 -- 172.21.15.63:0/1894778596 wait complete. 2024-09-12T02:57:55.857 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T02:57:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:55.865 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:55.865 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:57:55.865 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:57:55.865 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:55.880 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:57:55.951 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:55.949+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:56.007 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:56.007 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:57:56.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:57:56.007 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:57:56.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.007 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.007 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:57:56.007 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.150818923000003, 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:57:56.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:57:56.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.150685715000002, 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:57:56.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:57:56.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:57:56.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.017 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:57:56.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:57:56.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.018 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:57:56.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:57:56.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.019 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:57:56.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:57:56.019 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.019 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.019 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:57:56.020 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:57:56.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.020 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.020 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:57:56.020 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:57:56.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.021 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.021 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:57:56.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:57:56.021 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.021 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.021 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.022 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.022 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:57:56.022 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.150580965000003, 2024-09-12T02:57:56.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:57:56.022 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.022 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.022 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:57:56.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.024 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:57:56.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:57:56.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:57:56.028 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.150435147000003, 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:57:56.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:57:56.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:57:56.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.150361965000002, 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:57:56.034 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:57:56.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.150301978999998, 2024-09-12T02:57:56.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:57:56.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:57:56.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:57:56.046 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.046 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.046 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.150239632999998, 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:57:56.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:57:56.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:57:56.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:57:56.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:57:56.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.150182117, 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:57:56.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:57:56.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:57:56.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:57:56.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:57:56.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:57:56.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:57:56.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.057 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.148014492000001, 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:57:56.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:57:56.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:57:56.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:57:56.062 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.144855976999999, 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing_reply(2.14 epoch 25/19 rep_tid 7 lcod 25'5)", 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.138395031999998, 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010494969999999999, 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864695+0000", 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7300000000000001e-07 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864699+0000", 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.33e-06 2024-09-12T02:57:56.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864715+0000", 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6116e-05 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864727+0000", 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1759e-05 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865572+0000", 2024-09-12T02:57:56.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00084520699999999995 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865744+0000", 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000171612 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.137147104, 2024-09-12T02:57:56.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:57:56.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.075 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 37.118258152999999, 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.080 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 35.389856346999998, 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:57:56.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.086 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.634019764999998, 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.087 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:57:56.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:57:56.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:57:56.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 32.751930801, 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:57:56.092 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:57:56.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:57:56.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.067973188, 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:57:56.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:57:56.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:57:56.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:57:56.103 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 11.067867896999999, 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:57:56.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:57:56.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:57:56.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:57:56.109 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.3753047469999995, 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:57:56.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:57:56.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:46 2.6 e28/19 2:654134d2:::mds0_openfiles.0:head v 28'2, mlcod=0'0)", 2024-09-12T02:57:56.115 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.1151108500000007, 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015286869999999999, 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887979+0000", 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4000000000000002e-07 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887986+0000", 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1999999999999997e-06 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888007+0000", 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1075999999999999e-05 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888022+0000", 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5316e-05 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888142+0000", 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011911100000000001 2024-09-12T02:57:56.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888187+0000", 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5225000000000002e-05 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889432+0000", 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012450709999999999 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889507+0000", 2024-09-12T02:57:56.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5148000000000006e-05 2024-09-12T02:57:56.120 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.120 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.120 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.120 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.120 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.120 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:56.122 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:57:56.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.045+0000 7fd433000640 1 Processor -- start 2024-09-12T02:57:56.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.045+0000 7fd433000640 1 -- start start 2024-09-12T02:57:56.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd433000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd42c157fc0 0x7fd42c0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd433000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd42c0cc7a0 0x7fd42c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd433000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42c0cd110 con 0x7fd42c06ebb0 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd433000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd42c06d270 con 0x7fd42c0cc7a0 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd433000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd42c0cd8b0 con 0x7fd42c157fc0 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd431000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd42c0cc7a0 0x7fd42c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd431000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd42c0cc7a0 0x7fd42c0ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48052/0 (socket says 172.21.15.63:48052) 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd431000640 1 -- 172.21.15.63:0/1691927100 learned_addr learned my addr 172.21.15.63:0/1691927100 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd42be00640 1 --2- 172.21.15.63:0/1691927100 >> v2:172.21.15.119:3300/0 conn(0x7fd42c157fc0 0x7fd42c0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd431000640 1 -- 172.21.15.63:0/1691927100 >> v2:172.21.15.119:3300/0 conn(0x7fd42c157fc0 msgr2=0x7fd42c0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd431000640 1 --2- 172.21.15.63:0/1691927100 >> v2:172.21.15.119:3300/0 conn(0x7fd42c157fc0 0x7fd42c0cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd431000640 1 -- 172.21.15.63:0/1691927100 >> v1:172.21.15.119:6789/0 conn(0x7fd42c06ebb0 legacy=0x7fd42c06fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd431000640 1 -- 172.21.15.63:0/1691927100 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c0cdb90 con 0x7fd42c0cc7a0 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.049+0000 7fd431000640 1 --2- 172.21.15.63:0/1691927100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c0cc7a0 0x7fd42c0ccbd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0b3530 tx=0x7fd42401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357977189d0eb0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:56.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd42aa00640 1 -- 172.21.15.63:0/1691927100 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4240a55b0 con 0x7fd42c0cc7a0 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd42aa00640 1 -- 172.21.15.63:0/1691927100 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4240a5750 con 0x7fd42c0cc7a0 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd42aa00640 1 -- 172.21.15.63:0/1691927100 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4240a5b20 con 0x7fd42c0cc7a0 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 -- 172.21.15.63:0/1691927100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c0cc7a0 msgr2=0x7fd42c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 --2- 172.21.15.63:0/1691927100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c0cc7a0 0x7fd42c0ccbd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0b3530 tx=0x7fd42401c9f0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 -- 172.21.15.63:0/1691927100 shutdown_connections 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 --2- 172.21.15.63:0/1691927100 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c0cc7a0 0x7fd42c0ccbd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 --2- 172.21.15.63:0/1691927100 >> v2:172.21.15.119:3300/0 conn(0x7fd42c157fc0 0x7fd42c0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 -- 172.21.15.63:0/1691927100 >> 172.21.15.63:0/1691927100 conn(0x7fd42c06bcc0 msgr2=0x7fd42c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 -- 172.21.15.63:0/1691927100 shutdown_connections 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 -- 172.21.15.63:0/1691927100 wait complete. 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 Processor -- start 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 -- start start 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c06ebb0 0x7fd42c0b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:56.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42c0cc7a0 0x7fd42c1f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd42c157fc0 0x7fd42c0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c0c5300 con 0x7fd42c06ebb0 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c0c5180 con 0x7fd42c157fc0 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd433000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fd42c0702b0 con 0x7fd42c0cc7a0 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd42be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c06ebb0 0x7fd42c0b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd42be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c06ebb0 0x7fd42c0b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48058/0 (socket says 172.21.15.63:48058) 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd42be00640 1 -- 172.21.15.63:0/508461742 learned_addr learned my addr 172.21.15.63:0/508461742 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.053+0000 7fd431000640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd42c157fc0 0x7fd42c0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd42b400640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42c0cc7a0 0x7fd42c1f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd42be00640 1 -- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42c0cc7a0 msgr2=0x7fd42c1f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd42be00640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42c0cc7a0 0x7fd42c1f6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd42be00640 1 -- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd42c157fc0 msgr2=0x7fd42c0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd42be00640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd42c157fc0 0x7fd42c0afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd42be00640 1 -- 172.21.15.63:0/508461742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c0b18e0 con 0x7fd42c06ebb0 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd42be00640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c06ebb0 0x7fd42c0b24d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00e870 tx=0x7fd41c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd423e00640 1 -- 172.21.15.63:0/508461742 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c017070 con 0x7fd42c06ebb0 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd423e00640 1 -- 172.21.15.63:0/508461742 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41c00c8e0 con 0x7fd42c06ebb0 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd423e00640 1 -- 172.21.15.63:0/508461742 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00cc90 con 0x7fd42c06ebb0 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42c0b2a10 con 0x7fd42c06ebb0 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42c1f75f0 con 0x7fd42c06ebb0 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd42c14f750 con 0x7fd42c06ebb0 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd423e00640 1 -- 172.21.15.63:0/508461742 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd41c01a070 con 0x7fd42c06ebb0 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd423e00640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd40c0678f0 0x7fd40c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:56.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd423e00640 1 -- 172.21.15.63:0/508461742 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6706+0+0 (secure 0 0 0) 0x7fd41c085ed0 con 0x7fd42c06ebb0 2024-09-12T02:57:56.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.057+0000 7fd42b400640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd40c0678f0 0x7fd40c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:56.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.061+0000 7fd42b400640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd40c0678f0 0x7fd40c069db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0c3e10 tx=0x7fd418009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:56.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.065+0000 7fd423e00640 1 -- 172.21.15.63:0/508461742 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd41c055f30 con 0x7fd42c06ebb0 2024-09-12T02:57:56.131 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:56.117+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:56.222 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:56.221+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:56.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.241+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 2, "weight": 1.0} v 0) -- 0x7fd42c0ccbd0 con 0x7fd42c06ebb0 2024-09-12T02:57:56.258 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:56.258 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:56.258 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:57:56.258 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:56.273 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:57:56.323 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:56.321+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:56.392 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:56.392 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:56.392 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:57:56.392 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:57:56.392 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:56.406 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:57:56.424 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:56.421+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:56.525 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:56.519+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.777674175999998, 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:57:56.528 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:57:56.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:57:56.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:57:56.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:57:56.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:57:56.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:57:56.535 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.535 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.634478838, 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.536 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:57:56.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:57:56.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:57:56.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:57:56.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:57:56.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:57:56.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:57:56.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.634458312, 2024-09-12T02:57:56.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:57:56.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:57:56.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.634347499, 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:57:56.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:57:56.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.634325973000003, 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.556 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:57:56.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.560 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.561 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.569339327000002, 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.562 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:57:56.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:57:56.567 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.347235804, 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.568 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:57:56.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:57:56.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:57:56.573 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.347098813000002, 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.574 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:57:56.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:57:56.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.345981610999999, 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.580 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:57:56.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:57:56.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.345909497999997, 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.586 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:57:56.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.592 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.345685514000003, 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:57:56.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:57:56.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.345615531, 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:57:56.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:57:56.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:57:56.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.604 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.345509894000003, 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:57:56.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:57:56.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:57:56.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:57:56.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:57:56.610 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.345319797000002, 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:57:56.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.616 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.34525301, 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:57:56.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:57:56.622 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.769903413000002, 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:57:56.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:57:56.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:57:56.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:57:56.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:57:56.628 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.671203978999998, 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:57:56.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.671118737, 2024-09-12T02:57:56.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:57:56.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:57:56.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.670981623000003, 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.640 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:57:56.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:57:56.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.670811724000004, 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:56.646 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:56.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:56.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:56.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:56.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:57:56.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:57:56.650 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.650 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.650 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.650 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:56.650 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:56.650 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:56.652 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:56.647+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:56.652 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:57:56.753 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:56.751+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:56.797 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:56.797 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:57:56.798 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:57:56.798 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:56.814 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:57:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd423e00640 1 -- 172.21.15.63:0/508461742 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 2, "weight": 1.0}]=0 reweighted osd.2 to 1 (10000) v34) ==== 113+0+0 (secure 0 0 0) 0x7fd41c05a230 con 0x7fd42c06ebb0 2024-09-12T02:57:56.843 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T02:57:56.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd40c0678f0 msgr2=0x7fd40c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:56.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd40c0678f0 0x7fd40c069db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd42c0c3e10 tx=0x7fd418009040 comp rx=0 tx=0).stop 2024-09-12T02:57:56.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c06ebb0 msgr2=0x7fd42c0b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:56.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c06ebb0 0x7fd42c0b24d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00e870 tx=0x7fd41c00ec70 comp rx=0 tx=0).stop 2024-09-12T02:57:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 shutdown_connections 2024-09-12T02:57:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd42c157fc0 0x7fd42c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd40c0678f0 0x7fd40c069db0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd42c0cc7a0 0x7fd42c1f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 --2- 172.21.15.63:0/508461742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd42c06ebb0 0x7fd42c0b24d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 >> 172.21.15.63:0/508461742 conn(0x7fd42c06bcc0 msgr2=0x7fd42c0c3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 shutdown_connections 2024-09-12T02:57:56.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:56.841+0000 7fd433000640 1 -- 172.21.15.63:0/508461742 wait complete. 2024-09-12T02:57:56.853 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:56.849+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:56.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T02:57:56.867 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T02:57:56.958 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:56.957+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:56.969 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:57:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:57:56.969 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:57:56.969 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:56.986 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:57:57.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77fc000640 1 Processor -- start 2024-09-12T02:57:57.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77fc000640 1 -- start start 2024-09-12T02:57:57.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77fc000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406ed30 0x7f77f41523d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77fc000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f77f4158eb0 0x7f77f4152910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77fc000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f406c6d0 con 0x7f77f406f110 2024-09-12T02:57:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77fc000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f77f415cbf0 con 0x7f77f4158eb0 2024-09-12T02:57:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77fc000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f77f40c7e50 con 0x7f77f406ed30 2024-09-12T02:57:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77f8c00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f77f406f110 0x7f77f41587a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35766/0 (socket says 172.21.15.63:35766) 2024-09-12T02:57:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77f8c00640 1 -- 172.21.15.63:0/311768028 learned_addr learned my addr 172.21.15.63:0/311768028 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77fa000640 1 --2- 172.21.15.63:0/311768028 >> v2:172.21.15.119:3300/0 conn(0x7f77f4158eb0 0x7f77f4152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.009+0000 7f77f9600640 1 --2- 172.21.15.63:0/311768028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406ed30 0x7f77f41523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.013+0000 7f77f3e00640 1 -- 172.21.15.63:0/311768028 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529443040 0 0) 0x7f77f406c6d0 con 0x7f77f406f110 2024-09-12T02:57:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.013+0000 7f77f3e00640 1 -- 172.21.15.63:0/311768028 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77dc003530 con 0x7f77f406f110 2024-09-12T02:57:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.013+0000 7f77fa000640 1 -- 172.21.15.63:0/311768028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406ed30 msgr2=0x7f77f41523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.013+0000 7f77fa000640 1 --2- 172.21.15.63:0/311768028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406ed30 0x7f77f41523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.013+0000 7f77fa000640 1 -- 172.21.15.63:0/311768028 >> v1:172.21.15.63:6789/0 conn(0x7f77f406f110 legacy=0x7f77f41587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.013+0000 7f77fa000640 1 -- 172.21.15.63:0/311768028 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f415c630 con 0x7f77f4158eb0 2024-09-12T02:57:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.013+0000 7f77fa000640 1 --2- 172.21.15.63:0/311768028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f4158eb0 0x7f77f4152910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009d90 tx=0x7f77ec01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1348fc6dec7cb9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77f3e00640 1 -- 172.21.15.63:0/311768028 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0b2070 con 0x7f77f4158eb0 2024-09-12T02:57:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77f3e00640 1 -- 172.21.15.63:0/311768028 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ec0a5830 con 0x7f77f4158eb0 2024-09-12T02:57:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77f3e00640 1 -- 172.21.15.63:0/311768028 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0a5be0 con 0x7f77f4158eb0 2024-09-12T02:57:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 -- 172.21.15.63:0/311768028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f4158eb0 msgr2=0x7f77f4152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 --2- 172.21.15.63:0/311768028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f4158eb0 0x7f77f4152910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009d90 tx=0x7f77ec01c970 comp rx=0 tx=0).stop 2024-09-12T02:57:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 -- 172.21.15.63:0/311768028 shutdown_connections 2024-09-12T02:57:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 --2- 172.21.15.63:0/311768028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f4158eb0 0x7f77f4152910 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 --2- 172.21.15.63:0/311768028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406ed30 0x7f77f41523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 -- 172.21.15.63:0/311768028 >> 172.21.15.63:0/311768028 conn(0x7f77f4072960 msgr2=0x7f77f4072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 -- 172.21.15.63:0/311768028 shutdown_connections 2024-09-12T02:57:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 -- 172.21.15.63:0/311768028 wait complete. 2024-09-12T02:57:57.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:57:57.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 Processor -- start 2024-09-12T02:57:57.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.017+0000 7f77fc000640 1 -- start start 2024-09-12T02:57:57.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fc000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f406ed30 0x7f77f41f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fc000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406f110 0x7f77f4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fc000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4158eb0 0x7f77f414bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fc000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f77f40c4280 con 0x7f77f4158eb0 2024-09-12T02:57:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fc000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f77f40c4100 con 0x7f77f406ed30 2024-09-12T02:57:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fc000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f77f41657d0 con 0x7f77f406f110 2024-09-12T02:57:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fa000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4158eb0 0x7f77f414bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fa000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4158eb0 0x7f77f414bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48060/0 (socket says 172.21.15.63:48060) 2024-09-12T02:57:57.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fa000640 1 -- 172.21.15.63:0/3131530631 learned_addr learned my addr 172.21.15.63:0/3131530631 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:57.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77f8c00640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406f110 0x7f77f4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77f9600640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f406ed30 0x7f77f41f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fa000640 1 -- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406f110 msgr2=0x7f77f4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fa000640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406f110 0x7f77f4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fa000640 1 -- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f406ed30 msgr2=0x7f77f41f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fa000640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f406ed30 0x7f77f41f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fa000640 1 -- 172.21.15.63:0/3131530631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f41533f0 con 0x7f77f4158eb0 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fa000640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4158eb0 0x7f77f414bdf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0b0040 tx=0x7f77ec019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77f1600640 1 -- 172.21.15.63:0/3131530631 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0b2050 con 0x7f77f4158eb0 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77f1600640 1 -- 172.21.15.63:0/3131530631 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ec0be070 con 0x7f77f4158eb0 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f4155b10 con 0x7f77f4158eb0 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77f1600640 1 -- 172.21.15.63:0/3131530631 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec003dd0 con 0x7f77f4158eb0 2024-09-12T02:57:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f4155810 con 0x7f77f4158eb0 2024-09-12T02:57:57.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.021+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d00052a0 con 0x7f77f4158eb0 2024-09-12T02:57:57.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.025+0000 7f77f1600640 1 -- 172.21.15.63:0/3131530631 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77ec004040 con 0x7f77f4158eb0 2024-09-12T02:57:57.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.025+0000 7f77f1600640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 0x7f77d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.025+0000 7f77f1600640 1 -- 172.21.15.63:0/3131530631 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6706+0+0 (secure 0 0 0) 0x7f77ec120f40 con 0x7f77f4158eb0 2024-09-12T02:57:57.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.025+0000 7f77f9600640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 0x7f77d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.029+0000 7f77f9600640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 0x7f77d4069db0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009ac0 tx=0x7f77e8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.033+0000 7f77f1600640 1 -- 172.21.15.63:0/3131530631 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f77ec016560 con 0x7f77f4158eb0 2024-09-12T02:57:57.056 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:57.051+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:57.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c77000640 1 Processor -- start 2024-09-12T02:57:57.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c77000640 1 -- start start 2024-09-12T02:57:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c77000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c700c8990 0x7f8c700c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c77000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8c7015bc30 0x7f8c7006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c77000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 0x7f8c701524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c77000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f8c700680d0 con 0x7f8c7015bc30 2024-09-12T02:57:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c77000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f8c70070930 con 0x7f8c700c8990 2024-09-12T02:57:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c77000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f8c700703b0 con 0x7f8c700c8d70 2024-09-12T02:57:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8c7015bc30 0x7f8c7006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8c7015bc30 0x7f8c7006d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48076/0 (socket says 172.21.15.63:48076) 2024-09-12T02:57:57.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75200640 1 -- 172.21.15.63:0/578164694 learned_addr learned my addr 172.21.15.63:0/578164694 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:57.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75c00640 1 --2- 172.21.15.63:0/578164694 >> v2:172.21.15.119:3300/0 conn(0x7f8c700c8990 0x7f8c700c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c76600640 1 --2- 172.21.15.63:0/578164694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 0x7f8c701524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75c00640 1 -- 172.21.15.63:0/578164694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 msgr2=0x7f8c701524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:57.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75c00640 1 --2- 172.21.15.63:0/578164694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 0x7f8c701524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75c00640 1 -- 172.21.15.63:0/578164694 >> v2:172.21.15.63:3300/0 conn(0x7f8c7015bc30 msgr2=0x7f8c7006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:57.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75c00640 1 --2- 172.21.15.63:0/578164694 >> v2:172.21.15.63:3300/0 conn(0x7f8c7015bc30 0x7f8c7006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75c00640 1 -- 172.21.15.63:0/578164694 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7006d860 con 0x7f8c700c8990 2024-09-12T02:57:57.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.065+0000 7f8c75200640 1 --2- 172.21.15.63:0/578164694 >> v2:172.21.15.63:3300/0 conn(0x7f8c7015bc30 0x7f8c7006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:57.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c75c00640 1 --2- 172.21.15.63:0/578164694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c700c8990 0x7f8c700c6820 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c70071060 tx=0x7f8c6401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5193377de9f4dec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c6fe00640 1 -- 172.21.15.63:0/578164694 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c640b0070 con 0x7f8c700c8990 2024-09-12T02:57:57.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c6fe00640 1 -- 172.21.15.63:0/578164694 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c640ab600 con 0x7f8c700c8990 2024-09-12T02:57:57.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c6fe00640 1 -- 172.21.15.63:0/578164694 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c640ab9d0 con 0x7f8c700c8990 2024-09-12T02:57:57.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c77000640 1 -- 172.21.15.63:0/578164694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c700c8990 msgr2=0x7f8c700c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c77000640 1 --2- 172.21.15.63:0/578164694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c700c8990 0x7f8c700c6820 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c70071060 tx=0x7f8c6401c3f0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c77000640 1 -- 172.21.15.63:0/578164694 shutdown_connections 2024-09-12T02:57:57.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c77000640 1 --2- 172.21.15.63:0/578164694 >> v2:172.21.15.63:3300/0 conn(0x7f8c7015bc30 0x7f8c7006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c77000640 1 --2- 172.21.15.63:0/578164694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 0x7f8c701524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c77000640 1 --2- 172.21.15.63:0/578164694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c700c8990 0x7f8c700c6820 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c77000640 1 -- 172.21.15.63:0/578164694 >> 172.21.15.63:0/578164694 conn(0x7f8c7006f890 msgr2=0x7f8c7006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:57.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c77000640 1 -- 172.21.15.63:0/578164694 shutdown_connections 2024-09-12T02:57:57.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.073+0000 7f8c77000640 1 -- 172.21.15.63:0/578164694 wait complete. 2024-09-12T02:57:57.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c77000640 1 Processor -- start 2024-09-12T02:57:57.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c77000640 1 -- start start 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c77000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c700c8990 0x7f8c701f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c77000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 0x7f8c70157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c77000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c7015bc30 0x7f8c70159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c77000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7006ce00 con 0x7f8c7015bc30 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c77000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8c70152e00 con 0x7f8c700c8990 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c77000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f8c700c5210 con 0x7f8c700c8d70 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c76600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c7015bc30 0x7f8c70159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c75c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c700c8990 0x7f8c701f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c75200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 0x7f8c70157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c76600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c7015bc30 0x7f8c70159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48084/0 (socket says 172.21.15.63:48084) 2024-09-12T02:57:57.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c76600640 1 -- 172.21.15.63:0/2862361301 learned_addr learned my addr 172.21.15.63:0/2862361301 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c76600640 1 -- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 msgr2=0x7f8c70157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c76600640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 0x7f8c70157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c76600640 1 -- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c700c8990 msgr2=0x7f8c701f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c76600640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c700c8990 0x7f8c701f7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c76600640 1 -- 172.21.15.63:0/2862361301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7014a6c0 con 0x7f8c7015bc30 2024-09-12T02:57:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.077+0000 7f8c76600640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c7015bc30 0x7f8c70159e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800eed0 tx=0x7f8c6800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.081+0000 7f8c6d600640 1 -- 172.21.15.63:0/2862361301 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c68018020 con 0x7f8c7015bc30 2024-09-12T02:57:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.081+0000 7f8c6d600640 1 -- 172.21.15.63:0/2862361301 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c68014400 con 0x7f8c7015bc30 2024-09-12T02:57:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.081+0000 7f8c6d600640 1 -- 172.21.15.63:0/2862361301 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c680147f0 con 0x7f8c7015bc30 2024-09-12T02:57:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.081+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c701f4660 con 0x7f8c7015bc30 2024-09-12T02:57:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.081+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c701f3dc0 con 0x7f8c7015bc30 2024-09-12T02:57:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.081+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c701524b0 con 0x7f8c7015bc30 2024-09-12T02:57:57.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.081+0000 7f8c6d600640 1 -- 172.21.15.63:0/2862361301 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c6801b020 con 0x7f8c7015bc30 2024-09-12T02:57:57.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.085+0000 7f8c6d600640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8c500678f0 0x7f8c50069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.085+0000 7f8c6d600640 1 -- 172.21.15.63:0/2862361301 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6706+0+0 (secure 0 0 0) 0x7f8c68086cd0 con 0x7f8c7015bc30 2024-09-12T02:57:57.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.085+0000 7f8c75c00640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8c500678f0 0x7f8c50069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.085+0000 7f8c75c00640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8c500678f0 0x7f8c50069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c70071060 tx=0x7f8c64008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.089+0000 7f8c6d600640 1 -- 172.21.15.63:0/2862361301 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c68022070 con 0x7f8c7015bc30 2024-09-12T02:57:57.157 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:57.151+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:57.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.169+0000 7fa609000640 1 Processor -- start 2024-09-12T02:57:57.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.169+0000 7fa609000640 1 -- start start 2024-09-12T02:57:57.174 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:57:57.174 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'39)", 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.217426195999998, 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047813200000000004, 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.175 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955738+0000", 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3099999999999998e-07 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.176 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955742+0000", 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955753+0000", 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1321000000000001e-05 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955759+0000", 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1070000000000001e-06 2024-09-12T02:57:57.177 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955810+0000", 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0711000000000003e-05 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955823+0000", 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2605999999999999e-05 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960475+0000", 2024-09-12T02:57:57.178 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004652354 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960518+0000", 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3316999999999999e-05 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'39)", 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.215903400999998, 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039674089999999999, 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.179 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.180 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957261+0000", 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8400000000000004e-07 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957334+0000", 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3613000000000001e-05 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957347+0000", 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3349e-05 2024-09-12T02:57:57.181 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957353+0000", 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1089999999999997e-06 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957405+0000", 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2206000000000001e-05 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957427+0000", 2024-09-12T02:57:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2155999999999999e-05 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961190+0000", 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037629849999999999 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961227+0000", 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7307e-05 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.183 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.213658363, 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004389858, 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:57:57.184 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959506+0000", 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8599999999999998e-07 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.185 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959510+0000", 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7339999999999999e-06 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959523+0000", 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2773e-05 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959528+0000", 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9740000000000001e-06 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.186 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960547+0000", 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010187359999999999 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960560+0000", 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3223e-05 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963855+0000", 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032949910000000002 2024-09-12T02:57:57.187 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963895+0000", 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9740999999999998e-05 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.206105610999998, 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021753509999999998, 2024-09-12T02:57:57.188 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.189 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6599999999999996e-07 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967141+0000", 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2319999999999998e-05 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967152+0000", 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1432e-05 2024-09-12T02:57:57.190 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967158+0000", 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8019999999999997e-06 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967207+0000", 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9075e-05 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967224+0000", 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7427000000000001e-05 2024-09-12T02:57:57.191 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969194+0000", 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019695590000000001 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969233+0000", 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9169999999999999e-05 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.192 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.204707427000002, 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003562614, 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.193 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7899999999999998e-07 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968495+0000", 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8025000000000003e-05 2024-09-12T02:57:57.194 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968507+0000", 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2758999999999999e-05 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968513+0000", 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3009999999999997e-06 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968585+0000", 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2139999999999997e-05 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.195 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968599+0000", 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4752999999999999e-05 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.971980+0000", 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033801059999999999 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972018+0000", 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8850999999999998e-05 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.196 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:74 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'48, mlcod=17'44)", 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.203037473000002, 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022444370000000002, 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.197 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7100000000000001e-07 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.198 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970131+0000", 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4850000000000003e-06 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970144+0000", 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2595999999999999e-05 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970149+0000", 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.395e-06 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970209+0000", 2024-09-12T02:57:57.199 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9905999999999999e-05 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970225+0000", 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6177000000000001e-05 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972340+0000", 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002114917 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.200 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972370+0000", 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.029e-05 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:83 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'50)", 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.187056497, 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002809059, 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.201 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.202 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6000000000000004e-07 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986112+0000", 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8019999999999999e-06 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986123+0000", 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0953e-05 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.203 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986128+0000", 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7849999999999999e-06 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986166+0000", 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7923000000000003e-05 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986180+0000", 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4211e-05 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.204 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988884+0000", 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027039640000000001 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988916+0000", 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1860999999999999e-05 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.205 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:84 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'50)", 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.186059684999996, 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002347909, 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.206 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8899999999999999e-07 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987155+0000", 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0776000000000003e-05 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.207 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987167+0000", 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2215000000000001e-05 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987172+0000", 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.04e-06 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987232+0000", 2024-09-12T02:57:57.208 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9595000000000001e-05 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987246+0000", 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3757000000000001e-05 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989417+0000", 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021715329999999998 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.209 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989451+0000", 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4304000000000002e-05 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:90 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'60, mlcod=17'57)", 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.177523782000002, 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027093489999999998, 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.210 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.211 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995640+0000", 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9699999999999995e-07 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995794+0000", 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015367199999999999 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995805+0000", 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1061e-05 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.212 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995810+0000", 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4589999999999997e-06 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995856+0000", 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6127000000000001e-05 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995870+0000", 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3854e-05 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.213 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998315+0000", 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024450930000000002 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998349+0000", 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3386000000000002e-05 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.214 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:105 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'67, mlcod=17'64)", 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 60.995248664000002, 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026337050000000001, 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.215 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4300000000000003e-07 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177930+0000", 2024-09-12T02:57:57.216 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4735999999999999e-05 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177942+0000", 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2349e-05 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177949+0000", 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6599999999999998e-06 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.217 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178003+0000", 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3535999999999997e-05 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178018+0000", 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5227e-05 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180517+0000", 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024996419999999998 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.218 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180548+0000", 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0911999999999998e-05 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:158 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'112, mlcod=18'109)", 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.718009678000001, 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026267230000000001, 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.219 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:57:57.220 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.58e-07 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455235+0000", 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1242000000000006e-05 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455245+0000", 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.995e-06 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455250+0000", 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7079999999999996e-06 2024-09-12T02:57:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455297+0000", 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6885000000000003e-05 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455311+0000", 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4354e-05 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457734+0000", 2024-09-12T02:57:57.222 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024232540000000001 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457780+0000", 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5827e-05 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:159 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'113, mlcod=18'109)", 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.717288689999997, 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046885809999999998, 2024-09-12T02:57:57.223 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.224 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5300000000000004e-07 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455879+0000", 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8650000000000003e-06 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455889+0000", 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0139999999999999e-05 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.225 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455894+0000", 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2959999999999998e-06 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455944+0000", 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9774999999999997e-05 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455962+0000", 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8009999999999999e-05 2024-09-12T02:57:57.226 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460534+0000", 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045721299999999998 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460563+0000", 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8812000000000001e-05 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.227 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:4 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.321140335000003, 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073449359999999998, 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.228 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852025+0000", 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2280000000000001e-06 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852034+0000", 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1619999999999997e-06 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.229 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852060+0000", 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5714000000000001e-05 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852073+0000", 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3199e-05 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852384+0000", 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031071499999999998 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.230 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852627+0000", 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024345000000000001 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852778+0000", 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015093999999999999 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857277+0000", 2024-09-12T02:57:57.231 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044991120000000004 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859269+0000", 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019915879999999999 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3817999999999999e-05 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.232 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859368+0000", 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5009999999999998e-05 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.321048926000003, 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012795443, 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.233 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852115+0000", 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.54e-07 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852120+0000", 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2299999999999999e-06 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852132+0000", 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1746000000000001e-05 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852140+0000", 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2300000000000008e-06 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854507+0000", 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023667369999999998 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854587+0000", 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0024000000000005e-05 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854730+0000", 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014253599999999999 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859376+0000", 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046468200000000003 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864800+0000", 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054233670000000001 2024-09-12T02:57:57.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864864+0000", 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4397e-05 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864910+0000", 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5602000000000001e-05 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:28 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.320990678000001, 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011320167000000001, 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1600000000000001e-07 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852188+0000", 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.506e-05 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852199+0000", 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0677e-05 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852206+0000", 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8279999999999997e-06 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852418+0000", 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021227799999999999 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852545+0000", 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012638499999999999 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852774+0000", 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0002299 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856085+0000", 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033103569999999999 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863371+0000", 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072860260000000001 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863444+0000", 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.305e-05 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863493+0000", 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8890000000000001e-05 2024-09-12T02:57:57.243 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.320928617, 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012832368, 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5700000000000002e-07 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852262+0000", 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7135e-05 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852366+0000", 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103606 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852378+0000", 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2204999999999999e-05 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854980+0000", 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026019860000000001 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855096+0000", 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115887 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855213+0000", 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116916 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859383+0000", 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041700089999999997 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864993+0000", 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056103209999999997 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865043+0000", 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9481999999999998e-05 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865067+0000", 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4164000000000001e-05 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.320716214999997, 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012817586000000001, 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852448+0000", 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5600000000000005e-07 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852453+0000", 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9019999999999998e-06 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852462+0000", 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9069999999999996e-06 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852469+0000", 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.374e-06 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853604+0000", 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011349299999999999 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853717+0000", 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112797 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853836+0000", 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011936500000000001 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859663+0000", 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058266209999999997 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865167+0000", 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055044849999999999 2024-09-12T02:57:57.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865226+0000", 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8718000000000003e-05 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865265+0000", 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8730999999999999e-05 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:57:57.254 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.320684616000001, 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012748110999999999, 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6699999999999999e-07 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852492+0000", 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.291e-05 2024-09-12T02:57:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852500+0000", 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1580000000000005e-06 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852506+0000", 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5330000000000002e-06 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856830+0000", 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004324194 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856959+0000", 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012862099999999999 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865227+0000", 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082682280000000007 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.258 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.318362524999998, 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045219450000000003, 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854802+0000", 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854814+0000", 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1759999999999999e-05 2024-09-12T02:57:57.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854836+0000", 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2039999999999999e-05 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854855+0000", 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.929e-05 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854975+0000", 2024-09-12T02:57:57.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119561 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043479110000000003 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:2 2.f e25/19 2:f1f69726:::400.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 47.315046328000001, 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032847000000000002, 2024-09-12T02:57:57.262 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858118+0000", 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1540000000000001e-06 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858126+0000", 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7759999999999997e-06 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858138+0000", 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2184999999999999e-05 2024-09-12T02:57:57.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858145+0000", 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858282+0000", 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013642799999999999 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:57:57.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858297+0000", 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5328e-05 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861346+0000", 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030492729999999999 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861402+0000", 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5220999999999999e-05 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.266 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.267 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:57:57.267 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:57:57.267 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:57:57.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa609000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 0x7fa6040c7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa609000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa6040c6850 0x7fa6040c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa609000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa604155040 con 0x7fa604154c60 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa609000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa6040c8dc0 con 0x7fa6040c6850 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa609000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa604073df0 con 0x7fa604067a00 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa603400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa604154c60 0x7fa60406ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35772/0 (socket says 172.21.15.63:35772) 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa603400640 1 -- 172.21.15.63:0/3382599639 learned_addr learned my addr 172.21.15.63:0/3382599639 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa603e00640 1 --2- 172.21.15.63:0/3382599639 >> v2:172.21.15.63:3300/0 conn(0x7fa6040c6850 0x7fa6040c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa602a00640 1 --2- 172.21.15.63:0/3382599639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 0x7fa6040c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa602000640 1 -- 172.21.15.63:0/3382599639 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879786026 0 0) 0x7fa5f4001120 con 0x7fa604154c60 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa602000640 1 -- 172.21.15.63:0/3382599639 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5e8003530 con 0x7fa604154c60 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa602a00640 1 -- 172.21.15.63:0/3382599639 >> v2:172.21.15.63:3300/0 conn(0x7fa6040c6850 msgr2=0x7fa6040c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa602a00640 1 --2- 172.21.15.63:0/3382599639 >> v2:172.21.15.63:3300/0 conn(0x7fa6040c6850 0x7fa6040c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa602a00640 1 -- 172.21.15.63:0/3382599639 >> v1:172.21.15.63:6789/0 conn(0x7fa604154c60 legacy=0x7fa60406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa602a00640 1 -- 172.21.15.63:0/3382599639 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60415e9d0 con 0x7fa604067a00 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.173+0000 7fa603e00640 1 --2- 172.21.15.63:0/3382599639 >> v2:172.21.15.63:3300/0 conn(0x7fa6040c6850 0x7fa6040c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa602a00640 1 --2- 172.21.15.63:0/3382599639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 0x7fa6040c7340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097c0 tx=0x7fa5f001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f61ee7ecf5aa19d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa602000640 1 -- 172.21.15.63:0/3382599639 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00b5070 con 0x7fa604067a00 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa602000640 1 -- 172.21.15.63:0/3382599639 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f00a8990 con 0x7fa604067a00 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa602000640 1 -- 172.21.15.63:0/3382599639 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00a8d40 con 0x7fa604067a00 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa609000640 1 -- 172.21.15.63:0/3382599639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 msgr2=0x7fa6040c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa609000640 1 --2- 172.21.15.63:0/3382599639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 0x7fa6040c7340 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097c0 tx=0x7fa5f001ec90 comp rx=0 tx=0).stop 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa609000640 1 -- 172.21.15.63:0/3382599639 shutdown_connections 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa609000640 1 --2- 172.21.15.63:0/3382599639 >> v2:172.21.15.63:3300/0 conn(0x7fa6040c6850 0x7fa6040c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa609000640 1 --2- 172.21.15.63:0/3382599639 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 0x7fa6040c7340 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa609000640 1 -- 172.21.15.63:0/3382599639 >> 172.21.15.63:0/3382599639 conn(0x7fa60406f8e0 msgr2=0x7fa60406fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa609000640 1 -- 172.21.15.63:0/3382599639 shutdown_connections 2024-09-12T02:57:57.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.177+0000 7fa609000640 1 -- 172.21.15.63:0/3382599639 wait complete. 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 Processor -- start 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 -- start start 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 0x7fa6040cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6040c6850 0x7fa604158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa604154c60 0x7fa6041594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa604070400 con 0x7fa604154c60 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa60415ec70 con 0x7fa6040c6850 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa6040706e0 con 0x7fa604067a00 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa604154c60 0x7fa6041594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa604154c60 0x7fa6041594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48090/0 (socket says 172.21.15.63:48090) 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603e00640 1 -- 172.21.15.63:0/2133982263 learned_addr learned my addr 172.21.15.63:0/2133982263 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa602a00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6040c6850 0x7fa604158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 0x7fa6040cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603e00640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 msgr2=0x7fa6040cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603e00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa604067a00 0x7fa6040cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603e00640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6040c6850 msgr2=0x7fa604158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603e00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6040c6850 0x7fa604158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603e00640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6041f4260 con 0x7fa604154c60 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa603e00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa604154c60 0x7fa6041594c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009e50 tx=0x7fa5fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc018030 con 0x7fa604154c60 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5fc00cd90 con 0x7fa604154c60 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc003bc0 con 0x7fa604154c60 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa604153860 con 0x7fa604154c60 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.181+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa604155470 con 0x7fa604154c60 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fa6041f0300 con 0x7fa604154c60 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5fc01b070 con 0x7fa604154c60 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa5fb400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa5e40678c0 0x7fa5e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6706+0+0 (secure 0 0 0) 0x7fa5fc086890 con 0x7fa604154c60 2024-09-12T02:57:57.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v34) ==== 54+0+16 (secure 0 0 0) 0x7fa6041f0300 con 0x7fa604154c60 2024-09-12T02:57:57.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa603400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa5e40678c0 0x7fa5e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa6041556b0 0x7fa6041f0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6040c9040 con 0x7fa6041556b0 2024-09-12T02:57:57.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa602a00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa6041556b0 0x7fa6041f0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa603400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa5e40678c0 0x7fa5e4069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4005890 tx=0x7fa5f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.185+0000 7fa602a00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa6041556b0 0x7fa6041f0600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.189+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa6040c9040 con 0x7fa6041556b0 2024-09-12T02:57:57.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:57:57.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.201+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa60406d2c0 con 0x7fa6041556b0 2024-09-12T02:57:57.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.205+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa60406d2c0 con 0x7fa6041556b0 2024-09-12T02:57:57.278 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:57.263+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:57.278 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:57:57.279 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:57:57.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.205+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa604158510 0x7fa60414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.205+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fa6040cbfa0 con 0x7fa604158510 2024-09-12T02:57:57.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.205+0000 7fa603400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa604158510 0x7fa60414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.205+0000 7fa603400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa604158510 0x7fa60414d380 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.205+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa6040cbfa0 con 0x7fa604158510 2024-09-12T02:57:57.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.221+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa60414db10 con 0x7fa604158510 2024-09-12T02:57:57.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.221+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa60414db10 con 0x7fa604158510 2024-09-12T02:57:57.280 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:57:57.280 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:57:57.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.221+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa60414df70 0x7fa6040c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.221+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fa6040c6140 con 0x7fa60414df70 2024-09-12T02:57:57.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.221+0000 7fa602a00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa60414df70 0x7fa6040c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.221+0000 7fa602a00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa60414df70 0x7fa6040c5c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.225+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa6040c6140 con 0x7fa60414df70 2024-09-12T02:57:57.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.237+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa6040626e0 con 0x7fa60414df70 2024-09-12T02:57:57.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.237+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa6040626e0 con 0x7fa60414df70 2024-09-12T02:57:57.281 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:57:57.282 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:57:57.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.237+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa6040631c0 0x7fa6040ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.237+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fa604063600 con 0x7fa6040631c0 2024-09-12T02:57:57.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.237+0000 7fa603e00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa6040631c0 0x7fa6040ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.241+0000 7fa603e00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa6040631c0 0x7fa6040ca680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.241+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa604063600 con 0x7fa6040631c0 2024-09-12T02:57:57.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.245+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7f77d0005860 con 0x7f77f4158eb0 2024-09-12T02:57:57.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.253+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa6040cae90 con 0x7fa6040631c0 2024-09-12T02:57:57.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.253+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa6040cae90 con 0x7fa6040631c0 2024-09-12T02:57:57.284 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:57:57.284 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:57:57.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.257+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa60402c650 0x7fa60402ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.257+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fa604063600 con 0x7fa60402c650 2024-09-12T02:57:57.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.257+0000 7fa603400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa60402c650 0x7fa60402ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.257+0000 7fa603400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa60402c650 0x7fa60402ca70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.257+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa604063600 con 0x7fa60402c650 2024-09-12T02:57:57.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.269+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 3, "weight": 1.0} v 0) -- 0x7f8c700c54e0 con 0x7f8c7015bc30 2024-09-12T02:57:57.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.273+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa604063600 con 0x7fa60402c650 2024-09-12T02:57:57.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.277+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa604063600 con 0x7fa60402c650 2024-09-12T02:57:57.286 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:57:57.286 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:57:57.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.277+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa60402d4c0 0x7fa604206d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.277+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fa6040cabc0 con 0x7fa60402d4c0 2024-09-12T02:57:57.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.277+0000 7fa602a00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa60402d4c0 0x7fa604206d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.277+0000 7fa602a00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa60402d4c0 0x7fa604206d50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.277+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa6040cabc0 con 0x7fa60402d4c0 2024-09-12T02:57:57.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.293+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa60402d900 con 0x7fa60402d4c0 2024-09-12T02:57:57.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.297+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa60402d900 con 0x7fa60402d4c0 2024-09-12T02:57:57.299 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:57:57.299 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:57:57.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.297+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa6042077a0 0x7fa604209b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.297+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fa60420ca30 con 0x7fa6042077a0 2024-09-12T02:57:57.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.297+0000 7fa603e00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa6042077a0 0x7fa604209b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.297+0000 7fa603e00640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa6042077a0 0x7fa604209b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.297+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa60420ca30 con 0x7fa6042077a0 2024-09-12T02:57:57.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.313+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa60420c9b0 con 0x7fa6042077a0 2024-09-12T02:57:57.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.317+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa60420c9b0 con 0x7fa6042077a0 2024-09-12T02:57:57.319 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:57:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:57:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.317+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa60420a5e0 0x7fa60420aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.317+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fa60420fdd0 con 0x7fa60420a5e0 2024-09-12T02:57:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.317+0000 7fa603400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa60420a5e0 0x7fa60420aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:57.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.317+0000 7fa603400640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa60420a5e0 0x7fa60420aa40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:57.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.321+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa60420fdd0 con 0x7fa60420a5e0 2024-09-12T02:57:57.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.333+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa60402dab0 con 0x7fa60420a5e0 2024-09-12T02:57:57.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa5fb400640 1 -- 172.21.15.63:0/2133982263 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa60402dab0 con 0x7fa60420a5e0 2024-09-12T02:57:57.339 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa6041556b0 msgr2=0x7fa6041f0600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa6041556b0 0x7fa6041f0600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa604158510 msgr2=0x7fa60414d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa604158510 0x7fa60414d380 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa60414df70 msgr2=0x7fa6040c5c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa60414df70 0x7fa6040c5c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa6040631c0 msgr2=0x7fa6040ca680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa6040631c0 0x7fa6040ca680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa60402c650 msgr2=0x7fa60402ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa60402c650 0x7fa60402ca70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa603e00640 1 -- 172.21.15.63:0/2133982263 reap_dead start 2024-09-12T02:57:57.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa60402d4c0 msgr2=0x7fa604206d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa60402d4c0 0x7fa604206d50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa603e00640 1 -- 172.21.15.63:0/2133982263 reap_dead start 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa6042077a0 msgr2=0x7fa604209b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa6042077a0 0x7fa604209b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa60420a5e0 msgr2=0x7fa60420aa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa60420a5e0 0x7fa60420aa40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa603e00640 1 -- 172.21.15.63:0/2133982263 reap_dead start 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa5e40678c0 msgr2=0x7fa5e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa5e40678c0 0x7fa5e4069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4005890 tx=0x7fa5f4009040 comp rx=0 tx=0).stop 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa604154c60 msgr2=0x7fa6041594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa604154c60 0x7fa6041594c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009e50 tx=0x7fa5fc00c490 comp rx=0 tx=0).stop 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 shutdown_connections 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa604154c60 0x7fa6041594c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 --2- 172.21.15.63:0/2133982263 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa5e40678c0 0x7fa5e4069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 >> 172.21.15.63:0/2133982263 conn(0x7fa60406f8e0 msgr2=0x7fa604152490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 shutdown_connections 2024-09-12T02:57:57.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.337+0000 7fa609000640 1 -- 172.21.15.63:0/2133982263 wait complete. 2024-09-12T02:57:57.369 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:57.363+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:57.432 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:57.433 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:57.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:57:57.470 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:57.467+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:57.571 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:57.567+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:57.591 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:57.591 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:57.606 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:57:57.672 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:57.669+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:57.751 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:57.751 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:57.767 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:57:57.773 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:57.767+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:57.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.849+0000 7f77f1600640 1 -- 172.21.15.63:0/3131530631 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v35) ==== 101+0+0 (secure 0 0 0) 0x7f77ec0f1040 con 0x7f77f4158eb0 2024-09-12T02:57:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.849+0000 7f8c6d600640 1 -- 172.21.15.63:0/2862361301 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 3, "weight": 1.0}]=0 reweighted osd.3 to 1 (10000) v35) ==== 113+0+0 (secure 0 0 0) 0x7f8c68056e40 con 0x7f8c7015bc30 2024-09-12T02:57:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-12T02:57:57.853 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T02:57:57.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 msgr2=0x7f77d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 0x7f77d4069db0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009ac0 tx=0x7f77e8009190 comp rx=0 tx=0).stop 2024-09-12T02:57:57.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4158eb0 msgr2=0x7f77f414bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4158eb0 0x7f77f414bdf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0b0040 tx=0x7f77ec019710 comp rx=0 tx=0).stop 2024-09-12T02:57:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 shutdown_connections 2024-09-12T02:57:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4158eb0 0x7f77f414bdf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 0x7f77d4069db0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f406f110 0x7f77f4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 --2- 172.21.15.63:0/3131530631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f406ed30 0x7f77f41f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 >> 172.21.15.63:0/3131530631 conn(0x7f77f4072960 msgr2=0x7f77f414fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 shutdown_connections 2024-09-12T02:57:57.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f77fc000640 1 -- 172.21.15.63:0/3131530631 wait complete. 2024-09-12T02:57:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8c500678f0 msgr2=0x7f8c50069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8c500678f0 0x7f8c50069db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c70071060 tx=0x7f8c64008040 comp rx=0 tx=0).stop 2024-09-12T02:57:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c7015bc30 msgr2=0x7f8c70159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c7015bc30 0x7f8c70159e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800eed0 tx=0x7f8c6800b480 comp rx=0 tx=0).stop 2024-09-12T02:57:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 shutdown_connections 2024-09-12T02:57:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8c7015bc30 0x7f8c70159e50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8c500678f0 0x7f8c50069db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c700c8d70 0x7f8c70157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 --2- 172.21.15.63:0/2862361301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c700c8990 0x7f8c701f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 >> 172.21.15.63:0/2862361301 conn(0x7f8c7006f890 msgr2=0x7f8c7006fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 shutdown_connections 2024-09-12T02:57:57.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:57.853+0000 7f8c77000640 1 -- 172.21.15.63:0/2862361301 wait complete. 2024-09-12T02:57:57.873 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:57.871+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:57.890 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T02:57:57.971 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:57.971 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:57.974 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:57.971+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:57.988 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:57:58.075 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:58.073+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:58.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe545000640 1 Processor -- start 2024-09-12T02:57:58.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe545000640 1 -- start start 2024-09-12T02:57:58.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe545000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe540157fc0 0x7fe5400cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:58.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe545000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe5400cc7a0 0x7fe5400ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:58.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe545000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5400cd110 con 0x7fe54006ebb0 2024-09-12T02:57:58.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe545000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fe54006d270 con 0x7fe540157fc0 2024-09-12T02:57:58.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe545000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe5400cd8b0 con 0x7fe5400cc7a0 2024-09-12T02:57:58.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe540157fc0 0x7fe5400cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:58.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe540157fc0 0x7fe5400cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48096/0 (socket says 172.21.15.63:48096) 2024-09-12T02:57:58.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53d400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe54006ebb0 0x7fe54006fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35782/0 (socket says 172.21.15.63:35782) 2024-09-12T02:57:58.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53de00640 1 -- 172.21.15.63:0/705841418 learned_addr learned my addr 172.21.15.63:0/705841418 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53e800640 1 --2- 172.21.15.63:0/705841418 >> v2:172.21.15.119:3300/0 conn(0x7fe5400cc7a0 0x7fe5400ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53de00640 1 -- 172.21.15.63:0/705841418 >> v2:172.21.15.119:3300/0 conn(0x7fe5400cc7a0 msgr2=0x7fe5400ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53de00640 1 --2- 172.21.15.63:0/705841418 >> v2:172.21.15.119:3300/0 conn(0x7fe5400cc7a0 0x7fe5400ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53de00640 1 -- 172.21.15.63:0/705841418 >> v1:172.21.15.63:6789/0 conn(0x7fe54006ebb0 legacy=0x7fe54006fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53de00640 1 -- 172.21.15.63:0/705841418 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5400cdb90 con 0x7fe540157fc0 2024-09-12T02:57:58.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.077+0000 7fe53e800640 1 --2- 172.21.15.63:0/705841418 >> v2:172.21.15.119:3300/0 conn(0x7fe5400cc7a0 0x7fe5400ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:57:58.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe53de00640 1 --2- 172.21.15.63:0/705841418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 0x7fe5400cbf00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe54015baa0 tx=0x7fe53001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87741ce3928298a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:58.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe53ca00640 1 -- 172.21.15.63:0/705841418 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5300b0070 con 0x7fe540157fc0 2024-09-12T02:57:58.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe53ca00640 1 -- 172.21.15.63:0/705841418 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5300ab600 con 0x7fe540157fc0 2024-09-12T02:57:58.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe53ca00640 1 -- 172.21.15.63:0/705841418 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5300ab9d0 con 0x7fe540157fc0 2024-09-12T02:57:58.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe545000640 1 -- 172.21.15.63:0/705841418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 msgr2=0x7fe5400cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:58.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe545000640 1 --2- 172.21.15.63:0/705841418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 0x7fe5400cbf00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe54015baa0 tx=0x7fe53001c520 comp rx=0 tx=0).stop 2024-09-12T02:57:58.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe545000640 1 -- 172.21.15.63:0/705841418 shutdown_connections 2024-09-12T02:57:58.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe545000640 1 --2- 172.21.15.63:0/705841418 >> v2:172.21.15.119:3300/0 conn(0x7fe5400cc7a0 0x7fe5400ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe545000640 1 --2- 172.21.15.63:0/705841418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 0x7fe5400cbf00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe545000640 1 -- 172.21.15.63:0/705841418 >> 172.21.15.63:0/705841418 conn(0x7fe54006bcc0 msgr2=0x7fe54006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:58.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe545000640 1 -- 172.21.15.63:0/705841418 shutdown_connections 2024-09-12T02:57:58.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.081+0000 7fe545000640 1 -- 172.21.15.63:0/705841418 wait complete. 2024-09-12T02:57:58.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 Processor -- start 2024-09-12T02:57:58.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 -- start start 2024-09-12T02:57:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe54006ebb0 0x7fe5401f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5400cc7a0 0x7fe5401f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 0x7fe540150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5400c5300 con 0x7fe540157fc0 2024-09-12T02:57:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe5400c5180 con 0x7fe54006ebb0 2024-09-12T02:57:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe5400702b0 con 0x7fe5400cc7a0 2024-09-12T02:57:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 0x7fe540150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:58.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 0x7fe540150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48112/0 (socket says 172.21.15.63:48112) 2024-09-12T02:57:58.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53e800640 1 -- 172.21.15.63:0/3994763792 learned_addr learned my addr 172.21.15.63:0/3994763792 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:58.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53de00640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe54006ebb0 0x7fe5401f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:58.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53d400640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5400cc7a0 0x7fe5401f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53e800640 1 -- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5400cc7a0 msgr2=0x7fe5401f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53e800640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5400cc7a0 0x7fe5401f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53e800640 1 -- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe54006ebb0 msgr2=0x7fe5401f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53e800640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe54006ebb0 0x7fe5401f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53e800640 1 -- 172.21.15.63:0/3994763792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5401f7f90 con 0x7fe540157fc0 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe53e800640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 0x7fe540150bd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe53800cf20 tx=0x7fe53800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe536000640 1 -- 172.21.15.63:0/3994763792 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53801a070 con 0x7fe540157fc0 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe536000640 1 -- 172.21.15.63:0/3994763792 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe53800d840 con 0x7fe540157fc0 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe540154560 con 0x7fe540157fc0 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe536000640 1 -- 172.21.15.63:0/3994763792 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53800dc30 con 0x7fe540157fc0 2024-09-12T02:57:58.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.085+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe540154b20 con 0x7fe540157fc0 2024-09-12T02:57:58.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.089+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5400ccbd0 con 0x7fe540157fc0 2024-09-12T02:57:58.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.089+0000 7fe536000640 1 -- 172.21.15.63:0/3994763792 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe53801d070 con 0x7fe540157fc0 2024-09-12T02:57:58.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.089+0000 7fe536000640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe5200678f0 0x7fe520069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:58.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.089+0000 7fe536000640 1 -- 172.21.15.63:0/3994763792 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6706+0+0 (secure 0 0 0) 0x7fe5380868b0 con 0x7fe540157fc0 2024-09-12T02:57:58.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.089+0000 7fe53de00640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe5200678f0 0x7fe520069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:58.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.089+0000 7fe53de00640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe5200678f0 0x7fe520069db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe5300ad000 tx=0x7fe530008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:58.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.093+0000 7fe536000640 1 -- 172.21.15.63:0/3994763792 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe538056910 con 0x7fe540157fc0 2024-09-12T02:57:58.176 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:58.171+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:58.178 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:58.178 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:58.194 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:57:58.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.273+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 4, "weight": 1.0} v 0) -- 0x7fe5400cc220 con 0x7fe540157fc0 2024-09-12T02:57:58.276 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:57:58.273+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:57:58.378 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:57:58.375+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:57:58.382 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:58.383 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:58.399 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:57:58.478 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:58.475+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:58.579 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:58.575+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:58.591 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:58.592 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:58.607 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:57:58.680 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:57:58.675+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:57:58.751 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:58.751 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:58.767 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:57:58.781 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:58.779+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.849+0000 7fe536000640 1 -- 172.21.15.63:0/3994763792 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 4, "weight": 1.0}]=0 reweighted osd.4 to 1 (10000) v36) ==== 113+0+0 (secure 0 0 0) 0x7fe53805ac10 con 0x7fe540157fc0 2024-09-12T02:57:58.854 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T02:57:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe5200678f0 msgr2=0x7fe520069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:58.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe5200678f0 0x7fe520069db0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe5300ad000 tx=0x7fe530008040 comp rx=0 tx=0).stop 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 msgr2=0x7fe540150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 0x7fe540150bd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe53800cf20 tx=0x7fe53800a7d0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 shutdown_connections 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe540157fc0 0x7fe540150bd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe5200678f0 0x7fe520069db0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5400cc7a0 0x7fe5401f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 --2- 172.21.15.63:0/3994763792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe54006ebb0 0x7fe5401f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 >> 172.21.15.63:0/3994763792 conn(0x7fe54006bcc0 msgr2=0x7fe540071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 shutdown_connections 2024-09-12T02:57:58.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:58.853+0000 7fe545000640 1 -- 172.21.15.63:0/3994763792 wait complete. 2024-09-12T02:57:58.877 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T02:57:58.882 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:58.879+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:58.935 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:57:58.982 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:58.981+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:59.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaaa600640 1 Processor -- start 2024-09-12T02:57:59.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaaa600640 1 -- start start 2024-09-12T02:57:59.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaaa600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa4152870 0x7fdaa40cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaaa600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdaa40c4f50 0x7fdaa40cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaaa600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa40ceeb0 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaaa600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa40ce1d0 con 0x7fdaa40c4f50 2024-09-12T02:57:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaaa600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa40cdb50 con 0x7fdaa4152870 2024-09-12T02:57:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaa3e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdaa40c4f50 0x7fdaa40cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fda9aa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdaa40ce9e0 0x7fdaa40714b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35792/0 (socket says 172.21.15.63:35792) 2024-09-12T02:57:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fda9aa00640 1 -- 172.21.15.63:0/286207070 learned_addr learned my addr 172.21.15.63:0/286207070 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaa3400640 1 --2- 172.21.15.63:0/286207070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa4152870 0x7fdaa40cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaa3e00640 1 -- 172.21.15.63:0/286207070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa4152870 msgr2=0x7fdaa40cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:59.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaa3e00640 1 --2- 172.21.15.63:0/286207070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa4152870 0x7fdaa40cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaa3e00640 1 -- 172.21.15.63:0/286207070 >> v1:172.21.15.63:6789/0 conn(0x7fdaa40ce9e0 legacy=0x7fdaa40714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaa3e00640 1 -- 172.21.15.63:0/286207070 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa40ce420 con 0x7fdaa40c4f50 2024-09-12T02:57:59.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.021+0000 7fdaa2a00640 1 -- 172.21.15.63:0/286207070 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420704580 0 0) 0x7fdaa40ceeb0 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaa3e00640 1 --2- 172.21.15.63:0/286207070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40c4f50 0x7fdaa40cc800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009d90 tx=0x7fda9c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5020826a4c238b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaa2a00640 1 -- 172.21.15.63:0/286207070 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0b2070 con 0x7fdaa40c4f50 2024-09-12T02:57:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaa2a00640 1 -- 172.21.15.63:0/286207070 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9c0a5850 con 0x7fdaa40c4f50 2024-09-12T02:57:59.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaa2a00640 1 -- 172.21.15.63:0/286207070 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0a5c20 con 0x7fdaa40c4f50 2024-09-12T02:57:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaaa600640 1 -- 172.21.15.63:0/286207070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40c4f50 msgr2=0x7fdaa40cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaaa600640 1 --2- 172.21.15.63:0/286207070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40c4f50 0x7fdaa40cc800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009d90 tx=0x7fda9c01c990 comp rx=0 tx=0).stop 2024-09-12T02:57:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaaa600640 1 -- 172.21.15.63:0/286207070 shutdown_connections 2024-09-12T02:57:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaaa600640 1 --2- 172.21.15.63:0/286207070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40c4f50 0x7fdaa40cc800 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaaa600640 1 --2- 172.21.15.63:0/286207070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa4152870 0x7fdaa40cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaaa600640 1 -- 172.21.15.63:0/286207070 >> 172.21.15.63:0/286207070 conn(0x7fdaa406bcc0 msgr2=0x7fdaa406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaaa600640 1 -- 172.21.15.63:0/286207070 shutdown_connections 2024-09-12T02:57:59.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaaa600640 1 -- 172.21.15.63:0/286207070 wait complete. 2024-09-12T02:57:59.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.025+0000 7fdaaa600640 1 Processor -- start 2024-09-12T02:57:59.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 -- start start 2024-09-12T02:57:59.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa40c4f50 0x7fdaa40b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40ce9e0 0x7fdaa41545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdaa4152870 0x7fdaa4154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa4071bc0 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40cd150 con 0x7fdaa4152870 2024-09-12T02:57:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa4071d40 con 0x7fdaa40c4f50 2024-09-12T02:57:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40ce9e0 0x7fdaa41545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40ce9e0 0x7fdaa41545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48132/0 (socket says 172.21.15.63:48132) 2024-09-12T02:57:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9aa00640 1 -- 172.21.15.63:0/1639328724 learned_addr learned my addr 172.21.15.63:0/1639328724 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaa3400640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa40c4f50 0x7fdaa40b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaa3e00640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdaa4152870 0x7fdaa4154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9aa00640 1 -- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa40c4f50 msgr2=0x7fdaa40b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9aa00640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa40c4f50 0x7fdaa40b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9aa00640 1 -- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdaa4152870 msgr2=0x7fdaa4154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9aa00640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdaa4152870 0x7fdaa4154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9aa00640 1 -- 172.21.15.63:0/1639328724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa40b36e0 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaa3400640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa40c4f50 0x7fdaa40b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaa3e00640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdaa4152870 0x7fdaa4154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9aa00640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40ce9e0 0x7fdaa41545b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c480 tx=0x7fda8c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9be00640 1 -- 172.21.15.63:0/1639328724 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c018070 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa4156070 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9be00640 1 -- 172.21.15.63:0/1639328724 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c007500 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fda9be00640 1 -- 172.21.15.63:0/1639328724 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c004a30 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa41f7180 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.029+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa40cc800 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.033+0000 7fda9be00640 1 -- 172.21.15.63:0/1639328724 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda8c004bd0 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.033+0000 7fda9be00640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda800678f0 0x7fda80069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.033+0000 7fda9be00640 1 -- 172.21.15.63:0/1639328724 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6706+0+0 (secure 0 0 0) 0x7fda8c085390 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.033+0000 7fdaa3400640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda800678f0 0x7fda80069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.033+0000 7fdaa3400640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda800678f0 0x7fda80069db0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fda94009b10 tx=0x7fda94008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.037+0000 7fda9be00640 1 -- 172.21.15.63:0/1639328724 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fda8c055b10 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.068 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:59.068 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:59.082 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:57:59.083 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:59.079+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:59.184 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:59.179+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:59.205 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:59.205 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:59.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.213+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 5, "weight": 1.0} v 0) -- 0x7fdaa406c3b0 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.219 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:57:59.284 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:57:59.285+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:57:59.360 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:57:59.385 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:59.385 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:59.386 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:57:59.383+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:57:59.400 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:57:59.489 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:59.487+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:59.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6e2600640 1 Processor -- start 2024-09-12T02:57:59.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6e2600640 1 -- start start 2024-09-12T02:57:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6e2600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe6dc1590b0 0x7fe6dc0c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6e2600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe6dc0c8f40 0x7fe6dc0c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6e2600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6dc0c6970 con 0x7fe6dc152640 2024-09-12T02:57:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6e2600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fe6dc071f60 con 0x7fe6dc0c8f40 2024-09-12T02:57:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6e2600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe6dc0c8160 con 0x7fe6dc1590b0 2024-09-12T02:57:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6db400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe6dc152640 0x7fe6dc071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35808/0 (socket says 172.21.15.63:35808) 2024-09-12T02:57:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6db400640 1 -- 172.21.15.63:0/4274600197 learned_addr learned my addr 172.21.15.63:0/4274600197 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:57:59.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/4274600197 >> v2:172.21.15.63:3300/0 conn(0x7fe6dc0c8f40 0x7fe6dc0c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6d3e00640 1 --2- 172.21.15.63:0/4274600197 >> v2:172.21.15.119:3300/0 conn(0x7fe6dc1590b0 0x7fe6dc0c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6daa00640 1 -- 172.21.15.63:0/4274600197 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398682670 0 0) 0x7fe6dc0c6970 con 0x7fe6dc152640 2024-09-12T02:57:59.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6daa00640 1 -- 172.21.15.63:0/4274600197 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6c0003530 con 0x7fe6dc152640 2024-09-12T02:57:59.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6dbe00640 1 -- 172.21.15.63:0/4274600197 >> v2:172.21.15.119:3300/0 conn(0x7fe6dc1590b0 msgr2=0x7fe6dc0c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:57:59.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/4274600197 >> v2:172.21.15.119:3300/0 conn(0x7fe6dc1590b0 0x7fe6dc0c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6dbe00640 1 -- 172.21.15.63:0/4274600197 >> v1:172.21.15.63:6789/0 conn(0x7fe6dc152640 legacy=0x7fe6dc071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.497+0000 7fe6dbe00640 1 -- 172.21.15.63:0/4274600197 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6dc159500 con 0x7fe6dc0c8f40 2024-09-12T02:57:59.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/4274600197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc0c8f40 0x7fe6dc0c9350 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc06ef30 tx=0x7fe6d401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3925f850f6e8cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6daa00640 1 -- 172.21.15.63:0/4274600197 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40b2070 con 0x7fe6dc0c8f40 2024-09-12T02:57:59.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6daa00640 1 -- 172.21.15.63:0/4274600197 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d40a58e0 con 0x7fe6dc0c8f40 2024-09-12T02:57:59.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6daa00640 1 -- 172.21.15.63:0/4274600197 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40a5c90 con 0x7fe6dc0c8f40 2024-09-12T02:57:59.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6e2600640 1 -- 172.21.15.63:0/4274600197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc0c8f40 msgr2=0x7fe6dc0c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6e2600640 1 --2- 172.21.15.63:0/4274600197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc0c8f40 0x7fe6dc0c9350 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc06ef30 tx=0x7fe6d401c930 comp rx=0 tx=0).stop 2024-09-12T02:57:59.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6e2600640 1 -- 172.21.15.63:0/4274600197 shutdown_connections 2024-09-12T02:57:59.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6e2600640 1 --2- 172.21.15.63:0/4274600197 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc0c8f40 0x7fe6dc0c9350 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6e2600640 1 --2- 172.21.15.63:0/4274600197 >> v2:172.21.15.119:3300/0 conn(0x7fe6dc1590b0 0x7fe6dc0c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6e2600640 1 -- 172.21.15.63:0/4274600197 >> 172.21.15.63:0/4274600197 conn(0x7fe6dc06f3d0 msgr2=0x7fe6dc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:59.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6e2600640 1 -- 172.21.15.63:0/4274600197 shutdown_connections 2024-09-12T02:57:59.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.501+0000 7fe6e2600640 1 -- 172.21.15.63:0/4274600197 wait complete. 2024-09-12T02:57:59.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 Processor -- start 2024-09-12T02:57:59.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 -- start start 2024-09-12T02:57:59.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0c8f40 0x7fe6dc1f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc152640 0x7fe6dc1f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6dc1590b0 0x7fe6dc150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe6dc074290 con 0x7fe6dc152640 2024-09-12T02:57:59.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe6dc0c7df0 con 0x7fe6dc0c8f40 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe6dc152a20 con 0x7fe6dc1590b0 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc152640 0x7fe6dc1f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc152640 0x7fe6dc1f4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48150/0 (socket says 172.21.15.63:48150) 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3e00640 1 -- 172.21.15.63:0/1829718944 learned_addr learned my addr 172.21.15.63:0/1829718944 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6db400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0c8f40 0x7fe6dc1f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6dc1590b0 0x7fe6dc150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3e00640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6dc1590b0 msgr2=0x7fe6dc150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3e00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6dc1590b0 0x7fe6dc150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3e00640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0c8f40 msgr2=0x7fe6dc1f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3e00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6dc0c8f40 0x7fe6dc1f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3e00640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6dc1f4f80 con 0x7fe6dc152640 2024-09-12T02:57:59.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3e00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc152640 0x7fe6dc1f4a40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400e870 tx=0x7fe6c400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4017070 con 0x7fe6dc152640 2024-09-12T02:57:59.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c400c940 con 0x7fe6dc152640 2024-09-12T02:57:59.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c400ccf0 con 0x7fe6dc152640 2024-09-12T02:57:59.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6dc15c4c0 con 0x7fe6dc152640 2024-09-12T02:57:59.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6dc159ff0 con 0x7fe6dc152640 2024-09-12T02:57:59.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.505+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fe6dc0c85d0 con 0x7fe6dc152640 2024-09-12T02:57:59.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6c401a070 con 0x7fe6dc152640 2024-09-12T02:57:59.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6d3400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6b80678c0 0x7fe6b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6706+0+0 (secure 0 0 0) 0x7fe6c4085ff0 con 0x7fe6dc152640 2024-09-12T02:57:59.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v36) ==== 54+0+16 (secure 0 0 0) 0x7fe6c4088590 con 0x7fe6dc152640 2024-09-12T02:57:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6db400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6b80678c0 0x7fe6b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe6dc151440 0x7fe6dc0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6dc15a700 con 0x7fe6dc151440 2024-09-12T02:57:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe6dc151440 0x7fe6dc0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6db400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6b80678c0 0x7fe6b8069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe6dc151440 0x7fe6dc0c4190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.509+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc15a700 con 0x7fe6dc151440 2024-09-12T02:57:59.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.525+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe6dc0c4d60 con 0x7fe6dc151440 2024-09-12T02:57:59.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.525+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe6dc0c4d60 con 0x7fe6dc151440 2024-09-12T02:57:59.530 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:57:59.530 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:57:59.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.525+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6dc15aad0 0x7fe6dc1ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.525+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fe6dc071c40 con 0x7fe6dc15aad0 2024-09-12T02:57:59.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.529+0000 7fe6db400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6dc15aad0 0x7fe6dc1ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.529+0000 7fe6db400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6dc15aad0 0x7fe6dc1ea9f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.529+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc071c40 con 0x7fe6dc15aad0 2024-09-12T02:57:59.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.541+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe6dc1eaf30 con 0x7fe6dc15aad0 2024-09-12T02:57:59.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.545+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe6dc1eaf30 con 0x7fe6dc15aad0 2024-09-12T02:57:59.547 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:57:59.547 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:57:59.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.545+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe6dc1489c0 0x7fe6dc148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.545+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fe6dc0c9d70 con 0x7fe6dc1489c0 2024-09-12T02:57:59.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.545+0000 7fe6d3e00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe6dc1489c0 0x7fe6dc148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.545+0000 7fe6d3e00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe6dc1489c0 0x7fe6dc148da0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.545+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc0c9d70 con 0x7fe6dc1489c0 2024-09-12T02:57:59.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.557+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe6dc0ca280 con 0x7fe6dc1489c0 2024-09-12T02:57:59.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.561+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe6dc0ca280 con 0x7fe6dc1489c0 2024-09-12T02:57:59.564 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:57:59.564 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:57:59.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.561+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe6dc0626e0 0x7fe6dc062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.561+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fe6dc063040 con 0x7fe6dc0626e0 2024-09-12T02:57:59.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.561+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe6dc0626e0 0x7fe6dc062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.561+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe6dc0626e0 0x7fe6dc062b00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.561+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc063040 con 0x7fe6dc0626e0 2024-09-12T02:57:59.567 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:57:59.567 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:57:59.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.577+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe6dc063040 con 0x7fe6dc0626e0 2024-09-12T02:57:59.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.577+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe6dc063040 con 0x7fe6dc0626e0 2024-09-12T02:57:59.580 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:57:59.580 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:57:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.577+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe6dc02cb60 0x7fe6dc02cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.577+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fe6dc063040 con 0x7fe6dc02cb60 2024-09-12T02:57:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.577+0000 7fe6db400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe6dc02cb60 0x7fe6dc02cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.577+0000 7fe6db400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe6dc02cb60 0x7fe6dc02cf80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.582 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T02:57:59.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.577+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc063040 con 0x7fe6dc02cb60 2024-09-12T02:57:59.587 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:59.585+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:59.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.593+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe6dc063040 con 0x7fe6dc02cb60 2024-09-12T02:57:59.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.593+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe6dc063040 con 0x7fe6dc02cb60 2024-09-12T02:57:59.598 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:57:59.598 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:57:59.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.593+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe6dc205610 0x7fe6dc207a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.593+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fe6dc0631b0 con 0x7fe6dc205610 2024-09-12T02:57:59.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.597+0000 7fe6d3e00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe6dc205610 0x7fe6dc207a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.597+0000 7fe6d3e00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe6dc205610 0x7fe6dc207a00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.597+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc0631b0 con 0x7fe6dc205610 2024-09-12T02:57:59.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.609+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe6dc0631b0 con 0x7fe6dc205610 2024-09-12T02:57:59.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.613+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe6dc0631b0 con 0x7fe6dc205610 2024-09-12T02:57:59.615 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:57:59.615 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:57:59.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.613+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe6dc208450 0x7fe6dc20a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.613+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fe6dc0634c0 con 0x7fe6dc208450 2024-09-12T02:57:59.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.613+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe6dc208450 0x7fe6dc20a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.613+0000 7fe6dbe00640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe6dc208450 0x7fe6dc20a840 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.613+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc0634c0 con 0x7fe6dc208450 2024-09-12T02:57:59.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.625+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe6dc0634c0 con 0x7fe6dc208450 2024-09-12T02:57:59.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.629+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe6dc0634c0 con 0x7fe6dc208450 2024-09-12T02:57:59.632 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:57:59.633 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:57:59.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.629+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe6dc20b290 0x7fe6dc20d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:57:59.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.629+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fe6dc210500 con 0x7fe6dc20b290 2024-09-12T02:57:59.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.629+0000 7fe6db400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe6dc20b290 0x7fe6dc20d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:57:59.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.629+0000 7fe6db400640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe6dc20b290 0x7fe6dc20d680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:57:59.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.633+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc210500 con 0x7fe6dc20b290 2024-09-12T02:57:59.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.645+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe6dc20de90 con 0x7fe6dc20b290 2024-09-12T02:57:59.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6d3400640 1 -- 172.21.15.63:0/1829718944 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe6dc20de90 con 0x7fe6dc20b290 2024-09-12T02:57:59.651 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:57:59.652 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:57:59.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe6dc151440 msgr2=0x7fe6dc0c4190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe6dc151440 0x7fe6dc0c4190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6dc15aad0 msgr2=0x7fe6dc1ea9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6dc15aad0 0x7fe6dc1ea9f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe6dc1489c0 msgr2=0x7fe6dc148da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe6dc1489c0 0x7fe6dc148da0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe6dc0626e0 msgr2=0x7fe6dc062b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe6dc0626e0 0x7fe6dc062b00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe6dc02cb60 msgr2=0x7fe6dc02cf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe6dc02cb60 0x7fe6dc02cf80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe6dc205610 msgr2=0x7fe6dc207a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe6dc205610 0x7fe6dc207a00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe6dc208450 msgr2=0x7fe6dc20a840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe6dc208450 0x7fe6dc20a840 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe6dc20b290 msgr2=0x7fe6dc20d680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe6dc20b290 0x7fe6dc20d680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6dbe00640 1 -- 172.21.15.63:0/1829718944 reap_dead start 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6dbe00640 1 -- 172.21.15.63:0/1829718944 reap_dead start 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6dbe00640 1 -- 172.21.15.63:0/1829718944 reap_dead start 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6dbe00640 1 -- 172.21.15.63:0/1829718944 reap_dead start 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6dbe00640 1 -- 172.21.15.63:0/1829718944 reap_dead start 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6b80678c0 msgr2=0x7fe6b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6b80678c0 0x7fe6b8069d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc009040 comp rx=0 tx=0).stop 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc152640 msgr2=0x7fe6dc1f4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc152640 0x7fe6dc1f4a40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400e870 tx=0x7fe6c400ec70 comp rx=0 tx=0).stop 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 shutdown_connections 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6b80678c0 0x7fe6b8069d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 --2- 172.21.15.63:0/1829718944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6dc152640 0x7fe6dc1f4a40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 >> 172.21.15.63:0/1829718944 conn(0x7fe6dc06f3d0 msgr2=0x7fe6dc074da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 shutdown_connections 2024-09-12T02:57:59.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.649+0000 7fe6e2600640 1 -- 172.21.15.63:0/1829718944 wait complete. 2024-09-12T02:57:59.687 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:57:59.683+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:57:59.749 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:59.749 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:57:59.750 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:57:59.750 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:57:59.750 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:59.763 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T02:57:59.810 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:57:59.807+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:57:59.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fda9be00640 1 -- 172.21.15.63:0/1639328724 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 5, "weight": 1.0}]=0 reweighted osd.5 to 1 (10000) v37) ==== 113+0+0 (secure 0 0 0) 0x7fda8c055410 con 0x7fdaa40ce9e0 2024-09-12T02:57:59.856 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T02:57:59.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda800678f0 msgr2=0x7fda80069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fdaaa600640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda800678f0 0x7fda80069db0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fda94009b10 tx=0x7fda94008040 comp rx=0 tx=0).stop 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40ce9e0 msgr2=0x7fdaa41545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fdaaa600640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40ce9e0 0x7fdaa41545b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c480 tx=0x7fda8c00c940 comp rx=0 tx=0).stop 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 shutdown_connections 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fdaaa600640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdaa4152870 0x7fdaa4154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fdaaa600640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdaa40ce9e0 0x7fdaa41545b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fdaaa600640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fda800678f0 0x7fda80069db0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.853+0000 7fdaaa600640 1 --2- 172.21.15.63:0/1639328724 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdaa40c4f50 0x7fdaa40b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.857+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 >> 172.21.15.63:0/1639328724 conn(0x7fdaa406bcc0 msgr2=0x7fdaa414d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.857+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 shutdown_connections 2024-09-12T02:57:59.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:57:59.857+0000 7fdaaa600640 1 -- 172.21.15.63:0/1639328724 wait complete. 2024-09-12T02:57:59.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-12T02:57:59.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T02:57:59.927 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:57:59.925+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:57:59.937 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:57:59.937 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:57:59.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:57:59.938 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:57:59.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.938 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:59.938 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:57:59.938 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.083140909000001, 2024-09-12T02:57:59.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00551893, 2024-09-12T02:57:59.938 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:59.938 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853808+0000", 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4959999999999999e-06 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853827+0000", 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8675999999999999e-05 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:59.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853869+0000", 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2347e-05 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853889+0000", 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0248999999999999e-05 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854115+0000", 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022562600000000001 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854168+0000", 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3476000000000001e-05 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859207+0000", 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050389550000000003 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859324+0000", 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117105 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.942 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.081938170999997, 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077810020000000004, 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:59.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855011+0000", 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3259999999999998e-06 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:59.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855026+0000", 2024-09-12T02:57:59.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5023e-05 2024-09-12T02:57:59.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855055+0000", 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9298e-05 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0525000000000001e-05 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855570+0000", 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000494539 2024-09-12T02:57:59.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855624+0000", 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3656999999999998e-05 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862687+0000", 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007063593 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862789+0000", 2024-09-12T02:57:59.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010204099999999999 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.081816562, 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077503839999999999, 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:59.948 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855131+0000", 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5230000000000001e-06 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855143+0000", 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1412e-05 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0043000000000001e-05 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855176+0000", 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3429e-05 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856069+0000", 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00089251 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856116+0000", 2024-09-12T02:57:59.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6826999999999997e-05 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862797+0000", 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066810050000000003 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862880+0000", 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3634999999999995e-05 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:59.952 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.080711278000003, 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065292639999999999, 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856237+0000", 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.103e-06 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856252+0000", 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4813e-05 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856279+0000", 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7254e-05 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856297+0000", 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7929000000000001e-05 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856462+0000", 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016488700000000001 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856508+0000", 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5787000000000001e-05 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862657+0000", 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061494210000000004 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862764+0000", 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010707 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.079964011999998, 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005857943, 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:57:59.957 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856984+0000", 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3799999999999999e-06 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856997+0000", 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2896e-05 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857022+0000", 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5554999999999998e-05 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857043+0000", 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0919000000000001e-05 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857162+0000", 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118526 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857225+0000", 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3578999999999996e-05 2024-09-12T02:57:59.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862772+0000", 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055470789999999999 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862840+0000", 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8009000000000006e-05 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:57:59.961 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:57:59.962 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:57:59.963 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:00.009 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:00.007+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8d1600640 1 Processor -- start 2024-09-12T02:58:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8d1600640 1 -- start start 2024-09-12T02:58:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8d1600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8cc157fc0 0x7fa8cc06d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8d1600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8cc15b450 con 0x7fa8cc0c9690 2024-09-12T02:58:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8d1600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8cc1583a0 con 0x7fa8cc0c0f90 2024-09-12T02:58:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8d1600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa8cc06cec0 con 0x7fa8cc157fc0 2024-09-12T02:58:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8c3e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa8cc0c9690 0x7fa8cc0c1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35818/0 (socket says 172.21.15.63:35818) 2024-09-12T02:58:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8c3e00640 1 -- 172.21.15.63:0/457871794 learned_addr learned my addr 172.21.15.63:0/457871794 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8caa00640 1 --2- 172.21.15.63:0/457871794 >> v2:172.21.15.119:3300/0 conn(0x7fa8cc157fc0 0x7fa8cc06d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7f0fca400640 1 Processor -- start 2024-09-12T02:58:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7f0fca400640 1 -- start start 2024-09-12T02:58:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8ca000640 1 -- 172.21.15.63:0/457871794 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706663479 0 0) 0x7fa8cc15b450 con 0x7fa8cc0c9690 2024-09-12T02:58:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8ca000640 1 -- 172.21.15.63:0/457871794 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8b0003530 con 0x7fa8cc0c9690 2024-09-12T02:58:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8caa00640 1 -- 172.21.15.63:0/457871794 >> v1:172.21.15.119:6789/0 conn(0x7fa8cc0c0f90 legacy=0x7fa8cc1651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8caa00640 1 -- 172.21.15.63:0/457871794 >> v1:172.21.15.63:6789/0 conn(0x7fa8cc0c9690 legacy=0x7fa8cc0c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.021+0000 7fa8caa00640 1 -- 172.21.15.63:0/457871794 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8cc0c6aa0 con 0x7fa8cc157fc0 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fca400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0fc4157fc0 0x7f0fc40cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fca400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0fc40cc7a0 0x7f0fc40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fca400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc40cd110 con 0x7f0fc406ebb0 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fca400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc406d270 con 0x7f0fc4157fc0 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fca400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc40cd8b0 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fc3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0fc4157fc0 0x7f0fc40cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fc2a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0fc406ebb0 0x7f0fc406fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:38132/0 (socket says 172.21.15.63:38132) 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fc2a00640 1 -- 172.21.15.63:0/1573465405 learned_addr learned my addr 172.21.15.63:0/1573465405 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fc3e00640 1 --2- 172.21.15.63:0/1573465405 >> v2:172.21.15.119:3300/0 conn(0x7f0fc40cc7a0 0x7f0fc40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fc3400640 1 -- 172.21.15.63:0/1573465405 >> v2:172.21.15.119:3300/0 conn(0x7f0fc40cc7a0 msgr2=0x7f0fc40ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fc3400640 1 --2- 172.21.15.63:0/1573465405 >> v2:172.21.15.119:3300/0 conn(0x7f0fc40cc7a0 0x7f0fc40ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fc3400640 1 -- 172.21.15.63:0/1573465405 >> v1:172.21.15.119:6789/0 conn(0x7f0fc406ebb0 legacy=0x7f0fc406fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7f0fc3400640 1 -- 172.21.15.63:0/1573465405 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc40cdb90 con 0x7f0fc4157fc0 2024-09-12T02:58:00.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8caa00640 1 --2- 172.21.15.63:0/457871794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8cc157fc0 0x7fa8cc06d630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0097c0 tx=0x7fa8bc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b532d32562e428e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8ca000640 1 -- 172.21.15.63:0/457871794 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0aa600 con 0x7fa8cc157fc0 2024-09-12T02:58:00.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8ca000640 1 -- 172.21.15.63:0/457871794 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0af070 con 0x7fa8cc157fc0 2024-09-12T02:58:00.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8ca000640 1 -- 172.21.15.63:0/457871794 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0aa9a0 con 0x7fa8cc157fc0 2024-09-12T02:58:00.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8d1600640 1 -- 172.21.15.63:0/457871794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8cc157fc0 msgr2=0x7fa8cc06d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8d1600640 1 --2- 172.21.15.63:0/457871794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8cc157fc0 0x7fa8cc06d630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0097c0 tx=0x7fa8bc01c4a0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8d1600640 1 -- 172.21.15.63:0/457871794 shutdown_connections 2024-09-12T02:58:00.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8d1600640 1 --2- 172.21.15.63:0/457871794 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8cc157fc0 0x7fa8cc06d630 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8d1600640 1 -- 172.21.15.63:0/457871794 >> 172.21.15.63:0/457871794 conn(0x7fa8cc06f3d0 msgr2=0x7fa8cc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:00.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.025+0000 7fa8d1600640 1 -- 172.21.15.63:0/457871794 shutdown_connections 2024-09-12T02:58:00.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8d1600640 1 -- 172.21.15.63:0/457871794 wait complete. 2024-09-12T02:58:00.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8d1600640 1 Processor -- start 2024-09-12T02:58:00.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8d1600640 1 -- start start 2024-09-12T02:58:00.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fc3400640 1 --2- 172.21.15.63:0/1573465405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc4157fc0 0x7f0fc40cbf00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0fc415baa0 tx=0x7f0fb401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1500a401e61cc5c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8d1600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8cc0c0f90 0x7fa8cc150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8d1600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8cc0c9690 0x7fa8cc1f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8d1600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8cc157fc0 0x7fa8cc0c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8d1600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc0c21a0 con 0x7fa8cc0c9690 2024-09-12T02:58:00.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8d1600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa8cc0c2020 con 0x7fa8cc157fc0 2024-09-12T02:58:00.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8d1600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa8cc169110 con 0x7fa8cc0c0f90 2024-09-12T02:58:00.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fc2000640 1 -- 172.21.15.63:0/1573465405 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40a66f0 con 0x7f0fc4157fc0 2024-09-12T02:58:00.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fc2000640 1 -- 172.21.15.63:0/1573465405 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb40a6890 con 0x7f0fc4157fc0 2024-09-12T02:58:00.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8cc0c9690 0x7fa8cc1f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fc2000640 1 -- 172.21.15.63:0/1573465405 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40a6c60 con 0x7f0fc4157fc0 2024-09-12T02:58:00.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8cc0c9690 0x7fa8cc1f78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48168/0 (socket says 172.21.15.63:48168) 2024-09-12T02:58:00.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8c3e00640 1 -- 172.21.15.63:0/1827322559 learned_addr learned my addr 172.21.15.63:0/1827322559 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:00.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8caa00640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8cc0c0f90 0x7fa8cc150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8cb400640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8cc157fc0 0x7fa8cc0c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8c3e00640 1 -- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8cc0c0f90 msgr2=0x7fa8cc150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8c3e00640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8cc0c0f90 0x7fa8cc150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8c3e00640 1 -- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8cc157fc0 msgr2=0x7fa8cc0c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8c3e00640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8cc157fc0 0x7fa8cc0c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8c3e00640 1 -- 172.21.15.63:0/1827322559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8cc157600 con 0x7fa8cc0c9690 2024-09-12T02:58:00.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fca400640 1 -- 172.21.15.63:0/1573465405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc4157fc0 msgr2=0x7f0fc40cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fca400640 1 --2- 172.21.15.63:0/1573465405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc4157fc0 0x7f0fc40cbf00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0fc415baa0 tx=0x7f0fb401c930 comp rx=0 tx=0).stop 2024-09-12T02:58:00.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fca400640 1 -- 172.21.15.63:0/1573465405 shutdown_connections 2024-09-12T02:58:00.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fca400640 1 --2- 172.21.15.63:0/1573465405 >> v2:172.21.15.119:3300/0 conn(0x7f0fc40cc7a0 0x7f0fc40ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fca400640 1 --2- 172.21.15.63:0/1573465405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc4157fc0 0x7f0fc40cbf00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fca400640 1 -- 172.21.15.63:0/1573465405 >> 172.21.15.63:0/1573465405 conn(0x7f0fc406bcc0 msgr2=0x7f0fc406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:00.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7fa8c3e00640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8cc0c9690 0x7fa8cc1f78d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400c450 tx=0x7fa8b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.029+0000 7f0fca400640 1 -- 172.21.15.63:0/1573465405 shutdown_connections 2024-09-12T02:58:00.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fca400640 1 -- 172.21.15.63:0/1573465405 wait complete. 2024-09-12T02:58:00.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7fa8c2a00640 1 -- 172.21.15.63:0/1827322559 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4017070 con 0x7fa8cc0c9690 2024-09-12T02:58:00.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7fa8c2a00640 1 -- 172.21.15.63:0/1827322559 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b4005cf0 con 0x7fa8cc0c9690 2024-09-12T02:58:00.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8cc1f83f0 con 0x7fa8cc0c9690 2024-09-12T02:58:00.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7fa8c2a00640 1 -- 172.21.15.63:0/1827322559 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4007270 con 0x7fa8cc0c9690 2024-09-12T02:58:00.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8cc0c8420 con 0x7fa8cc0c9690 2024-09-12T02:58:00.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8cc06d630 con 0x7fa8cc0c9690 2024-09-12T02:58:00.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fca400640 1 Processor -- start 2024-09-12T02:58:00.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fca400640 1 -- start start 2024-09-12T02:58:00.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fca400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0fc406ebb0 0x7f0fc414b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fca400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc40cc7a0 0x7f0fc41593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fca400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc4157fc0 0x7f0fc41f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fca400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc40c5300 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fca400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc40c5180 con 0x7f0fc4157fc0 2024-09-12T02:58:00.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fca400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc40702b0 con 0x7f0fc406ebb0 2024-09-12T02:58:00.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc40cc7a0 0x7f0fc41593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc3400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0fc406ebb0 0x7f0fc414b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc4157fc0 0x7f0fc41f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc40cc7a0 0x7f0fc41593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48182/0 (socket says 172.21.15.63:48182) 2024-09-12T02:58:00.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc3400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0fc406ebb0 0x7f0fc414b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:38242/0 (socket says 172.21.15.63:38242) 2024-09-12T02:58:00.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc2a00640 1 -- 172.21.15.63:0/39784700 learned_addr learned my addr 172.21.15.63:0/39784700 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:00.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7fa8c2a00640 1 -- 172.21.15.63:0/1827322559 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa8b401a070 con 0x7fa8cc0c9690 2024-09-12T02:58:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc2a00640 1 -- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0fc406ebb0 msgr2=0x7f0fc414b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc2a00640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0fc406ebb0 0x7f0fc414b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc2a00640 1 -- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc4157fc0 msgr2=0x7f0fc41f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc2a00640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc4157fc0 0x7f0fc41f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc2a00640 1 -- 172.21.15.63:0/39784700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc41586c0 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.033+0000 7f0fc2a00640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc40cc7a0 0x7f0fc41593a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00c450 tx=0x7f0fac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.037+0000 7fa8c2a00640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a80678c0 0x7fa8a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.037+0000 7fa8c2a00640 1 -- 172.21.15.63:0/1827322559 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6706+0+0 (secure 0 0 0) 0x7fa8b4085270 con 0x7fa8cc0c9690 2024-09-12T02:58:00.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.037+0000 7fa8caa00640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a80678c0 0x7fa8a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.037+0000 7fa8caa00640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a80678c0 0x7fa8a8069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0ae000 tx=0x7fa8bc0b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fbb400640 1 -- 172.21.15.63:0/39784700 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac017070 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fbb400640 1 -- 172.21.15.63:0/39784700 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac005cf0 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc415a0b0 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fbb400640 1 -- 172.21.15.63:0/39784700 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac007290 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc415a670 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7fa8c2a00640 1 -- 172.21.15.63:0/1827322559 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa8b4055360 con 0x7fa8cc0c9690 2024-09-12T02:58:00.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc40ccbd0 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fbb400640 1 -- 172.21.15.63:0/39784700 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0fac01a070 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fbb400640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0fa00678f0 0x7f0fa0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:00.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fbb400640 1 -- 172.21.15.63:0/39784700 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6706+0+0 (secure 0 0 0) 0x7f0fac0852d0 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.041+0000 7f0fc3400640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0fa00678f0 0x7f0fa0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:00.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.045+0000 7f0fc3400640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0fa00678f0 0x7f0fa0069db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40af000 tx=0x7f0fb40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:00.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.053+0000 7f0fbb400640 1 -- 172.21.15.63:0/39784700 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0fac055440 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.089 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:00.089 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:00.089 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:00.090 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:00.091 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:00.087+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:00.103 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:00.191 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:00.187+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:00.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.221+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7fa8cc15a8d0 con 0x7fa8cc0c9690 2024-09-12T02:58:00.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.233+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 6, "weight": 1.0} v 0) -- 0x7f0fc40cc220 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.272 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:00.272 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:00.272 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:00.272 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:00.272 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:00.287 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:00.329 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:00.327+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:00.394 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:00.391+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:00.451 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:00.451 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:00.451 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.595484956999996, 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:00.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:00.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.457 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.595351749000002, 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:00.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.463 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.595246998999997, 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:00.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:00.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.595101180999997, 2024-09-12T02:58:00.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:00.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:00.473 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.474 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.595027999000003, 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.475 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:00.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:00.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.480 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.594968012999999, 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:00.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:00.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.594905666999999, 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.490 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.594848151000001, 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.592680526000002, 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.495 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:00.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:00.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.499 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.589522011, 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:00.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:00.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:00.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:00.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.504 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing_reply(2.14 epoch 25/19 rep_tid 7 lcod 25'5)", 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.583061065999999, 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010494969999999999, 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864695+0000", 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7300000000000001e-07 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864699+0000", 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.33e-06 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864715+0000", 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6116e-05 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864727+0000", 2024-09-12T02:58:00.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1759e-05 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865572+0000", 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00084520699999999995 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865744+0000", 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000171612 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.508 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.581813138000001, 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:00.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.511 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:00.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.562924187, 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:00.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 39.834522380999999, 2024-09-12T02:58:00.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:00.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:00.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 38.078685798999999, 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:00.525 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:00.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:00.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:00.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:00.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:00.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 37.196596835000001, 2024-09-12T02:58:00.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:00.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:00.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:00.537 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 15.512639222000001, 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:00.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:00.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:00.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:00.543 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:00.544 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 15.512533931, 2024-09-12T02:58:00.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:00.544 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.544 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.544 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.544 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:00.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.549 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.819970781, 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:00.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:46 2.6 e28/19 2:654134d2:::mds0_openfiles.0:head v 28'2, mlcod=0'0)", 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:00.555 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 12.559776884, 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015286869999999999, 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:00.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887979+0000", 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4000000000000002e-07 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887986+0000", 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1999999999999997e-06 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888007+0000", 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1075999999999999e-05 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888022+0000", 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5316e-05 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888142+0000", 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011911100000000001 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888187+0000", 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5225000000000002e-05 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889432+0000", 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012450709999999999 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889507+0000", 2024-09-12T02:58:00.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5148000000000006e-05 2024-09-12T02:58:00.560 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.560 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.560 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.560 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:00.560 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:00.560 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:00.561 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:00.562 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:00.559+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:00.662 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:00.659+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:00.731 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:00.732 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:00.732 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:00.732 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:00.746 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:00.763 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:00.761+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:00.864 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:00.859+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:00.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8c2a00640 1 -- 172.21.15.63:0/1827322559 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v38) ==== 87+0+0 (secure 0 0 0) 0x7fa8b4059660 con 0x7fa8cc0c9690 2024-09-12T02:58:00.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fbb400640 1 -- 172.21.15.63:0/39784700 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 6, "weight": 1.0}]=0 reweighted osd.6 to 1 (10000) v38) ==== 113+0+0 (secure 0 0 0) 0x7f0fac059740 con 0x7f0fc40cc7a0 2024-09-12T02:58:00.872 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-12T02:58:00.872 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.6 to 1 (10000) 2024-09-12T02:58:00.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a80678c0 msgr2=0x7fa8a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a80678c0 0x7fa8a8069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0ae000 tx=0x7fa8bc0b5040 comp rx=0 tx=0).stop 2024-09-12T02:58:00.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0fa00678f0 msgr2=0x7f0fa0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0fa00678f0 0x7f0fa0069db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40af000 tx=0x7f0fb40a7000 comp rx=0 tx=0).stop 2024-09-12T02:58:00.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8cc0c9690 msgr2=0x7fa8cc1f78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8cc0c9690 0x7fa8cc1f78d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400c450 tx=0x7fa8b400c910 comp rx=0 tx=0).stop 2024-09-12T02:58:00.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc40cc7a0 msgr2=0x7f0fc41593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:00.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc40cc7a0 0x7f0fc41593a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00c450 tx=0x7f0fac00c910 comp rx=0 tx=0).stop 2024-09-12T02:58:00.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 shutdown_connections 2024-09-12T02:58:00.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8cc157fc0 0x7fa8cc0c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8cc0c9690 0x7fa8cc1f78d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a80678c0 0x7fa8a8069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 --2- 172.21.15.63:0/1827322559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8cc0c0f90 0x7fa8cc150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 >> 172.21.15.63:0/1827322559 conn(0x7fa8cc06f3d0 msgr2=0x7fa8cc165f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:00.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 shutdown_connections 2024-09-12T02:58:00.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0fc4157fc0 0x7f0fc41f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0fc40cc7a0 0x7f0fc41593a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0fa00678f0 0x7f0fa0069db0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 shutdown_connections 2024-09-12T02:58:00.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 --2- 172.21.15.63:0/39784700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0fc406ebb0 0x7f0fc414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:00.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 >> 172.21.15.63:0/39784700 conn(0x7f0fc406bcc0 msgr2=0x7f0fc40ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:00.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 shutdown_connections 2024-09-12T02:58:00.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.869+0000 7f0fca400640 1 -- 172.21.15.63:0/39784700 wait complete. 2024-09-12T02:58:00.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:00.873+0000 7fa8d1600640 1 -- 172.21.15.63:0/1827322559 wait complete. 2024-09-12T02:58:00.908 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-12T02:58:00.912 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:00.912 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:00.912 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:00.913 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:00.913 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:00.925 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:00.965 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:00.963+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:01.066 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:01.063+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:01.092 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:01.092 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:01.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:01.092 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:01.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.092 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.092 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.341504447000005, 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.093 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:01.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:01.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.098 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:01.099 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.198309108999993, 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.100 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:01.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.198288582999993, 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.106 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:01.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.112 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.113 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:01.113 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.198177770000001, 2024-09-12T02:58:01.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:01.113 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.113 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.113 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.113 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.113 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.113 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.198156244000003, 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:01.121 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:01.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:01.125 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.133169597999995, 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:01.126 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:01.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:01.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.131 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.132 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:01.132 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.911066074999994, 2024-09-12T02:58:01.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:01.132 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.132 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.132 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.132 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.132 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:01.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:01.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.910929084000003, 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.138 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:01.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:01.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:01.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.909811882, 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.144 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:01.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:01.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:01.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:01.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.909739768999998, 2024-09-12T02:58:01.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:01.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:01.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:01.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.156 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.909515784999996, 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.157 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:01.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.161 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:01.162 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.909445801999993, 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.163 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:01.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:01.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.909340165000003, 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.169 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:01.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:01.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:01.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:01.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.175 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.909150068000002, 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:01.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:01.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:01.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:01.181 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.909083280999994, 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.182 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:01.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:01.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.333733683999995, 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.188 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:01.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:01.193 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 51.235034249999998, 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:01.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:01.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:01.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:01.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 51.234949008000001, 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:01.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:01.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.205 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 51.234811894000003, 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:01.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:01.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 51.234641994999997, 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:01.211 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:01.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:01.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:01.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:01.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:01.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:01.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:01.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:01.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:01.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:01.215 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.215 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.216 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.216 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:01.216 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:01.217 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:01.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:01.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f6e00640 1 Processor -- start 2024-09-12T02:58:01.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f6e00640 1 -- start start 2024-09-12T02:58:01.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f6e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe2f0154a60 0x7fe2f015e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f6e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0073290 0x7fe2f015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f6e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f00c7520 con 0x7fe2f00c8c70 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f6e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f00c78f0 con 0x7fe2f0154a60 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f6e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f00c7bd0 con 0x7fe2f0073290 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f5000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe2f00c8c70 0x7fe2f006bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35824/0 (socket says 172.21.15.63:35824) 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f5000640 1 -- 172.21.15.63:0/1893402621 learned_addr learned my addr 172.21.15.63:0/1893402621 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f6400640 1 --2- 172.21.15.63:0/1893402621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0073290 0x7fe2f015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.089+0000 7fe2f5a00640 1 --2- 172.21.15.63:0/1893402621 >> v2:172.21.15.119:3300/0 conn(0x7fe2f0154a60 0x7fe2f015e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2efe00640 1 -- 172.21.15.63:0/1893402621 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529300870 0 0) 0x7fe2f00c7520 con 0x7fe2f00c8c70 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2efe00640 1 -- 172.21.15.63:0/1893402621 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2d8003530 con 0x7fe2f00c8c70 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2f6400640 1 -- 172.21.15.63:0/1893402621 >> v2:172.21.15.119:3300/0 conn(0x7fe2f0154a60 msgr2=0x7fe2f015e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2f6400640 1 --2- 172.21.15.63:0/1893402621 >> v2:172.21.15.119:3300/0 conn(0x7fe2f0154a60 0x7fe2f015e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2f6400640 1 -- 172.21.15.63:0/1893402621 >> v1:172.21.15.63:6789/0 conn(0x7fe2f00c8c70 legacy=0x7fe2f006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2f6400640 1 -- 172.21.15.63:0/1893402621 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f00c7eb0 con 0x7fe2f0073290 2024-09-12T02:58:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2f6400640 1 --2- 172.21.15.63:0/1893402621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0073290 0x7fe2f015de00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009d90 tx=0x7fe2e801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a1157c2e8f4354 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2efe00640 1 -- 172.21.15.63:0/1893402621 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e80b4070 con 0x7fe2f0073290 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2efe00640 1 -- 172.21.15.63:0/1893402621 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e80af600 con 0x7fe2f0073290 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.093+0000 7fe2efe00640 1 -- 172.21.15.63:0/1893402621 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e80af9b0 con 0x7fe2f0073290 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 -- 172.21.15.63:0/1893402621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0073290 msgr2=0x7fe2f015de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 --2- 172.21.15.63:0/1893402621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0073290 0x7fe2f015de00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009d90 tx=0x7fe2e801f150 comp rx=0 tx=0).stop 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 -- 172.21.15.63:0/1893402621 shutdown_connections 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 --2- 172.21.15.63:0/1893402621 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0073290 0x7fe2f015de00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 --2- 172.21.15.63:0/1893402621 >> v2:172.21.15.119:3300/0 conn(0x7fe2f0154a60 0x7fe2f015e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 -- 172.21.15.63:0/1893402621 >> 172.21.15.63:0/1893402621 conn(0x7fe2f00c91d0 msgr2=0x7fe2f00c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 -- 172.21.15.63:0/1893402621 shutdown_connections 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 -- 172.21.15.63:0/1893402621 wait complete. 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 Processor -- start 2024-09-12T02:58:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 -- start start 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f0073290 0x7fe2f01489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f00c8c70 0x7fe2f01480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0154a60 0x7fe2f014a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f0154e40 con 0x7fe2f0073290 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f00c8470 con 0x7fe2f00c8c70 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f0073700 con 0x7fe2f0154a60 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f0073290 0x7fe2f01489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f0073290 0x7fe2f01489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48188/0 (socket says 172.21.15.63:48188) 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5a00640 1 -- 172.21.15.63:0/2044390378 learned_addr learned my addr 172.21.15.63:0/2044390378 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5000640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f00c8c70 0x7fe2f01480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f6400640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0154a60 0x7fe2f014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5a00640 1 -- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0154a60 msgr2=0x7fe2f014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5a00640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0154a60 0x7fe2f014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5a00640 1 -- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f00c8c70 msgr2=0x7fe2f01480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5a00640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f00c8c70 0x7fe2f01480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5a00640 1 -- 172.21.15.63:0/2044390378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f01571a0 con 0x7fe2f0073290 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5000640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f00c8c70 0x7fe2f01480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2f5a00640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f0073290 0x7fe2f01489e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400e8a0 tx=0x7fe2e400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.097+0000 7fe2ed600640 1 -- 172.21.15.63:0/2044390378 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4017070 con 0x7fe2f0073290 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2ed600640 1 -- 172.21.15.63:0/2044390378 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e400c940 con 0x7fe2f0073290 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f0156ec0 con 0x7fe2f0073290 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2ed600640 1 -- 172.21.15.63:0/2044390378 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400ccf0 con 0x7fe2f0073290 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f0146170 con 0x7fe2f0073290 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f015e970 con 0x7fe2f0073290 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2ed600640 1 -- 172.21.15.63:0/2044390378 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe2e401a070 con 0x7fe2f0073290 2024-09-12T02:58:01.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2ed600640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2d00678f0 0x7fe2d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2ed600640 1 -- 172.21.15.63:0/2044390378 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6706+0+0 (secure 0 0 0) 0x7fe2e40862c0 con 0x7fe2f0073290 2024-09-12T02:58:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2f5000640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2d00678f0 0x7fe2d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.101+0000 7fe2f5000640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2d00678f0 0x7fe2d0069db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00c6d40 tx=0x7fe2dc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.105+0000 7fe2ed600640 1 -- 172.21.15.63:0/2044390378 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe2e4056a00 con 0x7fe2f0073290 2024-09-12T02:58:01.228 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:01.213+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:01.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.285+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 7, "weight": 1.0} v 0) -- 0x7fe2f0072450 con 0x7fe2f0073290 2024-09-12T02:58:01.319 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:01.315+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:01.374 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:01.374 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:01.374 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:01.374 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:01.389 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:01.434 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:01.433+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:01.522 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:01.519+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:01.533 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:01.534 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:01.534 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:01.534 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:01.534 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:01.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:01.638 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:01.637+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:01.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:01.725 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:01.721+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:01.740 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:01.740 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:01.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'39)", 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.783633429000005, 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047813200000000004, 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:01.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955738+0000", 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3099999999999998e-07 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955742+0000", 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955753+0000", 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1321000000000001e-05 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955759+0000", 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1070000000000001e-06 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955810+0000", 2024-09-12T02:58:01.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0711000000000003e-05 2024-09-12T02:58:01.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955823+0000", 2024-09-12T02:58:01.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2605999999999999e-05 2024-09-12T02:58:01.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960475+0000", 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004652354 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960518+0000", 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3316999999999999e-05 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'39)", 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.782110634000006, 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039674089999999999, 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957261+0000", 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8400000000000004e-07 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957334+0000", 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3613000000000001e-05 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957347+0000", 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3349e-05 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957353+0000", 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1089999999999997e-06 2024-09-12T02:58:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957405+0000", 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2206000000000001e-05 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957427+0000", 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2155999999999999e-05 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961190+0000", 2024-09-12T02:58:01.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037629849999999999 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961227+0000", 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7307e-05 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:01.750 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.779865595999993, 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004389858, 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959506+0000", 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8599999999999998e-07 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959510+0000", 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7339999999999999e-06 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959523+0000", 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2773e-05 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959528+0000", 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9740000000000001e-06 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960547+0000", 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010187359999999999 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960560+0000", 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3223e-05 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963855+0000", 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032949910000000002 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963895+0000", 2024-09-12T02:58:01.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9740999999999998e-05 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.772312843999998, 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021753509999999998, 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.755 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6599999999999996e-07 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967141+0000", 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2319999999999998e-05 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967152+0000", 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1432e-05 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967158+0000", 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8019999999999997e-06 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967207+0000", 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9075e-05 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967224+0000", 2024-09-12T02:58:01.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7427000000000001e-05 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969194+0000", 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019695590000000001 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969233+0000", 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9169999999999999e-05 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.759 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.770914660000003, 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003562614, 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:01.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7899999999999998e-07 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968495+0000", 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8025000000000003e-05 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968507+0000", 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2758999999999999e-05 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968513+0000", 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3009999999999997e-06 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968585+0000", 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2139999999999997e-05 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968599+0000", 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4752999999999999e-05 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.971980+0000", 2024-09-12T02:58:01.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033801059999999999 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972018+0000", 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8850999999999998e-05 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:74 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'48, mlcod=17'44)", 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:01.764 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.769244705999995, 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022444370000000002, 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7100000000000001e-07 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970131+0000", 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4850000000000003e-06 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970144+0000", 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2595999999999999e-05 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970149+0000", 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.395e-06 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970209+0000", 2024-09-12T02:58:01.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9905999999999999e-05 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970225+0000", 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6177000000000001e-05 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972340+0000", 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002114917 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.768 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972370+0000", 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.029e-05 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:83 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'50)", 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.75326373, 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002809059, 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.769 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.770 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6000000000000004e-07 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986112+0000", 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8019999999999999e-06 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986123+0000", 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0953e-05 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.771 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986128+0000", 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7849999999999999e-06 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986166+0000", 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7923000000000003e-05 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.772 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986180+0000", 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4211e-05 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988884+0000", 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027039640000000001 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988916+0000", 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1860999999999999e-05 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.773 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:84 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'50)", 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.752266918000004, 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002347909, 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.774 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8899999999999999e-07 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.775 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987155+0000", 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0776000000000003e-05 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987167+0000", 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2215000000000001e-05 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987172+0000", 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.04e-06 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987232+0000", 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9595000000000001e-05 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987246+0000", 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3757000000000001e-05 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989417+0000", 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021715329999999998 2024-09-12T02:58:01.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989451+0000", 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4304000000000002e-05 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:90 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'60, mlcod=17'57)", 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.743731014999994, 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027093489999999998, 2024-09-12T02:58:01.778 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.779 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995640+0000", 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9699999999999995e-07 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995794+0000", 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015367199999999999 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995805+0000", 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1061e-05 2024-09-12T02:58:01.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995810+0000", 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4589999999999997e-06 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995856+0000", 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6127000000000001e-05 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.781 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995870+0000", 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3854e-05 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998315+0000", 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024450930000000002 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998349+0000", 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3386000000000002e-05 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:105 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'67, mlcod=17'64)", 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.561455897000002, 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026337050000000001, 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.783 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4300000000000003e-07 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.784 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177930+0000", 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4735999999999999e-05 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177942+0000", 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2349e-05 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177949+0000", 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6599999999999998e-06 2024-09-12T02:58:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178003+0000", 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3535999999999997e-05 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178018+0000", 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5227e-05 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.786 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180517+0000", 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024996419999999998 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180548+0000", 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0911999999999998e-05 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:158 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'112, mlcod=18'109)", 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:01.787 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.284216911000001, 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026267230000000001, 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.58e-07 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455235+0000", 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1242000000000006e-05 2024-09-12T02:58:01.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455245+0000", 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.995e-06 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455250+0000", 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7079999999999996e-06 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455297+0000", 2024-09-12T02:58:01.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6885000000000003e-05 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455311+0000", 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4354e-05 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457734+0000", 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024232540000000001 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.791 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457780+0000", 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5827e-05 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:159 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'113, mlcod=18'109)", 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 64.283495923000004, 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046885809999999998, 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.792 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5300000000000004e-07 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455879+0000", 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8650000000000003e-06 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455889+0000", 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0139999999999999e-05 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455894+0000", 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2959999999999998e-06 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455944+0000", 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9774999999999997e-05 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455962+0000", 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8009999999999999e-05 2024-09-12T02:58:01.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460534+0000", 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045721299999999998 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460563+0000", 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8812000000000001e-05 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:4 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.887347568000003, 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073449359999999998, 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852025+0000", 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2280000000000001e-06 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852034+0000", 2024-09-12T02:58:01.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1619999999999997e-06 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852060+0000", 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5714000000000001e-05 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852073+0000", 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3199e-05 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852384+0000", 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031071499999999998 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852627+0000", 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024345000000000001 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852778+0000", 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015093999999999999 2024-09-12T02:58:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857277+0000", 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044991120000000004 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859269+0000", 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019915879999999999 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3817999999999999e-05 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859368+0000", 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5009999999999998e-05 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:01.802 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.887256159000003, 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012795443, 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852115+0000", 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.54e-07 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852120+0000", 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2299999999999999e-06 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852132+0000", 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1746000000000001e-05 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852140+0000", 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2300000000000008e-06 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854507+0000", 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023667369999999998 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854587+0000", 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0024000000000005e-05 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854730+0000", 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014253599999999999 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859376+0000", 2024-09-12T02:58:01.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046468200000000003 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864800+0000", 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054233670000000001 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864864+0000", 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4397e-05 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864910+0000", 2024-09-12T02:58:01.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5602000000000001e-05 2024-09-12T02:58:01.808 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.808 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.808 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.808 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:28 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.808 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.887197911000001, 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011320167000000001, 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1600000000000001e-07 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852188+0000", 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.506e-05 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852199+0000", 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0677e-05 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852206+0000", 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8279999999999997e-06 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852418+0000", 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021227799999999999 2024-09-12T02:58:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852545+0000", 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012638499999999999 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852774+0000", 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0002299 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856085+0000", 2024-09-12T02:58:01.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033103569999999999 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863371+0000", 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072860260000000001 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863444+0000", 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.305e-05 2024-09-12T02:58:01.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863493+0000", 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8890000000000001e-05 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.88713585, 2024-09-12T02:58:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012832368, 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5700000000000002e-07 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852262+0000", 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7135e-05 2024-09-12T02:58:01.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852366+0000", 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103606 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852378+0000", 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2204999999999999e-05 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854980+0000", 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026019860000000001 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855096+0000", 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115887 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855213+0000", 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116916 2024-09-12T02:58:01.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859383+0000", 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041700089999999997 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864993+0000", 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056103209999999997 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.819 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865043+0000", 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9481999999999998e-05 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865067+0000", 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4164000000000001e-05 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.820 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.886923447999997, 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012817586000000001, 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852448+0000", 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5600000000000005e-07 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852453+0000", 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9019999999999998e-06 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852462+0000", 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9069999999999996e-06 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852469+0000", 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.374e-06 2024-09-12T02:58:01.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853604+0000", 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011349299999999999 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853717+0000", 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112797 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853836+0000", 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011936500000000001 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859663+0000", 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058266209999999997 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865167+0000", 2024-09-12T02:58:01.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055044849999999999 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865226+0000", 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8718000000000003e-05 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865265+0000", 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8730999999999999e-05 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.826 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.886891849000001, 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012748110999999999, 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6699999999999999e-07 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852492+0000", 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.291e-05 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852500+0000", 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1580000000000005e-06 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852506+0000", 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5330000000000002e-06 2024-09-12T02:58:01.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856830+0000", 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004324194 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856959+0000", 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012862099999999999 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865227+0000", 2024-09-12T02:58:01.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082682280000000007 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.884569757999998, 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045219450000000003, 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.831 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854802+0000", 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854814+0000", 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1759999999999999e-05 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854836+0000", 2024-09-12T02:58:01.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2039999999999999e-05 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854855+0000", 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.929e-05 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854975+0000", 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119561 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043479110000000003 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:2 2.f e25/19 2:f1f69726:::400.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.881253561000001, 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032847000000000002, 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:01.835 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.836 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858118+0000", 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1540000000000001e-06 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858126+0000", 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7759999999999997e-06 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858138+0000", 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2184999999999999e-05 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858145+0000", 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858282+0000", 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013642799999999999 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858297+0000", 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5328e-05 2024-09-12T02:58:01.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861346+0000", 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030492729999999999 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861402+0000", 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5220999999999999e-05 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:01.839 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:01.840 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:01.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:01.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43cb000640 1 Processor -- start 2024-09-12T02:58:01.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43cb000640 1 -- start start 2024-09-12T02:58:01.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43cb000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c40c8990 0x7f43c40c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43cb000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43c40c8d70 0x7f43c4070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43cb000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c4067ba0 con 0x7f43c4159300 2024-09-12T02:58:01.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43cb000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f43c40c7780 con 0x7f43c40c8d70 2024-09-12T02:58:01.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43cb000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f43c4070960 con 0x7f43c40c8990 2024-09-12T02:58:01.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43c9200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43c40c8d70 0x7f43c4070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43c9200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43c40c8d70 0x7f43c4070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48190/0 (socket says 172.21.15.63:48190) 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43c9200640 1 -- 172.21.15.63:0/3584338489 learned_addr learned my addr 172.21.15.63:0/3584338489 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43c9c00640 1 --2- 172.21.15.63:0/3584338489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c40c8990 0x7f43c40c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43c9200640 1 -- 172.21.15.63:0/3584338489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c40c8990 msgr2=0x7f43c40c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43c9200640 1 --2- 172.21.15.63:0/3584338489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c40c8990 0x7f43c40c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43c9200640 1 -- 172.21.15.63:0/3584338489 >> v1:172.21.15.119:6789/0 conn(0x7f43c4159300 legacy=0x7f43c4152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.809+0000 7f43c9200640 1 -- 172.21.15.63:0/3584338489 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c4067e40 con 0x7f43c40c8d70 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43c9200640 1 --2- 172.21.15.63:0/3584338489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8d70 0x7f43c4070420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009870 tx=0x7f43b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f9b77ef915b0f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43c3e00640 1 -- 172.21.15.63:0/3584338489 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b00b0070 con 0x7f43c40c8d70 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43c3e00640 1 -- 172.21.15.63:0/3584338489 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b00ab600 con 0x7f43c40c8d70 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43c3e00640 1 -- 172.21.15.63:0/3584338489 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b00ab9d0 con 0x7f43c40c8d70 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43cb000640 1 -- 172.21.15.63:0/3584338489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8d70 msgr2=0x7f43c4070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43cb000640 1 --2- 172.21.15.63:0/3584338489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8d70 0x7f43c4070420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009870 tx=0x7f43b001c4d0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43cb000640 1 -- 172.21.15.63:0/3584338489 shutdown_connections 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43cb000640 1 --2- 172.21.15.63:0/3584338489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8d70 0x7f43c4070420 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43cb000640 1 --2- 172.21.15.63:0/3584338489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c40c8990 0x7f43c40c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43cb000640 1 -- 172.21.15.63:0/3584338489 >> 172.21.15.63:0/3584338489 conn(0x7f43c406f900 msgr2=0x7f43c406fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43cb000640 1 -- 172.21.15.63:0/3584338489 shutdown_connections 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.813+0000 7f43cb000640 1 -- 172.21.15.63:0/3584338489 wait complete. 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 Processor -- start 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 -- start start 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8990 0x7f43c4153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43c40c8d70 0x7f43c414f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c4159300 0x7f43c414f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f43c406d840 con 0x7f43c40c8990 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f43c406d6c0 con 0x7f43c40c8d70 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f43c41657b0 con 0x7f43c4159300 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8990 0x7f43c4153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8990 0x7f43c4153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48196/0 (socket says 172.21.15.63:48196) 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9c00640 1 -- 172.21.15.63:0/1079805744 learned_addr learned my addr 172.21.15.63:0/1079805744 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9200640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43c40c8d70 0x7f43c414f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43ca600640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c4159300 0x7f43c414f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9c00640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c4159300 msgr2=0x7f43c414f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9c00640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c4159300 0x7f43c414f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9c00640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43c40c8d70 msgr2=0x7f43c414f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9c00640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43c40c8d70 0x7f43c414f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9c00640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c41f4ad0 con 0x7f43c40c8990 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43ca600640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43c4159300 0x7f43c414f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c9c00640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8990 0x7f43c4153140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f43b800e960 tx=0x7f43b800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8017070 con 0x7f43c40c8990 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43b800ca00 con 0x7f43c40c8990 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b800cdb0 con 0x7f43c40c8990 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c415aa70 con 0x7f43c40c8990 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.817+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c415b030 con 0x7f43c40c8990 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f43c40c7240 con 0x7f43c40c8990 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f43b801a070 con 0x7f43c40c8990 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43c1600640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f43a40678f0 0x7f43a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6706+0+0 (secure 0 0 0) 0x7f43b80864b0 con 0x7f43c40c8990 2024-09-12T02:58:01.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v38) ==== 54+0+16 (secure 0 0 0) 0x7f43b8088a50 con 0x7f43c40c8990 2024-09-12T02:58:01.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43c9200640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f43a40678f0 0x7f43a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f43c415b270 0x7f43c415b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43c415a820 con 0x7f43c415b270 2024-09-12T02:58:01.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43ca600640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f43c415b270 0x7f43c415b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43c9200640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f43a40678f0 0x7f43a4069db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43b00ad000 tx=0x7f43b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.821+0000 7f43ca600640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f43c415b270 0x7f43c415b830 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.825+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43c415a820 con 0x7f43c415b270 2024-09-12T02:58:01.851 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:01.837+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:01.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.837+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f43c4156ce0 con 0x7f43c415b270 2024-09-12T02:58:01.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.841+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f43bc001e50 con 0x7f43c415b270 2024-09-12T02:58:01.852 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:01.853 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:01.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.841+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f43c415c650 0x7f43c41f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.841+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f43c40cd6e0 con 0x7f43c415c650 2024-09-12T02:58:01.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.841+0000 7f43c9c00640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f43c415c650 0x7f43c41f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.841+0000 7f43c9c00640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f43c415c650 0x7f43c41f7280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.841+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43c40cd6e0 con 0x7f43c415c650 2024-09-12T02:58:01.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.853+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f43c406d4a0 con 0x7f43c415c650 2024-09-12T02:58:01.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.857+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f43c406d4a0 con 0x7f43c415c650 2024-09-12T02:58:01.860 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:01.860 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.857+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f43c41f7cd0 0x7f43c40626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.857+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f43c41f80b0 con 0x7f43c41f7cd0 2024-09-12T02:58:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.857+0000 7f43c9200640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f43c41f7cd0 0x7f43c40626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.857+0000 7f43c9200640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f43c41f7cd0 0x7f43c40626e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.857+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43c41f80b0 con 0x7f43c41f7cd0 2024-09-12T02:58:01.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.873+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f43c4162660 con 0x7f43c41f7cd0 2024-09-12T02:58:01.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.873+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f43c4162660 con 0x7f43c41f7cd0 2024-09-12T02:58:01.878 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:01.879 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:01.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.877+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f43c4063130 0x7f43c40ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.877+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f43c40635b0 con 0x7f43c4063130 2024-09-12T02:58:01.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.877+0000 7f43ca600640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f43c4063130 0x7f43c40ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.877+0000 7f43ca600640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f43c4063130 0x7f43c40ca740 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.877+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43c40635b0 con 0x7f43c4063130 2024-09-12T02:58:01.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.877+0000 7fe2ed600640 1 -- 172.21.15.63:0/2044390378 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 7, "weight": 1.0}]=0 reweighted osd.7 to 1 (10000) v39) ==== 113+0+0 (secure 0 0 0) 0x7fe2e4056300 con 0x7fe2f0073290 2024-09-12T02:58:01.880 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.7 to 1 (10000) 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2d00678f0 msgr2=0x7fe2d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2d00678f0 0x7fe2d0069db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00c6d40 tx=0x7fe2dc009040 comp rx=0 tx=0).stop 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f0073290 msgr2=0x7fe2f01489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f0073290 0x7fe2f01489e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400e8a0 tx=0x7fe2e400eca0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 shutdown_connections 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2d00678f0 0x7fe2d0069db0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f0154a60 0x7fe2f014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f00c8c70 0x7fe2f01480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 --2- 172.21.15.63:0/2044390378 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2f0073290 0x7fe2f01489e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 >> 172.21.15.63:0/2044390378 conn(0x7fe2f00c91d0 msgr2=0x7fe2f0152290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:01.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 shutdown_connections 2024-09-12T02:58:01.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.881+0000 7fe2f6e00640 1 -- 172.21.15.63:0/2044390378 wait complete. 2024-09-12T02:58:01.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.893+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f43c40caf50 con 0x7f43c4063130 2024-09-12T02:58:01.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.893+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f43c40caf50 con 0x7f43c4063130 2024-09-12T02:58:01.897 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:01.898 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:01.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.893+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f43c402c650 0x7f43c402ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.893+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f43c40cb670 con 0x7f43c402c650 2024-09-12T02:58:01.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.893+0000 7f43c9c00640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f43c402c650 0x7f43c402ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.897+0000 7f43c9c00640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f43c402c650 0x7f43c402ca70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.897+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43c40cb670 con 0x7f43c402c650 2024-09-12T02:58:01.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T02:58:01.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:58:01.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.909+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f43c40cb670 con 0x7f43c402c650 2024-09-12T02:58:01.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.917+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f43c40cb670 con 0x7f43c402c650 2024-09-12T02:58:01.918 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:01.919 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:01.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.917+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f43c402d630 0x7f43c420a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.917+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f43c402da90 con 0x7f43c402d630 2024-09-12T02:58:01.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.917+0000 7f43c9200640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f43c402d630 0x7f43c420a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.917+0000 7f43c9200640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f43c402d630 0x7f43c420a630 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.917+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43c402da90 con 0x7f43c402d630 2024-09-12T02:58:01.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.933+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f43c402da90 con 0x7f43c402d630 2024-09-12T02:58:01.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.937+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f43c402da90 con 0x7f43c402d630 2024-09-12T02:58:01.939 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:01.940 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:01.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.937+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f43c420b080 0x7f43c420d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.937+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f43c4210240 con 0x7f43c420b080 2024-09-12T02:58:01.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.937+0000 7f43ca600640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f43c420b080 0x7f43c420d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.937+0000 7f43ca600640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f43c420b080 0x7f43c420d470 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.941 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:01.939+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:01.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.941+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43c4210240 con 0x7f43c420b080 2024-09-12T02:58:01.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.953+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f43c420da30 con 0x7f43c420b080 2024-09-12T02:58:01.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.957+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f43c420da30 con 0x7f43c420b080 2024-09-12T02:58:01.960 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.957+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f43c420e150 0x7f43c420e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.957+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f43c4213610 con 0x7f43c420e150 2024-09-12T02:58:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.957+0000 7f43c9c00640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f43c420e150 0x7f43c420e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:01.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.957+0000 7f43c9c00640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f43c420e150 0x7f43c420e570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:01.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.961+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43c4213610 con 0x7f43c420e150 2024-09-12T02:58:01.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.973+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f43c420ebc0 con 0x7f43c420e150 2024-09-12T02:58:01.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43c1600640 1 -- 172.21.15.63:0/1079805744 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f43c420ebc0 con 0x7f43c420e150 2024-09-12T02:58:01.981 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f43c415b270 msgr2=0x7f43c415b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f43c415b270 0x7f43c415b830 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f43c415c650 msgr2=0x7f43c41f7280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f43c415c650 0x7f43c41f7280 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f43c41f7cd0 msgr2=0x7f43c40626e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f43c41f7cd0 0x7f43c40626e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f43c4063130 msgr2=0x7f43c40ca740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f43c4063130 0x7f43c40ca740 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f43c402c650 msgr2=0x7f43c402ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f43c402c650 0x7f43c402ca70 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f43c402d630 msgr2=0x7f43c420a630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f43c402d630 0x7f43c420a630 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f43c420b080 msgr2=0x7f43c420d470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f43c420b080 0x7f43c420d470 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f43c420e150 msgr2=0x7f43c420e570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f43c420e150 0x7f43c420e570 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43ca600640 1 -- 172.21.15.63:0/1079805744 reap_dead start 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43ca600640 1 -- 172.21.15.63:0/1079805744 reap_dead start 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43ca600640 1 -- 172.21.15.63:0/1079805744 reap_dead start 2024-09-12T02:58:01.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43ca600640 1 -- 172.21.15.63:0/1079805744 reap_dead start 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43ca600640 1 -- 172.21.15.63:0/1079805744 reap_dead start 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f43a40678f0 msgr2=0x7f43a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f43a40678f0 0x7f43a4069db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43b00ad000 tx=0x7f43b0008040 comp rx=0 tx=0).stop 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8990 msgr2=0x7f43c4153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8990 0x7f43c4153140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f43b800e960 tx=0x7f43b800ee20 comp rx=0 tx=0).stop 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 shutdown_connections 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f43a40678f0 0x7f43a4069db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 --2- 172.21.15.63:0/1079805744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43c40c8990 0x7f43c4153140 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 >> 172.21.15.63:0/1079805744 conn(0x7f43c406f900 msgr2=0x7f43c414fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 shutdown_connections 2024-09-12T02:58:01.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:01.977+0000 7f43cb000640 1 -- 172.21.15.63:0/1079805744 wait complete. 2024-09-12T02:58:02.006 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:02.006 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:02.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1f200640 1 Processor -- start 2024-09-12T02:58:02.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1f200640 1 -- start start 2024-09-12T02:58:02.068 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:02.065+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1f200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb18152a70 0x7ffb18158820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1f200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb180c9380 0x7ffb180c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1f200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb180ced50 0x7ffb180c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1f200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ffb18071590 con 0x7ffb180ced50 2024-09-12T02:58:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1f200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ffb18158d60 con 0x7ffb180c9380 2024-09-12T02:58:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1f200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ffb18071830 con 0x7ffb18152a70 2024-09-12T02:58:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1d200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb180ced50 0x7ffb180c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1d200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ffb180ced50 0x7ffb180c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48206/0 (socket says 172.21.15.63:48206) 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1d200640 1 -- 172.21.15.63:0/256025411 learned_addr learned my addr 172.21.15.63:0/256025411 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb17400640 1 --2- 172.21.15.63:0/256025411 >> v2:172.21.15.119:3300/0 conn(0x7ffb180c9380 0x7ffb180c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb17e00640 1 --2- 172.21.15.63:0/256025411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb18152a70 0x7ffb18158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1d200640 1 -- 172.21.15.63:0/256025411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb18152a70 msgr2=0x7ffb18158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1d200640 1 --2- 172.21.15.63:0/256025411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb18152a70 0x7ffb18158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1d200640 1 -- 172.21.15.63:0/256025411 >> v2:172.21.15.119:3300/0 conn(0x7ffb180c9380 msgr2=0x7ffb180c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1d200640 1 --2- 172.21.15.63:0/256025411 >> v2:172.21.15.119:3300/0 conn(0x7ffb180c9380 0x7ffb180c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb1d200640 1 -- 172.21.15.63:0/256025411 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb18071b10 con 0x7ffb180ced50 2024-09-12T02:58:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.065+0000 7ffb17400640 1 --2- 172.21.15.63:0/256025411 >> v2:172.21.15.119:3300/0 conn(0x7ffb180c9380 0x7ffb180c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:02.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1d200640 1 --2- 172.21.15.63:0/256025411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180ced50 0x7ffb180c36b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffb18072120 tx=0x7ffb1001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98924148f1e5b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:02.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb16a00640 1 -- 172.21.15.63:0/256025411 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb100b5070 con 0x7ffb180ced50 2024-09-12T02:58:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb16a00640 1 -- 172.21.15.63:0/256025411 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb100a89d0 con 0x7ffb180ced50 2024-09-12T02:58:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb16a00640 1 -- 172.21.15.63:0/256025411 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb100a8da0 con 0x7ffb180ced50 2024-09-12T02:58:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1f200640 1 -- 172.21.15.63:0/256025411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180ced50 msgr2=0x7ffb180c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1f200640 1 --2- 172.21.15.63:0/256025411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180ced50 0x7ffb180c36b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffb18072120 tx=0x7ffb1001ed10 comp rx=0 tx=0).stop 2024-09-12T02:58:02.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1f200640 1 -- 172.21.15.63:0/256025411 shutdown_connections 2024-09-12T02:58:02.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1f200640 1 --2- 172.21.15.63:0/256025411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180ced50 0x7ffb180c36b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1f200640 1 --2- 172.21.15.63:0/256025411 >> v2:172.21.15.119:3300/0 conn(0x7ffb180c9380 0x7ffb180c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1f200640 1 --2- 172.21.15.63:0/256025411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb18152a70 0x7ffb18158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1f200640 1 -- 172.21.15.63:0/256025411 >> 172.21.15.63:0/256025411 conn(0x7ffb1806bcc0 msgr2=0x7ffb1806fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:02.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1f200640 1 -- 172.21.15.63:0/256025411 shutdown_connections 2024-09-12T02:58:02.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.069+0000 7ffb1f200640 1 -- 172.21.15.63:0/256025411 wait complete. 2024-09-12T02:58:02.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 Processor -- start 2024-09-12T02:58:02.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 -- start start 2024-09-12T02:58:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180c9380 0x7ffb18153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb180ced50 0x7ffb181f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb18152a70 0x7ffb181557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180ce550 con 0x7ffb180c9380 2024-09-12T02:58:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ffb180ce270 con 0x7ffb18152a70 2024-09-12T02:58:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ffb180ce830 con 0x7ffb180ced50 2024-09-12T02:58:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180c9380 0x7ffb18153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180c9380 0x7ffb18153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48210/0 (socket says 172.21.15.63:48210) 2024-09-12T02:58:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17e00640 1 -- 172.21.15.63:0/2938451064 learned_addr learned my addr 172.21.15.63:0/2938451064 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17400640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb180ced50 0x7ffb181f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1d200640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb18152a70 0x7ffb181557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17e00640 1 -- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb180ced50 msgr2=0x7ffb181f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17e00640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb180ced50 0x7ffb181f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17e00640 1 -- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb18152a70 msgr2=0x7ffb181557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17e00640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb18152a70 0x7ffb181557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17e00640 1 -- 172.21.15.63:0/2938451064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb18157160 con 0x7ffb180c9380 2024-09-12T02:58:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb17e00640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180c9380 0x7ffb18153b70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffb08007ec0 tx=0x7ffb0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb0fe00640 1 -- 172.21.15.63:0/2938451064 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08014620 con 0x7ffb180c9380 2024-09-12T02:58:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb0fe00640 1 -- 172.21.15.63:0/2938451064 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb08019070 con 0x7ffb180c9380 2024-09-12T02:58:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb0fe00640 1 -- 172.21.15.63:0/2938451064 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08014a20 con 0x7ffb180c9380 2024-09-12T02:58:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb181f05b0 con 0x7ffb180c9380 2024-09-12T02:58:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.073+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb18156ba0 con 0x7ffb180c9380 2024-09-12T02:58:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.077+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1806c6d0 con 0x7ffb180c9380 2024-09-12T02:58:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.077+0000 7ffb0fe00640 1 -- 172.21.15.63:0/2938451064 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb08014bc0 con 0x7ffb180c9380 2024-09-12T02:58:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.077+0000 7ffb0fe00640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ffaf80678c0 0x7ffaf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.077+0000 7ffb0fe00640 1 -- 172.21.15.63:0/2938451064 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6706+0+0 (secure 0 0 0) 0x7ffb080869c0 con 0x7ffb180c9380 2024-09-12T02:58:02.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.077+0000 7ffb17400640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ffaf80678c0 0x7ffaf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.077+0000 7ffb17400640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ffaf80678c0 0x7ffaf8069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffb181593e0 tx=0x7ffb04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:02.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.081+0000 7ffb0fe00640 1 -- 172.21.15.63:0/2938451064 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffb08088e20 con 0x7ffb180c9380 2024-09-12T02:58:02.146 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:02.145+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:02.215 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:02.215 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:02.230 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:02.247 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:02.243+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:02.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.245+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb18152e50 con 0x7ffaf80678c0 2024-09-12T02:58:02.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.269+0000 7ffb0fe00640 1 -- 172.21.15.63:0/2938451064 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332644 (secure 0 0 0) 0x7ffb18152e50 con 0x7ffaf80678c0 2024-09-12T02:58:02.276 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:58:02.278 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ffaf80678c0 msgr2=0x7ffaf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ffaf80678c0 0x7ffaf8069d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffb181593e0 tx=0x7ffb04008040 comp rx=0 tx=0).stop 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180c9380 msgr2=0x7ffb18153b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180c9380 0x7ffb18153b70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffb08007ec0 tx=0x7ffb0800e4b0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 shutdown_connections 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb18152a70 0x7ffb181557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ffaf80678c0 0x7ffaf8069d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb180ced50 0x7ffb181f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 --2- 172.21.15.63:0/2938451064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffb180c9380 0x7ffb18153b70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 >> 172.21.15.63:0/2938451064 conn(0x7ffb1806bcc0 msgr2=0x7ffb1806fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 shutdown_connections 2024-09-12T02:58:02.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.273+0000 7ffb1f200640 1 -- 172.21.15.63:0/2938451064 wait complete. 2024-09-12T02:58:02.297 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T02:58:01.881981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220416,"kb_used_data":4160,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754304,"statfs":{"total":773094113280,"available":772868407296,"internally_reserved":0,"allocated":4259840,"data_stored":2526002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.027736"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899558+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:57:58.899558+0000","last_peered":"2024-09-12T02:57:58.899558+0000","last_clean":"2024-09-12T02:57:58.899558+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:57:58.899558+0000","last_undegraded":"2024-09-12T02:57:58.899558+0000","last_fullsized":"2024-09-12T02:57:58.899558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901929+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:57:58.901929+0000","last_peered":"2024-09-12T02:57:58.901929+0000","last_clean":"2024-09-12T02:57:58.901929+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:57:58.901929+0000","last_undegraded":"2024-09-12T02:57:58.901929+0000","last_fullsized":"2024-09-12T02:57:58.901929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900482+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:57:58.900482+0000","last_peered":"2024-09-12T02:57:58.900482+0000","last_clean":"2024-09-12T02:57:58.900482+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:57:58.900482+0000","last_undegraded":"2024-09-12T02:57:58.900482+0000","last_fullsized":"2024-09-12T02:57:58.900482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.902024+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:57:58.902024+0000","last_peered":"2024-09-12T02:57:58.902024+0000","last_clean":"2024-09-12T02:57:58.902024+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:57:58.902024+0000","last_undegraded":"2024-09-12T02:57:58.902024+0000","last_fullsized":"2024-09-12T02:57:58.902024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899442+0000","last_change":"2024-09-12T02:57:04.882473+0000","last_active":"2024-09-12T02:57:58.899442+0000","last_peered":"2024-09-12T02:57:58.899442+0000","last_clean":"2024-09-12T02:57:58.899442+0000","last_became_active":"2024-09-12T02:57:04.882182+0000","last_became_peered":"2024-09-12T02:57:04.882182+0000","last_unstale":"2024-09-12T02:57:58.899442+0000","last_undegraded":"2024-09-12T02:57:58.899442+0000","last_fullsized":"2024-09-12T02:57:58.899442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.857956+0000","last_change":"2024-09-12T02:57:47.879927+0000","last_active":"2024-09-12T02:57:57.857956+0000","last_peered":"2024-09-12T02:57:57.857956+0000","last_clean":"2024-09-12T02:57:57.857956+0000","last_became_active":"2024-09-12T02:57:47.878658+0000","last_became_peered":"2024-09-12T02:57:47.878658+0000","last_unstale":"2024-09-12T02:57:57.857956+0000","last_undegraded":"2024-09-12T02:57:57.857956+0000","last_fullsized":"2024-09-12T02:57:57.857956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:28.393450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850901+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:57:56.850901+0000","last_peered":"2024-09-12T02:57:56.850901+0000","last_clean":"2024-09-12T02:57:56.850901+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:57:56.850901+0000","last_undegraded":"2024-09-12T02:57:56.850901+0000","last_fullsized":"2024-09-12T02:57:56.850901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859283+0000","last_change":"2024-09-12T02:57:04.875312+0000","last_active":"2024-09-12T02:57:57.859283+0000","last_peered":"2024-09-12T02:57:57.859283+0000","last_clean":"2024-09-12T02:57:57.859283+0000","last_became_active":"2024-09-12T02:57:04.863748+0000","last_became_peered":"2024-09-12T02:57:04.863748+0000","last_unstale":"2024-09-12T02:57:57.859283+0000","last_undegraded":"2024-09-12T02:57:57.859283+0000","last_fullsized":"2024-09-12T02:57:57.859283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:39.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859732+0000","last_change":"2024-09-12T02:57:08.888677+0000","last_active":"2024-09-12T02:57:57.859732+0000","last_peered":"2024-09-12T02:57:57.859732+0000","last_clean":"2024-09-12T02:57:57.859732+0000","last_became_active":"2024-09-12T02:57:08.875948+0000","last_became_peered":"2024-09-12T02:57:08.875948+0000","last_unstale":"2024-09-12T02:57:57.859732+0000","last_undegraded":"2024-09-12T02:57:57.859732+0000","last_fullsized":"2024-09-12T02:57:57.859732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.194444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850517+0000","last_change":"2024-09-12T02:57:03.832933+0000","last_active":"2024-09-12T02:57:56.850517+0000","last_peered":"2024-09-12T02:57:56.850517+0000","last_clean":"2024-09-12T02:57:56.850517+0000","last_became_active":"2024-09-12T02:57:03.832253+0000","last_became_peered":"2024-09-12T02:57:03.832253+0000","last_unstale":"2024-09-12T02:57:56.850517+0000","last_undegraded":"2024-09-12T02:57:56.850517+0000","last_fullsized":"2024-09-12T02:57:56.850517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860746+0000","last_change":"2024-09-12T02:57:04.880036+0000","last_active":"2024-09-12T02:57:57.860746+0000","last_peered":"2024-09-12T02:57:57.860746+0000","last_clean":"2024-09-12T02:57:57.860746+0000","last_became_active":"2024-09-12T02:57:04.879490+0000","last_became_peered":"2024-09-12T02:57:04.879490+0000","last_unstale":"2024-09-12T02:57:57.860746+0000","last_undegraded":"2024-09-12T02:57:57.860746+0000","last_fullsized":"2024-09-12T02:57:57.860746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.579939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.861319+0000","last_change":"2024-09-12T02:57:08.890508+0000","last_active":"2024-09-12T02:57:57.861319+0000","last_peered":"2024-09-12T02:57:57.861319+0000","last_clean":"2024-09-12T02:57:57.861319+0000","last_became_active":"2024-09-12T02:57:08.886515+0000","last_became_peered":"2024-09-12T02:57:08.886515+0000","last_unstale":"2024-09-12T02:57:57.861319+0000","last_undegraded":"2024-09-12T02:57:57.861319+0000","last_fullsized":"2024-09-12T02:57:57.861319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:28.963220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.847833+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:57:56.847833+0000","last_peered":"2024-09-12T02:57:56.847833+0000","last_clean":"2024-09-12T02:57:56.847833+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:57:56.847833+0000","last_undegraded":"2024-09-12T02:57:56.847833+0000","last_fullsized":"2024-09-12T02:57:56.847833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850709+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:57:56.850709+0000","last_peered":"2024-09-12T02:57:56.850709+0000","last_clean":"2024-09-12T02:57:56.850709+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:57:56.850709+0000","last_undegraded":"2024-09-12T02:57:56.850709+0000","last_fullsized":"2024-09-12T02:57:56.850709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860787+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:57:57.860787+0000","last_peered":"2024-09-12T02:57:57.860787+0000","last_clean":"2024-09-12T02:57:57.860787+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:57:57.860787+0000","last_undegraded":"2024-09-12T02:57:57.860787+0000","last_fullsized":"2024-09-12T02:57:57.860787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901243+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:57:58.901243+0000","last_peered":"2024-09-12T02:57:58.901243+0000","last_clean":"2024-09-12T02:57:58.901243+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:57:58.901243+0000","last_undegraded":"2024-09-12T02:57:58.901243+0000","last_fullsized":"2024-09-12T02:57:58.901243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928823+0000","last_change":"2024-09-12T02:57:03.790544+0000","last_active":"2024-09-12T02:57:56.928823+0000","last_peered":"2024-09-12T02:57:56.928823+0000","last_clean":"2024-09-12T02:57:56.928823+0000","last_became_active":"2024-09-12T02:57:03.790195+0000","last_became_peered":"2024-09-12T02:57:03.790195+0000","last_unstale":"2024-09-12T02:57:56.928823+0000","last_undegraded":"2024-09-12T02:57:56.928823+0000","last_fullsized":"2024-09-12T02:57:56.928823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859419+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:57:57.859419+0000","last_peered":"2024-09-12T02:57:57.859419+0000","last_clean":"2024-09-12T02:57:57.859419+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:57:57.859419+0000","last_undegraded":"2024-09-12T02:57:57.859419+0000","last_fullsized":"2024-09-12T02:57:57.859419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900600+0000","last_change":"2024-09-12T02:57:04.835949+0000","last_active":"2024-09-12T02:57:58.900600+0000","last_peered":"2024-09-12T02:57:58.900600+0000","last_clean":"2024-09-12T02:57:58.900600+0000","last_became_active":"2024-09-12T02:57:04.835628+0000","last_became_peered":"2024-09-12T02:57:04.835628+0000","last_unstale":"2024-09-12T02:57:58.900600+0000","last_undegraded":"2024-09-12T02:57:58.900600+0000","last_fullsized":"2024-09-12T02:57:58.900600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929574+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:57:56.929574+0000","last_peered":"2024-09-12T02:57:56.929574+0000","last_clean":"2024-09-12T02:57:56.929574+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:57:56.929574+0000","last_undegraded":"2024-09-12T02:57:56.929574+0000","last_fullsized":"2024-09-12T02:57:56.929574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.930232+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:57:56.930232+0000","last_peered":"2024-09-12T02:57:56.930232+0000","last_clean":"2024-09-12T02:57:56.930232+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:57:56.930232+0000","last_undegraded":"2024-09-12T02:57:56.930232+0000","last_fullsized":"2024-09-12T02:57:56.930232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858871+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:57:57.858871+0000","last_peered":"2024-09-12T02:57:57.858871+0000","last_clean":"2024-09-12T02:57:57.858871+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:57:57.858871+0000","last_undegraded":"2024-09-12T02:57:57.858871+0000","last_fullsized":"2024-09-12T02:57:57.858871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848720+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:57:56.848720+0000","last_peered":"2024-09-12T02:57:56.848720+0000","last_clean":"2024-09-12T02:57:56.848720+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:57:56.848720+0000","last_undegraded":"2024-09-12T02:57:56.848720+0000","last_fullsized":"2024-09-12T02:57:56.848720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.861351+0000","last_change":"2024-09-12T02:57:08.881925+0000","last_active":"2024-09-12T02:57:57.861351+0000","last_peered":"2024-09-12T02:57:57.861351+0000","last_clean":"2024-09-12T02:57:57.861351+0000","last_became_active":"2024-09-12T02:57:08.880913+0000","last_became_peered":"2024-09-12T02:57:08.880913+0000","last_unstale":"2024-09-12T02:57:57.861351+0000","last_undegraded":"2024-09-12T02:57:57.861351+0000","last_fullsized":"2024-09-12T02:57:57.861351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:48.637854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899774+0000","last_change":"2024-09-12T02:57:04.837566+0000","last_active":"2024-09-12T02:57:58.899774+0000","last_peered":"2024-09-12T02:57:58.899774+0000","last_clean":"2024-09-12T02:57:58.899774+0000","last_became_active":"2024-09-12T02:57:04.837281+0000","last_became_peered":"2024-09-12T02:57:04.837281+0000","last_unstale":"2024-09-12T02:57:58.899774+0000","last_undegraded":"2024-09-12T02:57:58.899774+0000","last_fullsized":"2024-09-12T02:57:58.899774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:23.664487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849238+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:57:56.849238+0000","last_peered":"2024-09-12T02:57:56.849238+0000","last_clean":"2024-09-12T02:57:56.849238+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:57:56.849238+0000","last_undegraded":"2024-09-12T02:57:56.849238+0000","last_fullsized":"2024-09-12T02:57:56.849238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858427+0000","last_change":"2024-09-12T02:57:09.038564+0000","last_active":"2024-09-12T02:57:57.858427+0000","last_peered":"2024-09-12T02:57:57.858427+0000","last_clean":"2024-09-12T02:57:57.858427+0000","last_became_active":"2024-09-12T02:57:09.036310+0000","last_became_peered":"2024-09-12T02:57:09.036310+0000","last_unstale":"2024-09-12T02:57:57.858427+0000","last_undegraded":"2024-09-12T02:57:57.858427+0000","last_fullsized":"2024-09-12T02:57:57.858427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.627698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.902096+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:57:58.902096+0000","last_peered":"2024-09-12T02:57:58.902096+0000","last_clean":"2024-09-12T02:57:58.902096+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:57:58.902096+0000","last_undegraded":"2024-09-12T02:57:58.902096+0000","last_fullsized":"2024-09-12T02:57:58.902096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929218+0000","last_change":"2024-09-12T02:57:03.809884+0000","last_active":"2024-09-12T02:57:56.929218+0000","last_peered":"2024-09-12T02:57:56.929218+0000","last_clean":"2024-09-12T02:57:56.929218+0000","last_became_active":"2024-09-12T02:57:03.809610+0000","last_became_peered":"2024-09-12T02:57:03.809610+0000","last_unstale":"2024-09-12T02:57:56.929218+0000","last_undegraded":"2024-09-12T02:57:56.929218+0000","last_fullsized":"2024-09-12T02:57:56.929218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900235+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:57:58.900235+0000","last_peered":"2024-09-12T02:57:58.900235+0000","last_clean":"2024-09-12T02:57:58.900235+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:57:58.900235+0000","last_undegraded":"2024-09-12T02:57:58.900235+0000","last_fullsized":"2024-09-12T02:57:58.900235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928536+0000","last_change":"2024-09-12T02:57:04.837330+0000","last_active":"2024-09-12T02:57:56.928536+0000","last_peered":"2024-09-12T02:57:56.928536+0000","last_clean":"2024-09-12T02:57:56.928536+0000","last_became_active":"2024-09-12T02:57:04.836984+0000","last_became_peered":"2024-09-12T02:57:04.836984+0000","last_unstale":"2024-09-12T02:57:56.928536+0000","last_undegraded":"2024-09-12T02:57:56.928536+0000","last_fullsized":"2024-09-12T02:57:56.928536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851187+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:57:56.851187+0000","last_peered":"2024-09-12T02:57:56.851187+0000","last_clean":"2024-09-12T02:57:56.851187+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:57:56.851187+0000","last_undegraded":"2024-09-12T02:57:56.851187+0000","last_fullsized":"2024-09-12T02:57:56.851187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899026+0000","last_change":"2024-09-12T02:57:48.057463+0000","last_active":"2024-09-12T02:57:58.899026+0000","last_peered":"2024-09-12T02:57:58.899026+0000","last_clean":"2024-09-12T02:57:58.899026+0000","last_became_active":"2024-09-12T02:57:48.057061+0000","last_became_peered":"2024-09-12T02:57:48.057061+0000","last_unstale":"2024-09-12T02:57:58.899026+0000","last_undegraded":"2024-09-12T02:57:58.899026+0000","last_fullsized":"2024-09-12T02:57:58.899026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.916390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860927+0000","last_change":"2024-09-12T02:57:04.861898+0000","last_active":"2024-09-12T02:57:57.860927+0000","last_peered":"2024-09-12T02:57:57.860927+0000","last_clean":"2024-09-12T02:57:57.860927+0000","last_became_active":"2024-09-12T02:57:04.858339+0000","last_became_peered":"2024-09-12T02:57:04.858339+0000","last_unstale":"2024-09-12T02:57:57.860927+0000","last_undegraded":"2024-09-12T02:57:57.860927+0000","last_fullsized":"2024-09-12T02:57:57.860927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928664+0000","last_change":"2024-09-12T02:57:03.796368+0000","last_active":"2024-09-12T02:57:56.928664+0000","last_peered":"2024-09-12T02:57:56.928664+0000","last_clean":"2024-09-12T02:57:56.928664+0000","last_became_active":"2024-09-12T02:57:03.796016+0000","last_became_peered":"2024-09-12T02:57:03.796016+0000","last_unstale":"2024-09-12T02:57:56.928664+0000","last_undegraded":"2024-09-12T02:57:56.928664+0000","last_fullsized":"2024-09-12T02:57:56.928664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:27.840978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928529+0000","last_change":"2024-09-12T02:57:08.877519+0000","last_active":"2024-09-12T02:57:56.928529+0000","last_peered":"2024-09-12T02:57:56.928529+0000","last_clean":"2024-09-12T02:57:56.928529+0000","last_became_active":"2024-09-12T02:57:08.872329+0000","last_became_peered":"2024-09-12T02:57:08.872329+0000","last_unstale":"2024-09-12T02:57:56.928529+0000","last_undegraded":"2024-09-12T02:57:56.928529+0000","last_fullsized":"2024-09-12T02:57:56.928529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.661785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860235+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:57:57.860235+0000","last_peered":"2024-09-12T02:57:57.860235+0000","last_clean":"2024-09-12T02:57:57.860235+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:57:57.860235+0000","last_undegraded":"2024-09-12T02:57:57.860235+0000","last_fullsized":"2024-09-12T02:57:57.860235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859675+0000","last_change":"2024-09-12T02:57:03.802797+0000","last_active":"2024-09-12T02:57:57.859675+0000","last_peered":"2024-09-12T02:57:57.859675+0000","last_clean":"2024-09-12T02:57:57.859675+0000","last_became_active":"2024-09-12T02:57:03.798969+0000","last_became_peered":"2024-09-12T02:57:03.798969+0000","last_unstale":"2024-09-12T02:57:57.859675+0000","last_undegraded":"2024-09-12T02:57:57.859675+0000","last_fullsized":"2024-09-12T02:57:57.859675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.025589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928145+0000","last_change":"2024-09-12T02:57:08.883289+0000","last_active":"2024-09-12T02:57:56.928145+0000","last_peered":"2024-09-12T02:57:56.928145+0000","last_clean":"2024-09-12T02:57:56.928145+0000","last_became_active":"2024-09-12T02:57:08.880476+0000","last_became_peered":"2024-09-12T02:57:08.880476+0000","last_unstale":"2024-09-12T02:57:56.928145+0000","last_undegraded":"2024-09-12T02:57:56.928145+0000","last_fullsized":"2024-09-12T02:57:56.928145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:04.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928219+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:57:56.928219+0000","last_peered":"2024-09-12T02:57:56.928219+0000","last_clean":"2024-09-12T02:57:56.928219+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:57:56.928219+0000","last_undegraded":"2024-09-12T02:57:56.928219+0000","last_fullsized":"2024-09-12T02:57:56.928219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857566+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:57:58.857566+0000","last_peered":"2024-09-12T02:57:58.857566+0000","last_clean":"2024-09-12T02:57:58.857566+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:57:58.857566+0000","last_undegraded":"2024-09-12T02:57:58.857566+0000","last_fullsized":"2024-09-12T02:57:58.857566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929933+0000","last_change":"2024-09-12T02:57:08.872506+0000","last_active":"2024-09-12T02:57:56.929933+0000","last_peered":"2024-09-12T02:57:56.929933+0000","last_clean":"2024-09-12T02:57:56.929933+0000","last_became_active":"2024-09-12T02:57:08.872127+0000","last_became_peered":"2024-09-12T02:57:08.872127+0000","last_unstale":"2024-09-12T02:57:56.929933+0000","last_undegraded":"2024-09-12T02:57:56.929933+0000","last_fullsized":"2024-09-12T02:57:56.929933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:19.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899604+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:57:58.899604+0000","last_peered":"2024-09-12T02:57:58.899604+0000","last_clean":"2024-09-12T02:57:58.899604+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:57:58.899604+0000","last_undegraded":"2024-09-12T02:57:58.899604+0000","last_fullsized":"2024-09-12T02:57:58.899604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848975+0000","last_change":"2024-09-12T02:57:03.827694+0000","last_active":"2024-09-12T02:57:56.848975+0000","last_peered":"2024-09-12T02:57:56.848975+0000","last_clean":"2024-09-12T02:57:56.848975+0000","last_became_active":"2024-09-12T02:57:03.827099+0000","last_became_peered":"2024-09-12T02:57:03.827099+0000","last_unstale":"2024-09-12T02:57:56.848975+0000","last_undegraded":"2024-09-12T02:57:56.848975+0000","last_fullsized":"2024-09-12T02:57:56.848975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899678+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:57:58.899678+0000","last_peered":"2024-09-12T02:57:58.899678+0000","last_clean":"2024-09-12T02:57:58.899678+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:57:58.899678+0000","last_undegraded":"2024-09-12T02:57:58.899678+0000","last_fullsized":"2024-09-12T02:57:58.899678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901089+0000","last_change":"2024-09-12T02:57:04.882517+0000","last_active":"2024-09-12T02:57:58.901089+0000","last_peered":"2024-09-12T02:57:58.901089+0000","last_clean":"2024-09-12T02:57:58.901089+0000","last_became_active":"2024-09-12T02:57:04.882159+0000","last_became_peered":"2024-09-12T02:57:04.882159+0000","last_unstale":"2024-09-12T02:57:58.901089+0000","last_undegraded":"2024-09-12T02:57:58.901089+0000","last_fullsized":"2024-09-12T02:57:58.901089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858421+0000","last_change":"2024-09-12T02:57:03.798773+0000","last_active":"2024-09-12T02:57:57.858421+0000","last_peered":"2024-09-12T02:57:57.858421+0000","last_clean":"2024-09-12T02:57:57.858421+0000","last_became_active":"2024-09-12T02:57:03.797799+0000","last_became_peered":"2024-09-12T02:57:03.797799+0000","last_unstale":"2024-09-12T02:57:57.858421+0000","last_undegraded":"2024-09-12T02:57:57.858421+0000","last_fullsized":"2024-09-12T02:57:57.858421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849228+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:57:56.849228+0000","last_peered":"2024-09-12T02:57:56.849228+0000","last_clean":"2024-09-12T02:57:56.849228+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:57:56.849228+0000","last_undegraded":"2024-09-12T02:57:56.849228+0000","last_fullsized":"2024-09-12T02:57:56.849228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848045+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:57:56.848045+0000","last_peered":"2024-09-12T02:57:56.848045+0000","last_clean":"2024-09-12T02:57:56.848045+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:57:56.848045+0000","last_undegraded":"2024-09-12T02:57:56.848045+0000","last_fullsized":"2024-09-12T02:57:56.848045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928875+0000","last_change":"2024-09-12T02:57:47.799311+0000","last_active":"2024-09-12T02:57:56.928875+0000","last_peered":"2024-09-12T02:57:56.928875+0000","last_clean":"2024-09-12T02:57:56.928875+0000","last_became_active":"2024-09-12T02:57:47.798962+0000","last_became_peered":"2024-09-12T02:57:47.798962+0000","last_unstale":"2024-09-12T02:57:56.928875+0000","last_undegraded":"2024-09-12T02:57:56.928875+0000","last_fullsized":"2024-09-12T02:57:56.928875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:50.572922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857652+0000","last_change":"2024-09-12T02:57:03.798239+0000","last_active":"2024-09-12T02:57:58.857652+0000","last_peered":"2024-09-12T02:57:58.857652+0000","last_clean":"2024-09-12T02:57:58.857652+0000","last_became_active":"2024-09-12T02:57:03.797935+0000","last_became_peered":"2024-09-12T02:57:03.797935+0000","last_unstale":"2024-09-12T02:57:58.857652+0000","last_undegraded":"2024-09-12T02:57:58.857652+0000","last_fullsized":"2024-09-12T02:57:58.857652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.847541+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:57:56.847541+0000","last_peered":"2024-09-12T02:57:56.847541+0000","last_clean":"2024-09-12T02:57:56.847541+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:57:56.847541+0000","last_undegraded":"2024-09-12T02:57:56.847541+0000","last_fullsized":"2024-09-12T02:57:56.847541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859528+0000","last_change":"2024-09-12T02:57:04.858809+0000","last_active":"2024-09-12T02:57:57.859528+0000","last_peered":"2024-09-12T02:57:57.859528+0000","last_clean":"2024-09-12T02:57:57.859528+0000","last_became_active":"2024-09-12T02:57:04.858048+0000","last_became_peered":"2024-09-12T02:57:04.858048+0000","last_unstale":"2024-09-12T02:57:57.859528+0000","last_undegraded":"2024-09-12T02:57:57.859528+0000","last_fullsized":"2024-09-12T02:57:57.859528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:59.698440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929235+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:57:56.929235+0000","last_peered":"2024-09-12T02:57:56.929235+0000","last_clean":"2024-09-12T02:57:56.929235+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:57:56.929235+0000","last_undegraded":"2024-09-12T02:57:56.929235+0000","last_fullsized":"2024-09-12T02:57:56.929235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899232+0000","last_change":"2024-09-12T02:57:08.874656+0000","last_active":"2024-09-12T02:57:58.899232+0000","last_peered":"2024-09-12T02:57:58.899232+0000","last_clean":"2024-09-12T02:57:58.899232+0000","last_became_active":"2024-09-12T02:57:08.874202+0000","last_became_peered":"2024-09-12T02:57:08.874202+0000","last_unstale":"2024-09-12T02:57:58.899232+0000","last_undegraded":"2024-09-12T02:57:58.899232+0000","last_fullsized":"2024-09-12T02:57:58.899232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.794828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851432+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:57:56.851432+0000","last_peered":"2024-09-12T02:57:56.851432+0000","last_clean":"2024-09-12T02:57:56.851432+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:57:56.851432+0000","last_undegraded":"2024-09-12T02:57:56.851432+0000","last_fullsized":"2024-09-12T02:57:56.851432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857847+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:57:58.857847+0000","last_peered":"2024-09-12T02:57:58.857847+0000","last_clean":"2024-09-12T02:57:58.857847+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:57:58.857847+0000","last_undegraded":"2024-09-12T02:57:58.857847+0000","last_fullsized":"2024-09-12T02:57:58.857847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.856838+0000","last_change":"2024-09-12T02:57:09.030839+0000","last_active":"2024-09-12T02:57:57.856838+0000","last_peered":"2024-09-12T02:57:57.856838+0000","last_clean":"2024-09-12T02:57:57.856838+0000","last_became_active":"2024-09-12T02:57:09.029808+0000","last_became_peered":"2024-09-12T02:57:09.029808+0000","last_unstale":"2024-09-12T02:57:57.856838+0000","last_undegraded":"2024-09-12T02:57:57.856838+0000","last_fullsized":"2024-09-12T02:57:57.856838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851216+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:57:56.851216+0000","last_peered":"2024-09-12T02:57:56.851216+0000","last_clean":"2024-09-12T02:57:56.851216+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:57:56.851216+0000","last_undegraded":"2024-09-12T02:57:56.851216+0000","last_fullsized":"2024-09-12T02:57:56.851216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860255+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:57:57.860255+0000","last_peered":"2024-09-12T02:57:57.860255+0000","last_clean":"2024-09-12T02:57:57.860255+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:57:57.860255+0000","last_undegraded":"2024-09-12T02:57:57.860255+0000","last_fullsized":"2024-09-12T02:57:57.860255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858023+0000","last_change":"2024-09-12T02:57:08.896161+0000","last_active":"2024-09-12T02:57:57.858023+0000","last_peered":"2024-09-12T02:57:57.858023+0000","last_clean":"2024-09-12T02:57:57.858023+0000","last_became_active":"2024-09-12T02:57:08.895379+0000","last_became_peered":"2024-09-12T02:57:08.895379+0000","last_unstale":"2024-09-12T02:57:57.858023+0000","last_undegraded":"2024-09-12T02:57:57.858023+0000","last_fullsized":"2024-09-12T02:57:57.858023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:34.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849462+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:57:56.849462+0000","last_peered":"2024-09-12T02:57:56.849462+0000","last_clean":"2024-09-12T02:57:56.849462+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:57:56.849462+0000","last_undegraded":"2024-09-12T02:57:56.849462+0000","last_fullsized":"2024-09-12T02:57:56.849462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857339+0000","last_change":"2024-09-12T02:57:03.788301+0000","last_active":"2024-09-12T02:57:58.857339+0000","last_peered":"2024-09-12T02:57:58.857339+0000","last_clean":"2024-09-12T02:57:58.857339+0000","last_became_active":"2024-09-12T02:57:03.788002+0000","last_became_peered":"2024-09-12T02:57:03.788002+0000","last_unstale":"2024-09-12T02:57:58.857339+0000","last_undegraded":"2024-09-12T02:57:58.857339+0000","last_fullsized":"2024-09-12T02:57:58.857339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899583+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:57:58.899583+0000","last_peered":"2024-09-12T02:57:58.899583+0000","last_clean":"2024-09-12T02:57:58.899583+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:57:58.899583+0000","last_undegraded":"2024-09-12T02:57:58.899583+0000","last_fullsized":"2024-09-12T02:57:58.899583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.847968+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:57:56.847968+0000","last_peered":"2024-09-12T02:57:56.847968+0000","last_clean":"2024-09-12T02:57:56.847968+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:57:56.847968+0000","last_undegraded":"2024-09-12T02:57:56.847968+0000","last_fullsized":"2024-09-12T02:57:56.847968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848258+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:57:56.848258+0000","last_peered":"2024-09-12T02:57:56.848258+0000","last_clean":"2024-09-12T02:57:56.848258+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:57:56.848258+0000","last_undegraded":"2024-09-12T02:57:56.848258+0000","last_fullsized":"2024-09-12T02:57:56.848258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.902003+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:57:58.902003+0000","last_peered":"2024-09-12T02:57:58.902003+0000","last_clean":"2024-09-12T02:57:58.902003+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:57:58.902003+0000","last_undegraded":"2024-09-12T02:57:58.902003+0000","last_fullsized":"2024-09-12T02:57:58.902003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850441+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:57:56.850441+0000","last_peered":"2024-09-12T02:57:56.850441+0000","last_clean":"2024-09-12T02:57:56.850441+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:57:56.850441+0000","last_undegraded":"2024-09-12T02:57:56.850441+0000","last_fullsized":"2024-09-12T02:57:56.850441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859435+0000","last_change":"2024-09-12T02:57:03.802047+0000","last_active":"2024-09-12T02:57:57.859435+0000","last_peered":"2024-09-12T02:57:57.859435+0000","last_clean":"2024-09-12T02:57:57.859435+0000","last_became_active":"2024-09-12T02:57:03.797936+0000","last_became_peered":"2024-09-12T02:57:03.797936+0000","last_unstale":"2024-09-12T02:57:57.859435+0000","last_undegraded":"2024-09-12T02:57:57.859435+0000","last_fullsized":"2024-09-12T02:57:57.859435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:10.176640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901516+0000","last_change":"2024-09-12T02:57:09.030826+0000","last_active":"2024-09-12T02:57:58.901516+0000","last_peered":"2024-09-12T02:57:58.901516+0000","last_clean":"2024-09-12T02:57:58.901516+0000","last_became_active":"2024-09-12T02:57:09.029437+0000","last_became_peered":"2024-09-12T02:57:09.029437+0000","last_unstale":"2024-09-12T02:57:58.901516+0000","last_undegraded":"2024-09-12T02:57:58.901516+0000","last_fullsized":"2024-09-12T02:57:58.901516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:15.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899228+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:57:58.899228+0000","last_peered":"2024-09-12T02:57:58.899228+0000","last_clean":"2024-09-12T02:57:58.899228+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:57:58.899228+0000","last_undegraded":"2024-09-12T02:57:58.899228+0000","last_fullsized":"2024-09-12T02:57:58.899228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899340+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:57:58.899340+0000","last_peered":"2024-09-12T02:57:58.899340+0000","last_clean":"2024-09-12T02:57:58.899340+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:57:58.899340+0000","last_undegraded":"2024-09-12T02:57:58.899340+0000","last_fullsized":"2024-09-12T02:57:58.899340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860659+0000","last_change":"2024-09-12T02:57:09.031080+0000","last_active":"2024-09-12T02:57:57.860659+0000","last_peered":"2024-09-12T02:57:57.860659+0000","last_clean":"2024-09-12T02:57:57.860659+0000","last_became_active":"2024-09-12T02:57:09.029892+0000","last_became_peered":"2024-09-12T02:57:09.029892+0000","last_unstale":"2024-09-12T02:57:57.860659+0000","last_undegraded":"2024-09-12T02:57:57.860659+0000","last_fullsized":"2024-09-12T02:57:57.860659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850731+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:57:56.850731+0000","last_peered":"2024-09-12T02:57:56.850731+0000","last_clean":"2024-09-12T02:57:56.850731+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:57:56.850731+0000","last_undegraded":"2024-09-12T02:57:56.850731+0000","last_fullsized":"2024-09-12T02:57:56.850731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'12","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848380+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:57:56.848380+0000","last_peered":"2024-09-12T02:57:56.848380+0000","last_clean":"2024-09-12T02:57:56.848380+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:57:56.848380+0000","last_undegraded":"2024-09-12T02:57:56.848380+0000","last_fullsized":"2024-09-12T02:57:56.848380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928339+0000","last_change":"2024-09-12T02:57:08.884030+0000","last_active":"2024-09-12T02:57:56.928339+0000","last_peered":"2024-09-12T02:57:56.928339+0000","last_clean":"2024-09-12T02:57:56.928339+0000","last_became_active":"2024-09-12T02:57:08.880332+0000","last_became_peered":"2024-09-12T02:57:08.880332+0000","last_unstale":"2024-09-12T02:57:56.928339+0000","last_undegraded":"2024-09-12T02:57:56.928339+0000","last_fullsized":"2024-09-12T02:57:56.928339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:25.232846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860174+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:57:57.860174+0000","last_peered":"2024-09-12T02:57:57.860174+0000","last_clean":"2024-09-12T02:57:57.860174+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:57:57.860174+0000","last_undegraded":"2024-09-12T02:57:57.860174+0000","last_fullsized":"2024-09-12T02:57:57.860174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929136+0000","last_change":"2024-09-12T02:57:03.798009+0000","last_active":"2024-09-12T02:57:56.929136+0000","last_peered":"2024-09-12T02:57:56.929136+0000","last_clean":"2024-09-12T02:57:56.929136+0000","last_became_active":"2024-09-12T02:57:03.797749+0000","last_became_peered":"2024-09-12T02:57:03.797749+0000","last_unstale":"2024-09-12T02:57:56.929136+0000","last_undegraded":"2024-09-12T02:57:56.929136+0000","last_fullsized":"2024-09-12T02:57:56.929136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.058712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859325+0000","last_change":"2024-09-12T02:57:47.804893+0000","last_active":"2024-09-12T02:57:57.859325+0000","last_peered":"2024-09-12T02:57:57.859325+0000","last_clean":"2024-09-12T02:57:57.859325+0000","last_became_active":"2024-09-12T02:57:47.803416+0000","last_became_peered":"2024-09-12T02:57:47.803416+0000","last_unstale":"2024-09-12T02:57:57.859325+0000","last_undegraded":"2024-09-12T02:57:57.859325+0000","last_fullsized":"2024-09-12T02:57:57.859325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:39.193336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899535+0000","last_change":"2024-09-12T02:57:04.882349+0000","last_active":"2024-09-12T02:57:58.899535+0000","last_peered":"2024-09-12T02:57:58.899535+0000","last_clean":"2024-09-12T02:57:58.899535+0000","last_became_active":"2024-09-12T02:57:04.882060+0000","last_became_peered":"2024-09-12T02:57:04.882060+0000","last_unstale":"2024-09-12T02:57:58.899535+0000","last_undegraded":"2024-09-12T02:57:58.899535+0000","last_fullsized":"2024-09-12T02:57:58.899535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860873+0000","last_change":"2024-09-12T02:57:03.811429+0000","last_active":"2024-09-12T02:57:57.860873+0000","last_peered":"2024-09-12T02:57:57.860873+0000","last_clean":"2024-09-12T02:57:57.860873+0000","last_became_active":"2024-09-12T02:57:03.810672+0000","last_became_peered":"2024-09-12T02:57:03.810672+0000","last_unstale":"2024-09-12T02:57:57.860873+0000","last_undegraded":"2024-09-12T02:57:57.860873+0000","last_fullsized":"2024-09-12T02:57:57.860873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900481+0000","last_change":"2024-09-12T02:57:08.875903+0000","last_active":"2024-09-12T02:57:58.900481+0000","last_peered":"2024-09-12T02:57:58.900481+0000","last_clean":"2024-09-12T02:57:58.900481+0000","last_became_active":"2024-09-12T02:57:08.875270+0000","last_became_peered":"2024-09-12T02:57:08.875270+0000","last_unstale":"2024-09-12T02:57:58.900481+0000","last_undegraded":"2024-09-12T02:57:58.900481+0000","last_fullsized":"2024-09-12T02:57:58.900481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860765+0000","last_change":"2024-09-12T02:57:50.001684+0000","last_active":"2024-09-12T02:57:57.860765+0000","last_peered":"2024-09-12T02:57:57.860765+0000","last_clean":"2024-09-12T02:57:57.860765+0000","last_became_active":"2024-09-12T02:57:50.000771+0000","last_became_peered":"2024-09-12T02:57:50.000771+0000","last_unstale":"2024-09-12T02:57:57.860765+0000","last_undegraded":"2024-09-12T02:57:57.860765+0000","last_fullsized":"2024-09-12T02:57:57.860765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:46.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848805+0000","last_change":"2024-09-12T02:57:03.812106+0000","last_active":"2024-09-12T02:57:56.848805+0000","last_peered":"2024-09-12T02:57:56.848805+0000","last_clean":"2024-09-12T02:57:56.848805+0000","last_became_active":"2024-09-12T02:57:03.810041+0000","last_became_peered":"2024-09-12T02:57:03.810041+0000","last_unstale":"2024-09-12T02:57:56.848805+0000","last_undegraded":"2024-09-12T02:57:56.848805+0000","last_fullsized":"2024-09-12T02:57:56.848805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900739+0000","last_change":"2024-09-12T02:57:09.030507+0000","last_active":"2024-09-12T02:57:58.900739+0000","last_peered":"2024-09-12T02:57:58.900739+0000","last_clean":"2024-09-12T02:57:58.900739+0000","last_became_active":"2024-09-12T02:57:09.029459+0000","last_became_peered":"2024-09-12T02:57:09.029459+0000","last_unstale":"2024-09-12T02:57:58.900739+0000","last_undegraded":"2024-09-12T02:57:58.900739+0000","last_fullsized":"2024-09-12T02:57:58.900739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:26.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899468+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:57:58.899468+0000","last_peered":"2024-09-12T02:57:58.899468+0000","last_clean":"2024-09-12T02:57:58.899468+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:57:58.899468+0000","last_undegraded":"2024-09-12T02:57:58.899468+0000","last_fullsized":"2024-09-12T02:57:58.899468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929406+0000","last_change":"2024-09-12T02:57:47.802130+0000","last_active":"2024-09-12T02:57:56.929406+0000","last_peered":"2024-09-12T02:57:56.929406+0000","last_clean":"2024-09-12T02:57:56.929406+0000","last_became_active":"2024-09-12T02:57:47.801836+0000","last_became_peered":"2024-09-12T02:57:47.801836+0000","last_unstale":"2024-09-12T02:57:56.929406+0000","last_undegraded":"2024-09-12T02:57:56.929406+0000","last_fullsized":"2024-09-12T02:57:56.929406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.857742+0000","last_change":"2024-09-12T02:57:03.807210+0000","last_active":"2024-09-12T02:57:57.857742+0000","last_peered":"2024-09-12T02:57:57.857742+0000","last_clean":"2024-09-12T02:57:57.857742+0000","last_became_active":"2024-09-12T02:57:03.805335+0000","last_became_peered":"2024-09-12T02:57:03.805335+0000","last_unstale":"2024-09-12T02:57:57.857742+0000","last_undegraded":"2024-09-12T02:57:57.857742+0000","last_fullsized":"2024-09-12T02:57:57.857742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849521+0000","last_change":"2024-09-12T02:57:08.895753+0000","last_active":"2024-09-12T02:57:56.849521+0000","last_peered":"2024-09-12T02:57:56.849521+0000","last_clean":"2024-09-12T02:57:56.849521+0000","last_became_active":"2024-09-12T02:57:08.894542+0000","last_became_peered":"2024-09-12T02:57:08.894542+0000","last_unstale":"2024-09-12T02:57:56.849521+0000","last_undegraded":"2024-09-12T02:57:56.849521+0000","last_fullsized":"2024-09-12T02:57:56.849521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900516+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:57:58.900516+0000","last_peered":"2024-09-12T02:57:58.900516+0000","last_clean":"2024-09-12T02:57:58.900516+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:57:58.900516+0000","last_undegraded":"2024-09-12T02:57:58.900516+0000","last_fullsized":"2024-09-12T02:57:58.900516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900826+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:57:58.900826+0000","last_peered":"2024-09-12T02:57:58.900826+0000","last_clean":"2024-09-12T02:57:58.900826+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:57:58.900826+0000","last_undegraded":"2024-09-12T02:57:58.900826+0000","last_fullsized":"2024-09-12T02:57:58.900826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848316+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:57:56.848316+0000","last_peered":"2024-09-12T02:57:56.848316+0000","last_clean":"2024-09-12T02:57:56.848316+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:57:56.848316+0000","last_undegraded":"2024-09-12T02:57:56.848316+0000","last_fullsized":"2024-09-12T02:57:56.848316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899654+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:57:58.899654+0000","last_peered":"2024-09-12T02:57:58.899654+0000","last_clean":"2024-09-12T02:57:58.899654+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:57:58.899654+0000","last_undegraded":"2024-09-12T02:57:58.899654+0000","last_fullsized":"2024-09-12T02:57:58.899654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857526+0000","last_change":"2024-09-12T02:57:08.873190+0000","last_active":"2024-09-12T02:57:58.857526+0000","last_peered":"2024-09-12T02:57:58.857526+0000","last_clean":"2024-09-12T02:57:58.857526+0000","last_became_active":"2024-09-12T02:57:08.872526+0000","last_became_peered":"2024-09-12T02:57:08.872526+0000","last_unstale":"2024-09-12T02:57:58.857526+0000","last_undegraded":"2024-09-12T02:57:58.857526+0000","last_fullsized":"2024-09-12T02:57:58.857526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:15.257391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901315+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:57:58.901315+0000","last_peered":"2024-09-12T02:57:58.901315+0000","last_clean":"2024-09-12T02:57:58.901315+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:57:58.901315+0000","last_undegraded":"2024-09-12T02:57:58.901315+0000","last_fullsized":"2024-09-12T02:57:58.901315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.861656+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:57:57.861656+0000","last_peered":"2024-09-12T02:57:57.861656+0000","last_clean":"2024-09-12T02:57:57.861656+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:57:57.861656+0000","last_undegraded":"2024-09-12T02:57:57.861656+0000","last_fullsized":"2024-09-12T02:57:57.861656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900534+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:57:58.900534+0000","last_peered":"2024-09-12T02:57:58.900534+0000","last_clean":"2024-09-12T02:57:58.900534+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:57:58.900534+0000","last_undegraded":"2024-09-12T02:57:58.900534+0000","last_fullsized":"2024-09-12T02:57:58.900534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.847483+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:57:56.847483+0000","last_peered":"2024-09-12T02:57:56.847483+0000","last_clean":"2024-09-12T02:57:56.847483+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:57:56.847483+0000","last_undegraded":"2024-09-12T02:57:56.847483+0000","last_fullsized":"2024-09-12T02:57:56.847483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857460+0000","last_change":"2024-09-12T02:57:04.841244+0000","last_active":"2024-09-12T02:57:58.857460+0000","last_peered":"2024-09-12T02:57:58.857460+0000","last_clean":"2024-09-12T02:57:58.857460+0000","last_became_active":"2024-09-12T02:57:04.837935+0000","last_became_peered":"2024-09-12T02:57:04.837935+0000","last_unstale":"2024-09-12T02:57:58.857460+0000","last_undegraded":"2024-09-12T02:57:58.857460+0000","last_fullsized":"2024-09-12T02:57:58.857460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:50.023694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859200+0000","last_change":"2024-09-12T02:57:04.874054+0000","last_active":"2024-09-12T02:57:57.859200+0000","last_peered":"2024-09-12T02:57:57.859200+0000","last_clean":"2024-09-12T02:57:57.859200+0000","last_became_active":"2024-09-12T02:57:04.867372+0000","last_became_peered":"2024-09-12T02:57:04.867372+0000","last_unstale":"2024-09-12T02:57:57.859200+0000","last_undegraded":"2024-09-12T02:57:57.859200+0000","last_fullsized":"2024-09-12T02:57:57.859200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:06.010582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899233+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:57:58.899233+0000","last_peered":"2024-09-12T02:57:58.899233+0000","last_clean":"2024-09-12T02:57:58.899233+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:57:58.899233+0000","last_undegraded":"2024-09-12T02:57:58.899233+0000","last_fullsized":"2024-09-12T02:57:58.899233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901736+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:57:58.901736+0000","last_peered":"2024-09-12T02:57:58.901736+0000","last_clean":"2024-09-12T02:57:58.901736+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:57:58.901736+0000","last_undegraded":"2024-09-12T02:57:58.901736+0000","last_fullsized":"2024-09-12T02:57:58.901736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929026+0000","last_change":"2024-09-12T02:57:04.836873+0000","last_active":"2024-09-12T02:57:56.929026+0000","last_peered":"2024-09-12T02:57:56.929026+0000","last_clean":"2024-09-12T02:57:56.929026+0000","last_became_active":"2024-09-12T02:57:04.836564+0000","last_became_peered":"2024-09-12T02:57:04.836564+0000","last_unstale":"2024-09-12T02:57:56.929026+0000","last_undegraded":"2024-09-12T02:57:56.929026+0000","last_fullsized":"2024-09-12T02:57:56.929026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.539077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848736+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:57:56.848736+0000","last_peered":"2024-09-12T02:57:56.848736+0000","last_clean":"2024-09-12T02:57:56.848736+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:57:56.848736+0000","last_undegraded":"2024-09-12T02:57:56.848736+0000","last_fullsized":"2024-09-12T02:57:56.848736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.902023+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:57:58.902023+0000","last_peered":"2024-09-12T02:57:58.902023+0000","last_clean":"2024-09-12T02:57:58.902023+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:57:58.902023+0000","last_undegraded":"2024-09-12T02:57:58.902023+0000","last_fullsized":"2024-09-12T02:57:58.902023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.857507+0000","last_change":"2024-09-12T02:57:04.874760+0000","last_active":"2024-09-12T02:57:57.857507+0000","last_peered":"2024-09-12T02:57:57.857507+0000","last_clean":"2024-09-12T02:57:57.857507+0000","last_became_active":"2024-09-12T02:57:04.861196+0000","last_became_peered":"2024-09-12T02:57:04.861196+0000","last_unstale":"2024-09-12T02:57:57.857507+0000","last_undegraded":"2024-09-12T02:57:57.857507+0000","last_fullsized":"2024-09-12T02:57:57.857507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900588+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:57:58.900588+0000","last_peered":"2024-09-12T02:57:58.900588+0000","last_clean":"2024-09-12T02:57:58.900588+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:57:58.900588+0000","last_undegraded":"2024-09-12T02:57:58.900588+0000","last_fullsized":"2024-09-12T02:57:58.900588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858961+0000","last_change":"2024-09-12T02:57:04.879052+0000","last_active":"2024-09-12T02:57:57.858961+0000","last_peered":"2024-09-12T02:57:57.858961+0000","last_clean":"2024-09-12T02:57:57.858961+0000","last_became_active":"2024-09-12T02:57:04.877672+0000","last_became_peered":"2024-09-12T02:57:04.877672+0000","last_unstale":"2024-09-12T02:57:57.858961+0000","last_undegraded":"2024-09-12T02:57:57.858961+0000","last_fullsized":"2024-09-12T02:57:57.858961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899137+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:57:58.899137+0000","last_peered":"2024-09-12T02:57:58.899137+0000","last_clean":"2024-09-12T02:57:58.899137+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:57:58.899137+0000","last_undegraded":"2024-09-12T02:57:58.899137+0000","last_fullsized":"2024-09-12T02:57:58.899137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848258+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:57:56.848258+0000","last_peered":"2024-09-12T02:57:56.848258+0000","last_clean":"2024-09-12T02:57:56.848258+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:57:56.848258+0000","last_undegraded":"2024-09-12T02:57:56.848258+0000","last_fullsized":"2024-09-12T02:57:56.848258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850987+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:57:56.850987+0000","last_peered":"2024-09-12T02:57:56.850987+0000","last_clean":"2024-09-12T02:57:56.850987+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:57:56.850987+0000","last_undegraded":"2024-09-12T02:57:56.850987+0000","last_fullsized":"2024-09-12T02:57:56.850987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857788+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:57:58.857788+0000","last_peered":"2024-09-12T02:57:58.857788+0000","last_clean":"2024-09-12T02:57:58.857788+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:57:58.857788+0000","last_undegraded":"2024-09-12T02:57:58.857788+0000","last_fullsized":"2024-09-12T02:57:58.857788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.861423+0000","last_change":"2024-09-12T02:57:04.867799+0000","last_active":"2024-09-12T02:57:57.861423+0000","last_peered":"2024-09-12T02:57:57.861423+0000","last_clean":"2024-09-12T02:57:57.861423+0000","last_became_active":"2024-09-12T02:57:04.863800+0000","last_became_peered":"2024-09-12T02:57:04.863800+0000","last_unstale":"2024-09-12T02:57:57.861423+0000","last_undegraded":"2024-09-12T02:57:57.861423+0000","last_fullsized":"2024-09-12T02:57:57.861423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.857306+0000","last_change":"2024-09-12T02:57:04.864906+0000","last_active":"2024-09-12T02:57:57.857306+0000","last_peered":"2024-09-12T02:57:57.857306+0000","last_clean":"2024-09-12T02:57:57.857306+0000","last_became_active":"2024-09-12T02:57:04.863556+0000","last_became_peered":"2024-09-12T02:57:04.863556+0000","last_unstale":"2024-09-12T02:57:57.857306+0000","last_undegraded":"2024-09-12T02:57:57.857306+0000","last_fullsized":"2024-09-12T02:57:57.857306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929490+0000","last_change":"2024-09-12T02:57:04.826304+0000","last_active":"2024-09-12T02:57:56.929490+0000","last_peered":"2024-09-12T02:57:56.929490+0000","last_clean":"2024-09-12T02:57:56.929490+0000","last_became_active":"2024-09-12T02:57:04.825998+0000","last_became_peered":"2024-09-12T02:57:04.825998+0000","last_unstale":"2024-09-12T02:57:56.929490+0000","last_undegraded":"2024-09-12T02:57:56.929490+0000","last_fullsized":"2024-09-12T02:57:56.929490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:35.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899650+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:57:58.899650+0000","last_peered":"2024-09-12T02:57:58.899650+0000","last_clean":"2024-09-12T02:57:58.899650+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:57:58.899650+0000","last_undegraded":"2024-09-12T02:57:58.899650+0000","last_fullsized":"2024-09-12T02:57:58.899650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901223+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:57:58.901223+0000","last_peered":"2024-09-12T02:57:58.901223+0000","last_clean":"2024-09-12T02:57:58.901223+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:57:58.901223+0000","last_undegraded":"2024-09-12T02:57:58.901223+0000","last_fullsized":"2024-09-12T02:57:58.901223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859978+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:57:57.859978+0000","last_peered":"2024-09-12T02:57:57.859978+0000","last_clean":"2024-09-12T02:57:57.859978+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:57:57.859978+0000","last_undegraded":"2024-09-12T02:57:57.859978+0000","last_fullsized":"2024-09-12T02:57:57.859978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848324+0000","last_change":"2024-09-12T02:57:04.864295+0000","last_active":"2024-09-12T02:57:56.848324+0000","last_peered":"2024-09-12T02:57:56.848324+0000","last_clean":"2024-09-12T02:57:56.848324+0000","last_became_active":"2024-09-12T02:57:04.863563+0000","last_became_peered":"2024-09-12T02:57:04.863563+0000","last_unstale":"2024-09-12T02:57:56.848324+0000","last_undegraded":"2024-09-12T02:57:56.848324+0000","last_fullsized":"2024-09-12T02:57:56.848324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848502+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:57:56.848502+0000","last_peered":"2024-09-12T02:57:56.848502+0000","last_clean":"2024-09-12T02:57:56.848502+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:57:56.848502+0000","last_undegraded":"2024-09-12T02:57:56.848502+0000","last_fullsized":"2024-09-12T02:57:56.848502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851366+0000","last_change":"2024-09-12T02:57:04.881172+0000","last_active":"2024-09-12T02:57:56.851366+0000","last_peered":"2024-09-12T02:57:56.851366+0000","last_clean":"2024-09-12T02:57:56.851366+0000","last_became_active":"2024-09-12T02:57:04.880660+0000","last_became_peered":"2024-09-12T02:57:04.880660+0000","last_unstale":"2024-09-12T02:57:56.851366+0000","last_undegraded":"2024-09-12T02:57:56.851366+0000","last_fullsized":"2024-09-12T02:57:56.851366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:15.389185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900386+0000","last_change":"2024-09-12T02:57:04.876735+0000","last_active":"2024-09-12T02:57:58.900386+0000","last_peered":"2024-09-12T02:57:58.900386+0000","last_clean":"2024-09-12T02:57:58.900386+0000","last_became_active":"2024-09-12T02:57:04.876321+0000","last_became_peered":"2024-09-12T02:57:04.876321+0000","last_unstale":"2024-09-12T02:57:58.900386+0000","last_undegraded":"2024-09-12T02:57:58.900386+0000","last_fullsized":"2024-09-12T02:57:58.900386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849214+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:57:56.849214+0000","last_peered":"2024-09-12T02:57:56.849214+0000","last_clean":"2024-09-12T02:57:56.849214+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:57:56.849214+0000","last_undegraded":"2024-09-12T02:57:56.849214+0000","last_fullsized":"2024-09-12T02:57:56.849214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858708+0000","last_change":"2024-09-12T02:57:04.878277+0000","last_active":"2024-09-12T02:57:57.858708+0000","last_peered":"2024-09-12T02:57:57.858708+0000","last_clean":"2024-09-12T02:57:57.858708+0000","last_became_active":"2024-09-12T02:57:04.876816+0000","last_became_peered":"2024-09-12T02:57:04.876816+0000","last_unstale":"2024-09-12T02:57:57.858708+0000","last_undegraded":"2024-09-12T02:57:57.858708+0000","last_fullsized":"2024-09-12T02:57:57.858708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850252+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:57:56.850252+0000","last_peered":"2024-09-12T02:57:56.850252+0000","last_clean":"2024-09-12T02:57:56.850252+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:57:56.850252+0000","last_undegraded":"2024-09-12T02:57:56.850252+0000","last_fullsized":"2024-09-12T02:57:56.850252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858965+0000","last_change":"2024-09-12T02:57:04.876472+0000","last_active":"2024-09-12T02:57:57.858965+0000","last_peered":"2024-09-12T02:57:57.858965+0000","last_clean":"2024-09-12T02:57:57.858965+0000","last_became_active":"2024-09-12T02:57:04.867264+0000","last_became_peered":"2024-09-12T02:57:04.867264+0000","last_unstale":"2024-09-12T02:57:57.858965+0000","last_undegraded":"2024-09-12T02:57:57.858965+0000","last_fullsized":"2024-09-12T02:57:57.858965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899104+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:57:58.899104+0000","last_peered":"2024-09-12T02:57:58.899104+0000","last_clean":"2024-09-12T02:57:58.899104+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:57:58.899104+0000","last_undegraded":"2024-09-12T02:57:58.899104+0000","last_fullsized":"2024-09-12T02:57:58.899104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929118+0000","last_change":"2024-09-12T02:57:04.841638+0000","last_active":"2024-09-12T02:57:56.929118+0000","last_peered":"2024-09-12T02:57:56.929118+0000","last_clean":"2024-09-12T02:57:56.929118+0000","last_became_active":"2024-09-12T02:57:04.841367+0000","last_became_peered":"2024-09-12T02:57:04.841367+0000","last_unstale":"2024-09-12T02:57:56.929118+0000","last_undegraded":"2024-09-12T02:57:56.929118+0000","last_fullsized":"2024-09-12T02:57:56.929118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:24.890973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851266+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:57:56.851266+0000","last_peered":"2024-09-12T02:57:56.851266+0000","last_clean":"2024-09-12T02:57:56.851266+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:57:56.851266+0000","last_undegraded":"2024-09-12T02:57:56.851266+0000","last_fullsized":"2024-09-12T02:57:56.851266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":409600,"data_stored":182919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":169886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":760892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":966656,"data_stored":753922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":169091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":163062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":380928,"data_stored":163098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":376832,"data_stored":163132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:58:02.303 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:58:02.348 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:02.343+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:02.400 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:02.400 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:02.417 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:02.449 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:02.443+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:02.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.477+0000 7f09cac00640 1 Processor -- start 2024-09-12T02:58:02.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.477+0000 7f09cac00640 1 -- start start 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09cac00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c4154c90 0x7f09c40c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09cac00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09c406ec90 0x7f09c40ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09cac00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f09c415b5c0 0x7f09c406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09cac00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f09c415b130 con 0x7f09c406ec90 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09cac00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f09c40c36b0 con 0x7f09c415b5c0 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09cac00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f09c4155070 con 0x7f09c4154c90 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09c406ec90 0x7f09c40ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09c406ec90 0x7f09c40ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48226/0 (socket says 172.21.15.63:48226) 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c3400640 1 -- 172.21.15.63:0/1360595809 learned_addr learned my addr 172.21.15.63:0/1360595809 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:02.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c8c00640 1 --2- 172.21.15.63:0/1360595809 >> v2:172.21.15.119:3300/0 conn(0x7f09c415b5c0 0x7f09c406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c3e00640 1 --2- 172.21.15.63:0/1360595809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c4154c90 0x7f09c40c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c3400640 1 -- 172.21.15.63:0/1360595809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c4154c90 msgr2=0x7f09c40c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:02.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c3400640 1 --2- 172.21.15.63:0/1360595809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c4154c90 0x7f09c40c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c3400640 1 -- 172.21.15.63:0/1360595809 >> v2:172.21.15.119:3300/0 conn(0x7f09c415b5c0 msgr2=0x7f09c406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:02.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c3400640 1 --2- 172.21.15.63:0/1360595809 >> v2:172.21.15.119:3300/0 conn(0x7f09c415b5c0 0x7f09c406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.481+0000 7f09c3400640 1 -- 172.21.15.63:0/1360595809 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c40c8bf0 con 0x7f09c406ec90 2024-09-12T02:58:02.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09c3400640 1 --2- 172.21.15.63:0/1360595809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c406ec90 0x7f09c40ce270 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f09c40720f0 tx=0x7f09b001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8aa21e5b09ce74 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:02.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09c2a00640 1 -- 172.21.15.63:0/1360595809 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b00b5070 con 0x7f09c406ec90 2024-09-12T02:58:02.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09c2a00640 1 -- 172.21.15.63:0/1360595809 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b00a89d0 con 0x7f09c406ec90 2024-09-12T02:58:02.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09c2a00640 1 -- 172.21.15.63:0/1360595809 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b00a8da0 con 0x7f09c406ec90 2024-09-12T02:58:02.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 -- 172.21.15.63:0/1360595809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c406ec90 msgr2=0x7f09c40ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 --2- 172.21.15.63:0/1360595809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c406ec90 0x7f09c40ce270 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f09c40720f0 tx=0x7f09b001ed10 comp rx=0 tx=0).stop 2024-09-12T02:58:02.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 -- 172.21.15.63:0/1360595809 shutdown_connections 2024-09-12T02:58:02.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 --2- 172.21.15.63:0/1360595809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c406ec90 0x7f09c40ce270 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 --2- 172.21.15.63:0/1360595809 >> v2:172.21.15.119:3300/0 conn(0x7f09c415b5c0 0x7f09c406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 --2- 172.21.15.63:0/1360595809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c4154c90 0x7f09c40c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 -- 172.21.15.63:0/1360595809 >> 172.21.15.63:0/1360595809 conn(0x7f09c406bcc0 msgr2=0x7f09c406fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:02.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 -- 172.21.15.63:0/1360595809 shutdown_connections 2024-09-12T02:58:02.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 -- 172.21.15.63:0/1360595809 wait complete. 2024-09-12T02:58:02.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 Processor -- start 2024-09-12T02:58:02.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.485+0000 7f09cac00640 1 -- start start 2024-09-12T02:58:02.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09cac00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c406ec90 0x7f09c41f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09cac00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c4154c90 0x7f09c40ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09cac00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09c415b5c0 0x7f09c40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09cac00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f09c415aae0 con 0x7f09c4154c90 2024-09-12T02:58:02.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09cac00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f09c40c91b0 con 0x7f09c415b5c0 2024-09-12T02:58:02.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09cac00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f09c415adc0 con 0x7f09c406ec90 2024-09-12T02:58:02.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c4154c90 0x7f09c40ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c4154c90 0x7f09c40ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48230/0 (socket says 172.21.15.63:48230) 2024-09-12T02:58:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3400640 1 -- 172.21.15.63:0/269393770 learned_addr learned my addr 172.21.15.63:0/269393770 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3e00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c406ec90 0x7f09c41f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c8c00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09c415b5c0 0x7f09c40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3400640 1 -- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c406ec90 msgr2=0x7f09c41f15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3400640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c406ec90 0x7f09c41f15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3400640 1 -- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09c415b5c0 msgr2=0x7f09c40c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3400640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09c415b5c0 0x7f09c40c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3400640 1 -- 172.21.15.63:0/269393770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c40c7a60 con 0x7f09c4154c90 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c8c00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09c415b5c0 0x7f09c40c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09c3400640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c4154c90 0x7f09c40ca210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f09b00b3040 tx=0x7f09b001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09bbe00640 1 -- 172.21.15.63:0/269393770 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b00b5070 con 0x7f09c4154c90 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09bbe00640 1 -- 172.21.15.63:0/269393770 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b00b0a70 con 0x7f09c4154c90 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09bbe00640 1 -- 172.21.15.63:0/269393770 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b00b0e60 con 0x7f09c4154c90 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c40c98a0 con 0x7f09c4154c90 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c40c9e60 con 0x7f09c4154c90 2024-09-12T02:58:02.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.489+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c406c6d0 con 0x7f09c4154c90 2024-09-12T02:58:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.493+0000 7f09bbe00640 1 -- 172.21.15.63:0/269393770 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f09b00c2060 con 0x7f09c4154c90 2024-09-12T02:58:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.493+0000 7f09bbe00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f09a40678c0 0x7f09a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.493+0000 7f09bbe00640 1 -- 172.21.15.63:0/269393770 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6706+0+0 (secure 0 0 0) 0x7f09b0123240 con 0x7f09c4154c90 2024-09-12T02:58:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.493+0000 7f09c3e00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f09a40678c0 0x7f09a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.493+0000 7f09c3e00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f09a40678c0 0x7f09a4069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09b40045f0 tx=0x7f09b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:02.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.497+0000 7f09bbe00640 1 -- 172.21.15.63:0/269393770 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f09b0018870 con 0x7f09c4154c90 2024-09-12T02:58:02.550 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:02.547+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:02.567 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:02.567 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:02.585 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:02.651 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:02.647+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:02.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.669+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09c40cea80 con 0x7f09a40678c0 2024-09-12T02:58:02.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.693+0000 7f09bbe00640 1 -- 172.21.15.63:0/269393770 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332644 (secure 0 0 0) 0x7f09c40cea80 con 0x7f09a40678c0 2024-09-12T02:58:02.699 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:58:02.701 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:58:02.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f09a40678c0 msgr2=0x7f09a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f09a40678c0 0x7f09a4069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09b40045f0 tx=0x7f09b4008040 comp rx=0 tx=0).stop 2024-09-12T02:58:02.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c4154c90 msgr2=0x7f09c40ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c4154c90 0x7f09c40ca210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f09b00b3040 tx=0x7f09b001bab0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 shutdown_connections 2024-09-12T02:58:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09c415b5c0 0x7f09c40c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09c4154c90 0x7f09c40ca210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f09a40678c0 0x7f09a4069d80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 --2- 172.21.15.63:0/269393770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09c406ec90 0x7f09c41f15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 >> 172.21.15.63:0/269393770 conn(0x7f09c406bcc0 msgr2=0x7f09c4071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 shutdown_connections 2024-09-12T02:58:02.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.697+0000 7f09cac00640 1 -- 172.21.15.63:0/269393770 wait complete. 2024-09-12T02:58:02.721 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T02:58:01.881981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220416,"kb_used_data":4160,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754304,"statfs":{"total":773094113280,"available":772868407296,"internally_reserved":0,"allocated":4259840,"data_stored":2526002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.027736"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899558+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:57:58.899558+0000","last_peered":"2024-09-12T02:57:58.899558+0000","last_clean":"2024-09-12T02:57:58.899558+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:57:58.899558+0000","last_undegraded":"2024-09-12T02:57:58.899558+0000","last_fullsized":"2024-09-12T02:57:58.899558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901929+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:57:58.901929+0000","last_peered":"2024-09-12T02:57:58.901929+0000","last_clean":"2024-09-12T02:57:58.901929+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:57:58.901929+0000","last_undegraded":"2024-09-12T02:57:58.901929+0000","last_fullsized":"2024-09-12T02:57:58.901929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900482+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:57:58.900482+0000","last_peered":"2024-09-12T02:57:58.900482+0000","last_clean":"2024-09-12T02:57:58.900482+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:57:58.900482+0000","last_undegraded":"2024-09-12T02:57:58.900482+0000","last_fullsized":"2024-09-12T02:57:58.900482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.902024+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:57:58.902024+0000","last_peered":"2024-09-12T02:57:58.902024+0000","last_clean":"2024-09-12T02:57:58.902024+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:57:58.902024+0000","last_undegraded":"2024-09-12T02:57:58.902024+0000","last_fullsized":"2024-09-12T02:57:58.902024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899442+0000","last_change":"2024-09-12T02:57:04.882473+0000","last_active":"2024-09-12T02:57:58.899442+0000","last_peered":"2024-09-12T02:57:58.899442+0000","last_clean":"2024-09-12T02:57:58.899442+0000","last_became_active":"2024-09-12T02:57:04.882182+0000","last_became_peered":"2024-09-12T02:57:04.882182+0000","last_unstale":"2024-09-12T02:57:58.899442+0000","last_undegraded":"2024-09-12T02:57:58.899442+0000","last_fullsized":"2024-09-12T02:57:58.899442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.857956+0000","last_change":"2024-09-12T02:57:47.879927+0000","last_active":"2024-09-12T02:57:57.857956+0000","last_peered":"2024-09-12T02:57:57.857956+0000","last_clean":"2024-09-12T02:57:57.857956+0000","last_became_active":"2024-09-12T02:57:47.878658+0000","last_became_peered":"2024-09-12T02:57:47.878658+0000","last_unstale":"2024-09-12T02:57:57.857956+0000","last_undegraded":"2024-09-12T02:57:57.857956+0000","last_fullsized":"2024-09-12T02:57:57.857956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:40:28.393450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850901+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:57:56.850901+0000","last_peered":"2024-09-12T02:57:56.850901+0000","last_clean":"2024-09-12T02:57:56.850901+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:57:56.850901+0000","last_undegraded":"2024-09-12T02:57:56.850901+0000","last_fullsized":"2024-09-12T02:57:56.850901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859283+0000","last_change":"2024-09-12T02:57:04.875312+0000","last_active":"2024-09-12T02:57:57.859283+0000","last_peered":"2024-09-12T02:57:57.859283+0000","last_clean":"2024-09-12T02:57:57.859283+0000","last_became_active":"2024-09-12T02:57:04.863748+0000","last_became_peered":"2024-09-12T02:57:04.863748+0000","last_unstale":"2024-09-12T02:57:57.859283+0000","last_undegraded":"2024-09-12T02:57:57.859283+0000","last_fullsized":"2024-09-12T02:57:57.859283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:39.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859732+0000","last_change":"2024-09-12T02:57:08.888677+0000","last_active":"2024-09-12T02:57:57.859732+0000","last_peered":"2024-09-12T02:57:57.859732+0000","last_clean":"2024-09-12T02:57:57.859732+0000","last_became_active":"2024-09-12T02:57:08.875948+0000","last_became_peered":"2024-09-12T02:57:08.875948+0000","last_unstale":"2024-09-12T02:57:57.859732+0000","last_undegraded":"2024-09-12T02:57:57.859732+0000","last_fullsized":"2024-09-12T02:57:57.859732+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:27.194444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850517+0000","last_change":"2024-09-12T02:57:03.832933+0000","last_active":"2024-09-12T02:57:56.850517+0000","last_peered":"2024-09-12T02:57:56.850517+0000","last_clean":"2024-09-12T02:57:56.850517+0000","last_became_active":"2024-09-12T02:57:03.832253+0000","last_became_peered":"2024-09-12T02:57:03.832253+0000","last_unstale":"2024-09-12T02:57:56.850517+0000","last_undegraded":"2024-09-12T02:57:56.850517+0000","last_fullsized":"2024-09-12T02:57:56.850517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860746+0000","last_change":"2024-09-12T02:57:04.880036+0000","last_active":"2024-09-12T02:57:57.860746+0000","last_peered":"2024-09-12T02:57:57.860746+0000","last_clean":"2024-09-12T02:57:57.860746+0000","last_became_active":"2024-09-12T02:57:04.879490+0000","last_became_peered":"2024-09-12T02:57:04.879490+0000","last_unstale":"2024-09-12T02:57:57.860746+0000","last_undegraded":"2024-09-12T02:57:57.860746+0000","last_fullsized":"2024-09-12T02:57:57.860746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.579939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.861319+0000","last_change":"2024-09-12T02:57:08.890508+0000","last_active":"2024-09-12T02:57:57.861319+0000","last_peered":"2024-09-12T02:57:57.861319+0000","last_clean":"2024-09-12T02:57:57.861319+0000","last_became_active":"2024-09-12T02:57:08.886515+0000","last_became_peered":"2024-09-12T02:57:08.886515+0000","last_unstale":"2024-09-12T02:57:57.861319+0000","last_undegraded":"2024-09-12T02:57:57.861319+0000","last_fullsized":"2024-09-12T02:57:57.861319+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:28.963220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.847833+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:57:56.847833+0000","last_peered":"2024-09-12T02:57:56.847833+0000","last_clean":"2024-09-12T02:57:56.847833+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:57:56.847833+0000","last_undegraded":"2024-09-12T02:57:56.847833+0000","last_fullsized":"2024-09-12T02:57:56.847833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850709+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:57:56.850709+0000","last_peered":"2024-09-12T02:57:56.850709+0000","last_clean":"2024-09-12T02:57:56.850709+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:57:56.850709+0000","last_undegraded":"2024-09-12T02:57:56.850709+0000","last_fullsized":"2024-09-12T02:57:56.850709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860787+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:57:57.860787+0000","last_peered":"2024-09-12T02:57:57.860787+0000","last_clean":"2024-09-12T02:57:57.860787+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:57:57.860787+0000","last_undegraded":"2024-09-12T02:57:57.860787+0000","last_fullsized":"2024-09-12T02:57:57.860787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901243+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:57:58.901243+0000","last_peered":"2024-09-12T02:57:58.901243+0000","last_clean":"2024-09-12T02:57:58.901243+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:57:58.901243+0000","last_undegraded":"2024-09-12T02:57:58.901243+0000","last_fullsized":"2024-09-12T02:57:58.901243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928823+0000","last_change":"2024-09-12T02:57:03.790544+0000","last_active":"2024-09-12T02:57:56.928823+0000","last_peered":"2024-09-12T02:57:56.928823+0000","last_clean":"2024-09-12T02:57:56.928823+0000","last_became_active":"2024-09-12T02:57:03.790195+0000","last_became_peered":"2024-09-12T02:57:03.790195+0000","last_unstale":"2024-09-12T02:57:56.928823+0000","last_undegraded":"2024-09-12T02:57:56.928823+0000","last_fullsized":"2024-09-12T02:57:56.928823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859419+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:57:57.859419+0000","last_peered":"2024-09-12T02:57:57.859419+0000","last_clean":"2024-09-12T02:57:57.859419+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:57:57.859419+0000","last_undegraded":"2024-09-12T02:57:57.859419+0000","last_fullsized":"2024-09-12T02:57:57.859419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900600+0000","last_change":"2024-09-12T02:57:04.835949+0000","last_active":"2024-09-12T02:57:58.900600+0000","last_peered":"2024-09-12T02:57:58.900600+0000","last_clean":"2024-09-12T02:57:58.900600+0000","last_became_active":"2024-09-12T02:57:04.835628+0000","last_became_peered":"2024-09-12T02:57:04.835628+0000","last_unstale":"2024-09-12T02:57:58.900600+0000","last_undegraded":"2024-09-12T02:57:58.900600+0000","last_fullsized":"2024-09-12T02:57:58.900600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929574+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:57:56.929574+0000","last_peered":"2024-09-12T02:57:56.929574+0000","last_clean":"2024-09-12T02:57:56.929574+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:57:56.929574+0000","last_undegraded":"2024-09-12T02:57:56.929574+0000","last_fullsized":"2024-09-12T02:57:56.929574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.930232+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:57:56.930232+0000","last_peered":"2024-09-12T02:57:56.930232+0000","last_clean":"2024-09-12T02:57:56.930232+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:57:56.930232+0000","last_undegraded":"2024-09-12T02:57:56.930232+0000","last_fullsized":"2024-09-12T02:57:56.930232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858871+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:57:57.858871+0000","last_peered":"2024-09-12T02:57:57.858871+0000","last_clean":"2024-09-12T02:57:57.858871+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:57:57.858871+0000","last_undegraded":"2024-09-12T02:57:57.858871+0000","last_fullsized":"2024-09-12T02:57:57.858871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848720+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:57:56.848720+0000","last_peered":"2024-09-12T02:57:56.848720+0000","last_clean":"2024-09-12T02:57:56.848720+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:57:56.848720+0000","last_undegraded":"2024-09-12T02:57:56.848720+0000","last_fullsized":"2024-09-12T02:57:56.848720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.861351+0000","last_change":"2024-09-12T02:57:08.881925+0000","last_active":"2024-09-12T02:57:57.861351+0000","last_peered":"2024-09-12T02:57:57.861351+0000","last_clean":"2024-09-12T02:57:57.861351+0000","last_became_active":"2024-09-12T02:57:08.880913+0000","last_became_peered":"2024-09-12T02:57:08.880913+0000","last_unstale":"2024-09-12T02:57:57.861351+0000","last_undegraded":"2024-09-12T02:57:57.861351+0000","last_fullsized":"2024-09-12T02:57:57.861351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:48.637854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899774+0000","last_change":"2024-09-12T02:57:04.837566+0000","last_active":"2024-09-12T02:57:58.899774+0000","last_peered":"2024-09-12T02:57:58.899774+0000","last_clean":"2024-09-12T02:57:58.899774+0000","last_became_active":"2024-09-12T02:57:04.837281+0000","last_became_peered":"2024-09-12T02:57:04.837281+0000","last_unstale":"2024-09-12T02:57:58.899774+0000","last_undegraded":"2024-09-12T02:57:58.899774+0000","last_fullsized":"2024-09-12T02:57:58.899774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:23.664487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849238+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:57:56.849238+0000","last_peered":"2024-09-12T02:57:56.849238+0000","last_clean":"2024-09-12T02:57:56.849238+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:57:56.849238+0000","last_undegraded":"2024-09-12T02:57:56.849238+0000","last_fullsized":"2024-09-12T02:57:56.849238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858427+0000","last_change":"2024-09-12T02:57:09.038564+0000","last_active":"2024-09-12T02:57:57.858427+0000","last_peered":"2024-09-12T02:57:57.858427+0000","last_clean":"2024-09-12T02:57:57.858427+0000","last_became_active":"2024-09-12T02:57:09.036310+0000","last_became_peered":"2024-09-12T02:57:09.036310+0000","last_unstale":"2024-09-12T02:57:57.858427+0000","last_undegraded":"2024-09-12T02:57:57.858427+0000","last_fullsized":"2024-09-12T02:57:57.858427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.627698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.902096+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:57:58.902096+0000","last_peered":"2024-09-12T02:57:58.902096+0000","last_clean":"2024-09-12T02:57:58.902096+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:57:58.902096+0000","last_undegraded":"2024-09-12T02:57:58.902096+0000","last_fullsized":"2024-09-12T02:57:58.902096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929218+0000","last_change":"2024-09-12T02:57:03.809884+0000","last_active":"2024-09-12T02:57:56.929218+0000","last_peered":"2024-09-12T02:57:56.929218+0000","last_clean":"2024-09-12T02:57:56.929218+0000","last_became_active":"2024-09-12T02:57:03.809610+0000","last_became_peered":"2024-09-12T02:57:03.809610+0000","last_unstale":"2024-09-12T02:57:56.929218+0000","last_undegraded":"2024-09-12T02:57:56.929218+0000","last_fullsized":"2024-09-12T02:57:56.929218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900235+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:57:58.900235+0000","last_peered":"2024-09-12T02:57:58.900235+0000","last_clean":"2024-09-12T02:57:58.900235+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:57:58.900235+0000","last_undegraded":"2024-09-12T02:57:58.900235+0000","last_fullsized":"2024-09-12T02:57:58.900235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928536+0000","last_change":"2024-09-12T02:57:04.837330+0000","last_active":"2024-09-12T02:57:56.928536+0000","last_peered":"2024-09-12T02:57:56.928536+0000","last_clean":"2024-09-12T02:57:56.928536+0000","last_became_active":"2024-09-12T02:57:04.836984+0000","last_became_peered":"2024-09-12T02:57:04.836984+0000","last_unstale":"2024-09-12T02:57:56.928536+0000","last_undegraded":"2024-09-12T02:57:56.928536+0000","last_fullsized":"2024-09-12T02:57:56.928536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851187+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:57:56.851187+0000","last_peered":"2024-09-12T02:57:56.851187+0000","last_clean":"2024-09-12T02:57:56.851187+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:57:56.851187+0000","last_undegraded":"2024-09-12T02:57:56.851187+0000","last_fullsized":"2024-09-12T02:57:56.851187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899026+0000","last_change":"2024-09-12T02:57:48.057463+0000","last_active":"2024-09-12T02:57:58.899026+0000","last_peered":"2024-09-12T02:57:58.899026+0000","last_clean":"2024-09-12T02:57:58.899026+0000","last_became_active":"2024-09-12T02:57:48.057061+0000","last_became_peered":"2024-09-12T02:57:48.057061+0000","last_unstale":"2024-09-12T02:57:58.899026+0000","last_undegraded":"2024-09-12T02:57:58.899026+0000","last_fullsized":"2024-09-12T02:57:58.899026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.916390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860927+0000","last_change":"2024-09-12T02:57:04.861898+0000","last_active":"2024-09-12T02:57:57.860927+0000","last_peered":"2024-09-12T02:57:57.860927+0000","last_clean":"2024-09-12T02:57:57.860927+0000","last_became_active":"2024-09-12T02:57:04.858339+0000","last_became_peered":"2024-09-12T02:57:04.858339+0000","last_unstale":"2024-09-12T02:57:57.860927+0000","last_undegraded":"2024-09-12T02:57:57.860927+0000","last_fullsized":"2024-09-12T02:57:57.860927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928664+0000","last_change":"2024-09-12T02:57:03.796368+0000","last_active":"2024-09-12T02:57:56.928664+0000","last_peered":"2024-09-12T02:57:56.928664+0000","last_clean":"2024-09-12T02:57:56.928664+0000","last_became_active":"2024-09-12T02:57:03.796016+0000","last_became_peered":"2024-09-12T02:57:03.796016+0000","last_unstale":"2024-09-12T02:57:56.928664+0000","last_undegraded":"2024-09-12T02:57:56.928664+0000","last_fullsized":"2024-09-12T02:57:56.928664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:27.840978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928529+0000","last_change":"2024-09-12T02:57:08.877519+0000","last_active":"2024-09-12T02:57:56.928529+0000","last_peered":"2024-09-12T02:57:56.928529+0000","last_clean":"2024-09-12T02:57:56.928529+0000","last_became_active":"2024-09-12T02:57:08.872329+0000","last_became_peered":"2024-09-12T02:57:08.872329+0000","last_unstale":"2024-09-12T02:57:56.928529+0000","last_undegraded":"2024-09-12T02:57:56.928529+0000","last_fullsized":"2024-09-12T02:57:56.928529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.661785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860235+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:57:57.860235+0000","last_peered":"2024-09-12T02:57:57.860235+0000","last_clean":"2024-09-12T02:57:57.860235+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:57:57.860235+0000","last_undegraded":"2024-09-12T02:57:57.860235+0000","last_fullsized":"2024-09-12T02:57:57.860235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859675+0000","last_change":"2024-09-12T02:57:03.802797+0000","last_active":"2024-09-12T02:57:57.859675+0000","last_peered":"2024-09-12T02:57:57.859675+0000","last_clean":"2024-09-12T02:57:57.859675+0000","last_became_active":"2024-09-12T02:57:03.798969+0000","last_became_peered":"2024-09-12T02:57:03.798969+0000","last_unstale":"2024-09-12T02:57:57.859675+0000","last_undegraded":"2024-09-12T02:57:57.859675+0000","last_fullsized":"2024-09-12T02:57:57.859675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.025589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928145+0000","last_change":"2024-09-12T02:57:08.883289+0000","last_active":"2024-09-12T02:57:56.928145+0000","last_peered":"2024-09-12T02:57:56.928145+0000","last_clean":"2024-09-12T02:57:56.928145+0000","last_became_active":"2024-09-12T02:57:08.880476+0000","last_became_peered":"2024-09-12T02:57:08.880476+0000","last_unstale":"2024-09-12T02:57:56.928145+0000","last_undegraded":"2024-09-12T02:57:56.928145+0000","last_fullsized":"2024-09-12T02:57:56.928145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:04.472826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928219+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:57:56.928219+0000","last_peered":"2024-09-12T02:57:56.928219+0000","last_clean":"2024-09-12T02:57:56.928219+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:57:56.928219+0000","last_undegraded":"2024-09-12T02:57:56.928219+0000","last_fullsized":"2024-09-12T02:57:56.928219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857566+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:57:58.857566+0000","last_peered":"2024-09-12T02:57:58.857566+0000","last_clean":"2024-09-12T02:57:58.857566+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:57:58.857566+0000","last_undegraded":"2024-09-12T02:57:58.857566+0000","last_fullsized":"2024-09-12T02:57:58.857566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929933+0000","last_change":"2024-09-12T02:57:08.872506+0000","last_active":"2024-09-12T02:57:56.929933+0000","last_peered":"2024-09-12T02:57:56.929933+0000","last_clean":"2024-09-12T02:57:56.929933+0000","last_became_active":"2024-09-12T02:57:08.872127+0000","last_became_peered":"2024-09-12T02:57:08.872127+0000","last_unstale":"2024-09-12T02:57:56.929933+0000","last_undegraded":"2024-09-12T02:57:56.929933+0000","last_fullsized":"2024-09-12T02:57:56.929933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:19.461433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899604+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:57:58.899604+0000","last_peered":"2024-09-12T02:57:58.899604+0000","last_clean":"2024-09-12T02:57:58.899604+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:57:58.899604+0000","last_undegraded":"2024-09-12T02:57:58.899604+0000","last_fullsized":"2024-09-12T02:57:58.899604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848975+0000","last_change":"2024-09-12T02:57:03.827694+0000","last_active":"2024-09-12T02:57:56.848975+0000","last_peered":"2024-09-12T02:57:56.848975+0000","last_clean":"2024-09-12T02:57:56.848975+0000","last_became_active":"2024-09-12T02:57:03.827099+0000","last_became_peered":"2024-09-12T02:57:03.827099+0000","last_unstale":"2024-09-12T02:57:56.848975+0000","last_undegraded":"2024-09-12T02:57:56.848975+0000","last_fullsized":"2024-09-12T02:57:56.848975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899678+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:57:58.899678+0000","last_peered":"2024-09-12T02:57:58.899678+0000","last_clean":"2024-09-12T02:57:58.899678+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:57:58.899678+0000","last_undegraded":"2024-09-12T02:57:58.899678+0000","last_fullsized":"2024-09-12T02:57:58.899678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901089+0000","last_change":"2024-09-12T02:57:04.882517+0000","last_active":"2024-09-12T02:57:58.901089+0000","last_peered":"2024-09-12T02:57:58.901089+0000","last_clean":"2024-09-12T02:57:58.901089+0000","last_became_active":"2024-09-12T02:57:04.882159+0000","last_became_peered":"2024-09-12T02:57:04.882159+0000","last_unstale":"2024-09-12T02:57:58.901089+0000","last_undegraded":"2024-09-12T02:57:58.901089+0000","last_fullsized":"2024-09-12T02:57:58.901089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858421+0000","last_change":"2024-09-12T02:57:03.798773+0000","last_active":"2024-09-12T02:57:57.858421+0000","last_peered":"2024-09-12T02:57:57.858421+0000","last_clean":"2024-09-12T02:57:57.858421+0000","last_became_active":"2024-09-12T02:57:03.797799+0000","last_became_peered":"2024-09-12T02:57:03.797799+0000","last_unstale":"2024-09-12T02:57:57.858421+0000","last_undegraded":"2024-09-12T02:57:57.858421+0000","last_fullsized":"2024-09-12T02:57:57.858421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849228+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:57:56.849228+0000","last_peered":"2024-09-12T02:57:56.849228+0000","last_clean":"2024-09-12T02:57:56.849228+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:57:56.849228+0000","last_undegraded":"2024-09-12T02:57:56.849228+0000","last_fullsized":"2024-09-12T02:57:56.849228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848045+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:57:56.848045+0000","last_peered":"2024-09-12T02:57:56.848045+0000","last_clean":"2024-09-12T02:57:56.848045+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:57:56.848045+0000","last_undegraded":"2024-09-12T02:57:56.848045+0000","last_fullsized":"2024-09-12T02:57:56.848045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928875+0000","last_change":"2024-09-12T02:57:47.799311+0000","last_active":"2024-09-12T02:57:56.928875+0000","last_peered":"2024-09-12T02:57:56.928875+0000","last_clean":"2024-09-12T02:57:56.928875+0000","last_became_active":"2024-09-12T02:57:47.798962+0000","last_became_peered":"2024-09-12T02:57:47.798962+0000","last_unstale":"2024-09-12T02:57:56.928875+0000","last_undegraded":"2024-09-12T02:57:56.928875+0000","last_fullsized":"2024-09-12T02:57:56.928875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:50.572922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857652+0000","last_change":"2024-09-12T02:57:03.798239+0000","last_active":"2024-09-12T02:57:58.857652+0000","last_peered":"2024-09-12T02:57:58.857652+0000","last_clean":"2024-09-12T02:57:58.857652+0000","last_became_active":"2024-09-12T02:57:03.797935+0000","last_became_peered":"2024-09-12T02:57:03.797935+0000","last_unstale":"2024-09-12T02:57:58.857652+0000","last_undegraded":"2024-09-12T02:57:58.857652+0000","last_fullsized":"2024-09-12T02:57:58.857652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.847541+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:57:56.847541+0000","last_peered":"2024-09-12T02:57:56.847541+0000","last_clean":"2024-09-12T02:57:56.847541+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:57:56.847541+0000","last_undegraded":"2024-09-12T02:57:56.847541+0000","last_fullsized":"2024-09-12T02:57:56.847541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859528+0000","last_change":"2024-09-12T02:57:04.858809+0000","last_active":"2024-09-12T02:57:57.859528+0000","last_peered":"2024-09-12T02:57:57.859528+0000","last_clean":"2024-09-12T02:57:57.859528+0000","last_became_active":"2024-09-12T02:57:04.858048+0000","last_became_peered":"2024-09-12T02:57:04.858048+0000","last_unstale":"2024-09-12T02:57:57.859528+0000","last_undegraded":"2024-09-12T02:57:57.859528+0000","last_fullsized":"2024-09-12T02:57:57.859528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:59.698440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929235+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:57:56.929235+0000","last_peered":"2024-09-12T02:57:56.929235+0000","last_clean":"2024-09-12T02:57:56.929235+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:57:56.929235+0000","last_undegraded":"2024-09-12T02:57:56.929235+0000","last_fullsized":"2024-09-12T02:57:56.929235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899232+0000","last_change":"2024-09-12T02:57:08.874656+0000","last_active":"2024-09-12T02:57:58.899232+0000","last_peered":"2024-09-12T02:57:58.899232+0000","last_clean":"2024-09-12T02:57:58.899232+0000","last_became_active":"2024-09-12T02:57:08.874202+0000","last_became_peered":"2024-09-12T02:57:08.874202+0000","last_unstale":"2024-09-12T02:57:58.899232+0000","last_undegraded":"2024-09-12T02:57:58.899232+0000","last_fullsized":"2024-09-12T02:57:58.899232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.794828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851432+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:57:56.851432+0000","last_peered":"2024-09-12T02:57:56.851432+0000","last_clean":"2024-09-12T02:57:56.851432+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:57:56.851432+0000","last_undegraded":"2024-09-12T02:57:56.851432+0000","last_fullsized":"2024-09-12T02:57:56.851432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857847+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:57:58.857847+0000","last_peered":"2024-09-12T02:57:58.857847+0000","last_clean":"2024-09-12T02:57:58.857847+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:57:58.857847+0000","last_undegraded":"2024-09-12T02:57:58.857847+0000","last_fullsized":"2024-09-12T02:57:58.857847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.856838+0000","last_change":"2024-09-12T02:57:09.030839+0000","last_active":"2024-09-12T02:57:57.856838+0000","last_peered":"2024-09-12T02:57:57.856838+0000","last_clean":"2024-09-12T02:57:57.856838+0000","last_became_active":"2024-09-12T02:57:09.029808+0000","last_became_peered":"2024-09-12T02:57:09.029808+0000","last_unstale":"2024-09-12T02:57:57.856838+0000","last_undegraded":"2024-09-12T02:57:57.856838+0000","last_fullsized":"2024-09-12T02:57:57.856838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851216+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:57:56.851216+0000","last_peered":"2024-09-12T02:57:56.851216+0000","last_clean":"2024-09-12T02:57:56.851216+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:57:56.851216+0000","last_undegraded":"2024-09-12T02:57:56.851216+0000","last_fullsized":"2024-09-12T02:57:56.851216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860255+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:57:57.860255+0000","last_peered":"2024-09-12T02:57:57.860255+0000","last_clean":"2024-09-12T02:57:57.860255+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:57:57.860255+0000","last_undegraded":"2024-09-12T02:57:57.860255+0000","last_fullsized":"2024-09-12T02:57:57.860255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858023+0000","last_change":"2024-09-12T02:57:08.896161+0000","last_active":"2024-09-12T02:57:57.858023+0000","last_peered":"2024-09-12T02:57:57.858023+0000","last_clean":"2024-09-12T02:57:57.858023+0000","last_became_active":"2024-09-12T02:57:08.895379+0000","last_became_peered":"2024-09-12T02:57:08.895379+0000","last_unstale":"2024-09-12T02:57:57.858023+0000","last_undegraded":"2024-09-12T02:57:57.858023+0000","last_fullsized":"2024-09-12T02:57:57.858023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:34.049864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849462+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:57:56.849462+0000","last_peered":"2024-09-12T02:57:56.849462+0000","last_clean":"2024-09-12T02:57:56.849462+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:57:56.849462+0000","last_undegraded":"2024-09-12T02:57:56.849462+0000","last_fullsized":"2024-09-12T02:57:56.849462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857339+0000","last_change":"2024-09-12T02:57:03.788301+0000","last_active":"2024-09-12T02:57:58.857339+0000","last_peered":"2024-09-12T02:57:58.857339+0000","last_clean":"2024-09-12T02:57:58.857339+0000","last_became_active":"2024-09-12T02:57:03.788002+0000","last_became_peered":"2024-09-12T02:57:03.788002+0000","last_unstale":"2024-09-12T02:57:58.857339+0000","last_undegraded":"2024-09-12T02:57:58.857339+0000","last_fullsized":"2024-09-12T02:57:58.857339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899583+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:57:58.899583+0000","last_peered":"2024-09-12T02:57:58.899583+0000","last_clean":"2024-09-12T02:57:58.899583+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:57:58.899583+0000","last_undegraded":"2024-09-12T02:57:58.899583+0000","last_fullsized":"2024-09-12T02:57:58.899583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.847968+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:57:56.847968+0000","last_peered":"2024-09-12T02:57:56.847968+0000","last_clean":"2024-09-12T02:57:56.847968+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:57:56.847968+0000","last_undegraded":"2024-09-12T02:57:56.847968+0000","last_fullsized":"2024-09-12T02:57:56.847968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848258+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:57:56.848258+0000","last_peered":"2024-09-12T02:57:56.848258+0000","last_clean":"2024-09-12T02:57:56.848258+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:57:56.848258+0000","last_undegraded":"2024-09-12T02:57:56.848258+0000","last_fullsized":"2024-09-12T02:57:56.848258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.902003+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:57:58.902003+0000","last_peered":"2024-09-12T02:57:58.902003+0000","last_clean":"2024-09-12T02:57:58.902003+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:57:58.902003+0000","last_undegraded":"2024-09-12T02:57:58.902003+0000","last_fullsized":"2024-09-12T02:57:58.902003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850441+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:57:56.850441+0000","last_peered":"2024-09-12T02:57:56.850441+0000","last_clean":"2024-09-12T02:57:56.850441+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:57:56.850441+0000","last_undegraded":"2024-09-12T02:57:56.850441+0000","last_fullsized":"2024-09-12T02:57:56.850441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859435+0000","last_change":"2024-09-12T02:57:03.802047+0000","last_active":"2024-09-12T02:57:57.859435+0000","last_peered":"2024-09-12T02:57:57.859435+0000","last_clean":"2024-09-12T02:57:57.859435+0000","last_became_active":"2024-09-12T02:57:03.797936+0000","last_became_peered":"2024-09-12T02:57:03.797936+0000","last_unstale":"2024-09-12T02:57:57.859435+0000","last_undegraded":"2024-09-12T02:57:57.859435+0000","last_fullsized":"2024-09-12T02:57:57.859435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:10.176640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901516+0000","last_change":"2024-09-12T02:57:09.030826+0000","last_active":"2024-09-12T02:57:58.901516+0000","last_peered":"2024-09-12T02:57:58.901516+0000","last_clean":"2024-09-12T02:57:58.901516+0000","last_became_active":"2024-09-12T02:57:09.029437+0000","last_became_peered":"2024-09-12T02:57:09.029437+0000","last_unstale":"2024-09-12T02:57:58.901516+0000","last_undegraded":"2024-09-12T02:57:58.901516+0000","last_fullsized":"2024-09-12T02:57:58.901516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:15.670241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899228+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:57:58.899228+0000","last_peered":"2024-09-12T02:57:58.899228+0000","last_clean":"2024-09-12T02:57:58.899228+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:57:58.899228+0000","last_undegraded":"2024-09-12T02:57:58.899228+0000","last_fullsized":"2024-09-12T02:57:58.899228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899340+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:57:58.899340+0000","last_peered":"2024-09-12T02:57:58.899340+0000","last_clean":"2024-09-12T02:57:58.899340+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:57:58.899340+0000","last_undegraded":"2024-09-12T02:57:58.899340+0000","last_fullsized":"2024-09-12T02:57:58.899340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860659+0000","last_change":"2024-09-12T02:57:09.031080+0000","last_active":"2024-09-12T02:57:57.860659+0000","last_peered":"2024-09-12T02:57:57.860659+0000","last_clean":"2024-09-12T02:57:57.860659+0000","last_became_active":"2024-09-12T02:57:09.029892+0000","last_became_peered":"2024-09-12T02:57:09.029892+0000","last_unstale":"2024-09-12T02:57:57.860659+0000","last_undegraded":"2024-09-12T02:57:57.860659+0000","last_fullsized":"2024-09-12T02:57:57.860659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850731+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:57:56.850731+0000","last_peered":"2024-09-12T02:57:56.850731+0000","last_clean":"2024-09-12T02:57:56.850731+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:57:56.850731+0000","last_undegraded":"2024-09-12T02:57:56.850731+0000","last_fullsized":"2024-09-12T02:57:56.850731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'12","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848380+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:57:56.848380+0000","last_peered":"2024-09-12T02:57:56.848380+0000","last_clean":"2024-09-12T02:57:56.848380+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:57:56.848380+0000","last_undegraded":"2024-09-12T02:57:56.848380+0000","last_fullsized":"2024-09-12T02:57:56.848380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.928339+0000","last_change":"2024-09-12T02:57:08.884030+0000","last_active":"2024-09-12T02:57:56.928339+0000","last_peered":"2024-09-12T02:57:56.928339+0000","last_clean":"2024-09-12T02:57:56.928339+0000","last_became_active":"2024-09-12T02:57:08.880332+0000","last_became_peered":"2024-09-12T02:57:08.880332+0000","last_unstale":"2024-09-12T02:57:56.928339+0000","last_undegraded":"2024-09-12T02:57:56.928339+0000","last_fullsized":"2024-09-12T02:57:56.928339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:25.232846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860174+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:57:57.860174+0000","last_peered":"2024-09-12T02:57:57.860174+0000","last_clean":"2024-09-12T02:57:57.860174+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:57:57.860174+0000","last_undegraded":"2024-09-12T02:57:57.860174+0000","last_fullsized":"2024-09-12T02:57:57.860174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929136+0000","last_change":"2024-09-12T02:57:03.798009+0000","last_active":"2024-09-12T02:57:56.929136+0000","last_peered":"2024-09-12T02:57:56.929136+0000","last_clean":"2024-09-12T02:57:56.929136+0000","last_became_active":"2024-09-12T02:57:03.797749+0000","last_became_peered":"2024-09-12T02:57:03.797749+0000","last_unstale":"2024-09-12T02:57:56.929136+0000","last_undegraded":"2024-09-12T02:57:56.929136+0000","last_fullsized":"2024-09-12T02:57:56.929136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:13.058712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859325+0000","last_change":"2024-09-12T02:57:47.804893+0000","last_active":"2024-09-12T02:57:57.859325+0000","last_peered":"2024-09-12T02:57:57.859325+0000","last_clean":"2024-09-12T02:57:57.859325+0000","last_became_active":"2024-09-12T02:57:47.803416+0000","last_became_peered":"2024-09-12T02:57:47.803416+0000","last_unstale":"2024-09-12T02:57:57.859325+0000","last_undegraded":"2024-09-12T02:57:57.859325+0000","last_fullsized":"2024-09-12T02:57:57.859325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:39.193336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899535+0000","last_change":"2024-09-12T02:57:04.882349+0000","last_active":"2024-09-12T02:57:58.899535+0000","last_peered":"2024-09-12T02:57:58.899535+0000","last_clean":"2024-09-12T02:57:58.899535+0000","last_became_active":"2024-09-12T02:57:04.882060+0000","last_became_peered":"2024-09-12T02:57:04.882060+0000","last_unstale":"2024-09-12T02:57:58.899535+0000","last_undegraded":"2024-09-12T02:57:58.899535+0000","last_fullsized":"2024-09-12T02:57:58.899535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860873+0000","last_change":"2024-09-12T02:57:03.811429+0000","last_active":"2024-09-12T02:57:57.860873+0000","last_peered":"2024-09-12T02:57:57.860873+0000","last_clean":"2024-09-12T02:57:57.860873+0000","last_became_active":"2024-09-12T02:57:03.810672+0000","last_became_peered":"2024-09-12T02:57:03.810672+0000","last_unstale":"2024-09-12T02:57:57.860873+0000","last_undegraded":"2024-09-12T02:57:57.860873+0000","last_fullsized":"2024-09-12T02:57:57.860873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900481+0000","last_change":"2024-09-12T02:57:08.875903+0000","last_active":"2024-09-12T02:57:58.900481+0000","last_peered":"2024-09-12T02:57:58.900481+0000","last_clean":"2024-09-12T02:57:58.900481+0000","last_became_active":"2024-09-12T02:57:08.875270+0000","last_became_peered":"2024-09-12T02:57:08.875270+0000","last_unstale":"2024-09-12T02:57:58.900481+0000","last_undegraded":"2024-09-12T02:57:58.900481+0000","last_fullsized":"2024-09-12T02:57:58.900481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.860765+0000","last_change":"2024-09-12T02:57:50.001684+0000","last_active":"2024-09-12T02:57:57.860765+0000","last_peered":"2024-09-12T02:57:57.860765+0000","last_clean":"2024-09-12T02:57:57.860765+0000","last_became_active":"2024-09-12T02:57:50.000771+0000","last_became_peered":"2024-09-12T02:57:50.000771+0000","last_unstale":"2024-09-12T02:57:57.860765+0000","last_undegraded":"2024-09-12T02:57:57.860765+0000","last_fullsized":"2024-09-12T02:57:57.860765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:46.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848805+0000","last_change":"2024-09-12T02:57:03.812106+0000","last_active":"2024-09-12T02:57:56.848805+0000","last_peered":"2024-09-12T02:57:56.848805+0000","last_clean":"2024-09-12T02:57:56.848805+0000","last_became_active":"2024-09-12T02:57:03.810041+0000","last_became_peered":"2024-09-12T02:57:03.810041+0000","last_unstale":"2024-09-12T02:57:56.848805+0000","last_undegraded":"2024-09-12T02:57:56.848805+0000","last_fullsized":"2024-09-12T02:57:56.848805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900739+0000","last_change":"2024-09-12T02:57:09.030507+0000","last_active":"2024-09-12T02:57:58.900739+0000","last_peered":"2024-09-12T02:57:58.900739+0000","last_clean":"2024-09-12T02:57:58.900739+0000","last_became_active":"2024-09-12T02:57:09.029459+0000","last_became_peered":"2024-09-12T02:57:09.029459+0000","last_unstale":"2024-09-12T02:57:58.900739+0000","last_undegraded":"2024-09-12T02:57:58.900739+0000","last_fullsized":"2024-09-12T02:57:58.900739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:26.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899468+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:57:58.899468+0000","last_peered":"2024-09-12T02:57:58.899468+0000","last_clean":"2024-09-12T02:57:58.899468+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:57:58.899468+0000","last_undegraded":"2024-09-12T02:57:58.899468+0000","last_fullsized":"2024-09-12T02:57:58.899468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929406+0000","last_change":"2024-09-12T02:57:47.802130+0000","last_active":"2024-09-12T02:57:56.929406+0000","last_peered":"2024-09-12T02:57:56.929406+0000","last_clean":"2024-09-12T02:57:56.929406+0000","last_became_active":"2024-09-12T02:57:47.801836+0000","last_became_peered":"2024-09-12T02:57:47.801836+0000","last_unstale":"2024-09-12T02:57:56.929406+0000","last_undegraded":"2024-09-12T02:57:56.929406+0000","last_fullsized":"2024-09-12T02:57:56.929406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:07.642177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.857742+0000","last_change":"2024-09-12T02:57:03.807210+0000","last_active":"2024-09-12T02:57:57.857742+0000","last_peered":"2024-09-12T02:57:57.857742+0000","last_clean":"2024-09-12T02:57:57.857742+0000","last_became_active":"2024-09-12T02:57:03.805335+0000","last_became_peered":"2024-09-12T02:57:03.805335+0000","last_unstale":"2024-09-12T02:57:57.857742+0000","last_undegraded":"2024-09-12T02:57:57.857742+0000","last_fullsized":"2024-09-12T02:57:57.857742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849521+0000","last_change":"2024-09-12T02:57:08.895753+0000","last_active":"2024-09-12T02:57:56.849521+0000","last_peered":"2024-09-12T02:57:56.849521+0000","last_clean":"2024-09-12T02:57:56.849521+0000","last_became_active":"2024-09-12T02:57:08.894542+0000","last_became_peered":"2024-09-12T02:57:08.894542+0000","last_unstale":"2024-09-12T02:57:56.849521+0000","last_undegraded":"2024-09-12T02:57:56.849521+0000","last_fullsized":"2024-09-12T02:57:56.849521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900516+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:57:58.900516+0000","last_peered":"2024-09-12T02:57:58.900516+0000","last_clean":"2024-09-12T02:57:58.900516+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:57:58.900516+0000","last_undegraded":"2024-09-12T02:57:58.900516+0000","last_fullsized":"2024-09-12T02:57:58.900516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900826+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:57:58.900826+0000","last_peered":"2024-09-12T02:57:58.900826+0000","last_clean":"2024-09-12T02:57:58.900826+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:57:58.900826+0000","last_undegraded":"2024-09-12T02:57:58.900826+0000","last_fullsized":"2024-09-12T02:57:58.900826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848316+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:57:56.848316+0000","last_peered":"2024-09-12T02:57:56.848316+0000","last_clean":"2024-09-12T02:57:56.848316+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:57:56.848316+0000","last_undegraded":"2024-09-12T02:57:56.848316+0000","last_fullsized":"2024-09-12T02:57:56.848316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899654+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:57:58.899654+0000","last_peered":"2024-09-12T02:57:58.899654+0000","last_clean":"2024-09-12T02:57:58.899654+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:57:58.899654+0000","last_undegraded":"2024-09-12T02:57:58.899654+0000","last_fullsized":"2024-09-12T02:57:58.899654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857526+0000","last_change":"2024-09-12T02:57:08.873190+0000","last_active":"2024-09-12T02:57:58.857526+0000","last_peered":"2024-09-12T02:57:58.857526+0000","last_clean":"2024-09-12T02:57:58.857526+0000","last_became_active":"2024-09-12T02:57:08.872526+0000","last_became_peered":"2024-09-12T02:57:08.872526+0000","last_unstale":"2024-09-12T02:57:58.857526+0000","last_undegraded":"2024-09-12T02:57:58.857526+0000","last_fullsized":"2024-09-12T02:57:58.857526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:15.257391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901315+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:57:58.901315+0000","last_peered":"2024-09-12T02:57:58.901315+0000","last_clean":"2024-09-12T02:57:58.901315+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:57:58.901315+0000","last_undegraded":"2024-09-12T02:57:58.901315+0000","last_fullsized":"2024-09-12T02:57:58.901315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.861656+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:57:57.861656+0000","last_peered":"2024-09-12T02:57:57.861656+0000","last_clean":"2024-09-12T02:57:57.861656+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:57:57.861656+0000","last_undegraded":"2024-09-12T02:57:57.861656+0000","last_fullsized":"2024-09-12T02:57:57.861656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900534+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:57:58.900534+0000","last_peered":"2024-09-12T02:57:58.900534+0000","last_clean":"2024-09-12T02:57:58.900534+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:57:58.900534+0000","last_undegraded":"2024-09-12T02:57:58.900534+0000","last_fullsized":"2024-09-12T02:57:58.900534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.847483+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:57:56.847483+0000","last_peered":"2024-09-12T02:57:56.847483+0000","last_clean":"2024-09-12T02:57:56.847483+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:57:56.847483+0000","last_undegraded":"2024-09-12T02:57:56.847483+0000","last_fullsized":"2024-09-12T02:57:56.847483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857460+0000","last_change":"2024-09-12T02:57:04.841244+0000","last_active":"2024-09-12T02:57:58.857460+0000","last_peered":"2024-09-12T02:57:58.857460+0000","last_clean":"2024-09-12T02:57:58.857460+0000","last_became_active":"2024-09-12T02:57:04.837935+0000","last_became_peered":"2024-09-12T02:57:04.837935+0000","last_unstale":"2024-09-12T02:57:58.857460+0000","last_undegraded":"2024-09-12T02:57:58.857460+0000","last_fullsized":"2024-09-12T02:57:58.857460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:50.023694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859200+0000","last_change":"2024-09-12T02:57:04.874054+0000","last_active":"2024-09-12T02:57:57.859200+0000","last_peered":"2024-09-12T02:57:57.859200+0000","last_clean":"2024-09-12T02:57:57.859200+0000","last_became_active":"2024-09-12T02:57:04.867372+0000","last_became_peered":"2024-09-12T02:57:04.867372+0000","last_unstale":"2024-09-12T02:57:57.859200+0000","last_undegraded":"2024-09-12T02:57:57.859200+0000","last_fullsized":"2024-09-12T02:57:57.859200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:06.010582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899233+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:57:58.899233+0000","last_peered":"2024-09-12T02:57:58.899233+0000","last_clean":"2024-09-12T02:57:58.899233+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:57:58.899233+0000","last_undegraded":"2024-09-12T02:57:58.899233+0000","last_fullsized":"2024-09-12T02:57:58.899233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901736+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:57:58.901736+0000","last_peered":"2024-09-12T02:57:58.901736+0000","last_clean":"2024-09-12T02:57:58.901736+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:57:58.901736+0000","last_undegraded":"2024-09-12T02:57:58.901736+0000","last_fullsized":"2024-09-12T02:57:58.901736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929026+0000","last_change":"2024-09-12T02:57:04.836873+0000","last_active":"2024-09-12T02:57:56.929026+0000","last_peered":"2024-09-12T02:57:56.929026+0000","last_clean":"2024-09-12T02:57:56.929026+0000","last_became_active":"2024-09-12T02:57:04.836564+0000","last_became_peered":"2024-09-12T02:57:04.836564+0000","last_unstale":"2024-09-12T02:57:56.929026+0000","last_undegraded":"2024-09-12T02:57:56.929026+0000","last_fullsized":"2024-09-12T02:57:56.929026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:23.539077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848736+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:57:56.848736+0000","last_peered":"2024-09-12T02:57:56.848736+0000","last_clean":"2024-09-12T02:57:56.848736+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:57:56.848736+0000","last_undegraded":"2024-09-12T02:57:56.848736+0000","last_fullsized":"2024-09-12T02:57:56.848736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.902023+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:57:58.902023+0000","last_peered":"2024-09-12T02:57:58.902023+0000","last_clean":"2024-09-12T02:57:58.902023+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:57:58.902023+0000","last_undegraded":"2024-09-12T02:57:58.902023+0000","last_fullsized":"2024-09-12T02:57:58.902023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.857507+0000","last_change":"2024-09-12T02:57:04.874760+0000","last_active":"2024-09-12T02:57:57.857507+0000","last_peered":"2024-09-12T02:57:57.857507+0000","last_clean":"2024-09-12T02:57:57.857507+0000","last_became_active":"2024-09-12T02:57:04.861196+0000","last_became_peered":"2024-09-12T02:57:04.861196+0000","last_unstale":"2024-09-12T02:57:57.857507+0000","last_undegraded":"2024-09-12T02:57:57.857507+0000","last_fullsized":"2024-09-12T02:57:57.857507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900588+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:57:58.900588+0000","last_peered":"2024-09-12T02:57:58.900588+0000","last_clean":"2024-09-12T02:57:58.900588+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:57:58.900588+0000","last_undegraded":"2024-09-12T02:57:58.900588+0000","last_fullsized":"2024-09-12T02:57:58.900588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858961+0000","last_change":"2024-09-12T02:57:04.879052+0000","last_active":"2024-09-12T02:57:57.858961+0000","last_peered":"2024-09-12T02:57:57.858961+0000","last_clean":"2024-09-12T02:57:57.858961+0000","last_became_active":"2024-09-12T02:57:04.877672+0000","last_became_peered":"2024-09-12T02:57:04.877672+0000","last_unstale":"2024-09-12T02:57:57.858961+0000","last_undegraded":"2024-09-12T02:57:57.858961+0000","last_fullsized":"2024-09-12T02:57:57.858961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899137+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:57:58.899137+0000","last_peered":"2024-09-12T02:57:58.899137+0000","last_clean":"2024-09-12T02:57:58.899137+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:57:58.899137+0000","last_undegraded":"2024-09-12T02:57:58.899137+0000","last_fullsized":"2024-09-12T02:57:58.899137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848258+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:57:56.848258+0000","last_peered":"2024-09-12T02:57:56.848258+0000","last_clean":"2024-09-12T02:57:56.848258+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:57:56.848258+0000","last_undegraded":"2024-09-12T02:57:56.848258+0000","last_fullsized":"2024-09-12T02:57:56.848258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850987+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:57:56.850987+0000","last_peered":"2024-09-12T02:57:56.850987+0000","last_clean":"2024-09-12T02:57:56.850987+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:57:56.850987+0000","last_undegraded":"2024-09-12T02:57:56.850987+0000","last_fullsized":"2024-09-12T02:57:56.850987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.857788+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:57:58.857788+0000","last_peered":"2024-09-12T02:57:58.857788+0000","last_clean":"2024-09-12T02:57:58.857788+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:57:58.857788+0000","last_undegraded":"2024-09-12T02:57:58.857788+0000","last_fullsized":"2024-09-12T02:57:58.857788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.861423+0000","last_change":"2024-09-12T02:57:04.867799+0000","last_active":"2024-09-12T02:57:57.861423+0000","last_peered":"2024-09-12T02:57:57.861423+0000","last_clean":"2024-09-12T02:57:57.861423+0000","last_became_active":"2024-09-12T02:57:04.863800+0000","last_became_peered":"2024-09-12T02:57:04.863800+0000","last_unstale":"2024-09-12T02:57:57.861423+0000","last_undegraded":"2024-09-12T02:57:57.861423+0000","last_fullsized":"2024-09-12T02:57:57.861423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.857306+0000","last_change":"2024-09-12T02:57:04.864906+0000","last_active":"2024-09-12T02:57:57.857306+0000","last_peered":"2024-09-12T02:57:57.857306+0000","last_clean":"2024-09-12T02:57:57.857306+0000","last_became_active":"2024-09-12T02:57:04.863556+0000","last_became_peered":"2024-09-12T02:57:04.863556+0000","last_unstale":"2024-09-12T02:57:57.857306+0000","last_undegraded":"2024-09-12T02:57:57.857306+0000","last_fullsized":"2024-09-12T02:57:57.857306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929490+0000","last_change":"2024-09-12T02:57:04.826304+0000","last_active":"2024-09-12T02:57:56.929490+0000","last_peered":"2024-09-12T02:57:56.929490+0000","last_clean":"2024-09-12T02:57:56.929490+0000","last_became_active":"2024-09-12T02:57:04.825998+0000","last_became_peered":"2024-09-12T02:57:04.825998+0000","last_unstale":"2024-09-12T02:57:56.929490+0000","last_undegraded":"2024-09-12T02:57:56.929490+0000","last_fullsized":"2024-09-12T02:57:56.929490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:35.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899650+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:57:58.899650+0000","last_peered":"2024-09-12T02:57:58.899650+0000","last_clean":"2024-09-12T02:57:58.899650+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:57:58.899650+0000","last_undegraded":"2024-09-12T02:57:58.899650+0000","last_fullsized":"2024-09-12T02:57:58.899650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.901223+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:57:58.901223+0000","last_peered":"2024-09-12T02:57:58.901223+0000","last_clean":"2024-09-12T02:57:58.901223+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:57:58.901223+0000","last_undegraded":"2024-09-12T02:57:58.901223+0000","last_fullsized":"2024-09-12T02:57:58.901223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.859978+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:57:57.859978+0000","last_peered":"2024-09-12T02:57:57.859978+0000","last_clean":"2024-09-12T02:57:57.859978+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:57:57.859978+0000","last_undegraded":"2024-09-12T02:57:57.859978+0000","last_fullsized":"2024-09-12T02:57:57.859978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848324+0000","last_change":"2024-09-12T02:57:04.864295+0000","last_active":"2024-09-12T02:57:56.848324+0000","last_peered":"2024-09-12T02:57:56.848324+0000","last_clean":"2024-09-12T02:57:56.848324+0000","last_became_active":"2024-09-12T02:57:04.863563+0000","last_became_peered":"2024-09-12T02:57:04.863563+0000","last_unstale":"2024-09-12T02:57:56.848324+0000","last_undegraded":"2024-09-12T02:57:56.848324+0000","last_fullsized":"2024-09-12T02:57:56.848324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.848502+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:57:56.848502+0000","last_peered":"2024-09-12T02:57:56.848502+0000","last_clean":"2024-09-12T02:57:56.848502+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:57:56.848502+0000","last_undegraded":"2024-09-12T02:57:56.848502+0000","last_fullsized":"2024-09-12T02:57:56.848502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851366+0000","last_change":"2024-09-12T02:57:04.881172+0000","last_active":"2024-09-12T02:57:56.851366+0000","last_peered":"2024-09-12T02:57:56.851366+0000","last_clean":"2024-09-12T02:57:56.851366+0000","last_became_active":"2024-09-12T02:57:04.880660+0000","last_became_peered":"2024-09-12T02:57:04.880660+0000","last_unstale":"2024-09-12T02:57:56.851366+0000","last_undegraded":"2024-09-12T02:57:56.851366+0000","last_fullsized":"2024-09-12T02:57:56.851366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:15.389185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.900386+0000","last_change":"2024-09-12T02:57:04.876735+0000","last_active":"2024-09-12T02:57:58.900386+0000","last_peered":"2024-09-12T02:57:58.900386+0000","last_clean":"2024-09-12T02:57:58.900386+0000","last_became_active":"2024-09-12T02:57:04.876321+0000","last_became_peered":"2024-09-12T02:57:04.876321+0000","last_unstale":"2024-09-12T02:57:58.900386+0000","last_undegraded":"2024-09-12T02:57:58.900386+0000","last_fullsized":"2024-09-12T02:57:58.900386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.849214+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:57:56.849214+0000","last_peered":"2024-09-12T02:57:56.849214+0000","last_clean":"2024-09-12T02:57:56.849214+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:57:56.849214+0000","last_undegraded":"2024-09-12T02:57:56.849214+0000","last_fullsized":"2024-09-12T02:57:56.849214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858708+0000","last_change":"2024-09-12T02:57:04.878277+0000","last_active":"2024-09-12T02:57:57.858708+0000","last_peered":"2024-09-12T02:57:57.858708+0000","last_clean":"2024-09-12T02:57:57.858708+0000","last_became_active":"2024-09-12T02:57:04.876816+0000","last_became_peered":"2024-09-12T02:57:04.876816+0000","last_unstale":"2024-09-12T02:57:57.858708+0000","last_undegraded":"2024-09-12T02:57:57.858708+0000","last_fullsized":"2024-09-12T02:57:57.858708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.850252+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:57:56.850252+0000","last_peered":"2024-09-12T02:57:56.850252+0000","last_clean":"2024-09-12T02:57:56.850252+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:57:56.850252+0000","last_undegraded":"2024-09-12T02:57:56.850252+0000","last_fullsized":"2024-09-12T02:57:56.850252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-12T02:57:57.858965+0000","last_change":"2024-09-12T02:57:04.876472+0000","last_active":"2024-09-12T02:57:57.858965+0000","last_peered":"2024-09-12T02:57:57.858965+0000","last_clean":"2024-09-12T02:57:57.858965+0000","last_became_active":"2024-09-12T02:57:04.867264+0000","last_became_peered":"2024-09-12T02:57:04.867264+0000","last_unstale":"2024-09-12T02:57:57.858965+0000","last_undegraded":"2024-09-12T02:57:57.858965+0000","last_fullsized":"2024-09-12T02:57:57.858965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T02:57:58.899104+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:57:58.899104+0000","last_peered":"2024-09-12T02:57:58.899104+0000","last_clean":"2024-09-12T02:57:58.899104+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:57:58.899104+0000","last_undegraded":"2024-09-12T02:57:58.899104+0000","last_fullsized":"2024-09-12T02:57:58.899104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.929118+0000","last_change":"2024-09-12T02:57:04.841638+0000","last_active":"2024-09-12T02:57:56.929118+0000","last_peered":"2024-09-12T02:57:56.929118+0000","last_clean":"2024-09-12T02:57:56.929118+0000","last_became_active":"2024-09-12T02:57:04.841367+0000","last_became_peered":"2024-09-12T02:57:04.841367+0000","last_unstale":"2024-09-12T02:57:56.929118+0000","last_undegraded":"2024-09-12T02:57:56.929118+0000","last_fullsized":"2024-09-12T02:57:56.929118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:24.890973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T02:57:56.851266+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:57:56.851266+0000","last_peered":"2024-09-12T02:57:56.851266+0000","last_clean":"2024-09-12T02:57:56.851266+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:57:56.851266+0000","last_undegraded":"2024-09-12T02:57:56.851266+0000","last_fullsized":"2024-09-12T02:57:56.851266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":409600,"data_stored":182919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":169886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509458,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":760892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":966656,"data_stored":753922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":169091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":372736,"data_stored":163062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":380928,"data_stored":163098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":376832,"data_stored":163132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:58:02.726 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T02:58:02.726 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T02:58:02.726 INFO:tasks.thrashosds.thrasher:Reweighting osd 1 to 0.42014547862251883 2024-09-12T02:58:02.726 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 0.42014547862251883 2024-09-12T02:58:02.734 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:02.734 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:02.750 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:02.798 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:02.797+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:02.852 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:02.849+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:02.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.873+0000 7f9dd1000640 1 Processor -- start 2024-09-12T02:58:02.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.873+0000 7f9dd1000640 1 -- start start 2024-09-12T02:58:02.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dd1000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0ce9e0 0x7f9dcc0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dd1000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9dcc0c4f50 0x7f9dcc0cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dd1000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dcc0ceeb0 con 0x7f9dcc152870 2024-09-12T02:58:02.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dd1000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9dcc0ce1d0 con 0x7f9dcc0c4f50 2024-09-12T02:58:02.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dd1000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc0cdb50 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dca800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9dcc0c4f50 0x7f9dcc0cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dc1400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0ce9e0 0x7f9dcc0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dc1400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0ce9e0 0x7f9dcc0cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:38328/0 (socket says 172.21.15.63:38328) 2024-09-12T02:58:02.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dc1400640 1 -- 172.21.15.63:0/545121332 learned_addr learned my addr 172.21.15.63:0/545121332 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:02.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dca800640 1 --2- 172.21.15.63:0/545121332 >> v2:172.21.15.119:3300/0 conn(0x7f9dcc0c4f50 0x7f9dcc0cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:39810/0 (socket says 172.21.15.63:39810) 2024-09-12T02:58:02.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dc9e00640 1 --1- 172.21.15.63:0/545121332 >> v1:172.21.15.119:6789/0 conn(0x7f9dcc152870 0x7f9dcc0714b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:38150/0 (socket says 172.21.15.63:38150) 2024-09-12T02:58:02.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dca800640 1 -- 172.21.15.63:0/545121332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0ce9e0 msgr2=0x7f9dcc0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:02.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dca800640 1 --2- 172.21.15.63:0/545121332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0ce9e0 0x7f9dcc0cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dca800640 1 -- 172.21.15.63:0/545121332 >> v1:172.21.15.119:6789/0 conn(0x7f9dcc152870 legacy=0x7f9dcc0714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dca800640 1 -- 172.21.15.63:0/545121332 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc0ce420 con 0x7f9dcc0c4f50 2024-09-12T02:58:02.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.877+0000 7f9dc1400640 1 --2- 172.21.15.63:0/545121332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0ce9e0 0x7f9dcc0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:02.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.881+0000 7f9dca800640 1 --2- 172.21.15.63:0/545121332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc0c4f50 0x7f9dcc0cc800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009d90 tx=0x7f9dc401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e91ddc5dadd5d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:02.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dc9400640 1 -- 172.21.15.63:0/545121332 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40b2070 con 0x7f9dcc0c4f50 2024-09-12T02:58:02.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dc9400640 1 -- 172.21.15.63:0/545121332 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc40a5830 con 0x7f9dcc0c4f50 2024-09-12T02:58:02.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dc9400640 1 -- 172.21.15.63:0/545121332 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40a5c00 con 0x7f9dcc0c4f50 2024-09-12T02:58:02.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/545121332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc0c4f50 msgr2=0x7f9dcc0cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dd1000640 1 --2- 172.21.15.63:0/545121332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc0c4f50 0x7f9dcc0cc800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009d90 tx=0x7f9dc401c970 comp rx=0 tx=0).stop 2024-09-12T02:58:02.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/545121332 shutdown_connections 2024-09-12T02:58:02.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dd1000640 1 --2- 172.21.15.63:0/545121332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc0c4f50 0x7f9dcc0cc800 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dd1000640 1 --2- 172.21.15.63:0/545121332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0ce9e0 0x7f9dcc0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/545121332 >> 172.21.15.63:0/545121332 conn(0x7f9dcc06bcc0 msgr2=0x7f9dcc06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:02.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/545121332 shutdown_connections 2024-09-12T02:58:02.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/545121332 wait complete. 2024-09-12T02:58:02.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 Processor -- start 2024-09-12T02:58:02.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 -- start start 2024-09-12T02:58:02.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0c4f50 0x7f9dcc155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dcc0ce9e0 0x7f9dcc1f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc152870 0x7f9dcc0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc071bc0 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc0cd150 con 0x7f9dcc152870 2024-09-12T02:58:02.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc071d40 con 0x7f9dcc0c4f50 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dcc0ce9e0 0x7f9dcc1f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dcc0ce9e0 0x7f9dcc1f2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48240/0 (socket says 172.21.15.63:48240) 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc1400640 1 -- 172.21.15.63:0/2507431426 learned_addr learned my addr 172.21.15.63:0/2507431426 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc9e00640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0c4f50 0x7f9dcc155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dca800640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc152870 0x7f9dcc0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc1400640 1 -- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0c4f50 msgr2=0x7f9dcc155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc1400640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0c4f50 0x7f9dcc155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc1400640 1 -- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc152870 msgr2=0x7f9dcc0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc1400640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc152870 0x7f9dcc0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc1400640 1 -- 172.21.15.63:0/2507431426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc162720 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dca800640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc152870 0x7f9dcc0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:02.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc1400640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dcc0ce9e0 0x7f9dcc1f2170 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9db400e980 tx=0x7f9db400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:02.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc2a00640 1 -- 172.21.15.63:0/2507431426 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4017020 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc2a00640 1 -- 172.21.15.63:0/2507431426 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db4004240 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dc2a00640 1 -- 172.21.15.63:0/2507431426 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db400c7f0 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc1629f0 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.889+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc0c5860 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.893+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc0cc800 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.893+0000 7f9dc2a00640 1 -- 172.21.15.63:0/2507431426 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9db401a020 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.893+0000 7f9dc2a00640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9da80678c0 0x7f9da8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:02.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.893+0000 7f9dc2a00640 1 -- 172.21.15.63:0/2507431426 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6706+0+0 (secure 0 0 0) 0x7f9db4086070 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.893+0000 7f9dc9e00640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9da80678c0 0x7f9da8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:02.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.893+0000 7f9dc9e00640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9da80678c0 0x7f9da8069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc000f70 tx=0x7f9dbc007c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:02.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:02.897+0000 7f9dc2a00640 1 -- 172.21.15.63:0/2507431426 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9db4021030 con 0x7f9dcc0ce9e0 2024-09-12T02:58:02.908 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T02:58:02.947 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:02.947 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:02.953 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:02.949+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:02.963 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:03.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.049+0000 7f794c000640 1 Processor -- start 2024-09-12T02:58:03.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.049+0000 7f794c000640 1 -- start start 2024-09-12T02:58:03.054 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:03.051+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794c000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7944152640 0x7f79441590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794c000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7944071ca0 0x7f79440c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:03.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794c000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79440c6970 con 0x7f7944071850 2024-09-12T02:58:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794c000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f79440c8160 con 0x7f7944071ca0 2024-09-12T02:58:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794c000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f79440c6c30 con 0x7f7944152640 2024-09-12T02:58:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f7948c00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7944071850 0x7f79440c8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:35826/0 (socket says 172.21.15.63:35826) 2024-09-12T02:58:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f7948c00640 1 -- 172.21.15.63:0/3408868154 learned_addr learned my addr 172.21.15.63:0/3408868154 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794a000640 1 --2- 172.21.15.63:0/3408868154 >> v2:172.21.15.63:3300/0 conn(0x7f7944071ca0 0x7f79440c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:03.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f7949600640 1 --2- 172.21.15.63:0/3408868154 >> v2:172.21.15.119:3300/0 conn(0x7f7944152640 0x7f79441590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794a000640 1 -- 172.21.15.63:0/3408868154 >> v2:172.21.15.119:3300/0 conn(0x7f7944152640 msgr2=0x7f79441590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794a000640 1 --2- 172.21.15.63:0/3408868154 >> v2:172.21.15.119:3300/0 conn(0x7f7944152640 0x7f79441590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794a000640 1 -- 172.21.15.63:0/3408868154 >> v1:172.21.15.63:6789/0 conn(0x7f7944071850 legacy=0x7f79440c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f794a000640 1 -- 172.21.15.63:0/3408868154 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79440c7830 con 0x7f7944071ca0 2024-09-12T02:58:03.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.053+0000 7f7943e00640 1 -- 172.21.15.63:0/3408868154 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198307687 0 0) 0x7f79440c6970 con 0x7f7944071850 2024-09-12T02:58:03.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f794a000640 1 --2- 172.21.15.63:0/3408868154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071ca0 0x7f79440c9110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79440c82e0 tx=0x7f793c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2a4fe2ff20070d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:03.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f7943e00640 1 -- 172.21.15.63:0/3408868154 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c0b2070 con 0x7f7944071ca0 2024-09-12T02:58:03.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f7943e00640 1 -- 172.21.15.63:0/3408868154 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c0a57f0 con 0x7f7944071ca0 2024-09-12T02:58:03.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f7943e00640 1 -- 172.21.15.63:0/3408868154 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c0a5bc0 con 0x7f7944071ca0 2024-09-12T02:58:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f794c000640 1 -- 172.21.15.63:0/3408868154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071ca0 msgr2=0x7f79440c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f794c000640 1 --2- 172.21.15.63:0/3408868154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071ca0 0x7f79440c9110 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f79440c82e0 tx=0x7f793c01c930 comp rx=0 tx=0).stop 2024-09-12T02:58:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f794c000640 1 -- 172.21.15.63:0/3408868154 shutdown_connections 2024-09-12T02:58:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f794c000640 1 --2- 172.21.15.63:0/3408868154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071ca0 0x7f79440c9110 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f794c000640 1 --2- 172.21.15.63:0/3408868154 >> v2:172.21.15.119:3300/0 conn(0x7f7944152640 0x7f79441590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f794c000640 1 -- 172.21.15.63:0/3408868154 >> 172.21.15.63:0/3408868154 conn(0x7f794406f3d0 msgr2=0x7f794406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f794c000640 1 -- 172.21.15.63:0/3408868154 shutdown_connections 2024-09-12T02:58:03.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.057+0000 7f794c000640 1 -- 172.21.15.63:0/3408868154 wait complete. 2024-09-12T02:58:03.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 Processor -- start 2024-09-12T02:58:03.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 -- start start 2024-09-12T02:58:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071850 0x7f7944150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:03.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7944071ca0 0x7f79440c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7944152640 0x7f794414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f79440c9650 con 0x7f7944071850 2024-09-12T02:58:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7944152a20 con 0x7f7944152640 2024-09-12T02:58:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f79440c97d0 con 0x7f7944071ca0 2024-09-12T02:58:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7949600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071850 0x7f7944150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7949600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071850 0x7f7944150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48258/0 (socket says 172.21.15.63:48258) 2024-09-12T02:58:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7949600640 1 -- 172.21.15.63:0/1720428309 learned_addr learned my addr 172.21.15.63:0/1720428309 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7948c00640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7944071ca0 0x7f79440c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:03.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794a000640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7944152640 0x7f794414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7949600640 1 -- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7944071ca0 msgr2=0x7f79440c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7949600640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7944071ca0 0x7f79440c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7949600640 1 -- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7944152640 msgr2=0x7f794414d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7949600640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7944152640 0x7f794414d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7949600640 1 -- 172.21.15.63:0/1720428309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79440c5fc0 con 0x7f7944071850 2024-09-12T02:58:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794a000640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7944152640 0x7f794414d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:03.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7949600640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071850 0x7f7944150760 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f793800d620 tx=0x7f793800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7941600640 1 -- 172.21.15.63:0/1720428309 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79380125f0 con 0x7f7944071850 2024-09-12T02:58:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7941600640 1 -- 172.21.15.63:0/1720428309 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7938019070 con 0x7f7944071850 2024-09-12T02:58:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794414f7e0 con 0x7f7944071850 2024-09-12T02:58:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f7941600640 1 -- 172.21.15.63:0/1720428309 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79380129b0 con 0x7f7944071850 2024-09-12T02:58:03.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.061+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7944162bd0 con 0x7f7944071850 2024-09-12T02:58:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.065+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79440c6970 con 0x7f7944071850 2024-09-12T02:58:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.065+0000 7f7941600640 1 -- 172.21.15.63:0/1720428309 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7938012b50 con 0x7f7944071850 2024-09-12T02:58:03.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.065+0000 7f7941600640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f79240678c0 0x7f7924069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:03.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.065+0000 7f7941600640 1 -- 172.21.15.63:0/1720428309 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6706+0+0 (secure 0 0 0) 0x7f7938086ee0 con 0x7f7944071850 2024-09-12T02:58:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.065+0000 7f7948c00640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f79240678c0 0x7f7924069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:03.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.069+0000 7f7948c00640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f79240678c0 0x7f7924069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7944150510 tx=0x7f7930007b60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:03.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.073+0000 7f7941600640 1 -- 172.21.15.63:0/1720428309 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f79380576a0 con 0x7f7944071850 2024-09-12T02:58:03.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.085+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 1, "weight": 0.42014547862251883} v 0) -- 0x7f9dcc0cd570 con 0x7f9dcc0ce9e0 2024-09-12T02:58:03.155 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:03.153+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:03.163 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:03.163 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:03.179 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:03.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.253+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7f794414eb00 con 0x7f7944071850 2024-09-12T02:58:03.256 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:03.251+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:03.356 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:03.353+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:03.369 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:03.370 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:03.385 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:03.421 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:58:03.430 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:58:03.474 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:03.471+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:03.558 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:03.557+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:03.571 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:03.571 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:03.586 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:03.660 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:03.657+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:03.718 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:03.718 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:03.732 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:03.777 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:03.775+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:03.854 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:03.854 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:03.861 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:03.857+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:03.868 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.881+0000 7f7941600640 1 -- 172.21.15.63:0/1720428309 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v40) ==== 97+0+0 (secure 0 0 0) 0x7f7938056fa0 con 0x7f7944071850 2024-09-12T02:58:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.881+0000 7f9dc2a00640 1 -- 172.21.15.63:0/2507431426 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 1, "weight": 0.42014547862251883}]=0 reweighted osd.1 to 0.420145 (6b8e) v40) ==== 135+0+0 (secure 0 0 0) 0x7f9db4056850 con 0x7f9dcc0ce9e0 2024-09-12T02:58:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.1 to 0.420145 (6b8e) 2024-09-12T02:58:03.884 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-12T02:58:03.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9da80678c0 msgr2=0x7f9da8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:03.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9da80678c0 0x7f9da8069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc000f70 tx=0x7f9dbc007c90 comp rx=0 tx=0).stop 2024-09-12T02:58:03.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dcc0ce9e0 msgr2=0x7f9dcc1f2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:03.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dcc0ce9e0 0x7f9dcc1f2170 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9db400e980 tx=0x7f9db400ee40 comp rx=0 tx=0).stop 2024-09-12T02:58:03.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f79240678c0 msgr2=0x7f7924069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:03.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f79240678c0 0x7f7924069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7944150510 tx=0x7f7930007b60 comp rx=0 tx=0).stop 2024-09-12T02:58:03.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071850 msgr2=0x7f7944150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:03.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071850 0x7f7944150760 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f793800d620 tx=0x7f793800dae0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 shutdown_connections 2024-09-12T02:58:03.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7944152640 0x7f794414d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f79240678c0 0x7f7924069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7944071ca0 0x7f79440c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 --2- 172.21.15.63:0/1720428309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7944071850 0x7f7944150760 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 >> 172.21.15.63:0/1720428309 conn(0x7f794406f3d0 msgr2=0x7f794414af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 shutdown_connections 2024-09-12T02:58:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 shutdown_connections 2024-09-12T02:58:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9dcc152870 0x7f9dcc0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9dcc0ce9e0 0x7f9dcc1f2170 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9da80678c0 0x7f9da8069d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 --2- 172.21.15.63:0/2507431426 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9dcc0c4f50 0x7f9dcc155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:03.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 >> 172.21.15.63:0/2507431426 conn(0x7f9dcc06bcc0 msgr2=0x7f9dcc151360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:03.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f794c000640 1 -- 172.21.15.63:0/1720428309 wait complete. 2024-09-12T02:58:03.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 shutdown_connections 2024-09-12T02:58:03.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:03.885+0000 7f9dd1000640 1 -- 172.21.15.63:0/2507431426 wait complete. 2024-09-12T02:58:03.962 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:03.959+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:04.012 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:04.030 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:04.031 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:04.045 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:58:04.063 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:04.061+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.153+0000 7f5c43a00640 1 Processor -- start 2024-09-12T02:58:04.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.153+0000 7f5c43a00640 1 -- start start 2024-09-12T02:58:04.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.153+0000 7f5c43a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c1527e0 0x7f5c3c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.153+0000 7f5c43a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5c3c0c4ff0 0x7f5c3c06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c43a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c0c9720 con 0x7f5c3c0ce080 2024-09-12T02:58:04.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c43a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3c06f6f0 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c43a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3c06f9d0 con 0x7f5c3c1527e0 2024-09-12T02:58:04.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c41a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5c3c0ce080 0x7f5c3c1585b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45538/0 (socket says 172.21.15.63:45538) 2024-09-12T02:58:04.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c41a00640 1 -- 172.21.15.63:0/344887680 learned_addr learned my addr 172.21.15.63:0/344887680 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:04.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c41000640 1 --2- 172.21.15.63:0/344887680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c1527e0 0x7f5c3c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c3be00640 1 --2- 172.21.15.63:0/344887680 >> v2:172.21.15.119:3300/0 conn(0x7f5c3c0c4ff0 0x7f5c3c06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c3b400640 1 -- 172.21.15.63:0/344887680 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803752577 0 0) 0x7f5c3c0c9720 con 0x7f5c3c0ce080 2024-09-12T02:58:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c3b400640 1 -- 172.21.15.63:0/344887680 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c24003530 con 0x7f5c3c0ce080 2024-09-12T02:58:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c41000640 1 -- 172.21.15.63:0/344887680 >> v2:172.21.15.119:3300/0 conn(0x7f5c3c0c4ff0 msgr2=0x7f5c3c06fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c41000640 1 --2- 172.21.15.63:0/344887680 >> v2:172.21.15.119:3300/0 conn(0x7f5c3c0c4ff0 0x7f5c3c06fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c41000640 1 -- 172.21.15.63:0/344887680 >> v1:172.21.15.63:6789/0 conn(0x7f5c3c0ce080 legacy=0x7f5c3c1585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.157+0000 7f5c41000640 1 -- 172.21.15.63:0/344887680 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c0c9a00 con 0x7f5c3c1527e0 2024-09-12T02:58:04.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c41000640 1 --2- 172.21.15.63:0/344887680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c1527e0 0x7f5c3c0c82a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c300097c0 tx=0x7f5c3001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adfaf475b5a58a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c3b400640 1 -- 172.21.15.63:0/344887680 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300b5070 con 0x7f5c3c1527e0 2024-09-12T02:58:04.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c3b400640 1 -- 172.21.15.63:0/344887680 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300a8990 con 0x7f5c3c1527e0 2024-09-12T02:58:04.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c3b400640 1 -- 172.21.15.63:0/344887680 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300a8d40 con 0x7f5c3c1527e0 2024-09-12T02:58:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 -- 172.21.15.63:0/344887680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c1527e0 msgr2=0x7f5c3c0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 --2- 172.21.15.63:0/344887680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c1527e0 0x7f5c3c0c82a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c300097c0 tx=0x7f5c3001ec90 comp rx=0 tx=0).stop 2024-09-12T02:58:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 -- 172.21.15.63:0/344887680 shutdown_connections 2024-09-12T02:58:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 --2- 172.21.15.63:0/344887680 >> v2:172.21.15.119:3300/0 conn(0x7f5c3c0c4ff0 0x7f5c3c06fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 --2- 172.21.15.63:0/344887680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c1527e0 0x7f5c3c0c82a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 -- 172.21.15.63:0/344887680 >> 172.21.15.63:0/344887680 conn(0x7f5c3c067a00 msgr2=0x7f5c3c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 -- 172.21.15.63:0/344887680 shutdown_connections 2024-09-12T02:58:04.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 -- 172.21.15.63:0/344887680 wait complete. 2024-09-12T02:58:04.165 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:04.159+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 Processor -- start 2024-09-12T02:58:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.161+0000 7f5c43a00640 1 -- start start 2024-09-12T02:58:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c43a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c3c0c4ff0 0x7f5c3c1e3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c43a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c0ce080 0x7f5c3c148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c43a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c3c1527e0 0x7f5c3c14e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c43a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c0c93e0 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c43a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c0c9fc0 con 0x7f5c3c1527e0 2024-09-12T02:58:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c43a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3c15bb60 con 0x7f5c3c0ce080 2024-09-12T02:58:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c3c0c4ff0 0x7f5c3c1e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c3c0c4ff0 0x7f5c3c1e3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52142/0 (socket says 172.21.15.63:52142) 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41000640 1 -- 172.21.15.63:0/72725798 learned_addr learned my addr 172.21.15.63:0/72725798 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c3be00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c0ce080 0x7f5c3c148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c3c1527e0 0x7f5c3c14e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41000640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c0ce080 msgr2=0x7f5c3c148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41000640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c3c0ce080 0x7f5c3c148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41000640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c3c1527e0 msgr2=0x7f5c3c14e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41000640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c3c1527e0 0x7f5c3c14e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41000640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c0cd170 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c3c1527e0 0x7f5c3c14e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c41000640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c3c0c4ff0 0x7f5c3c1e3340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5c300b3040 tx=0x7f5c3001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300be070 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c30004230 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c300b5040 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c0c78e0 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c14dd80 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f5c3c0c8d10 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.165+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c300c1070 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c38c00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c1c067940 0x7f5c1c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6648+0+0 (secure 0 0 0) 0x7f5c301228f0 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v40) ==== 54+0+16 (secure 0 0 0) 0x7f5c300187f0 con 0x7f5c3c0c4ff0 2024-09-12T02:58:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c3be00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c1c067940 0x7f5c1c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5c3c0c6ca0 0x7f5c3c0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c3c0c66c0 con 0x7f5c3c0c6ca0 2024-09-12T02:58:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c41a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5c3c0c6ca0 0x7f5c3c0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c3be00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c1c067940 0x7f5c1c069e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0ccff0 tx=0x7f5c28009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c41a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5c3c0c6ca0 0x7f5c3c0c7080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.169+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c3c0c66c0 con 0x7f5c3c0c6ca0 2024-09-12T02:58:04.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.185+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5c3c070200 con 0x7f5c3c0c6ca0 2024-09-12T02:58:04.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.185+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5c3c070200 con 0x7f5c3c0c6ca0 2024-09-12T02:58:04.190 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.189+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5c3c0c59b0 0x7f5c3c0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.189+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f5c3c0008e0 con 0x7f5c3c0c59b0 2024-09-12T02:58:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.189+0000 7f5c41000640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5c3c0c59b0 0x7f5c3c0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.189+0000 7f5c41000640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5c3c0c59b0 0x7f5c3c0c5dd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.189+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c3c0008e0 con 0x7f5c3c0c59b0 2024-09-12T02:58:04.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.201+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5c3c06f1a0 con 0x7f5c3c0c59b0 2024-09-12T02:58:04.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.205+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5c3c06f1a0 con 0x7f5c3c0c59b0 2024-09-12T02:58:04.207 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:04.208 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:04.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.205+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5c3c062bf0 0x7f5c3c063030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.205+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f5c3c1e5050 con 0x7f5c3c062bf0 2024-09-12T02:58:04.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.205+0000 7f5c3be00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5c3c062bf0 0x7f5c3c063030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.205+0000 7f5c3be00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5c3c062bf0 0x7f5c3c063030 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.205+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c3c1e5050 con 0x7f5c3c062bf0 2024-09-12T02:58:04.212 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:04.212 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:04.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.221+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5c3c1487d0 con 0x7f5c3c062bf0 2024-09-12T02:58:04.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.221+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5c3c1487d0 con 0x7f5c3c062bf0 2024-09-12T02:58:04.271 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:04.272 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T02:58:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.221+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5c3c0ca820 0x7f5c3c0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.221+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f5c3c1f1410 con 0x7f5c3c0ca820 2024-09-12T02:58:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.221+0000 7f5c41a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5c3c0ca820 0x7f5c3c0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.221+0000 7f5c41a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5c3c0ca820 0x7f5c3c0cac40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.225+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c34017870 con 0x7f5c3c0ca820 2024-09-12T02:58:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.237+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5c3c14eac0 con 0x7f5c3c0ca820 2024-09-12T02:58:04.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.237+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5c3c14eac0 con 0x7f5c3c0ca820 2024-09-12T02:58:04.274 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.241+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5c3c02cb60 0x7f5c3c02cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.241+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f5c3c14eac0 con 0x7f5c3c02cb60 2024-09-12T02:58:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.241+0000 7f5c41000640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5c3c02cb60 0x7f5c3c02cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.241+0000 7f5c41000640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5c3c02cb60 0x7f5c3c02cfa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.241+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c3c14eac0 con 0x7f5c3c02cb60 2024-09-12T02:58:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.257+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5c3c14eac0 con 0x7f5c3c02cb60 2024-09-12T02:58:04.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.257+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5c3c14eac0 con 0x7f5c3c02cb60 2024-09-12T02:58:04.276 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:04.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.257+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5c3c202620 0x7f5c3c204a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.257+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f5c3c02db80 con 0x7f5c3c202620 2024-09-12T02:58:04.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.257+0000 7f5c3be00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5c3c202620 0x7f5c3c204a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.257+0000 7f5c3be00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5c3c202620 0x7f5c3c204a10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.261+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c3c02db80 con 0x7f5c3c202620 2024-09-12T02:58:04.277 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:04.269+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:04.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.273+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5c3c1e5b50 con 0x7f5c3c202620 2024-09-12T02:58:04.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.277+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5c3c1e5b50 con 0x7f5c3c202620 2024-09-12T02:58:04.280 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:04.281 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:04.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.277+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5c3c205460 0x7f5c3c2058a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.277+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f5c3c20aa20 con 0x7f5c3c205460 2024-09-12T02:58:04.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.277+0000 7f5c41a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5c3c205460 0x7f5c3c2058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.277+0000 7f5c41a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5c3c205460 0x7f5c3c2058a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.281+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c3c20aa20 con 0x7f5c3c205460 2024-09-12T02:58:04.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.293+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5c3c205ef0 con 0x7f5c3c205460 2024-09-12T02:58:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.297+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5c3c205ef0 con 0x7f5c3c205460 2024-09-12T02:58:04.301 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.297+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5c3c206610 0x7f5c3c206a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.297+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f5c3c2070c0 con 0x7f5c3c206610 2024-09-12T02:58:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.297+0000 7f5c41000640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5c3c206610 0x7f5c3c206a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.297+0000 7f5c41000640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5c3c206610 0x7f5c3c206a50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:04.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.301+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c3c2070c0 con 0x7f5c3c206610 2024-09-12T02:58:04.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.317+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f5c3c02db50 con 0x7f5c3c206610 2024-09-12T02:58:04.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c38c00640 1 -- 172.21.15.63:0/72725798 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5c3c02db50 con 0x7f5c3c206610 2024-09-12T02:58:04.323 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5c3c0c6ca0 msgr2=0x7f5c3c0c7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f5c3c0c6ca0 0x7f5c3c0c7080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5c3c0c59b0 msgr2=0x7f5c3c0c5dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5c3c0c59b0 0x7f5c3c0c5dd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5c3c062bf0 msgr2=0x7f5c3c063030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5c3c062bf0 0x7f5c3c063030 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5c3c0ca820 msgr2=0x7f5c3c0cac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f5c3c0ca820 0x7f5c3c0cac40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5c3c02cb60 msgr2=0x7f5c3c02cfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5c3c02cb60 0x7f5c3c02cfa0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5c3c202620 msgr2=0x7f5c3c204a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f5c3c202620 0x7f5c3c204a10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5c3c205460 msgr2=0x7f5c3c2058a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f5c3c205460 0x7f5c3c2058a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5c3c206610 msgr2=0x7f5c3c206a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5c3c206610 0x7f5c3c206a50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c41a00640 1 -- 172.21.15.63:0/72725798 reap_dead start 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c41a00640 1 -- 172.21.15.63:0/72725798 reap_dead start 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c41a00640 1 -- 172.21.15.63:0/72725798 reap_dead start 2024-09-12T02:58:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c41a00640 1 -- 172.21.15.63:0/72725798 reap_dead start 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c41a00640 1 -- 172.21.15.63:0/72725798 reap_dead start 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c1c067940 msgr2=0x7f5c1c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c1c067940 0x7f5c1c069e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0ccff0 tx=0x7f5c28009190 comp rx=0 tx=0).stop 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c3c0c4ff0 msgr2=0x7f5c3c1e3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c3c0c4ff0 0x7f5c3c1e3340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5c300b3040 tx=0x7f5c3001ba30 comp rx=0 tx=0).stop 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 shutdown_connections 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5c1c067940 0x7f5c1c069e00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 --2- 172.21.15.63:0/72725798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c3c0c4ff0 0x7f5c3c1e3340 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 >> 172.21.15.63:0/72725798 conn(0x7f5c3c067a00 msgr2=0x7f5c3c15a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 shutdown_connections 2024-09-12T02:58:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:04.321+0000 7f5c43a00640 1 -- 172.21.15.63:0/72725798 wait complete. 2024-09-12T02:58:04.372 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:04.367+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:04.440 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:04.440 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:04.440 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:04.440 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:04.440 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:04.454 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T02:58:04.502 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:04.499+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:04.574 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:04.571+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:04.624 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 54.769633456999998, 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00551893, 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:04.625 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:04.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853808+0000", 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4959999999999999e-06 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853827+0000", 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8675999999999999e-05 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853869+0000", 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2347e-05 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853889+0000", 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0248999999999999e-05 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854115+0000", 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022562600000000001 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854168+0000", 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3476000000000001e-05 2024-09-12T02:58:04.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859207+0000", 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050389550000000003 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859324+0000", 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117105 2024-09-12T02:58:04.629 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 54.768430719000001, 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077810020000000004, 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855011+0000", 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3259999999999998e-06 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:04.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855026+0000", 2024-09-12T02:58:04.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5023e-05 2024-09-12T02:58:04.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:04.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855055+0000", 2024-09-12T02:58:04.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9298e-05 2024-09-12T02:58:04.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:04.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:04.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0525000000000001e-05 2024-09-12T02:58:04.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:04.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855570+0000", 2024-09-12T02:58:04.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000494539 2024-09-12T02:58:04.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:04.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855624+0000", 2024-09-12T02:58:04.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3656999999999998e-05 2024-09-12T02:58:04.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:04.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862687+0000", 2024-09-12T02:58:04.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007063593 2024-09-12T02:58:04.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:04.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862789+0000", 2024-09-12T02:58:04.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010204099999999999 2024-09-12T02:58:04.637 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.637 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:04.637 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.637 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:04.637 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:04.638 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 54.768309109999997, 2024-09-12T02:58:04.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077503839999999999, 2024-09-12T02:58:04.638 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:04.639 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:04.639 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:04.639 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:04.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:04.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:04.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855131+0000", 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5230000000000001e-06 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855143+0000", 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1412e-05 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0043000000000001e-05 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855176+0000", 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3429e-05 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856069+0000", 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00089251 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856116+0000", 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6826999999999997e-05 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:04.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862797+0000", 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066810050000000003 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862880+0000", 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3634999999999995e-05 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:04.643 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 54.767203825999999, 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065292639999999999, 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:04.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856237+0000", 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.103e-06 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856252+0000", 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4813e-05 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856279+0000", 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7254e-05 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856297+0000", 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7929000000000001e-05 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856462+0000", 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016488700000000001 2024-09-12T02:58:04.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856508+0000", 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5787000000000001e-05 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862657+0000", 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061494210000000004 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862764+0000", 2024-09-12T02:58:04.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010707 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 54.766456560000002, 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005857943, 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856984+0000", 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3799999999999999e-06 2024-09-12T02:58:04.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856997+0000", 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2896e-05 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857022+0000", 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5554999999999998e-05 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857043+0000", 2024-09-12T02:58:04.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0919000000000001e-05 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857162+0000", 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118526 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857225+0000", 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3578999999999996e-05 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:04.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862772+0000", 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055470789999999999 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862840+0000", 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8009000000000006e-05 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:04.652 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:04.654 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:04.675 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:04.673+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:04.776 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:04.773+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:04.826 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:04.826 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:04.826 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:04.826 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:04.840 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:04.877 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:04.873+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:04.968 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:04.968 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:04.968 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:04.968 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:04.968 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:04.979 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:04.975+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:04.982 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:05.079 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:05.075+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:05.154 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:05.154 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:05.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:05.154 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:05.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.154 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.155 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:05.155 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.297847707999999, 2024-09-12T02:58:05.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:05.155 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.155 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.155 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.155 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:05.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:05.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:05.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.297714499999998, 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.161 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:05.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:05.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.166 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.297609749999999, 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:05.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:05.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.172 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.297463931999999, 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:05.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:05.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:05.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.297390749999998, 2024-09-12T02:58:05.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:05.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.182 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:05.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:05.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:05.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:05.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:05.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.297330764000002, 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:05.185 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.186 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.186 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.186 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:05.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:05.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:05.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:05.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:05.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:05.194 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.194 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.194 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.194 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.194 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:05.194 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.297268418000002, 2024-09-12T02:58:05.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:05.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:05.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:05.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:05.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:05.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.297210902000003, 2024-09-12T02:58:05.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:05.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:05.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.204 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.295043276999998, 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:05.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:05.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.291884762000002, 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:05.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:05.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing_reply(2.14 epoch 25/19 rep_tid 7 lcod 25'5)", 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:05.214 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.285423817000002, 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010494969999999999, 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:05.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864695+0000", 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7300000000000001e-07 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864699+0000", 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.33e-06 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864715+0000", 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6116e-05 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864727+0000", 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1759e-05 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865572+0000", 2024-09-12T02:58:05.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00084520699999999995 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865744+0000", 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000171612 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.284175888999997, 2024-09-12T02:58:05.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:05.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:05.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:05.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:05.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:05.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:05.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:05.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:05.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:05.224 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:05.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.225 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.265286938000003, 2024-09-12T02:58:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.226 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.227 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.227 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:05.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:05.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:05.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:05.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:05.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:05.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:05.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:05.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.231 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.231 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:05.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:05.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.231 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.231 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.233 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:05.233 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:05.233 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 44.536885132000002, 2024-09-12T02:58:05.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:05.233 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.233 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.234 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.234 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:05.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:05.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.239 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.240 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.240 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:05.240 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:05.240 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 42.781048550000001, 2024-09-12T02:58:05.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:05.240 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.240 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:05.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:05.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 41.898959585999997, 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.246 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:05.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.252 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 20.215001973, 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:05.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:05.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:05.258 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 20.214896681999999, 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:05.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:05.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:05.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:05.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.522333532000001, 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:05.265 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:05.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:05.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:05.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:05.272 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.272 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.272 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.272 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:46 2.6 e28/19 2:654134d2:::mds0_openfiles.0:head v 28'2, mlcod=0'0)", 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 17.262139635, 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015286869999999999, 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887979+0000", 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4000000000000002e-07 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887986+0000", 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1999999999999997e-06 2024-09-12T02:58:05.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888007+0000", 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1075999999999999e-05 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888022+0000", 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5316e-05 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888142+0000", 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011911100000000001 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888187+0000", 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5225000000000002e-05 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889432+0000", 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012450709999999999 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889507+0000", 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5148000000000006e-05 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.277 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:05.279 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:05.279 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:05.277+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:05.380 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:05.377+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:05.451 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:05.451 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:05.451 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:05.464 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:05.480 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:05.477+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:05.581 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:05.579+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:05.586 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:05.586 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:05.586 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:05.586 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:05.586 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:05.600 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:05.682 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:05.677+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:05.770 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 70.019878384999998, 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.771 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:05.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:05.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:05.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.876683047, 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.778 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:05.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:05.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.876662521, 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:05.784 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:05.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:05.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.790 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.876551707999994, 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.791 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:05.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.794 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:05.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.796 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.876530181999996, 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.797 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:05.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:05.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.811543536000002, 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.803 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.804 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:05.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:05.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.589440013000001, 2024-09-12T02:58:05.809 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:05.810 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.811 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.812 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:05.813 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.814 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.815 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.589303021999996, 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.816 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.817 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.818 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.819 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:05.820 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.821 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.588185820000007, 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.822 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.823 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:05.824 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.825 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:05.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:05.828 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.588113707000005, 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.829 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:05.830 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.831 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:05.832 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.833 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.834 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.587889723000004, 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.835 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:05.836 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.837 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:05.839 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.840 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.58781974, 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:05.841 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.842 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.843 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.844 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:05.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.587714102999996, 2024-09-12T02:58:05.848 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.849 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:05.850 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.851 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.852 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.587524005999995, 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.855 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:05.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.860 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.587457219000001, 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.861 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:05.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:05.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.012107622000002, 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:05.867 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.913408187999998, 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:05.873 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:05.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:05.878 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.913322946000001, 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:05.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:05.884 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.913185832000003, 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:05.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:05.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:05.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.913015932999997, 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:05.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:05.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:05.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:05.893 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.894 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.894 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.894 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:05.894 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:05.894 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:05.895 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:05.896 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:05.893+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:05.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T02:58:05.996 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:05.993+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:06.048 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:06.048 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:06.049 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:06.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:06.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.085+0000 7f3d5a600640 1 Processor -- start 2024-09-12T02:58:06.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.085+0000 7f3d5a600640 1 -- start start 2024-09-12T02:58:06.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d5a600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3d540c8fd0 0x7f3d540c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d5a600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d5406fc30 0x7f3d540caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d5a600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5406e980 con 0x7f3d540c8bf0 2024-09-12T02:58:06.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d5a600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f3d5406ec40 con 0x7f3d540c8fd0 2024-09-12T02:58:06.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d5a600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5406ef20 con 0x7f3d5406fc30 2024-09-12T02:58:06.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d59200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3d540c8bf0 0x7f3d5406cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45554/0 (socket says 172.21.15.63:45554) 2024-09-12T02:58:06.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d59200640 1 -- 172.21.15.63:0/639054390 learned_addr learned my addr 172.21.15.63:0/639054390 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:06.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d53e00640 1 --2- 172.21.15.63:0/639054390 >> v2:172.21.15.63:3300/0 conn(0x7f3d540c8fd0 0x7f3d540c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d59c00640 1 --2- 172.21.15.63:0/639054390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d5406fc30 0x7f3d540caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d53400640 1 -- 172.21.15.63:0/639054390 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4120293605 0 0) 0x7f3d5406e980 con 0x7f3d540c8bf0 2024-09-12T02:58:06.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d53400640 1 -- 172.21.15.63:0/639054390 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d3c003530 con 0x7f3d540c8bf0 2024-09-12T02:58:06.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d53e00640 1 -- 172.21.15.63:0/639054390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d5406fc30 msgr2=0x7f3d540caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:06.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d53e00640 1 --2- 172.21.15.63:0/639054390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d5406fc30 0x7f3d540caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d53e00640 1 -- 172.21.15.63:0/639054390 >> v1:172.21.15.63:6789/0 conn(0x7f3d540c8bf0 legacy=0x7f3d5406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.089+0000 7f3d53e00640 1 -- 172.21.15.63:0/639054390 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5415ab80 con 0x7f3d540c8fd0 2024-09-12T02:58:06.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d53e00640 1 --2- 172.21.15.63:0/639054390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8fd0 0x7f3d540c9440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3d400097c0 tx=0x7f3d4001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490eada7a11f8ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d53400640 1 -- 172.21.15.63:0/639054390 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400b5070 con 0x7f3d540c8fd0 2024-09-12T02:58:06.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d53400640 1 -- 172.21.15.63:0/639054390 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d400a8990 con 0x7f3d540c8fd0 2024-09-12T02:58:06.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d53400640 1 -- 172.21.15.63:0/639054390 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400a8d40 con 0x7f3d540c8fd0 2024-09-12T02:58:06.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d5a600640 1 -- 172.21.15.63:0/639054390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8fd0 msgr2=0x7f3d540c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d5a600640 1 --2- 172.21.15.63:0/639054390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8fd0 0x7f3d540c9440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3d400097c0 tx=0x7f3d4001ec90 comp rx=0 tx=0).stop 2024-09-12T02:58:06.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d5a600640 1 -- 172.21.15.63:0/639054390 shutdown_connections 2024-09-12T02:58:06.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d5a600640 1 --2- 172.21.15.63:0/639054390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d5406fc30 0x7f3d540caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d5a600640 1 --2- 172.21.15.63:0/639054390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8fd0 0x7f3d540c9440 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d5a600640 1 -- 172.21.15.63:0/639054390 >> 172.21.15.63:0/639054390 conn(0x7f3d54067a00 msgr2=0x7f3d54067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:06.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d5a600640 1 -- 172.21.15.63:0/639054390 shutdown_connections 2024-09-12T02:58:06.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d5a600640 1 -- 172.21.15.63:0/639054390 wait complete. 2024-09-12T02:58:06.097 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:06.091+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:06.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.093+0000 7f3d5a600640 1 Processor -- start 2024-09-12T02:58:06.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d5a600640 1 -- start start 2024-09-12T02:58:06.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d5a600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406fc30 0x7f3d5414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d5a600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8bf0 0x7f3d5414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d5a600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d540c8fd0 0x7f3d5414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d5a600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5415a830 con 0x7f3d540c8bf0 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d5a600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5415b140 con 0x7f3d5406fc30 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d5a600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5415b660 con 0x7f3d540c8fd0 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d53e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8bf0 0x7f3d5414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d53e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8bf0 0x7f3d5414af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52166/0 (socket says 172.21.15.63:52166) 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d53e00640 1 -- 172.21.15.63:0/978506337 learned_addr learned my addr 172.21.15.63:0/978506337 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d59c00640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d540c8fd0 0x7f3d5414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d59200640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406fc30 0x7f3d5414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d53e00640 1 -- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d540c8fd0 msgr2=0x7f3d5414d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d53e00640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d540c8fd0 0x7f3d5414d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d53e00640 1 -- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406fc30 msgr2=0x7f3d5414aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d53e00640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406fc30 0x7f3d5414aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d53e00640 1 -- 172.21.15.63:0/978506337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d540cd380 con 0x7f3d540c8bf0 2024-09-12T02:58:06.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d53e00640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8bf0 0x7f3d5414af90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3d4001c8c0 tx=0x7f3d4001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d50c00640 1 -- 172.21.15.63:0/978506337 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400bf070 con 0x7f3d540c8bf0 2024-09-12T02:58:06.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d50c00640 1 -- 172.21.15.63:0/978506337 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d400b0640 con 0x7f3d540c8bf0 2024-09-12T02:58:06.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d50c00640 1 -- 172.21.15.63:0/978506337 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400b5040 con 0x7f3d540c8bf0 2024-09-12T02:58:06.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d541f3dd0 con 0x7f3d540c8bf0 2024-09-12T02:58:06.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.097+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d541f3af0 con 0x7f3d540c8bf0 2024-09-12T02:58:06.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.101+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d54069870 con 0x7f3d540c8bf0 2024-09-12T02:58:06.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.101+0000 7f3d50c00640 1 -- 172.21.15.63:0/978506337 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d400b0a10 con 0x7f3d540c8bf0 2024-09-12T02:58:06.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.101+0000 7f3d50c00640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.101+0000 7f3d50c00640 1 -- 172.21.15.63:0/978506337 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6648+0+0 (secure 0 0 0) 0x7f3d40122830 con 0x7f3d540c8bf0 2024-09-12T02:58:06.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.101+0000 7f3d59200640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.101+0000 7f3d59200640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3d48005890 tx=0x7f3d48009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.105+0000 7f3d50c00640 1 -- 172.21.15.63:0/978506337 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d400187f0 con 0x7f3d540c8bf0 2024-09-12T02:58:06.197 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:06.193+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:06.242 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:06.242 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:06.242 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:06.258 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:06.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.293+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7f3d540700b0 con 0x7f3d540c8bf0 2024-09-12T02:58:06.299 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:06.297+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:06.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:06.400 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:06.399+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:06.456 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'39)", 2024-09-12T02:58:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.498567402999996, 2024-09-12T02:58:06.456 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047813200000000004, 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.457 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955738+0000", 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3099999999999998e-07 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955742+0000", 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.458 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955753+0000", 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1321000000000001e-05 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955759+0000", 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1070000000000001e-06 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955810+0000", 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0711000000000003e-05 2024-09-12T02:58:06.459 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955823+0000", 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2605999999999999e-05 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960475+0000", 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004652354 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960518+0000", 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3316999999999999e-05 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'39)", 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.497044607999996, 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039674089999999999, 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.461 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.462 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957261+0000", 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8400000000000004e-07 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957334+0000", 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3613000000000001e-05 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957347+0000", 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3349e-05 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.463 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957353+0000", 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1089999999999997e-06 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957405+0000", 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2206000000000001e-05 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957427+0000", 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2155999999999999e-05 2024-09-12T02:58:06.464 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961190+0000", 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037629849999999999 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961227+0000", 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7307e-05 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.465 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.494799569999998, 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004389858, 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.466 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959506+0000", 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8599999999999998e-07 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959510+0000", 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7339999999999999e-06 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.467 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959523+0000", 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2773e-05 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959528+0000", 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9740000000000001e-06 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960547+0000", 2024-09-12T02:58:06.468 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010187359999999999 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960560+0000", 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3223e-05 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963855+0000", 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032949910000000002 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.469 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963895+0000", 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9740999999999998e-05 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.487246818000003, 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021753509999999998, 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.471 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6599999999999996e-07 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967141+0000", 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2319999999999998e-05 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967152+0000", 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1432e-05 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.472 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967158+0000", 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8019999999999997e-06 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967207+0000", 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9075e-05 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967224+0000", 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7427000000000001e-05 2024-09-12T02:58:06.473 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969194+0000", 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019695590000000001 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969233+0000", 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9169999999999999e-05 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.474 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.485848634000007, 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003562614, 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.475 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7899999999999998e-07 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.476 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968495+0000", 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8025000000000003e-05 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968507+0000", 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2758999999999999e-05 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968513+0000", 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3009999999999997e-06 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.477 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968585+0000", 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2139999999999997e-05 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968599+0000", 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4752999999999999e-05 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.971980+0000", 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033801059999999999 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.478 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972018+0000", 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8850999999999998e-05 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:74 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'48, mlcod=17'44)", 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.484178679999999, 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022444370000000002, 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.479 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.480 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7100000000000001e-07 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970131+0000", 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4850000000000003e-06 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970144+0000", 2024-09-12T02:58:06.481 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2595999999999999e-05 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970149+0000", 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.395e-06 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970209+0000", 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9905999999999999e-05 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.482 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970225+0000", 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6177000000000001e-05 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972340+0000", 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002114917 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972370+0000", 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.029e-05 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.483 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:83 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'50)", 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.468197704000005, 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002809059, 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.484 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6000000000000004e-07 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.485 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986112+0000", 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8019999999999999e-06 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986123+0000", 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0953e-05 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986128+0000", 2024-09-12T02:58:06.486 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7849999999999999e-06 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986166+0000", 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7923000000000003e-05 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986180+0000", 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4211e-05 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.487 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988884+0000", 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027039640000000001 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988916+0000", 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1860999999999999e-05 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:84 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'50)", 2024-09-12T02:58:06.488 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.467200891999994, 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002347909, 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.489 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8899999999999999e-07 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987155+0000", 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0776000000000003e-05 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.490 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987167+0000", 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2215000000000001e-05 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987172+0000", 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.04e-06 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987232+0000", 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9595000000000001e-05 2024-09-12T02:58:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987246+0000", 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3757000000000001e-05 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989417+0000", 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021715329999999998 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.492 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989451+0000", 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4304000000000002e-05 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:90 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'60, mlcod=17'57)", 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.458664988999999, 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027093489999999998, 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.493 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.494 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995640+0000", 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9699999999999995e-07 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995794+0000", 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015367199999999999 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995805+0000", 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1061e-05 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.495 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995810+0000", 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4589999999999997e-06 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995856+0000", 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6127000000000001e-05 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995870+0000", 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3854e-05 2024-09-12T02:58:06.496 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998315+0000", 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024450930000000002 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998349+0000", 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3386000000000002e-05 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.497 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:105 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'67, mlcod=17'64)", 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.276389871000006, 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026337050000000001, 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.498 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4300000000000003e-07 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177930+0000", 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4735999999999999e-05 2024-09-12T02:58:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177942+0000", 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2349e-05 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177949+0000", 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6599999999999998e-06 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.500 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178003+0000", 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3535999999999997e-05 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178018+0000", 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5227e-05 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180517+0000", 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024996419999999998 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.501 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180548+0000", 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0911999999999998e-05 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:158 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'112, mlcod=18'109)", 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.999150885000006, 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026267230000000001, 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.502 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.503 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.58e-07 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455235+0000", 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1242000000000006e-05 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455245+0000", 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.995e-06 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.504 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455250+0000", 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7079999999999996e-06 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455297+0000", 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6885000000000003e-05 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455311+0000", 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4354e-05 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.505 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457734+0000", 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024232540000000001 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457780+0000", 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5827e-05 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.506 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:159 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'113, mlcod=18'109)", 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 68.998429896999994, 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046885809999999998, 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.507 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5300000000000004e-07 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455879+0000", 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8650000000000003e-06 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.508 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455889+0000", 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0139999999999999e-05 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455894+0000", 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2959999999999998e-06 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455944+0000", 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9774999999999997e-05 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455962+0000", 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8009999999999999e-05 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460534+0000", 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045721299999999998 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460563+0000", 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8812000000000001e-05 2024-09-12T02:58:06.510 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:4 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.602281542, 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073449359999999998, 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852025+0000", 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2280000000000001e-06 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852034+0000", 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1619999999999997e-06 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852060+0000", 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5714000000000001e-05 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852073+0000", 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3199e-05 2024-09-12T02:58:06.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852384+0000", 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031071499999999998 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852627+0000", 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024345000000000001 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852778+0000", 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015093999999999999 2024-09-12T02:58:06.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857277+0000", 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044991120000000004 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859269+0000", 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019915879999999999 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:06.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3817999999999999e-05 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859368+0000", 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5009999999999998e-05 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:06.516 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.602190133000001, 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012795443, 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852115+0000", 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.54e-07 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852120+0000", 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2299999999999999e-06 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852132+0000", 2024-09-12T02:58:06.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1746000000000001e-05 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852140+0000", 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2300000000000008e-06 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854507+0000", 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023667369999999998 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854587+0000", 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0024000000000005e-05 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854730+0000", 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014253599999999999 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859376+0000", 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046468200000000003 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864800+0000", 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054233670000000001 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864864+0000", 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4397e-05 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864910+0000", 2024-09-12T02:58:06.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5602000000000001e-05 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:28 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.602131884999999, 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011320167000000001, 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:06.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1600000000000001e-07 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852188+0000", 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.506e-05 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852199+0000", 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0677e-05 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852206+0000", 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8279999999999997e-06 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852418+0000", 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021227799999999999 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852545+0000", 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012638499999999999 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852774+0000", 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0002299 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856085+0000", 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033103569999999999 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863371+0000", 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072860260000000001 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863444+0000", 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.305e-05 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863493+0000", 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8890000000000001e-05 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.602069823999997, 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012832368, 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5700000000000002e-07 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852262+0000", 2024-09-12T02:58:06.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7135e-05 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852366+0000", 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103606 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852378+0000", 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2204999999999999e-05 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854980+0000", 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026019860000000001 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855096+0000", 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115887 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855213+0000", 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116916 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859383+0000", 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041700089999999997 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864993+0000", 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056103209999999997 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865043+0000", 2024-09-12T02:58:06.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9481999999999998e-05 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865067+0000", 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4164000000000001e-05 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.601857422000002, 2024-09-12T02:58:06.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012817586000000001, 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:06.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852448+0000", 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5600000000000005e-07 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852453+0000", 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9019999999999998e-06 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852462+0000", 2024-09-12T02:58:06.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9069999999999996e-06 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852469+0000", 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.374e-06 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853604+0000", 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011349299999999999 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853717+0000", 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112797 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853836+0000", 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011936500000000001 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859663+0000", 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058266209999999997 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865167+0000", 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055044849999999999 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865226+0000", 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8718000000000003e-05 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865265+0000", 2024-09-12T02:58:06.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8730999999999999e-05 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.601825822999999, 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012748110999999999, 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6699999999999999e-07 2024-09-12T02:58:06.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852492+0000", 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.291e-05 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852500+0000", 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1580000000000005e-06 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852506+0000", 2024-09-12T02:58:06.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5330000000000002e-06 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856830+0000", 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004324194 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856959+0000", 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012862099999999999 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865227+0000", 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082682280000000007 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.599503732000002, 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045219450000000003, 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.543 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854802+0000", 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854814+0000", 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1759999999999999e-05 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854836+0000", 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2039999999999999e-05 2024-09-12T02:58:06.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854855+0000", 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.929e-05 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854975+0000", 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119561 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043479110000000003 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:2 2.f e25/19 2:f1f69726:::400.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.596187534999999, 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032847000000000002, 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:06.547 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:06.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858118+0000", 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1540000000000001e-06 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858126+0000", 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7759999999999997e-06 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858138+0000", 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2184999999999999e-05 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858145+0000", 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858282+0000", 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013642799999999999 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858297+0000", 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5328e-05 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861346+0000", 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030492729999999999 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861402+0000", 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5220999999999999e-05 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:06.551 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:06.553 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:06.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b62a00640 1 Processor -- start 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b62a00640 1 -- start start 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b62a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b5c1517d0 0x7f6b5c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b62a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b5c0c9470 0x7f6b5c165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b62a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b5c070520 con 0x7f6b5c15e340 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b62a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5c06f6f0 con 0x7f6b5c1517d0 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b62a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5c0c8cf0 con 0x7f6b5c0c9470 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b5be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b5c1517d0 0x7f6b5c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b5be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b5c1517d0 0x7f6b5c15de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52182/0 (socket says 172.21.15.63:52182) 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b5be00640 1 -- 172.21.15.63:0/2412279983 learned_addr learned my addr 172.21.15.63:0/2412279983 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b60a00640 1 --2- 172.21.15.63:0/2412279983 >> v2:172.21.15.119:3300/0 conn(0x7f6b5c0c9470 0x7f6b5c165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b5be00640 1 -- 172.21.15.63:0/2412279983 >> v2:172.21.15.119:3300/0 conn(0x7f6b5c0c9470 msgr2=0x7f6b5c165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:06.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b5be00640 1 --2- 172.21.15.63:0/2412279983 >> v2:172.21.15.119:3300/0 conn(0x7f6b5c0c9470 0x7f6b5c165190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b5be00640 1 -- 172.21.15.63:0/2412279983 >> v1:172.21.15.119:6789/0 conn(0x7f6b5c15e340 legacy=0x7f6b5c0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.485+0000 7f6b5be00640 1 -- 172.21.15.63:0/2412279983 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5c0c9180 con 0x7f6b5c1517d0 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b5be00640 1 --2- 172.21.15.63:0/2412279983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c1517d0 0x7f6b5c15de00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0711a0 tx=0x7f6b4c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabd7817cf3b799e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b5aa00640 1 -- 172.21.15.63:0/2412279983 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0b5070 con 0x7f6b5c1517d0 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b5aa00640 1 -- 172.21.15.63:0/2412279983 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4c0a8a10 con 0x7f6b5c1517d0 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b5aa00640 1 -- 172.21.15.63:0/2412279983 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0a8de0 con 0x7f6b5c1517d0 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b62a00640 1 -- 172.21.15.63:0/2412279983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c1517d0 msgr2=0x7f6b5c15de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b62a00640 1 --2- 172.21.15.63:0/2412279983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c1517d0 0x7f6b5c15de00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0711a0 tx=0x7f6b4c01ed10 comp rx=0 tx=0).stop 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b62a00640 1 -- 172.21.15.63:0/2412279983 shutdown_connections 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b62a00640 1 --2- 172.21.15.63:0/2412279983 >> v2:172.21.15.119:3300/0 conn(0x7f6b5c0c9470 0x7f6b5c165190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b62a00640 1 --2- 172.21.15.63:0/2412279983 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c1517d0 0x7f6b5c15de00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b62a00640 1 -- 172.21.15.63:0/2412279983 >> 172.21.15.63:0/2412279983 conn(0x7f6b5c067a00 msgr2=0x7f6b5c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b62a00640 1 -- 172.21.15.63:0/2412279983 shutdown_connections 2024-09-12T02:58:06.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.489+0000 7f6b62a00640 1 -- 172.21.15.63:0/2412279983 wait complete. 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 Processor -- start 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 -- start start 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5c0c9470 0x7f6b5c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b5c1517d0 0x7f6b5c152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c15e340 0x7f6b5c153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c070240 con 0x7f6b5c15e340 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c06ffa0 con 0x7f6b5c1517d0 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5c06fc00 con 0x7f6b5c0c9470 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b60a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c15e340 0x7f6b5c153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b5be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5c0c9470 0x7f6b5c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b5be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5c0c9470 0x7f6b5c1540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:49340/0 (socket says 172.21.15.63:49340) 2024-09-12T02:58:06.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b60a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c15e340 0x7f6b5c153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52186/0 (socket says 172.21.15.63:52186) 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b5be00640 1 -- 172.21.15.63:0/3885405274 learned_addr learned my addr 172.21.15.63:0/3885405274 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b5b400640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b5c1517d0 0x7f6b5c152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b60a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5c0c9470 msgr2=0x7f6b5c1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b60a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b5c0c9470 0x7f6b5c1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b60a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b5c1517d0 msgr2=0x7f6b5c152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b60a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b5c1517d0 0x7f6b5c152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b60a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5c149b60 con 0x7f6b5c15e340 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b60a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c15e340 0x7f6b5c153230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6b54007d90 tx=0x7f6b5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400edd0 con 0x7f6b5c15e340 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b540039a0 con 0x7f6b5c15e340 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5c149e20 con 0x7f6b5c15e340 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b54003d90 con 0x7f6b5c15e340 2024-09-12T02:58:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.493+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b5c1f4170 con 0x7f6b5c15e340 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.497+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f6b5c06ec50 con 0x7f6b5c15e340 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.497+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b5401b020 con 0x7f6b5c15e340 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.497+0000 7f6b53e00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b3c0678c0 0x7f6b3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.497+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6648+0+0 (secure 0 0 0) 0x7f6b540861c0 con 0x7f6b5c15e340 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.497+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v41) ==== 54+0+16 (secure 0 0 0) 0x7f6b54088760 con 0x7f6b5c15e340 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.497+0000 7f6b5be00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b3c0678c0 0x7f6b3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.497+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f6b5c14a0b0 0x7f6b5c0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.497+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b5c15c9b0 con 0x7f6b5c14a0b0 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.497+0000 7f6b5b400640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f6b5c14a0b0 0x7f6b5c0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.501+0000 7f6b5b400640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f6b5c14a0b0 0x7f6b5c0c3a80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.501+0000 7f6b5be00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b3c0678c0 0x7f6b3c069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c01ed50 tx=0x7f6b4c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.501+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b5c15c9b0 con 0x7f6b5c14a0b0 2024-09-12T02:58:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.517+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f6b5c0c4ed0 con 0x7f6b5c14a0b0 2024-09-12T02:58:06.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.521+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f6b5c0c4ed0 con 0x7f6b5c14a0b0 2024-09-12T02:58:06.563 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.521+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f6b5c14b600 0x7f6b5c14d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.521+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f6b5c0ca350 con 0x7f6b5c14b600 2024-09-12T02:58:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.521+0000 7f6b5be00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f6b5c14b600 0x7f6b5c14d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.521+0000 7f6b5be00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f6b5c14b600 0x7f6b5c14d310 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.521+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b5c0ca350 con 0x7f6b5c14b600 2024-09-12T02:58:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.537+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f6b5c0ca070 con 0x7f6b5c14b600 2024-09-12T02:58:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.537+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f6b5c0ca070 con 0x7f6b5c14b600 2024-09-12T02:58:06.565 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.537+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f6b5c1f0d70 0x7f6b5c1f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.537+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f6b5c1f16f0 con 0x7f6b5c1f0d70 2024-09-12T02:58:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.537+0000 7f6b5b400640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f6b5c1f0d70 0x7f6b5c1f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.541+0000 7f6b5b400640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f6b5c1f0d70 0x7f6b5c1f11b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.541+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b5c1f16f0 con 0x7f6b5c1f0d70 2024-09-12T02:58:06.566 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:06.549+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.557+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f6b5c062930 con 0x7f6b5c1f0d70 2024-09-12T02:58:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.557+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f6b5c062930 con 0x7f6b5c1f0d70 2024-09-12T02:58:06.567 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.557+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b5c063410 0x7f6b5c0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.557+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f6b5c0c9ab0 con 0x7f6b5c063410 2024-09-12T02:58:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.561+0000 7f6b60a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b5c063410 0x7f6b5c0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.561+0000 7f6b60a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b5c063410 0x7f6b5c0cbf50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.561+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b5c0c9ab0 con 0x7f6b5c063410 2024-09-12T02:58:06.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.577+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f6b5c0cc760 con 0x7f6b5c063410 2024-09-12T02:58:06.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.581+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f6b5c0cc760 con 0x7f6b5c063410 2024-09-12T02:58:06.585 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.581+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f6b5c02c650 0x7f6b5c02ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.581+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f6b5c0c9ab0 con 0x7f6b5c02c650 2024-09-12T02:58:06.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.581+0000 7f6b5be00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f6b5c02c650 0x7f6b5c02ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.585+0000 7f6b5be00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f6b5c02c650 0x7f6b5c02ca70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.585+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b5c0c9ab0 con 0x7f6b5c02c650 2024-09-12T02:58:06.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.597+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f6b5c0c9ab0 con 0x7f6b5c02c650 2024-09-12T02:58:06.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.601+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f6b5c0c9ab0 con 0x7f6b5c02c650 2024-09-12T02:58:06.605 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:06.606 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:06.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.601+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f6b5c02d4c0 0x7f6b5c2071e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.601+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f6b5c02d8e0 con 0x7f6b5c02d4c0 2024-09-12T02:58:06.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.601+0000 7f6b5b400640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f6b5c02d4c0 0x7f6b5c2071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.605+0000 7f6b5b400640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f6b5c02d4c0 0x7f6b5c2071e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.605+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b5c02d8e0 con 0x7f6b5c02d4c0 2024-09-12T02:58:06.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.617+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f6b5c02d8e0 con 0x7f6b5c02d4c0 2024-09-12T02:58:06.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.625+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f6b5c02d8e0 con 0x7f6b5c02d4c0 2024-09-12T02:58:06.626 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.625+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f6b5c207c30 0x7f6b5c20a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.625+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f6b5c20cdf0 con 0x7f6b5c207c30 2024-09-12T02:58:06.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.625+0000 7f6b60a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f6b5c207c30 0x7f6b5c20a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.625+0000 7f6b60a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f6b5c207c30 0x7f6b5c20a020 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.625+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b5c20cdf0 con 0x7f6b5c207c30 2024-09-12T02:58:06.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.641+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f6b5c20a560 con 0x7f6b5c207c30 2024-09-12T02:58:06.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.645+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f6b5c20a560 con 0x7f6b5c207c30 2024-09-12T02:58:06.648 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:06.648 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:06.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.645+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f6b5c20abe0 0x7f6b5c20cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:06.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.645+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f6b5c20ffb0 con 0x7f6b5c20abe0 2024-09-12T02:58:06.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.645+0000 7f6b5be00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f6b5c20abe0 0x7f6b5c20cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:06.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.645+0000 7f6b5be00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f6b5c20abe0 0x7f6b5c20cfd0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:06.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.649+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b5c20ffb0 con 0x7f6b5c20abe0 2024-09-12T02:58:06.654 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:06.649+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:06.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.661+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f6b5c20ff80 con 0x7f6b5c20abe0 2024-09-12T02:58:06.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b53e00640 1 -- 172.21.15.63:0/3885405274 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f6b5c20ff80 con 0x7f6b5c20abe0 2024-09-12T02:58:06.668 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:06.669 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f6b5c14a0b0 msgr2=0x7f6b5c0c3a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f6b5c14a0b0 0x7f6b5c0c3a80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f6b5c14b600 msgr2=0x7f6b5c14d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f6b5c14b600 0x7f6b5c14d310 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f6b5c1f0d70 msgr2=0x7f6b5c1f11b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f6b5c1f0d70 0x7f6b5c1f11b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b5c063410 msgr2=0x7f6b5c0cbf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b5c063410 0x7f6b5c0cbf50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f6b5c02c650 msgr2=0x7f6b5c02ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f6b5c02c650 0x7f6b5c02ca70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b60a00640 1 -- 172.21.15.63:0/3885405274 reap_dead start 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b60a00640 1 -- 172.21.15.63:0/3885405274 reap_dead start 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f6b5c02d4c0 msgr2=0x7f6b5c2071e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f6b5c02d4c0 0x7f6b5c2071e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f6b5c207c30 msgr2=0x7f6b5c20a020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f6b5c207c30 0x7f6b5c20a020 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f6b5c20abe0 msgr2=0x7f6b5c20cfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f6b5c20abe0 0x7f6b5c20cfd0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b3c0678c0 msgr2=0x7f6b3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b3c0678c0 0x7f6b3c069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c01ed50 tx=0x7f6b4c009040 comp rx=0 tx=0).stop 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c15e340 msgr2=0x7f6b5c153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 --2- 172.21.15.63:0/3885405274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b5c15e340 0x7f6b5c153230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6b54007d90 tx=0x7f6b5400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b60a00640 1 -- 172.21.15.63:0/3885405274 reap_dead start 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 shutdown_connections 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 >> 172.21.15.63:0/3885405274 conn(0x7f6b5c067a00 msgr2=0x7f6b5c0ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 shutdown_connections 2024-09-12T02:58:06.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.665+0000 7f6b62a00640 1 -- 172.21.15.63:0/3885405274 wait complete. 2024-09-12T02:58:06.724 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:06.724 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:06.739 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:06.755 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:06.751+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:06.856 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:06.853+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:06.928 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:06.928 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:06.944 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:06.956 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:06.951+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:06.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d50c00640 1 -- 172.21.15.63:0/978506337 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v42) ==== 91+0+0 (secure 0 0 0) 0x7f3d400f2840 con 0x7f3d540c8bf0 2024-09-12T02:58:06.969 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 msgr2=0x7f3d34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3d48005890 tx=0x7f3d48009040 comp rx=0 tx=0).stop 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8bf0 msgr2=0x7f3d5414af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8bf0 0x7f3d5414af90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3d4001c8c0 tx=0x7f3d4001ba30 comp rx=0 tx=0).stop 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 shutdown_connections 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d340678c0 0x7f3d34069d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d540c8fd0 0x7f3d5414d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d540c8bf0 0x7f3d5414af90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 --2- 172.21.15.63:0/978506337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d5406fc30 0x7f3d5414aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 >> 172.21.15.63:0/978506337 conn(0x7f3d54067a00 msgr2=0x7f3d541595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 shutdown_connections 2024-09-12T02:58:06.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:06.965+0000 7f3d5a600640 1 -- 172.21.15.63:0/978506337 wait complete. 2024-09-12T02:58:07.057 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:07.053+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:07.123 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:07.123 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:07.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:07.158 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:07.155+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:07.259 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:07.255+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:07.334 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:07.334 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:07.350 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:07.360 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:07.355+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:07.461 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:07.459+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:07.496 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:07.496 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:07.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:07.562 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:07.559+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:07.658 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:07.658 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:07.662 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:07.661+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:07.674 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:07.763 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:07.761+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:07.864 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:07.859+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:07.868 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:07.868 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:07.883 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:07.965 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:07.963+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:08.066 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:08.063+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:08.089 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:08.089 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:08.105 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:08.167 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:08.165+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:08.269 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:08.263+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:08.270 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:08.270 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:08.286 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:08.369 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:08.365+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:08.417 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:08.417 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:08.431 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:08.470 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:08.469+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:08.549 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:08.549 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:08.563 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:08.571 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:08.569+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:08.672 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:08.667+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:08.685 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:08.685 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:08.688 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:08.699 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:58:08.789 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:08.787+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:08.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.825+0000 7f455b000640 1 Processor -- start 2024-09-12T02:58:08.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.825+0000 7f455b000640 1 -- start start 2024-09-12T02:58:08.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f455b000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f455406bf20 0x7f455406e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f455b000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f45540c7aa0 0x7f455406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f455b000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45540c7030 0x7f455406c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f455b000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f45540c91e0 con 0x7f455406bf20 2024-09-12T02:58:08.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f455b000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4554073d30 con 0x7f45540c7aa0 2024-09-12T02:58:08.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f455b000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4554073440 con 0x7f45540c7030 2024-09-12T02:58:08.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f4559c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f455406bf20 0x7f455406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f4559c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f455406bf20 0x7f455406e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52192/0 (socket says 172.21.15.63:52192) 2024-09-12T02:58:08.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f4559c00640 1 -- 172.21.15.63:0/2235087076 learned_addr learned my addr 172.21.15.63:0/2235087076 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:08.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f455a600640 1 --2- 172.21.15.63:0/2235087076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45540c7030 0x7f455406c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f4559200640 1 --2- 172.21.15.63:0/2235087076 >> v2:172.21.15.119:3300/0 conn(0x7f45540c7aa0 0x7f455406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f4559c00640 1 -- 172.21.15.63:0/2235087076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45540c7030 msgr2=0x7f455406c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:08.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f4559c00640 1 --2- 172.21.15.63:0/2235087076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45540c7030 0x7f455406c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:08.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f4559c00640 1 -- 172.21.15.63:0/2235087076 >> v2:172.21.15.119:3300/0 conn(0x7f45540c7aa0 msgr2=0x7f455406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:08.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f4559c00640 1 --2- 172.21.15.63:0/2235087076 >> v2:172.21.15.119:3300/0 conn(0x7f45540c7aa0 0x7f455406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:08.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.829+0000 7f4559c00640 1 -- 172.21.15.63:0/2235087076 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45540c9430 con 0x7f455406bf20 2024-09-12T02:58:08.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f4559c00640 1 --2- 172.21.15.63:0/2235087076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 0x7f455406e900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f45540686d0 tx=0x7f454801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388109eedd62e958 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f4553e00640 1 -- 172.21.15.63:0/2235087076 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480b5070 con 0x7f455406bf20 2024-09-12T02:58:08.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f4553e00640 1 -- 172.21.15.63:0/2235087076 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45480a89d0 con 0x7f455406bf20 2024-09-12T02:58:08.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f4553e00640 1 -- 172.21.15.63:0/2235087076 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480a8da0 con 0x7f455406bf20 2024-09-12T02:58:08.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f455b000640 1 -- 172.21.15.63:0/2235087076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 msgr2=0x7f455406e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:08.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f455b000640 1 --2- 172.21.15.63:0/2235087076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 0x7f455406e900 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f45540686d0 tx=0x7f454801ed10 comp rx=0 tx=0).stop 2024-09-12T02:58:08.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f455b000640 1 -- 172.21.15.63:0/2235087076 shutdown_connections 2024-09-12T02:58:08.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f455b000640 1 --2- 172.21.15.63:0/2235087076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45540c7030 0x7f455406c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:08.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f455b000640 1 --2- 172.21.15.63:0/2235087076 >> v2:172.21.15.119:3300/0 conn(0x7f45540c7aa0 0x7f455406c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:08.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f455b000640 1 --2- 172.21.15.63:0/2235087076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 0x7f455406e900 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:08.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f455b000640 1 -- 172.21.15.63:0/2235087076 >> 172.21.15.63:0/2235087076 conn(0x7f45540ccf10 msgr2=0x7f45540cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:08.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f455b000640 1 -- 172.21.15.63:0/2235087076 shutdown_connections 2024-09-12T02:58:08.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.833+0000 7f455b000640 1 -- 172.21.15.63:0/2235087076 wait complete. 2024-09-12T02:58:08.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 Processor -- start 2024-09-12T02:58:08.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 -- start start 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 0x7f45540cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45540c7030 0x7f45541e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45540c7aa0 0x7f45541f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f45540c9710 con 0x7f455406bf20 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f45540739c0 con 0x7f45540c7aa0 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f45540741c0 con 0x7f45540c7030 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 0x7f45540cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 0x7f45540cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52206/0 (socket says 172.21.15.63:52206) 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559c00640 1 -- 172.21.15.63:0/3567620578 learned_addr learned my addr 172.21.15.63:0/3567620578 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:08.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455a600640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45540c7aa0 0x7f45541f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559200640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45540c7030 0x7f45541e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559c00640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45540c7030 msgr2=0x7f45541e2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:08.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559c00640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45540c7030 0x7f45541e2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:08.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559c00640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45540c7aa0 msgr2=0x7f45541f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:08.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559c00640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45540c7aa0 0x7f45541f3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:08.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559c00640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45540cb7c0 con 0x7f455406bf20 2024-09-12T02:58:08.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4559c00640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 0x7f45540cc3a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f45480b3040 tx=0x7f454801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480b5070 con 0x7f455406bf20 2024-09-12T02:58:08.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45480b0950 con 0x7f455406bf20 2024-09-12T02:58:08.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45541573a0 con 0x7f455406bf20 2024-09-12T02:58:08.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480b0d40 con 0x7f455406bf20 2024-09-12T02:58:08.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.837+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45541f3630 con 0x7f455406bf20 2024-09-12T02:58:08.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.841+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f455406e900 con 0x7f455406bf20 2024-09-12T02:58:08.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.841+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45480c2060 con 0x7f455406bf20 2024-09-12T02:58:08.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.841+0000 7f4551600640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f45340678f0 0x7f4534069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.841+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6648+0+0 (secure 0 0 0) 0x7f4548123560 con 0x7f455406bf20 2024-09-12T02:58:08.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.841+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v42) ==== 54+0+16 (secure 0 0 0) 0x7f45480c9020 con 0x7f455406bf20 2024-09-12T02:58:08.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.841+0000 7f4559200640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f45340678f0 0x7f4534069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.841+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f45540c4280 0x7f4554156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.841+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f455406fba0 con 0x7f45540c4280 2024-09-12T02:58:08.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.841+0000 7f455a600640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f45540c4280 0x7f4554156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.845+0000 7f4559200640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f45340678f0 0x7f4534069db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f455414bda0 tx=0x7f4540009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.845+0000 7f455a600640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f45540c4280 0x7f4554156ab0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.845+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f455406fba0 con 0x7f45540c4280 2024-09-12T02:58:08.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.861+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4554072fd0 con 0x7f45540c4280 2024-09-12T02:58:08.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.865+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4554072fd0 con 0x7f45540c4280 2024-09-12T02:58:08.868 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:08.868 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:08.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.865+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f455414aa70 0x7f455414aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.865+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f4554155dd0 con 0x7f455414aa70 2024-09-12T02:58:08.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.865+0000 7f4559c00640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f455414aa70 0x7f455414aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.865+0000 7f4559c00640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f455414aa70 0x7f455414aed0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.870 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:08.870 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:08.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.865+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4554155dd0 con 0x7f455414aa70 2024-09-12T02:58:08.873 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:08.871+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:08.884 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T02:58:08.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.881+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f45541e3110 con 0x7f455414aa70 2024-09-12T02:58:08.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.885+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f45541e3110 con 0x7f455414aa70 2024-09-12T02:58:08.887 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:08.887 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:08.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.885+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f45541e3d30 0x7f45541e4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.885+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f45541e4670 con 0x7f45541e3d30 2024-09-12T02:58:08.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.885+0000 7f4559200640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f45541e3d30 0x7f45541e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.885+0000 7f4559200640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f45541e3d30 0x7f45541e4130 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.885+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45541e4670 con 0x7f45541e3d30 2024-09-12T02:58:08.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.897+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f45541e4670 con 0x7f45541e3d30 2024-09-12T02:58:08.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.901+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f45541e4670 con 0x7f45541e3d30 2024-09-12T02:58:08.903 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:08.904 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:08.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.901+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4554062fb0 0x7f45541e17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.901+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f45541e4670 con 0x7f4554062fb0 2024-09-12T02:58:08.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.901+0000 7f455a600640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4554062fb0 0x7f45541e17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.901+0000 7f455a600640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4554062fb0 0x7f45541e17f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.901+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45541e4670 con 0x7f4554062fb0 2024-09-12T02:58:08.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.917+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f45541e4670 con 0x7f4554062fb0 2024-09-12T02:58:08.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.917+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f45541e4670 con 0x7f4554062fb0 2024-09-12T02:58:08.921 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:08.922 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:08.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.917+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f45541e2240 0x7f455402c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.917+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f4554063660 con 0x7f45541e2240 2024-09-12T02:58:08.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.917+0000 7f4559c00640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f45541e2240 0x7f455402c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.921+0000 7f4559c00640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f45541e2240 0x7f455402c650 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.921+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4554063660 con 0x7f45541e2240 2024-09-12T02:58:08.931 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T02:58:08.932 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T02:58:08.932 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T02:58:08.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T02:58:08.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.937+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4554063660 con 0x7f45541e2240 2024-09-12T02:58:08.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.941+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4554063660 con 0x7f45541e2240 2024-09-12T02:58:08.943 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:08.943 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:08.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.941+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f455402d0a0 0x7f455402d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.941+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f455402da40 con 0x7f455402d0a0 2024-09-12T02:58:08.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.941+0000 7f4559200640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f455402d0a0 0x7f455402d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.941+0000 7f4559200640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f455402d0a0 0x7f455402d500 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.941+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4540028e50 con 0x7f455402d0a0 2024-09-12T02:58:08.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.957+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4554206ba0 con 0x7f455402d0a0 2024-09-12T02:58:08.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.961+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4554206ba0 con 0x7f455402d0a0 2024-09-12T02:58:08.963 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:08.963 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:08.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.961+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4554207220 0x7f4554209610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.961+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f455420c490 con 0x7f4554207220 2024-09-12T02:58:08.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.961+0000 7f455a600640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4554207220 0x7f4554209610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.961+0000 7f455a600640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4554207220 0x7f4554209610 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.961+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f455420c490 con 0x7f4554207220 2024-09-12T02:58:08.974 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:08.973+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:08.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.977+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f4554209e20 con 0x7f4554207220 2024-09-12T02:58:08.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.981+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f4554209e20 con 0x7f4554207220 2024-09-12T02:58:08.983 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:08.984 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:08.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.981+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f455420a540 0x7f455420a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:08.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.981+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f455420f860 con 0x7f455420a540 2024-09-12T02:58:08.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.981+0000 7f4559c00640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f455420a540 0x7f455420a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:08.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.981+0000 7f4559c00640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f455420a540 0x7f455420a9a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:08.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.981+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f455420f860 con 0x7f455420a540 2024-09-12T02:58:08.992 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T02:58:09.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:08.997+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f455420e6e0 con 0x7f455420a540 2024-09-12T02:58:09.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f4551600640 1 -- 172.21.15.63:0/3567620578 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f455420e6e0 con 0x7f455420a540 2024-09-12T02:58:09.003 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:09.004 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:09.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f45540c4280 msgr2=0x7f4554156ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f45540c4280 0x7f4554156ab0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f455414aa70 msgr2=0x7f455414aed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f455414aa70 0x7f455414aed0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f45541e3d30 msgr2=0x7f45541e4130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f45541e3d30 0x7f45541e4130 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4554062fb0 msgr2=0x7f45541e17f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f4554062fb0 0x7f45541e17f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f45541e2240 msgr2=0x7f455402c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f45541e2240 0x7f455402c650 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f455402d0a0 msgr2=0x7f455402d500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f455402d0a0 0x7f455402d500 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4554207220 msgr2=0x7f4554209610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f4554207220 0x7f4554209610 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f455420a540 msgr2=0x7f455420a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f455420a540 0x7f455420a9a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455a600640 1 -- 172.21.15.63:0/3567620578 reap_dead start 2024-09-12T02:58:09.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455a600640 1 -- 172.21.15.63:0/3567620578 reap_dead start 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455a600640 1 -- 172.21.15.63:0/3567620578 reap_dead start 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455a600640 1 -- 172.21.15.63:0/3567620578 reap_dead start 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455a600640 1 -- 172.21.15.63:0/3567620578 reap_dead start 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f45340678f0 msgr2=0x7f4534069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f45340678f0 0x7f4534069db0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f455414bda0 tx=0x7f4540009190 comp rx=0 tx=0).stop 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 msgr2=0x7f45540cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 0x7f45540cc3a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f45480b3040 tx=0x7f454801bab0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 shutdown_connections 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f45340678f0 0x7f4534069db0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 --2- 172.21.15.63:0/3567620578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f455406bf20 0x7f45540cc3a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 >> 172.21.15.63:0/3567620578 conn(0x7f45540ccf10 msgr2=0x7f455406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 shutdown_connections 2024-09-12T02:58:09.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.001+0000 7f455b000640 1 -- 172.21.15.63:0/3567620578 wait complete. 2024-09-12T02:58:09.049 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:09.049 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:09.049 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:09.049 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:09.049 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:09.063 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T02:58:09.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.089+0000 7f6b7b600640 1 Processor -- start 2024-09-12T02:58:09.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.089+0000 7f6b7b600640 1 -- start start 2024-09-12T02:58:09.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b7b600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74074070 0x7f6b740c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b7b600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b740c28c0 0x7f6b74161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b7b600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b741580c0 con 0x7f6b74151a80 2024-09-12T02:58:09.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b7b600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6b740c8500 con 0x7f6b740c28c0 2024-09-12T02:58:09.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b7b600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6b740c2d70 con 0x7f6b74074070 2024-09-12T02:58:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b73e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74074070 0x7f6b740c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b78c00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6b74151a80 0x7f6b74072e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:52918/0 (socket says 172.21.15.63:52918) 2024-09-12T02:58:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b78c00640 1 -- 172.21.15.63:0/3302843953 learned_addr learned my addr 172.21.15.63:0/3302843953 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b79600640 1 --2- 172.21.15.63:0/3302843953 >> v2:172.21.15.119:3300/0 conn(0x7f6b740c28c0 0x7f6b74161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b73e00640 1 -- 172.21.15.63:0/3302843953 >> v2:172.21.15.119:3300/0 conn(0x7f6b740c28c0 msgr2=0x7f6b74161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b73e00640 1 --2- 172.21.15.63:0/3302843953 >> v2:172.21.15.119:3300/0 conn(0x7f6b740c28c0 0x7f6b74161e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b73e00640 1 -- 172.21.15.63:0/3302843953 >> v1:172.21.15.119:6789/0 conn(0x7f6b74151a80 legacy=0x7f6b74072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.093+0000 7f6b73e00640 1 -- 172.21.15.63:0/3302843953 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b741583a0 con 0x7f6b74074070 2024-09-12T02:58:09.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b73e00640 1 --2- 172.21.15.63:0/3302843953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74074070 0x7f6b740c2380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b600097f0 tx=0x7f6b60020ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd64c0960db02297 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:09.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b73400640 1 -- 172.21.15.63:0/3302843953 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b600b7070 con 0x7f6b74074070 2024-09-12T02:58:09.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b73400640 1 -- 172.21.15.63:0/3302843953 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b600aaba0 con 0x7f6b74074070 2024-09-12T02:58:09.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b73400640 1 -- 172.21.15.63:0/3302843953 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b600b2440 con 0x7f6b74074070 2024-09-12T02:58:09.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b7b600640 1 -- 172.21.15.63:0/3302843953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74074070 msgr2=0x7f6b740c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b7b600640 1 --2- 172.21.15.63:0/3302843953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74074070 0x7f6b740c2380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b600097f0 tx=0x7f6b60020ea0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b7b600640 1 -- 172.21.15.63:0/3302843953 shutdown_connections 2024-09-12T02:58:09.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b7b600640 1 --2- 172.21.15.63:0/3302843953 >> v2:172.21.15.119:3300/0 conn(0x7f6b740c28c0 0x7f6b74161e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b7b600640 1 --2- 172.21.15.63:0/3302843953 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74074070 0x7f6b740c2380 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b7b600640 1 -- 172.21.15.63:0/3302843953 >> 172.21.15.63:0/3302843953 conn(0x7f6b7406f3d0 msgr2=0x7f6b7406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:09.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.097+0000 7f6b7b600640 1 -- 172.21.15.63:0/3302843953 shutdown_connections 2024-09-12T02:58:09.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b7b600640 1 -- 172.21.15.63:0/3302843953 wait complete. 2024-09-12T02:58:09.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b7b600640 1 Processor -- start 2024-09-12T02:58:09.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b7b600640 1 -- start start 2024-09-12T02:58:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b7b600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b74074070 0x7f6b7414d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b7b600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b740c28c0 0x7f6b741e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b7b600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74151a80 0x7f6b74146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b7b600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6b740cc4c0 con 0x7f6b74074070 2024-09-12T02:58:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b7b600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6b740cc1e0 con 0x7f6b740c28c0 2024-09-12T02:58:09.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b7b600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6b740c81f0 con 0x7f6b74151a80 2024-09-12T02:58:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b73e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b740c28c0 0x7f6b741e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b78c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b74074070 0x7f6b7414d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.101+0000 7f6b79600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74151a80 0x7f6b74146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b79600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74151a80 0x7f6b74146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:49386/0 (socket says 172.21.15.63:49386) 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b79600640 1 -- 172.21.15.63:0/3769416924 learned_addr learned my addr 172.21.15.63:0/3769416924 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b79600640 1 -- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b740c28c0 msgr2=0x7f6b741e33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b79600640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b740c28c0 0x7f6b741e33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b79600640 1 -- 172.21.15.63:0/3769416924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b74074070 msgr2=0x7f6b7414d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b79600640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b74074070 0x7f6b7414d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b79600640 1 -- 172.21.15.63:0/3769416924 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7414dcf0 con 0x7f6b74151a80 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b79600640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74151a80 0x7f6b74146ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009dd0 tx=0x7f6b6c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b70c00640 1 -- 172.21.15.63:0/3769416924 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c018020 con 0x7f6b74151a80 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b70c00640 1 -- 172.21.15.63:0/3769416924 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6c014480 con 0x7f6b74151a80 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b70c00640 1 -- 172.21.15.63:0/3769416924 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c014870 con 0x7f6b74151a80 2024-09-12T02:58:09.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b74148850 con 0x7f6b74151a80 2024-09-12T02:58:09.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b74148e10 con 0x7f6b74151a80 2024-09-12T02:58:09.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b740c7cf0 con 0x7f6b74151a80 2024-09-12T02:58:09.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.105+0000 7f6b70c00640 1 -- 172.21.15.63:0/3769416924 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b6c01b020 con 0x7f6b74151a80 2024-09-12T02:58:09.109 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:09.107+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:09.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.109+0000 7f6b70c00640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b540678c0 0x7f6b54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.109+0000 7f6b70c00640 1 -- 172.21.15.63:0/3769416924 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(42..42 src has 1..42) ==== 6648+0+0 (secure 0 0 0) 0x7f6b6c086c20 con 0x7f6b74151a80 2024-09-12T02:58:09.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.109+0000 7f6b78c00640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b540678c0 0x7f6b54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.109+0000 7f6b78c00640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b540678c0 0x7f6b54069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6b68005890 tx=0x7f6b68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:09.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.113+0000 7f6b70c00640 1 -- 172.21.15.63:0/3769416924 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b6c022030 con 0x7f6b74151a80 2024-09-12T02:58:09.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe815c00640 1 Processor -- start 2024-09-12T02:58:09.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe815c00640 1 -- start start 2024-09-12T02:58:09.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe815c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe8100ccb50 0x7fe8100c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe815c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100c3810 0x7fe810152550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe815c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8100c62f0 con 0x7fe8100cc770 2024-09-12T02:58:09.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe815c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe81015bcc0 con 0x7fe8100ccb50 2024-09-12T02:58:09.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe815c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe8100c65d0 con 0x7fe8100c3810 2024-09-12T02:58:09.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe80f400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe8100ccb50 0x7fe8100c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe80fe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe8100cc770 0x7fe810158750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:52924/0 (socket says 172.21.15.63:52924) 2024-09-12T02:58:09.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe80fe00640 1 -- 172.21.15.63:0/3205243409 learned_addr learned my addr 172.21.15.63:0/3205243409 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:09.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.149+0000 7fe815200640 1 --2- 172.21.15.63:0/3205243409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100c3810 0x7fe810152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.153+0000 7fe815200640 1 -- 172.21.15.63:0/3205243409 >> v2:172.21.15.119:3300/0 conn(0x7fe8100ccb50 msgr2=0x7fe8100c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:09.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.153+0000 7fe815200640 1 --2- 172.21.15.63:0/3205243409 >> v2:172.21.15.119:3300/0 conn(0x7fe8100ccb50 0x7fe8100c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.153+0000 7fe815200640 1 -- 172.21.15.63:0/3205243409 >> v1:172.21.15.119:6789/0 conn(0x7fe8100cc770 legacy=0x7fe810158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.153+0000 7fe80ea00640 1 -- 172.21.15.63:0/3205243409 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 663778602 0 0) 0x7fe8100c62f0 con 0x7fe8100cc770 2024-09-12T02:58:09.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.153+0000 7fe815200640 1 -- 172.21.15.63:0/3205243409 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81015bf10 con 0x7fe8100c3810 2024-09-12T02:58:09.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.153+0000 7fe80f400640 1 --2- 172.21.15.63:0/3205243409 >> v2:172.21.15.119:3300/0 conn(0x7fe8100ccb50 0x7fe8100c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:09.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe815200640 1 --2- 172.21.15.63:0/3205243409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100c3810 0x7fe810152550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe808009d90 tx=0x7fe80801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a22bb747bf6f44b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:09.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe80ea00640 1 -- 172.21.15.63:0/3205243409 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8080b2070 con 0x7fe8100c3810 2024-09-12T02:58:09.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe80ea00640 1 -- 172.21.15.63:0/3205243409 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8080a5830 con 0x7fe8100c3810 2024-09-12T02:58:09.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe80ea00640 1 -- 172.21.15.63:0/3205243409 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8080a5c00 con 0x7fe8100c3810 2024-09-12T02:58:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe815c00640 1 -- 172.21.15.63:0/3205243409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100c3810 msgr2=0x7fe810152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe815c00640 1 --2- 172.21.15.63:0/3205243409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100c3810 0x7fe810152550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe808009d90 tx=0x7fe80801c970 comp rx=0 tx=0).stop 2024-09-12T02:58:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe815c00640 1 -- 172.21.15.63:0/3205243409 shutdown_connections 2024-09-12T02:58:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe815c00640 1 --2- 172.21.15.63:0/3205243409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100c3810 0x7fe810152550 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe815c00640 1 --2- 172.21.15.63:0/3205243409 >> v2:172.21.15.119:3300/0 conn(0x7fe8100ccb50 0x7fe8100c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe815c00640 1 -- 172.21.15.63:0/3205243409 >> 172.21.15.63:0/3205243409 conn(0x7fe81006be90 msgr2=0x7fe81006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe815c00640 1 -- 172.21.15.63:0/3205243409 shutdown_connections 2024-09-12T02:58:09.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.157+0000 7fe815c00640 1 -- 172.21.15.63:0/3205243409 wait complete. 2024-09-12T02:58:09.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 Processor -- start 2024-09-12T02:58:09.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 -- start start 2024-09-12T02:58:09.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8100c3810 0x7fe8100c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100cc770 0x7fe810150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8100ccb50 0x7fe8101f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe81015c9f0 con 0x7fe8100c3810 2024-09-12T02:58:09.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe810165810 con 0x7fe8100ccb50 2024-09-12T02:58:09.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe81014be20 con 0x7fe8100cc770 2024-09-12T02:58:09.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8100c3810 0x7fe8100c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8100c3810 0x7fe8100c2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52234/0 (socket says 172.21.15.63:52234) 2024-09-12T02:58:09.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80fe00640 1 -- 172.21.15.63:0/3133808118 learned_addr learned my addr 172.21.15.63:0/3133808118 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:09.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815200640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8100ccb50 0x7fe8101f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80f400640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100cc770 0x7fe810150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80fe00640 1 -- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100cc770 msgr2=0x7fe810150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80fe00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100cc770 0x7fe810150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80fe00640 1 -- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8100ccb50 msgr2=0x7fe8101f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80fe00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8100ccb50 0x7fe8101f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80fe00640 1 -- 172.21.15.63:0/3133808118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8100c93c0 con 0x7fe8100c3810 2024-09-12T02:58:09.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe80fe00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8100c3810 0x7fe8100c2bd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c4d0 tx=0x7fe80000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:09.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe807e00640 1 -- 172.21.15.63:0/3133808118 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800018070 con 0x7fe8100c3810 2024-09-12T02:58:09.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe807e00640 1 -- 172.21.15.63:0/3133808118 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8000074e0 con 0x7fe8100c3810 2024-09-12T02:58:09.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe807e00640 1 -- 172.21.15.63:0/3133808118 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800004a30 con 0x7fe8100c3810 2024-09-12T02:58:09.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8100c96a0 con 0x7fe8100c3810 2024-09-12T02:58:09.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.161+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8101585e0 con 0x7fe8100c3810 2024-09-12T02:58:09.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.165+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8100c8000 con 0x7fe8100c3810 2024-09-12T02:58:09.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.165+0000 7fe807e00640 1 -- 172.21.15.63:0/3133808118 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe800004bd0 con 0x7fe8100c3810 2024-09-12T02:58:09.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.165+0000 7fe807e00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe7f00678f0 0x7fe7f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:09.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.165+0000 7fe807e00640 1 -- 172.21.15.63:0/3133808118 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6648+0+0 (secure 0 0 0) 0x7fe800085210 con 0x7fe8100c3810 2024-09-12T02:58:09.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.165+0000 7fe80f400640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe7f00678f0 0x7fe7f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:09.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.165+0000 7fe80f400640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe7f00678f0 0x7fe7f0069db0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009580 tx=0x7fe7fc009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:09.175 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:09.173+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:09.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.173+0000 7fe807e00640 1 -- 172.21.15.63:0/3133808118 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe800055340 con 0x7fe8100c3810 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.333722389000002, 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00551893, 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.189 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853808+0000", 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4959999999999999e-06 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853827+0000", 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8675999999999999e-05 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853869+0000", 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2347e-05 2024-09-12T02:58:09.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853889+0000", 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0248999999999999e-05 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854115+0000", 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022562600000000001 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854168+0000", 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3476000000000001e-05 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859207+0000", 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050389550000000003 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859324+0000", 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117105 2024-09-12T02:58:09.193 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.332519650999998, 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077810020000000004, 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855011+0000", 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3259999999999998e-06 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855026+0000", 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5023e-05 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855055+0000", 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9298e-05 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0525000000000001e-05 2024-09-12T02:58:09.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855570+0000", 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000494539 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855624+0000", 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3656999999999998e-05 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862687+0000", 2024-09-12T02:58:09.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007063593 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862789+0000", 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010204099999999999 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.332398042000001, 2024-09-12T02:58:09.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077503839999999999, 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855131+0000", 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5230000000000001e-06 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855143+0000", 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1412e-05 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0043000000000001e-05 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855176+0000", 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3429e-05 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856069+0000", 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00089251 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856116+0000", 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6826999999999997e-05 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862797+0000", 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066810050000000003 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862880+0000", 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3634999999999995e-05 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.202 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.331292758000004, 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065292639999999999, 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856237+0000", 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.103e-06 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856252+0000", 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4813e-05 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856279+0000", 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7254e-05 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856297+0000", 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7929000000000001e-05 2024-09-12T02:58:09.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856462+0000", 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016488700000000001 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856508+0000", 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5787000000000001e-05 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862657+0000", 2024-09-12T02:58:09.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061494210000000004 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862764+0000", 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010707 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.330545491999999, 2024-09-12T02:58:09.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005857943, 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856984+0000", 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3799999999999999e-06 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856997+0000", 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2896e-05 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857022+0000", 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5554999999999998e-05 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857043+0000", 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0919000000000001e-05 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857162+0000", 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118526 2024-09-12T02:58:09.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857225+0000", 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3578999999999996e-05 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862772+0000", 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055470789999999999 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862840+0000", 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8009000000000006e-05 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.2734179829999999, 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00045081800000000002, 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.212 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914111+0000", 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1699999999999997e-07 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914116+0000", 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.259e-06 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914129+0000", 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3451e-05 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914140+0000", 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0721e-05 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914241+0000", 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000100843 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914561+0000", 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031982700000000001 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.215 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.2699260810000004, 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000219385, 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5800000000000001e-07 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917605+0000", 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1379999999999999e-06 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917611+0000", 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9179999999999999e-06 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917620+0000", 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0389999999999993e-06 2024-09-12T02:58:09.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917681+0000", 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0482999999999997e-05 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917821+0000", 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014054900000000001 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.219 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.220 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.220 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:09.221 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:09.276 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:09.273+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:09.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.297+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f6b740c7fd0 con 0x7f6b74151a80 2024-09-12T02:58:09.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b70c00640 1 -- 172.21.15.63:0/3769416924 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v42) ==== 81+0+38239 (secure 0 0 0) 0x7f6b6c010040 con 0x7f6b74151a80 2024-09-12T02:58:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:58:09.304 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 42, 2024-09-12T02:58:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "20b0bc3b-ca7e-4b63-a9bc-3526f84b65da", 2024-09-12T02:58:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2024-09-12T02:56:41.049401+0000", 2024-09-12T02:58:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2024-09-12T02:58:06.960094+0000", 2024-09-12T02:58:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2024-09-12T02:56:53.715732+0000", 2024-09-12T02:58:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2024-09-12T02:56:43.361756+0000", 2024-09-12T02:58:09.304 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5804032, 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "nodeep-scrub", 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 6, 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T02:58:09.305 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 4, 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "luminous", 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "squid", 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_crimson": false, 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": ".mgr", 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:56:53.830004+0000", 2024-09-12T02:58:09.306 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2024-09-12T02:58:09.307 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2024-09-12T02:58:09.308 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:58:09.309 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:58:09.310 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:58:09.311 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_max": 32, 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": {} 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 8, 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 8, 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.25, 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 2, 2024-09-12T02:58:09.312 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 2, 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:57:02.599829+0000", 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-12T02:58:09.313 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-12T02:58:09.314 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "21", 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:58:09.315 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:58:09.316 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:58:09.317 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5, 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5, 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.5, 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.5, 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.319 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:57:03.211064+0000", 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:58:09.320 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 64, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 64, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 64, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 64, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 64, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:58:09.321 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "22", 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:58:09.322 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:58:09.323 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:58:09.324 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.05000000074505806 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5, 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5, 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-12T02:58:09.325 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.5, 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.5, 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 4, 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data_ec", 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:57:06.889005+0000", 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 5, 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 3, 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 4, 2024-09-12T02:58:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 3, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 1, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-12T02:58:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "26", 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:58:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:58:09.329 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:58:09.330 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 8192, 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-12T02:58:09.331 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "5c33857f-3772-4c5f-9025-2157ac056da1", 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 15, 2024-09-12T02:58:09.332 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:09.333 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2024-09-12T02:58:09.334 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2024-09-12T02:58:09.335 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:09.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6825/3662141659", 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/3662141659", 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/3662141659", 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/3662141659", 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:09.337 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "9a1b1d8b-fd3f-4b94-8135-941da7cb2797", 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 0.420135498046875, 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2024-09-12T02:58:09.338 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 27, 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:09.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:09.340 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.341 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.342 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/866448188", 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/866448188", 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/866448188", 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/866448188", 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:09.343 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f23c8af2-7fa2-4e43-99de-7bf2670b72ce", 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:09.344 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 15, 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.345 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.346 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.347 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.348 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6817/4130213561", 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/4130213561", 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6823/4130213561", 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/4130213561", 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0b6a2786-33e7-4286-92f4-e8d25573149a", 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 15, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:09.350 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:09.352 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/2574114576", 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/2574114576", 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6815/2574114576", 2024-09-12T02:58:09.354 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/2574114576", 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "cdd5dfe1-3893-42ee-8706-50ef5c92ac9f", 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:09.355 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6808", 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.356 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6809", 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6810", 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.357 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6811", 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6814", 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.358 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6815", 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6812", 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.359 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6813", 2024-09-12T02:58:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6809/946317737", 2024-09-12T02:58:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6811/946317737", 2024-09-12T02:58:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6815/946317737", 2024-09-12T02:58:09.360 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6813/946317737", 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "442157e7-0a20-45b7-a3b6-f4a930643516", 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:09.361 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6824", 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:09.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6825", 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.363 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6826", 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6827", 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.364 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6830", 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6831", 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.365 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6828", 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6829", 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6825/4151470176", 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6827/4151470176", 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6831/4151470176", 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6829/4151470176", 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0f1cd9bc-aafa-4004-b7e5-6ea6e409d398", 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:09.367 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6816", 2024-09-12T02:58:09.368 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6817", 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.369 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6818", 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6819", 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.370 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6822", 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6823", 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6820", 2024-09-12T02:58:09.371 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6821", 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6817/2029574290", 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6819/2029574290", 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6823/2029574290", 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6821/2029574290", 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:09.372 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ac41ac05-d082-43f8-93ec-ba27bf53fd08", 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:09.373 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6800", 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.374 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6801", 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6802", 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.375 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6803", 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6806", 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.376 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6807", 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6804", 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:09.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6805", 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6801/3494373582", 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6803/3494373582", 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6807/3494373582", 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6805/3494373582", 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:09.378 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.481445+0000", 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:09.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.975485+0000", 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.719623+0000", 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:09.381 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.227734+0000", 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:09.382 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:49.777737+0000", 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.183864+0000", 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2024-09-12T02:58:09.383 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.071981+0000", 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:09.384 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:49.830810+0000", 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [ 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.d", 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 7, 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 1 2024-09-12T02:58:09.385 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.19", 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 3, 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.36", 2024-09-12T02:58:09.386 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 5, 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "4.3", 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 1, 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:09.387 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_primaries": [], 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklist": {}, 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "range_blocklist": {}, 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_data_ec": { 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-device-class": "", 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-num-failure-domains": "0", 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-osds-per-failure-domain": "0", 2024-09-12T02:58:09.388 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-root": "default", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "2", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "w": "8" 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2024-09-12T02:58:09.389 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {}, 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode": { 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_enabled": false, 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_bucket_count": 0, 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_bucket": 0 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:09.390 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:09.391 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:09.391 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:09.391 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:09.392 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b540678c0 msgr2=0x7f6b54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b540678c0 0x7f6b54069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6b68005890 tx=0x7f6b68009040 comp rx=0 tx=0).stop 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74151a80 msgr2=0x7f6b74146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74151a80 0x7f6b74146ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c009dd0 tx=0x7f6b6c00c490 comp rx=0 tx=0).stop 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 shutdown_connections 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b540678c0 0x7f6b54069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b74151a80 0x7f6b74146ac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b740c28c0 0x7f6b741e33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 --2- 172.21.15.63:0/3769416924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b74074070 0x7f6b7414d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 >> 172.21.15.63:0/3769416924 conn(0x7f6b7406f3d0 msgr2=0x7f6b74072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:09.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 shutdown_connections 2024-09-12T02:58:09.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.301+0000 7f6b7b600640 1 -- 172.21.15.63:0/3769416924 wait complete. 2024-09-12T02:58:09.394 INFO:tasks.thrashosds.thrasher:j is {'epoch': 42, 'fsid': '20b0bc3b-ca7e-4b63-a9bc-3526f84b65da', 'created': '2024-09-12T02:56:41.049401+0000', 'modified': '2024-09-12T02:58:06.960094+0000', 'last_up_change': '2024-09-12T02:56:53.715732+0000', 'last_in_change': '2024-09-12T02:56:43.361756+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:56:53.830004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:57:02.599829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:57:03.211064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T02:57:06.889005+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': '5c33857f-3772-4c5f-9025-2157ac056da1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6824', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6825', 'nonce': 3662141659}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6826', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6827', 'nonce': 3662141659}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6830', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6831', 'nonce': 3662141659}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6828', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6829', 'nonce': 3662141659}]}, 'public_addr': '172.21.15.63:6825/3662141659', 'cluster_addr': '172.21.15.63:6827/3662141659', 'heartbeat_back_addr': '172.21.15.63:6831/3662141659', 'heartbeat_front_addr': '172.21.15.63:6829/3662141659', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '9a1b1d8b-fd3f-4b94-8135-941da7cb2797', 'up': 1, 'in': 1, 'weight': 0.420135498046875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6800', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6801', 'nonce': 866448188}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6802', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6803', 'nonce': 866448188}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6806', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6807', 'nonce': 866448188}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6804', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6805', 'nonce': 866448188}]}, 'public_addr': '172.21.15.63:6801/866448188', 'cluster_addr': '172.21.15.63:6803/866448188', 'heartbeat_back_addr': '172.21.15.63:6807/866448188', 'heartbeat_front_addr': '172.21.15.63:6805/866448188', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f23c8af2-7fa2-4e43-99de-7bf2670b72ce', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6816', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6817', 'nonce': 4130213561}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6818', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6819', 'nonce': 4130213561}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6822', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6823', 'nonce': 4130213561}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6820', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6821', 'nonce': 4130213561}]}, 'public_addr': '172.21.15.63:6817/4130213561', 'cluster_addr': '172.21.15.63:6819/4130213561', 'heartbeat_back_addr': '172.21.15.63:6823/4130213561', 'heartbeat_front_addr': '172.21.15.63:6821/4130213561', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b6a2786-33e7-4286-92f4-e8d25573149a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6808', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6809', 'nonce': 2574114576}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6810', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6811', 'nonce': 2574114576}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6814', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6815', 'nonce': 2574114576}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6812', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6813', 'nonce': 2574114576}]}, 'public_addr': '172.21.15.63:6809/2574114576', 'cluster_addr': '172.21.15.63:6811/2574114576', 'heartbeat_back_addr': '172.21.15.63:6815/2574114576', 'heartbeat_front_addr': '172.21.15.63:6813/2574114576', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cdd5dfe1-3893-42ee-8706-50ef5c92ac9f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6808', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6809', 'nonce': 946317737}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6810', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6811', 'nonce': 946317737}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6814', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6815', 'nonce': 946317737}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6812', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6813', 'nonce': 946317737}]}, 'public_addr': '172.21.15.119:6809/946317737', 'cluster_addr': '172.21.15.119:6811/946317737', 'heartbeat_back_addr': '172.21.15.119:6815/946317737', 'heartbeat_front_addr': '172.21.15.119:6813/946317737', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '442157e7-0a20-45b7-a3b6-f4a930643516', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6824', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6825', 'nonce': 4151470176}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6826', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6827', 'nonce': 4151470176}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6830', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6831', 'nonce': 4151470176}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6828', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6829', 'nonce': 4151470176}]}, 'public_addr': '172.21.15.119:6825/4151470176', 'cluster_addr': '172.21.15.119:6827/4151470176', 'heartbeat_back_addr': '172.21.15.119:6831/4151470176', 'heartbeat_front_addr': '172.21.15.119:6829/4151470176', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0f1cd9bc-aafa-4004-b7e5-6ea6e409d398', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6816', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6817', 'nonce': 2029574290}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6818', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6819', 'nonce': 2029574290}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6822', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6823', 'nonce': 2029574290}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6820', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6821', 'nonce': 2029574290}]}, 'public_addr': '172.21.15.119:6817/2029574290', 'cluster_addr': '172.21.15.119:6819/2029574290', 'heartbeat_back_addr': '172.21.15.119:6823/2029574290', 'heartbeat_front_addr': '172.21.15.119:6821/2029574290', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'ac41ac05-d082-43f8-93ec-ba27bf53fd08', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6800', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6801', 'nonce': 3494373582}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6802', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6803', 'nonce': 3494373582}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6806', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6807', 'nonce': 3494373582}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6804', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6805', 'nonce': 3494373582}]}, 'public_addr': '172.21.15.119:6801/3494373582', 'cluster_addr': '172.21.15.119:6803/3494373582', 'heartbeat_back_addr': '172.21.15.119:6807/3494373582', 'heartbeat_front_addr': '172.21.15.119:6805/3494373582', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.481445+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.975485+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.719623+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.227734+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:49.777737+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.183864+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.071981+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:49.830810+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.d', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '3.19', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '3.36', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '4.3', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T02:58:09.395 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-12T02:58:09.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.365+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7fe810152550 con 0x7fe8100c3810 2024-09-12T02:58:09.395 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:09.387+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:09.401 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:09.492 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:09.489+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:09.571 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:09.571 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:09.571 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:09.571 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:09.571 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:09.585 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:09.629 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:09.627+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:09.694 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:09.691+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:09.702 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:09.702 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:09.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:09.702 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:09.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.702 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:09.702 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:09.702 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.847720211000002, 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:09.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:09.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:09.706 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:09.707 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.847587003000001, 2024-09-12T02:58:09.708 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.709 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:09.710 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:09.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.713 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.847482253000003, 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:09.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:09.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:09.719 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.847336435000003, 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:09.724 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.847263253000001, 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:09.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:09.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:09.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.847203266999998, 2024-09-12T02:58:09.730 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:09.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:09.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:09.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.847140920999998, 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:09.736 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:09.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.847083404999999, 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:09.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.844915780000001, 2024-09-12T02:58:09.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.748 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.841757264999998, 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:09.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:09.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:09.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing_reply(2.14 epoch 25/19 rep_tid 7 lcod 25'5)", 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.835296319999998, 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010494969999999999, 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864695+0000", 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7300000000000001e-07 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864699+0000", 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.33e-06 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864715+0000", 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6116e-05 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864727+0000", 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1759e-05 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865572+0000", 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00084520699999999995 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865744+0000", 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000171612 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 59.834048392, 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:09.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:09.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.815159440999999, 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:09.762 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.764 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.766 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 49.086757634999998, 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:09.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:09.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:09.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 47.330921052999997, 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.772 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:09.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:09.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:09.777 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 46.448832089, 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:09.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:09.782 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 24.764874475999999, 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:09.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:09.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:09.788 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 24.764769184999999, 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.790 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:09.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:09.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 22.072206035000001, 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.794 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:09.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.796 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.797 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:46 2.6 e28/19 2:654134d2:::mds0_openfiles.0:head v 28'2, mlcod=0'0)", 2024-09-12T02:58:09.799 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 21.812012138, 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015286869999999999, 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887979+0000", 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4000000000000002e-07 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887986+0000", 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1999999999999997e-06 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888007+0000", 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1075999999999999e-05 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888022+0000", 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5316e-05 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888142+0000", 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011911100000000001 2024-09-12T02:58:09.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888187+0000", 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5225000000000002e-05 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889432+0000", 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012450709999999999 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:09.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889507+0000", 2024-09-12T02:58:09.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5148000000000006e-05 2024-09-12T02:58:09.804 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.804 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.804 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.804 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:09.804 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:09.804 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:09.806 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:09.806 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:09.803+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:09.906 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:09.905+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:09.976 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:09.976 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:09.977 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:09.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe807e00640 1 -- 172.21.15.63:0/3133808118 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v43) ==== 101+0+0 (secure 0 0 0) 0x7fe800059640 con 0x7fe8100c3810 2024-09-12T02:58:09.979 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe7f00678f0 msgr2=0x7fe7f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe7f00678f0 0x7fe7f0069db0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009580 tx=0x7fe7fc009190 comp rx=0 tx=0).stop 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8100c3810 msgr2=0x7fe8100c2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8100c3810 0x7fe8100c2bd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe80000c4d0 tx=0x7fe80000c990 comp rx=0 tx=0).stop 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 shutdown_connections 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8100ccb50 0x7fe8101f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe7f00678f0 0x7fe7f0069db0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8100cc770 0x7fe810150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 --2- 172.21.15.63:0/3133808118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8100c3810 0x7fe8100c2bd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:09.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.977+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 >> 172.21.15.63:0/3133808118 conn(0x7fe81006be90 msgr2=0x7fe810151a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:09.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.981+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 shutdown_connections 2024-09-12T02:58:09.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:09.981+0000 7fe815c00640 1 -- 172.21.15.63:0/3133808118 wait complete. 2024-09-12T02:58:09.994 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:10.007 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:10.005+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:10.109 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:10.105+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:10.110 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:10.110 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:10.110 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:10.110 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:10.110 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:10.124 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:10.210 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:10.209+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:10.248 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:10.248 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:10.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:10.248 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:10.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.248 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.497761588000003, 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.249 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:10.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:10.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:10.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.354566250000005, 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.255 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:10.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:10.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:10.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.354545724000005, 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.261 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:10.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.354434910999998, 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.267 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:10.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:10.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:10.273 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.354413385000001, 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:10.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:10.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:10.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.289426739000007, 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.280 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:10.281 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:10.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:10.285 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.067323216000005, 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:10.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:10.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.289 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.290 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.067186225, 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.291 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.292 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:10.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:10.294 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:10.295 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.296 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.066069022999997, 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.297 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.298 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:10.302 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.065996909999996, 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.303 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:10.306 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.308 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.065772925999994, 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.309 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.310 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:10.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:10.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.065702943000005, 2024-09-12T02:58:10.315 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.316 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.317 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.318 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:10.319 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.320 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:10.321 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.065597306000001, 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.322 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.323 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.324 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:10.325 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.326 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:10.327 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.065407209, 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.328 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.329 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.330 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:10.331 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.332 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.333 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.065340422000006, 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.334 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.335 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.339 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.489990825000007, 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.340 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:10.341 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.342 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.343 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:10.344 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.345 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.391291391000003, 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:10.346 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:10.347 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:10.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.391206148999999, 2024-09-12T02:58:10.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.354 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:10.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.391069035000001, 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.357 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:10.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:10.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:10.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.390899136000002, 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:10.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:10.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.366 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.367 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:10.367 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:10.367 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:10.368 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:10.369 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:10.365+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:10.469 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:10.467+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:10.518 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:10.519 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:10.519 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:10.519 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:10.534 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:10.582 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:10.581+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:10.671 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:10.667+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:10.681 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:10.681 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:10.681 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:10.681 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:10.681 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:10.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:10.772 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:10.767+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:10.873 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:10.869+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:10.886 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'39)", 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.930030079999995, 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047813200000000004, 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.887 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955738+0000", 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3099999999999998e-07 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955742+0000", 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955753+0000", 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1321000000000001e-05 2024-09-12T02:58:10.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955759+0000", 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1070000000000001e-06 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955810+0000", 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0711000000000003e-05 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.890 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955823+0000", 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2605999999999999e-05 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960475+0000", 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004652354 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960518+0000", 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3316999999999999e-05 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.891 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'39)", 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.928507284999995, 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039674089999999999, 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957261+0000", 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8400000000000004e-07 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957334+0000", 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3613000000000001e-05 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957347+0000", 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3349e-05 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957353+0000", 2024-09-12T02:58:10.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1089999999999997e-06 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957405+0000", 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2206000000000001e-05 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957427+0000", 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2155999999999999e-05 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961190+0000", 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037629849999999999 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961227+0000", 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7307e-05 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.896 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.926262246999997, 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004389858, 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959506+0000", 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8599999999999998e-07 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959510+0000", 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7339999999999999e-06 2024-09-12T02:58:10.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959523+0000", 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2773e-05 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959528+0000", 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9740000000000001e-06 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960547+0000", 2024-09-12T02:58:10.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010187359999999999 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960560+0000", 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3223e-05 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963855+0000", 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032949910000000002 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963895+0000", 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9740999999999998e-05 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.918709495000002, 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021753509999999998, 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.901 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6599999999999996e-07 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967141+0000", 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2319999999999998e-05 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967152+0000", 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1432e-05 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967158+0000", 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8019999999999997e-06 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967207+0000", 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9075e-05 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967224+0000", 2024-09-12T02:58:10.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7427000000000001e-05 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969194+0000", 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019695590000000001 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969233+0000", 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9169999999999999e-05 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.905 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.917311311000006, 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003562614, 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7899999999999998e-07 2024-09-12T02:58:10.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968495+0000", 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8025000000000003e-05 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968507+0000", 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2758999999999999e-05 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968513+0000", 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3009999999999997e-06 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968585+0000", 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2139999999999997e-05 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968599+0000", 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4752999999999999e-05 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.971980+0000", 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033801059999999999 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972018+0000", 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8850999999999998e-05 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:74 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'48, mlcod=17'44)", 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.915641356999998, 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022444370000000002, 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7100000000000001e-07 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970131+0000", 2024-09-12T02:58:10.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4850000000000003e-06 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970144+0000", 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2595999999999999e-05 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970149+0000", 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.395e-06 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970209+0000", 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9905999999999999e-05 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970225+0000", 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6177000000000001e-05 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972340+0000", 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002114917 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972370+0000", 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.029e-05 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:83 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'50)", 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.899660381000004, 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002809059, 2024-09-12T02:58:10.915 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6000000000000004e-07 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986112+0000", 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8019999999999999e-06 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986123+0000", 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0953e-05 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986128+0000", 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7849999999999999e-06 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986166+0000", 2024-09-12T02:58:10.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7923000000000003e-05 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986180+0000", 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4211e-05 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988884+0000", 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027039640000000001 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988916+0000", 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1860999999999999e-05 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:84 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'50)", 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.898663569000007, 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002347909, 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8899999999999999e-07 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987155+0000", 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0776000000000003e-05 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987167+0000", 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2215000000000001e-05 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987172+0000", 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.04e-06 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987232+0000", 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9595000000000001e-05 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987246+0000", 2024-09-12T02:58:10.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3757000000000001e-05 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989417+0000", 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021715329999999998 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989451+0000", 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4304000000000002e-05 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.924 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:90 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'60, mlcod=17'57)", 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.890127665999998, 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027093489999999998, 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:10.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995640+0000", 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9699999999999995e-07 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995794+0000", 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015367199999999999 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995805+0000", 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1061e-05 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995810+0000", 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4589999999999997e-06 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.927 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995856+0000", 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6127000000000001e-05 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995870+0000", 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3854e-05 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998315+0000", 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024450930000000002 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998349+0000", 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3386000000000002e-05 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:105 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'67, mlcod=17'64)", 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 74.707852548000005, 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026337050000000001, 2024-09-12T02:58:10.929 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4300000000000003e-07 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177930+0000", 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4735999999999999e-05 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177942+0000", 2024-09-12T02:58:10.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2349e-05 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177949+0000", 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6599999999999998e-06 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178003+0000", 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3535999999999997e-05 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178018+0000", 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5227e-05 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180517+0000", 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024996419999999998 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180548+0000", 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0911999999999998e-05 2024-09-12T02:58:10.933 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:158 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'112, mlcod=18'109)", 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.430613562000005, 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026267230000000001, 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.58e-07 2024-09-12T02:58:10.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455235+0000", 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1242000000000006e-05 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455245+0000", 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.995e-06 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455250+0000", 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7079999999999996e-06 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455297+0000", 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6885000000000003e-05 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455311+0000", 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4354e-05 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457734+0000", 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024232540000000001 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457780+0000", 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5827e-05 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.938 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:159 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'113, mlcod=18'109)", 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.429892573999993, 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046885809999999998, 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5300000000000004e-07 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455879+0000", 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8650000000000003e-06 2024-09-12T02:58:10.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455889+0000", 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0139999999999999e-05 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455894+0000", 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2959999999999998e-06 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455944+0000", 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9774999999999997e-05 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455962+0000", 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8009999999999999e-05 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460534+0000", 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045721299999999998 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460563+0000", 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8812000000000001e-05 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:4 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.033744218999999, 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073449359999999998, 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.943 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852025+0000", 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2280000000000001e-06 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852034+0000", 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1619999999999997e-06 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852060+0000", 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5714000000000001e-05 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852073+0000", 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3199e-05 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852384+0000", 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031071499999999998 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852627+0000", 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024345000000000001 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852778+0000", 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015093999999999999 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857277+0000", 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044991120000000004 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859269+0000", 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019915879999999999 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3817999999999999e-05 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859368+0000", 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5009999999999998e-05 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.03365281, 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012795443, 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:10.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852115+0000", 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.54e-07 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852120+0000", 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2299999999999999e-06 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852132+0000", 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1746000000000001e-05 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852140+0000", 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2300000000000008e-06 2024-09-12T02:58:10.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854507+0000", 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023667369999999998 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854587+0000", 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0024000000000005e-05 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:10.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854730+0000", 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014253599999999999 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859376+0000", 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046468200000000003 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864800+0000", 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054233670000000001 2024-09-12T02:58:10.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864864+0000", 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4397e-05 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864910+0000", 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5602000000000001e-05 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:28 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.033594561999998, 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011320167000000001, 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1600000000000001e-07 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852188+0000", 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.506e-05 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852199+0000", 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0677e-05 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852206+0000", 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8279999999999997e-06 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852418+0000", 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021227799999999999 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852545+0000", 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012638499999999999 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852774+0000", 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0002299 2024-09-12T02:58:10.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856085+0000", 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033103569999999999 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863371+0000", 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072860260000000001 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863444+0000", 2024-09-12T02:58:10.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.305e-05 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863493+0000", 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8890000000000001e-05 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:10.960 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.033532501000003, 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012832368, 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5700000000000002e-07 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852262+0000", 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7135e-05 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.962 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852366+0000", 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103606 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852378+0000", 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2204999999999999e-05 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854980+0000", 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026019860000000001 2024-09-12T02:58:10.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855096+0000", 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115887 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855213+0000", 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116916 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:10.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859383+0000", 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041700089999999997 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864993+0000", 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056103209999999997 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865043+0000", 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9481999999999998e-05 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865067+0000", 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4164000000000001e-05 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.966 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.033320099000001, 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012817586000000001, 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852448+0000", 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5600000000000005e-07 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852453+0000", 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9019999999999998e-06 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852462+0000", 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9069999999999996e-06 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852469+0000", 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.374e-06 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853604+0000", 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011349299999999999 2024-09-12T02:58:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853717+0000", 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112797 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853836+0000", 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011936500000000001 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859663+0000", 2024-09-12T02:58:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058266209999999997 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865167+0000", 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055044849999999999 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865226+0000", 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8718000000000003e-05 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865265+0000", 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8730999999999999e-05 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.033288499999998, 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012748110999999999, 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6699999999999999e-07 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852492+0000", 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.291e-05 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852500+0000", 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1580000000000005e-06 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852506+0000", 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5330000000000002e-06 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856830+0000", 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004324194 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.975 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856959+0000", 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012862099999999999 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865227+0000", 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082682280000000007 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:10.976 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.030966409000001, 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045219450000000003, 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854802+0000", 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854814+0000", 2024-09-12T02:58:10.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1759999999999999e-05 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854836+0000", 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2039999999999999e-05 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854855+0000", 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.929e-05 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854975+0000", 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119561 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043479110000000003 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.980 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:2 2.f e25/19 2:f1f69726:::400.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.027650211999998, 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032847000000000002, 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858118+0000", 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1540000000000001e-06 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858126+0000", 2024-09-12T02:58:10.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7759999999999997e-06 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858138+0000", 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2184999999999999e-05 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858145+0000", 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:10.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858282+0000", 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013642799999999999 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858297+0000", 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5328e-05 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861346+0000", 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030492729999999999 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:10.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:10.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861402+0000", 2024-09-12T02:58:10.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5220999999999999e-05 2024-09-12T02:58:10.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.985 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.985 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:10.985 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:10.985 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:10.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:10.987 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:10.983+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:11.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:11.088 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:11.085+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:11.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.177+0000 7f71dc400640 1 Processor -- start 2024-09-12T02:58:11.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.177+0000 7f71dc400640 1 -- start start 2024-09-12T02:58:11.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71dc400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71d40c4ff0 0x7f71d40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71dc400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 0x7f71d40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71dc400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d40c9720 con 0x7f71d41527e0 2024-09-12T02:58:11.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71dc400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f71d4070570 con 0x7f71d40c4ff0 2024-09-12T02:58:11.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71dc400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f71d406f6f0 con 0x7f71d40ce080 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71d9000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71d40c4ff0 0x7f71d40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71d9000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71d40c4ff0 0x7f71d40c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:59018/0 (socket says 172.21.15.63:59018) 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71d9000640 1 -- 172.21.15.63:0/1005436814 learned_addr learned my addr 172.21.15.63:0/1005436814 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71d9a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f71d41527e0 0x7f71d406fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:52938/0 (socket says 172.21.15.63:52938) 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71da400640 1 --2- 172.21.15.63:0/1005436814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 0x7f71d40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71d9000640 1 -- 172.21.15.63:0/1005436814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 msgr2=0x7f71d40ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71d9000640 1 --2- 172.21.15.63:0/1005436814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 0x7f71d40ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71d9000640 1 -- 172.21.15.63:0/1005436814 >> v1:172.21.15.119:6789/0 conn(0x7f71d41527e0 legacy=0x7f71d406fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71d9000640 1 -- 172.21.15.63:0/1005436814 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d40c9a00 con 0x7f71d40c4ff0 2024-09-12T02:58:11.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.181+0000 7f71da400640 1 --2- 172.21.15.63:0/1005436814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 0x7f71d40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:11.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71d9000640 1 --2- 172.21.15.63:0/1005436814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 0x7f71d40c82a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009870 tx=0x7f71c001ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7d9ea7fa8094e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.189 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:11.183+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71d3e00640 1 -- 172.21.15.63:0/1005436814 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c00b5070 con 0x7f71d40c4ff0 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71d3e00640 1 -- 172.21.15.63:0/1005436814 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c00a8a50 con 0x7f71d40c4ff0 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71d3e00640 1 -- 172.21.15.63:0/1005436814 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c00a8e20 con 0x7f71d40c4ff0 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71dc400640 1 -- 172.21.15.63:0/1005436814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 msgr2=0x7f71d40c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71dc400640 1 --2- 172.21.15.63:0/1005436814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 0x7f71d40c82a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009870 tx=0x7f71c001ed50 comp rx=0 tx=0).stop 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71dc400640 1 -- 172.21.15.63:0/1005436814 shutdown_connections 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71dc400640 1 --2- 172.21.15.63:0/1005436814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 0x7f71d40ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71dc400640 1 --2- 172.21.15.63:0/1005436814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 0x7f71d40c82a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71dc400640 1 -- 172.21.15.63:0/1005436814 >> 172.21.15.63:0/1005436814 conn(0x7f71d4067a00 msgr2=0x7f71d4067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:11.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.185+0000 7f71dc400640 1 -- 172.21.15.63:0/1005436814 shutdown_connections 2024-09-12T02:58:11.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71dc400640 1 -- 172.21.15.63:0/1005436814 wait complete. 2024-09-12T02:58:11.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71dc400640 1 Processor -- start 2024-09-12T02:58:11.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71dc400640 1 -- start start 2024-09-12T02:58:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71dc400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 0x7f71d41e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71dc400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 0x7f71d4151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71dc400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71d41527e0 0x7f71d4151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71dc400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f71d40c9fc0 con 0x7f71d41527e0 2024-09-12T02:58:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71dc400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f71d406f9d0 con 0x7f71d40c4ff0 2024-09-12T02:58:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71dc400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f71d40c93e0 con 0x7f71d40ce080 2024-09-12T02:58:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71da400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71d41527e0 0x7f71d4151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71d9a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 0x7f71d41e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71da400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71d41527e0 0x7f71d4151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52240/0 (socket says 172.21.15.63:52240) 2024-09-12T02:58:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71d9000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 0x7f71d4151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.189+0000 7f71da400640 1 -- 172.21.15.63:0/72182030 learned_addr learned my addr 172.21.15.63:0/72182030 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d9a00640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 msgr2=0x7f71d4151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d9a00640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 0x7f71d4151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d9a00640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71d41527e0 msgr2=0x7f71d4151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d9a00640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71d41527e0 0x7f71d4151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d9a00640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d41f4710 con 0x7f71d40c4ff0 2024-09-12T02:58:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d9000640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71d40ce080 0x7f71d4151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:11.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71da400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71d41527e0 0x7f71d4151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d9a00640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 0x7f71d41e4200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c390 tx=0x7f71c800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c80074e0 con 0x7f71d40c4ff0 2024-09-12T02:58:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c8007680 con 0x7f71d40c4ff0 2024-09-12T02:58:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8004a30 con 0x7f71d40c4ff0 2024-09-12T02:58:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d41566d0 con 0x7f71d40c4ff0 2024-09-12T02:58:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d406de70 con 0x7f71d40c4ff0 2024-09-12T02:58:11.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f71d415bb60 con 0x7f71d40c4ff0 2024-09-12T02:58:11.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.193+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f71c801a020 con 0x7f71d40c4ff0 2024-09-12T02:58:11.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71d1600640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f71b40678c0 0x7f71b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6648+0+0 (secure 0 0 0) 0x7f71c8085d50 con 0x7f71d40c4ff0 2024-09-12T02:58:11.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v43) ==== 54+0+16 (secure 0 0 0) 0x7f71c8021030 con 0x7f71d40c4ff0 2024-09-12T02:58:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71d9000640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f71b40678c0 0x7f71b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f71d41572e0 0x7f71d41f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71d41f49f0 con 0x7f71d41572e0 2024-09-12T02:58:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71da400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f71d41572e0 0x7f71d41f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71d9000640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f71b40678c0 0x7f71b4069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f71c00b2000 tx=0x7f71c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71da400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f71d41572e0 0x7f71d41f0970 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.197+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71d41f49f0 con 0x7f71d41572e0 2024-09-12T02:58:11.205 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:11.205 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:11.205 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:11.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.213+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f71d415b490 con 0x7f71d41572e0 2024-09-12T02:58:11.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.217+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f71d415b490 con 0x7f71d41572e0 2024-09-12T02:58:11.219 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:11.220 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:11.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.217+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f71d4156210 0x7f71d406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.217+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f71d41522b0 con 0x7f71d4156210 2024-09-12T02:58:11.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.217+0000 7f71d9a00640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f71d4156210 0x7f71d406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.217+0000 7f71d9a00640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f71d4156210 0x7f71d406cdd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.217+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71d41522b0 con 0x7f71d4156210 2024-09-12T02:58:11.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.233+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f71d4152bc0 con 0x7f71d4156210 2024-09-12T02:58:11.239 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.233+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f71d4152bc0 con 0x7f71d4156210 2024-09-12T02:58:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.233+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f71d406d820 0x7f71d40626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.233+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f71d406f310 con 0x7f71d406d820 2024-09-12T02:58:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.233+0000 7f71d9000640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f71d406d820 0x7f71d40626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.237+0000 7f71d9000640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f71d406d820 0x7f71d40626e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.237+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71d406f310 con 0x7f71d406d820 2024-09-12T02:58:11.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.253+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f71d4062ef0 con 0x7f71d406d820 2024-09-12T02:58:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.253+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f71d4062ef0 con 0x7f71d406d820 2024-09-12T02:58:11.258 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:11.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.253+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f71d41e20e0 0x7f71d41e2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.253+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f71d4062e70 con 0x7f71d41e20e0 2024-09-12T02:58:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.257+0000 7f71da400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f71d41e20e0 0x7f71d41e2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.257+0000 7f71da400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f71d41e20e0 0x7f71d41e2500 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.257+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71d4062e70 con 0x7f71d41e20e0 2024-09-12T02:58:11.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.285+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f71d4062e70 con 0x7f71d41e20e0 2024-09-12T02:58:11.289 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:11.287+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.289+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f71d4062e70 con 0x7f71d41e20e0 2024-09-12T02:58:11.291 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.289+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f71d402cb60 0x7f71d402cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.289+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f71d4062e70 con 0x7f71d402cb60 2024-09-12T02:58:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.289+0000 7f71d9a00640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f71d402cb60 0x7f71d402cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.289+0000 7f71d9a00640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f71d402cb60 0x7f71d402cf80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.289+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71d4062e70 con 0x7f71d402cb60 2024-09-12T02:58:11.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.305+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f71d4062e70 con 0x7f71d402cb60 2024-09-12T02:58:11.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.309+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f71d4062e70 con 0x7f71d402cb60 2024-09-12T02:58:11.314 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:11.314 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:11.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.309+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f71d4204e30 0x7f71d4207220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.309+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f71d4152d70 con 0x7f71d4204e30 2024-09-12T02:58:11.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.313+0000 7f71d9000640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f71d4204e30 0x7f71d4207220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.313+0000 7f71d9000640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f71d4204e30 0x7f71d4207220 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.313+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71d4152d70 con 0x7f71d4204e30 2024-09-12T02:58:11.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.325+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f71d4152d70 con 0x7f71d4204e30 2024-09-12T02:58:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.329+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f71d4152d70 con 0x7f71d4204e30 2024-09-12T02:58:11.334 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:11.334 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.333+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f71d4207c70 0x7f71d420a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.333+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f71d40634c0 con 0x7f71d4207c70 2024-09-12T02:58:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.333+0000 7f71da400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f71d4207c70 0x7f71d420a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.333+0000 7f71da400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f71d4207c70 0x7f71d420a060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.333+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71d40634c0 con 0x7f71d4207c70 2024-09-12T02:58:11.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.349+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f71d40634c0 con 0x7f71d4207c70 2024-09-12T02:58:11.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.353+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f71d40634c0 con 0x7f71d4207c70 2024-09-12T02:58:11.357 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:11.357 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:11.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.353+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f71d420aab0 0x7f71d420cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:11.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.353+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f71d420fd40 con 0x7f71d420aab0 2024-09-12T02:58:11.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.357+0000 7f71d9a00640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f71d420aab0 0x7f71d420cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:11.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.357+0000 7f71d9a00640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f71d420aab0 0x7f71d420cea0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:11.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.357+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71d420fd40 con 0x7f71d420aab0 2024-09-12T02:58:11.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.369+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f71d4075640 con 0x7f71d420aab0 2024-09-12T02:58:11.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71d1600640 1 -- 172.21.15.63:0/72182030 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f71d4075640 con 0x7f71d420aab0 2024-09-12T02:58:11.378 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f71d41572e0 msgr2=0x7f71d41f0970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f71d41572e0 0x7f71d41f0970 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f71d4156210 msgr2=0x7f71d406cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f71d4156210 0x7f71d406cdd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f71d406d820 msgr2=0x7f71d40626e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f71d406d820 0x7f71d40626e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f71d41e20e0 msgr2=0x7f71d41e2500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f71d41e20e0 0x7f71d41e2500 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f71d402cb60 msgr2=0x7f71d402cf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f71d402cb60 0x7f71d402cf80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f71d4204e30 msgr2=0x7f71d4207220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f71d4204e30 0x7f71d4207220 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f71d4207c70 msgr2=0x7f71d420a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f71d4207c70 0x7f71d420a060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f71d420aab0 msgr2=0x7f71d420cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f71d420aab0 0x7f71d420cea0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71da400640 1 -- 172.21.15.63:0/72182030 reap_dead start 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71da400640 1 -- 172.21.15.63:0/72182030 reap_dead start 2024-09-12T02:58:11.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71da400640 1 -- 172.21.15.63:0/72182030 reap_dead start 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71da400640 1 -- 172.21.15.63:0/72182030 reap_dead start 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71da400640 1 -- 172.21.15.63:0/72182030 reap_dead start 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f71b40678c0 msgr2=0x7f71b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f71b40678c0 0x7f71b4069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f71c00b2000 tx=0x7f71c0009040 comp rx=0 tx=0).stop 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 msgr2=0x7f71d41e4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 0x7f71d41e4200 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c390 tx=0x7f71c800c850 comp rx=0 tx=0).stop 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 shutdown_connections 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f71b40678c0 0x7f71b4069d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 --2- 172.21.15.63:0/72182030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71d40c4ff0 0x7f71d41e4200 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f71c800c390 tx=0x7f71c800c850 comp rx=0 tx=0).stop 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 >> 172.21.15.63:0/72182030 conn(0x7f71d4067a00 msgr2=0x7f71d40c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 shutdown_connections 2024-09-12T02:58:11.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:11.377+0000 7f71dc400640 1 -- 172.21.15.63:0/72182030 wait complete. 2024-09-12T02:58:11.390 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:11.389+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:11.412 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:11.412 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:11.429 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:11.526 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:11.525+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:11.592 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:11.587+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:11.623 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:11.623 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:11.639 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:11.693 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:11.687+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:11.794 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:11.791+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:11.828 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:11.828 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:11.844 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:11.894 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:11.891+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:11.995 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:11.991+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:11.999 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:11.999 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:12.011 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T02:58:12.018 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:12.114 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:12.113+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:12.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf43e00640 1 Processor -- start 2024-09-12T02:58:12.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf43e00640 1 -- start start 2024-09-12T02:58:12.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf43e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440c28b0 0x7faf440c8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:12.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf43e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf44157980 con 0x7faf440c8e40 2024-09-12T02:58:12.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf43e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf440c1af0 con 0x7faf44150d80 2024-09-12T02:58:12.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf43e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7faf440c92b0 con 0x7faf440c28b0 2024-09-12T02:58:12.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf43400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7faf440c8e40 0x7faf44156ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45568/0 (socket says 172.21.15.63:45568) 2024-09-12T02:58:12.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf43400640 1 -- 172.21.15.63:0/2146810427 learned_addr learned my addr 172.21.15.63:0/2146810427 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:12.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf42000640 1 --2- 172.21.15.63:0/2146810427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440c28b0 0x7faf440c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:12.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf41600640 1 -- 172.21.15.63:0/2146810427 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096778474 0 0) 0x7faf44157980 con 0x7faf440c8e40 2024-09-12T02:58:12.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf41600640 1 -- 172.21.15.63:0/2146810427 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf28003450 con 0x7faf440c8e40 2024-09-12T02:58:12.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf41600640 1 -- 172.21.15.63:0/2146810427 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800022082 0 0) 0x7faf440c1af0 con 0x7faf44150d80 2024-09-12T02:58:12.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.173+0000 7faf41600640 1 -- 172.21.15.63:0/2146810427 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf44157980 con 0x7faf44150d80 2024-09-12T02:58:12.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.177+0000 7faf42000640 1 -- 172.21.15.63:0/2146810427 >> v1:172.21.15.119:6789/0 conn(0x7faf44150d80 legacy=0x7faf440c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:12.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.177+0000 7faf42000640 1 -- 172.21.15.63:0/2146810427 >> v1:172.21.15.63:6789/0 conn(0x7faf440c8e40 legacy=0x7faf44156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:12.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.177+0000 7faf42000640 1 -- 172.21.15.63:0/2146810427 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf440c1dd0 con 0x7faf440c28b0 2024-09-12T02:58:12.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf42000640 1 --2- 172.21.15.63:0/2146810427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440c28b0 0x7faf440c8900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf300097f0 tx=0x7faf3001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d0d58569dfe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:12.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf41600640 1 -- 172.21.15.63:0/2146810427 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300b5070 con 0x7faf440c28b0 2024-09-12T02:58:12.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf41600640 1 -- 172.21.15.63:0/2146810427 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf300a89d0 con 0x7faf440c28b0 2024-09-12T02:58:12.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf41600640 1 -- 172.21.15.63:0/2146810427 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300a8da0 con 0x7faf440c28b0 2024-09-12T02:58:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf43e00640 1 -- 172.21.15.63:0/2146810427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440c28b0 msgr2=0x7faf440c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf43e00640 1 --2- 172.21.15.63:0/2146810427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440c28b0 0x7faf440c8900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faf300097f0 tx=0x7faf3001ecd0 comp rx=0 tx=0).stop 2024-09-12T02:58:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf43e00640 1 -- 172.21.15.63:0/2146810427 shutdown_connections 2024-09-12T02:58:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf43e00640 1 --2- 172.21.15.63:0/2146810427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440c28b0 0x7faf440c8900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf43e00640 1 -- 172.21.15.63:0/2146810427 >> 172.21.15.63:0/2146810427 conn(0x7faf4406d900 msgr2=0x7faf4406f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf43e00640 1 -- 172.21.15.63:0/2146810427 shutdown_connections 2024-09-12T02:58:12.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.181+0000 7faf43e00640 1 -- 172.21.15.63:0/2146810427 wait complete. 2024-09-12T02:58:12.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf43e00640 1 Processor -- start 2024-09-12T02:58:12.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf43e00640 1 -- start start 2024-09-12T02:58:12.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf43e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf440c8e40 0x7faf44156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:12.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf43e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf44150d80 0x7faf44159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf43e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440afbc0 0x7faf4414a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf43e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faf44151160 con 0x7faf44150d80 2024-09-12T02:58:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf43e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faf440c2390 con 0x7faf440c8e40 2024-09-12T02:58:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf43e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7faf441512e0 con 0x7faf440afbc0 2024-09-12T02:58:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf42000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf44150d80 0x7faf44159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf42000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf44150d80 0x7faf44159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:52252/0 (socket says 172.21.15.63:52252) 2024-09-12T02:58:12.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf42000640 1 -- 172.21.15.63:0/205631453 learned_addr learned my addr 172.21.15.63:0/205631453 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:12.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf43400640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440afbc0 0x7faf4414a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:12.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.185+0000 7faf42a00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf440c8e40 0x7faf44156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:12.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf42000640 1 -- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440afbc0 msgr2=0x7faf4414a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf42000640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440afbc0 0x7faf4414a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf42000640 1 -- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf440c8e40 msgr2=0x7faf44156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf42000640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf440c8e40 0x7faf44156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf42000640 1 -- 172.21.15.63:0/205631453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf440aec70 con 0x7faf44150d80 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf42000640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf44150d80 0x7faf44159010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faf300097f0 tx=0x7faf3001ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf3aa00640 1 -- 172.21.15.63:0/205631453 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300bf070 con 0x7faf44150d80 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf3aa00640 1 -- 172.21.15.63:0/205631453 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf300b0720 con 0x7faf44150d80 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf3aa00640 1 -- 172.21.15.63:0/205631453 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf300b5040 con 0x7faf44150d80 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf441571b0 con 0x7faf44150d80 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf440c8190 con 0x7faf44150d80 2024-09-12T02:58:12.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf4415a300 con 0x7faf44150d80 2024-09-12T02:58:12.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.189+0000 7faf3aa00640 1 -- 172.21.15.63:0/205631453 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faf300c2070 con 0x7faf44150d80 2024-09-12T02:58:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.193+0000 7faf3aa00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faf240678f0 0x7faf24069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.193+0000 7faf3aa00640 1 -- 172.21.15.63:0/205631453 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6648+0+0 (secure 0 0 0) 0x7faf30122670 con 0x7faf44150d80 2024-09-12T02:58:12.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.193+0000 7faf42a00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faf240678f0 0x7faf24069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:12.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.193+0000 7faf42a00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faf240678f0 0x7faf24069db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf340011f0 tx=0x7faf34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:12.196 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:12.191+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:12.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.197+0000 7faf3aa00640 1 -- 172.21.15.63:0/205631453 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faf30018830 con 0x7faf44150d80 2024-09-12T02:58:12.228 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:12.228 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:12.246 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:12.338 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:12.337+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:12.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.389+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7faf441545c0 con 0x7faf44150d80 2024-09-12T02:58:12.398 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:12.395+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:12.442 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:12.442 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:12.458 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:12.499 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:12.495+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:12.600 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:12.597+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:12.653 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:12.669 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:12.700 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:12.695+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:12.802 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:12.797+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:12.866 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:12.866 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:12.884 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:12.930 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:12.927+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.985+0000 7faf3aa00640 1 -- 172.21.15.63:0/205631453 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v44) ==== 87+0+0 (secure 0 0 0) 0x7faf300f27a0 con 0x7faf44150d80 2024-09-12T02:58:12.990 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-12T02:58:12.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faf240678f0 msgr2=0x7faf24069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:12.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faf240678f0 0x7faf24069db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf340011f0 tx=0x7faf34009040 comp rx=0 tx=0).stop 2024-09-12T02:58:12.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf44150d80 msgr2=0x7faf44159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:12.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf44150d80 0x7faf44159010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7faf300097f0 tx=0x7faf3001ba70 comp rx=0 tx=0).stop 2024-09-12T02:58:12.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 shutdown_connections 2024-09-12T02:58:12.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7faf240678f0 0x7faf24069db0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:12.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf440afbc0 0x7faf4414a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:12.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faf44150d80 0x7faf44159010 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:12.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 --2- 172.21.15.63:0/205631453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf440c8e40 0x7faf44156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:12.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 >> 172.21.15.63:0/205631453 conn(0x7faf4406d900 msgr2=0x7faf4415a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:12.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 shutdown_connections 2024-09-12T02:58:12.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:12.989+0000 7faf43e00640 1 -- 172.21.15.63:0/205631453 wait complete. 2024-09-12T02:58:13.003 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:13.001+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:13.020 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:13.020 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:13.035 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:13.104 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:13.101+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:13.195 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:13.195 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:13.205 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:13.201+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:13.209 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:13.307 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:13.305+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:13.330 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:13.330 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:13.344 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:58:13.402 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:13.450 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:13.449+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:13.466 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:13.466 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:13.480 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T02:58:13.525 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:13.523+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:13.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.549+0000 7fe319a00640 1 Processor -- start 2024-09-12T02:58:13.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.549+0000 7fe319a00640 1 -- start start 2024-09-12T02:58:13.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe319a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe3140c8990 0x7fe314158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe319a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe314070060 con 0x7fe314152850 2024-09-12T02:58:13.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe319a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3140c5140 con 0x7fe3140c8140 2024-09-12T02:58:13.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe319a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe3140c3190 con 0x7fe3140c8990 2024-09-12T02:58:13.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe313e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe314152850 0x7fe3140ce040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41310/0 (socket says 172.21.15.63:41310) 2024-09-12T02:58:13.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe313e00640 1 -- 172.21.15.63:0/131358316 learned_addr learned my addr 172.21.15.63:0/131358316 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:13.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe319000640 1 --2- 172.21.15.63:0/131358316 >> v2:172.21.15.119:3300/0 conn(0x7fe3140c8990 0x7fe314158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe312a00640 1 -- 172.21.15.63:0/131358316 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421144022 0 0) 0x7fe314070060 con 0x7fe314152850 2024-09-12T02:58:13.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe312a00640 1 -- 172.21.15.63:0/131358316 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2f8003530 con 0x7fe314152850 2024-09-12T02:58:13.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe312a00640 1 -- 172.21.15.63:0/131358316 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968208363 0 0) 0x7fe3140c5140 con 0x7fe3140c8140 2024-09-12T02:58:13.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe312a00640 1 -- 172.21.15.63:0/131358316 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe314070060 con 0x7fe3140c8140 2024-09-12T02:58:13.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe319000640 1 -- 172.21.15.63:0/131358316 >> v1:172.21.15.119:6789/0 conn(0x7fe3140c8140 legacy=0x7fe314160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe319000640 1 -- 172.21.15.63:0/131358316 >> v1:172.21.15.63:6789/0 conn(0x7fe314152850 legacy=0x7fe3140ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.553+0000 7fe319000640 1 -- 172.21.15.63:0/131358316 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3140c3470 con 0x7fe3140c8990 2024-09-12T02:58:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319000640 1 --2- 172.21.15.63:0/131358316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3140c8990 0x7fe314158410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0097c0 tx=0x7fe30c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac1b083315053578 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe312a00640 1 -- 172.21.15.63:0/131358316 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0b0070 con 0x7fe3140c8990 2024-09-12T02:58:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe312a00640 1 -- 172.21.15.63:0/131358316 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c0ab600 con 0x7fe3140c8990 2024-09-12T02:58:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe312a00640 1 -- 172.21.15.63:0/131358316 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0ab9b0 con 0x7fe3140c8990 2024-09-12T02:58:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 -- 172.21.15.63:0/131358316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3140c8990 msgr2=0x7fe314158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 --2- 172.21.15.63:0/131358316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3140c8990 0x7fe314158410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0097c0 tx=0x7fe30c01c4a0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 -- 172.21.15.63:0/131358316 shutdown_connections 2024-09-12T02:58:13.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 --2- 172.21.15.63:0/131358316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3140c8990 0x7fe314158410 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 -- 172.21.15.63:0/131358316 >> 172.21.15.63:0/131358316 conn(0x7fe314067a00 msgr2=0x7fe314067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:13.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 -- 172.21.15.63:0/131358316 shutdown_connections 2024-09-12T02:58:13.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 -- 172.21.15.63:0/131358316 wait complete. 2024-09-12T02:58:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 Processor -- start 2024-09-12T02:58:13.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 -- start start 2024-09-12T02:58:13.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3140c8140 0x7fe314160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3140c8990 0x7fe31414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe314152850 0x7fe3140c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe3140ce8d0 con 0x7fe3140c8990 2024-09-12T02:58:13.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe3140ce750 con 0x7fe314152850 2024-09-12T02:58:13.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.557+0000 7fe319a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe31406fc30 con 0x7fe3140c8140 2024-09-12T02:58:13.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3140c8140 0x7fe314160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3140c8140 0x7fe314160fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:42556/0 (socket says 172.21.15.63:42556) 2024-09-12T02:58:13.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3140c8990 0x7fe31414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313e00640 1 -- 172.21.15.63:0/2859438077 learned_addr learned my addr 172.21.15.63:0/2859438077 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:13.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe319000640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe314152850 0x7fe3140c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313e00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe314152850 msgr2=0x7fe3140c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313e00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe314152850 0x7fe3140c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313e00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3140c8990 msgr2=0x7fe31414f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313e00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3140c8990 0x7fe31414f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313e00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3141f3ee0 con 0x7fe3140c8140 2024-09-12T02:58:13.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313400640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3140c8990 0x7fe31414f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe313e00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3140c8140 0x7fe314160fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe30400cbc0 tx=0x7fe30400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304017070 con 0x7fe3140c8140 2024-09-12T02:58:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30400ad60 con 0x7fe3140c8140 2024-09-12T02:58:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304012640 con 0x7fe3140c8140 2024-09-12T02:58:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3141f3360 con 0x7fe3140c8140 2024-09-12T02:58:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3141f3920 con 0x7fe3140c8140 2024-09-12T02:58:13.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fe314069870 con 0x7fe3140c8140 2024-09-12T02:58:13.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.561+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe30401a070 con 0x7fe3140c8140 2024-09-12T02:58:13.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe30be00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2f40678c0 0x7fe2f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(44..44 src has 1..44) ==== 6648+0+0 (secure 0 0 0) 0x7fe304085f10 con 0x7fe3140c8140 2024-09-12T02:58:13.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe313400640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2f40678c0 0x7fe2f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v44) ==== 54+0+16 (secure 0 0 0) 0x7fe3040863a0 con 0x7fe3140c8140 2024-09-12T02:58:13.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe31414f8d0 0x7fe3141517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe314158410 con 0x7fe31414f8d0 2024-09-12T02:58:13.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe319000640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe31414f8d0 0x7fe3141517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe313400640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2f40678c0 0x7fe2f4069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe314157c70 tx=0x7fe300009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe319000640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe31414f8d0 0x7fe3141517d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.565+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe314158410 con 0x7fe31414f8d0 2024-09-12T02:58:13.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.581+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe3141576e0 con 0x7fe31414f8d0 2024-09-12T02:58:13.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.581+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe3141576e0 con 0x7fe31414f8d0 2024-09-12T02:58:13.586 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:13.586 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:13.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.581+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe31406ce60 0x7fe31406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.581+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fe314159bb0 con 0x7fe31406ce60 2024-09-12T02:58:13.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.585+0000 7fe313e00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe31406ce60 0x7fe31406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.585+0000 7fe313e00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe31406ce60 0x7fe31406d930 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.585+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe314159bb0 con 0x7fe31406ce60 2024-09-12T02:58:13.598 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:13.598 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:13.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.597+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe31406dfe0 con 0x7fe31406ce60 2024-09-12T02:58:13.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.601+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe31406dfe0 con 0x7fe31406ce60 2024-09-12T02:58:13.603 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:13.604 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:13.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.601+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe3141f6a10 0x7fe3141f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.601+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fe3140c8e70 con 0x7fe3141f6a10 2024-09-12T02:58:13.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.601+0000 7fe313400640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe3141f6a10 0x7fe3141f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.601+0000 7fe313400640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe3141f6a10 0x7fe3141f6e50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.601+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3140c8e70 con 0x7fe3141f6a10 2024-09-12T02:58:13.610 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:13.605+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:13.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T02:58:13.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.617+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe3140c9300 con 0x7fe3141f6a10 2024-09-12T02:58:13.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.617+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe3140c9300 con 0x7fe3141f6a10 2024-09-12T02:58:13.621 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.617+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe3140626e0 0x7fe314062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.617+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fe3140c9de0 con 0x7fe3140626e0 2024-09-12T02:58:13.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.617+0000 7fe319000640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe3140626e0 0x7fe314062b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.617+0000 7fe319000640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe3140626e0 0x7fe314062b20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.621+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3140c9de0 con 0x7fe3140626e0 2024-09-12T02:58:13.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.633+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe3140632b0 con 0x7fe3140626e0 2024-09-12T02:58:13.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.637+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe3140632b0 con 0x7fe3140626e0 2024-09-12T02:58:13.638 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.637+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe314063060 0x7fe31402cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.637+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fe3140c9de0 con 0x7fe314063060 2024-09-12T02:58:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.637+0000 7fe313e00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe314063060 0x7fe31402cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.637+0000 7fe313e00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe314063060 0x7fe31402cb60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.637+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3140c9de0 con 0x7fe314063060 2024-09-12T02:58:13.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.653+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe3140c9de0 con 0x7fe314063060 2024-09-12T02:58:13.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.657+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe3140c9de0 con 0x7fe314063060 2024-09-12T02:58:13.659 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:13.660 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:13.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.657+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe31402d5b0 0x7fe314209890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.657+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fe31402da10 con 0x7fe31402d5b0 2024-09-12T02:58:13.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.657+0000 7fe313400640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe31402d5b0 0x7fe314209890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.657+0000 7fe313400640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe31402d5b0 0x7fe314209890 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.657+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe31402da10 con 0x7fe31402d5b0 2024-09-12T02:58:13.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.673+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe31402da10 con 0x7fe31402d5b0 2024-09-12T02:58:13.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.677+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe31402da10 con 0x7fe31402d5b0 2024-09-12T02:58:13.679 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.677+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe31420a2e0 0x7fe31420c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.677+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fe31420f5a0 con 0x7fe31420a2e0 2024-09-12T02:58:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.677+0000 7fe319000640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe31420a2e0 0x7fe31420c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.677+0000 7fe319000640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe31420a2e0 0x7fe31420c6d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.677+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe31420f5a0 con 0x7fe31420a2e0 2024-09-12T02:58:13.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.705+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe31420cc10 con 0x7fe31420a2e0 2024-09-12T02:58:13.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.709+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe31420cc10 con 0x7fe31420a2e0 2024-09-12T02:58:13.710 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:13.711 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:13.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.709+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe31420d330 0x7fe31420d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:13.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.709+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fe314212970 con 0x7fe31420d330 2024-09-12T02:58:13.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.709+0000 7fe313e00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe31420d330 0x7fe31420d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:13.712 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:13.707+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:13.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.709+0000 7fe313e00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe31420d330 0x7fe31420d730 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:13.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.709+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe314212970 con 0x7fe31420d330 2024-09-12T02:58:13.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.737+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fe3142117f0 con 0x7fe31420d330 2024-09-12T02:58:13.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe30be00640 1 -- 172.21.15.63:0/2859438077 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe3142117f0 con 0x7fe31420d330 2024-09-12T02:58:13.744 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:13.745 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:13.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe31414f8d0 msgr2=0x7fe3141517d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe31414f8d0 0x7fe3141517d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe31406ce60 msgr2=0x7fe31406d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe31406ce60 0x7fe31406d930 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe3141f6a10 msgr2=0x7fe3141f6e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe3141f6a10 0x7fe3141f6e50 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe3140626e0 msgr2=0x7fe314062b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe3140626e0 0x7fe314062b20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe314063060 msgr2=0x7fe31402cb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe314063060 0x7fe31402cb60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe31402d5b0 msgr2=0x7fe314209890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fe31402d5b0 0x7fe314209890 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe31420a2e0 msgr2=0x7fe31420c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe31420a2e0 0x7fe31420c6d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe31420d330 msgr2=0x7fe31420d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319000640 1 -- 172.21.15.63:0/2859438077 reap_dead start 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe31420d330 0x7fe31420d730 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319000640 1 -- 172.21.15.63:0/2859438077 reap_dead start 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319000640 1 -- 172.21.15.63:0/2859438077 reap_dead start 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319000640 1 -- 172.21.15.63:0/2859438077 reap_dead start 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2f40678c0 msgr2=0x7fe2f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2f40678c0 0x7fe2f4069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe314157c70 tx=0x7fe300009040 comp rx=0 tx=0).stop 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3140c8140 msgr2=0x7fe314160fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3140c8140 0x7fe314160fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe30400cbc0 tx=0x7fe30400a430 comp rx=0 tx=0).stop 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 shutdown_connections 2024-09-12T02:58:13.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2f40678c0 0x7fe2f4069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 --2- 172.21.15.63:0/2859438077 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3140c8140 0x7fe314160fd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:13.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 >> 172.21.15.63:0/2859438077 conn(0x7fe314067a00 msgr2=0x7fe3140cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:13.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 shutdown_connections 2024-09-12T02:58:13.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:13.741+0000 7fe319a00640 1 -- 172.21.15.63:0/2859438077 wait complete. 2024-09-12T02:58:13.777 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 63.923139761999998, 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00551893, 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:13.778 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:13.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853808+0000", 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4959999999999999e-06 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853827+0000", 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8675999999999999e-05 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853869+0000", 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2347e-05 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853889+0000", 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0248999999999999e-05 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854115+0000", 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022562600000000001 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854168+0000", 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3476000000000001e-05 2024-09-12T02:58:13.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859207+0000", 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050389550000000003 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859324+0000", 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117105 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 63.921937024000002, 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077810020000000004, 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855011+0000", 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3259999999999998e-06 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855026+0000", 2024-09-12T02:58:13.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5023e-05 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855055+0000", 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9298e-05 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0525000000000001e-05 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:13.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855570+0000", 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000494539 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855624+0000", 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3656999999999998e-05 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862687+0000", 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007063593 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862789+0000", 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010204099999999999 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 63.921815414999998, 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077503839999999999, 2024-09-12T02:58:13.787 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855131+0000", 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5230000000000001e-06 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855143+0000", 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1412e-05 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:13.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0043000000000001e-05 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855176+0000", 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3429e-05 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856069+0000", 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00089251 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.790 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856116+0000", 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6826999999999997e-05 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862797+0000", 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066810050000000003 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862880+0000", 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3634999999999995e-05 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.791 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 63.920710131, 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065292639999999999, 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:13.792 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856237+0000", 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.103e-06 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856252+0000", 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4813e-05 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856279+0000", 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7254e-05 2024-09-12T02:58:13.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856297+0000", 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7929000000000001e-05 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856462+0000", 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016488700000000001 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:13.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856508+0000", 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5787000000000001e-05 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862657+0000", 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061494210000000004 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862764+0000", 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010707 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:13.796 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 63.919962865000002, 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005857943, 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:13.797 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856984+0000", 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3799999999999999e-06 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856997+0000", 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2896e-05 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857022+0000", 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5554999999999998e-05 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857043+0000", 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0919000000000001e-05 2024-09-12T02:58:13.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857162+0000", 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118526 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857225+0000", 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3578999999999996e-05 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:13.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862772+0000", 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055470789999999999 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862840+0000", 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8009000000000006e-05 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:13.801 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.8628353559999997, 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00045081800000000002, 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:13.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914111+0000", 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1699999999999997e-07 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914116+0000", 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.259e-06 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:13.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914129+0000", 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3451e-05 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914140+0000", 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0721e-05 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914241+0000", 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000100843 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.804 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914561+0000", 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031982700000000001 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 8.8593434539999993, 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000219385, 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:13.805 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5800000000000001e-07 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917605+0000", 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1379999999999999e-06 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917611+0000", 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9179999999999999e-06 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917620+0000", 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0389999999999993e-06 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917681+0000", 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0482999999999997e-05 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917821+0000", 2024-09-12T02:58:13.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014054900000000001 2024-09-12T02:58:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:13.809 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:13.809 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:13.810 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:13.858 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:13.855+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:13.912 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:13.909+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:13.982 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:13.983 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:13.983 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:13.983 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:13.997 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:14.012 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:14.009+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:14.113 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:14.111+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:14.115 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:14.116 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:14.116 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:14.116 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:14.116 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:14.130 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:14.214 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:14.213+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.441662132000005, 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:14.298 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:14.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:14.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:14.303 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.441528923999996, 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.304 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:14.306 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:14.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:14.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.308 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.308 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:14.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:14.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.308 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.309 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.441424174000005, 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.310 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:14.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.313 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:14.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.315 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.441278355999998, 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.316 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.317 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:14.318 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.319 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:14.320 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.321 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.441205174000004, 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:14.322 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.323 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.324 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:14.325 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.326 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:14.327 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.441145187999993, 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.328 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.329 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:14.330 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:14.331 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.332 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:14.333 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.441082842, 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:14.334 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.335 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:14.336 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.338 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.441025326000002, 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:14.340 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.341 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:14.342 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.438857701000003, 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.343 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:14.344 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.345 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.346 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.347 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.435699185999994, 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:14.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing_reply(2.14 epoch 25/19 rep_tid 7 lcod 25'5)", 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.429238240999993, 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010494969999999999, 2024-09-12T02:58:14.352 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864695+0000", 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7300000000000001e-07 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864699+0000", 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.33e-06 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.354 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864715+0000", 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6116e-05 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864727+0000", 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1759e-05 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865572+0000", 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00084520699999999995 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865744+0000", 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000171612 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.427990312999995, 2024-09-12T02:58:14.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:14.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:14.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:14.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:14.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:14.362 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.409101362000001, 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:14.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 53.680699556, 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:14.367 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.368 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:14.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:14.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 51.924862974, 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.373 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:14.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.377 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 51.042774010000002, 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.379 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.380 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.381 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:14.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.358816396999998, 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:14.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.386 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:14.390 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.358711106000001, 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.391 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.392 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:14.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:14.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 26.666147956, 2024-09-12T02:58:14.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.397 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:14.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:46 2.6 e28/19 2:654134d2:::mds0_openfiles.0:head v 28'2, mlcod=0'0)", 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 26.405954058999999, 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015286869999999999, 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887979+0000", 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4000000000000002e-07 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887986+0000", 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1999999999999997e-06 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888007+0000", 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1075999999999999e-05 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888022+0000", 2024-09-12T02:58:14.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5316e-05 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888142+0000", 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011911100000000001 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888187+0000", 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5225000000000002e-05 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889432+0000", 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012450709999999999 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889507+0000", 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5148000000000006e-05 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.407 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:14.408 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T02:58:14.408 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T02:58:14.408 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-12T02:58:14.408 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-12T02:58:14.410 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:14.405+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:14.410 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:14.511 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:14.507+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:14.538 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:14.538 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:14.538 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:14.538 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:14.552 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.549+0000 7f3d98000640 1 Processor -- start 2024-09-12T02:58:14.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.549+0000 7f3d98000640 1 -- start start 2024-09-12T02:58:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.549+0000 7f3d98000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 0x7f3d900c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.549+0000 7f3d98000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3d9006ec90 0x7f3d900ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.549+0000 7f3d98000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d90155070 con 0x7f3d9015b5c0 2024-09-12T02:58:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.549+0000 7f3d98000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f3d9015b130 con 0x7f3d9006ec90 2024-09-12T02:58:14.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.549+0000 7f3d98000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f3d900c36b0 con 0x7f3d90154c90 2024-09-12T02:58:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.553+0000 7f3d94c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3d9006ec90 0x7f3d900ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.553+0000 7f3d95600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 0x7f3d900c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.553+0000 7f3d96000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3d9015b5c0 0x7f3d9006cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41326/0 (socket says 172.21.15.63:41326) 2024-09-12T02:58:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.553+0000 7f3d96000640 1 -- 172.21.15.63:0/3044056291 learned_addr learned my addr 172.21.15.63:0/3044056291 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.553+0000 7f3d94c00640 1 -- 172.21.15.63:0/3044056291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 msgr2=0x7f3d900c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.553+0000 7f3d94c00640 1 --2- 172.21.15.63:0/3044056291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 0x7f3d900c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.553+0000 7f3d94c00640 1 -- 172.21.15.63:0/3044056291 >> v1:172.21.15.63:6789/0 conn(0x7f3d9015b5c0 legacy=0x7f3d9006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.553+0000 7f3d8fe00640 1 -- 172.21.15.63:0/3044056291 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 257263939 0 0) 0x7f3d90155070 con 0x7f3d9015b5c0 2024-09-12T02:58:14.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.553+0000 7f3d94c00640 1 -- 172.21.15.63:0/3044056291 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d900c8bf0 con 0x7f3d9006ec90 2024-09-12T02:58:14.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d94c00640 1 --2- 172.21.15.63:0/3044056291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9006ec90 0x7f3d900ce270 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0097c0 tx=0x7f3d7c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbf0f6c021efa9b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:14.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d8fe00640 1 -- 172.21.15.63:0/3044056291 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0b5070 con 0x7f3d9006ec90 2024-09-12T02:58:14.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d8fe00640 1 -- 172.21.15.63:0/3044056291 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0a8990 con 0x7f3d9006ec90 2024-09-12T02:58:14.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d8fe00640 1 -- 172.21.15.63:0/3044056291 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0a8d60 con 0x7f3d9006ec90 2024-09-12T02:58:14.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d98000640 1 -- 172.21.15.63:0/3044056291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9006ec90 msgr2=0x7f3d900ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d98000640 1 --2- 172.21.15.63:0/3044056291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9006ec90 0x7f3d900ce270 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0097c0 tx=0x7f3d7c01ec90 comp rx=0 tx=0).stop 2024-09-12T02:58:14.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d98000640 1 -- 172.21.15.63:0/3044056291 shutdown_connections 2024-09-12T02:58:14.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d98000640 1 --2- 172.21.15.63:0/3044056291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9006ec90 0x7f3d900ce270 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d98000640 1 --2- 172.21.15.63:0/3044056291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 0x7f3d900c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d98000640 1 -- 172.21.15.63:0/3044056291 >> 172.21.15.63:0/3044056291 conn(0x7f3d9006bcc0 msgr2=0x7f3d9006fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:14.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d98000640 1 -- 172.21.15.63:0/3044056291 shutdown_connections 2024-09-12T02:58:14.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d98000640 1 -- 172.21.15.63:0/3044056291 wait complete. 2024-09-12T02:58:14.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.557+0000 7f3d98000640 1 Processor -- start 2024-09-12T02:58:14.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d98000640 1 -- start start 2024-09-12T02:58:14.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d98000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9006ec90 0x7f3d9014d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d98000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 0x7f3d9014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d98000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9015b5c0 0x7f3d901f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d98000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9015aae0 con 0x7f3d9006ec90 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d98000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d900c91b0 con 0x7f3d9015b5c0 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d98000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9015adc0 con 0x7f3d90154c90 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d95600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9006ec90 0x7f3d9014d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d95600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9006ec90 0x7f3d9014d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37802/0 (socket says 172.21.15.63:37802) 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d95600640 1 -- 172.21.15.63:0/2687866927 learned_addr learned my addr 172.21.15.63:0/2687866927 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d96000640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9015b5c0 0x7f3d901f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d94c00640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 0x7f3d9014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d95600640 1 -- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 msgr2=0x7f3d9014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d95600640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 0x7f3d9014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d95600640 1 -- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9015b5c0 msgr2=0x7f3d901f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d95600640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9015b5c0 0x7f3d901f0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d95600640 1 -- 172.21.15.63:0/2687866927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d900c55a0 con 0x7f3d9006ec90 2024-09-12T02:58:14.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d95600640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9006ec90 0x7f3d9014d6e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400e9b0 tx=0x7f3d8400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:14.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d8d600640 1 -- 172.21.15.63:0/2687866927 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84017070 con 0x7f3d9006ec90 2024-09-12T02:58:14.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d8d600640 1 -- 172.21.15.63:0/2687866927 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8400c9a0 con 0x7f3d9006ec90 2024-09-12T02:58:14.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d8d600640 1 -- 172.21.15.63:0/2687866927 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400cd70 con 0x7f3d9006ec90 2024-09-12T02:58:14.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d900c5880 con 0x7f3d9006ec90 2024-09-12T02:58:14.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.561+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d901f3e10 con 0x7f3d9006ec90 2024-09-12T02:58:14.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.565+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d9006c6d0 con 0x7f3d9006ec90 2024-09-12T02:58:14.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.565+0000 7f3d8d600640 1 -- 172.21.15.63:0/2687866927 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d8401a070 con 0x7f3d9006ec90 2024-09-12T02:58:14.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.565+0000 7f3d8d600640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d700678c0 0x7f3d70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:14.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.565+0000 7f3d8d600640 1 -- 172.21.15.63:0/2687866927 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6648+0+0 (secure 0 0 0) 0x7f3d84086470 con 0x7f3d9006ec90 2024-09-12T02:58:14.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.565+0000 7f3d94c00640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d700678c0 0x7f3d70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:14.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.569+0000 7f3d94c00640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d700678c0 0x7f3d70069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0b2000 tx=0x7f3d7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:14.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.569+0000 7f3d8d600640 1 -- 172.21.15.63:0/2687866927 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d84056510 con 0x7f3d9006ec90 2024-09-12T02:58:14.612 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:14.609+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:14.713 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:14.709+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:14.717 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:14.717 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:14.717 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:14.717 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:14.717 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:14.732 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:14.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.757+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f3d900ccf60 con 0x7f3d9006ec90 2024-09-12T02:58:14.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.757+0000 7f3d8d600640 1 -- 172.21.15.63:0/2687866927 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v44) ==== 81+0+38229 (secure 0 0 0) 0x7f3d8405a810 con 0x7f3d9006ec90 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 44, 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "fsid": "20b0bc3b-ca7e-4b63-a9bc-3526f84b65da", 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "created": "2024-09-12T02:56:41.049401+0000", 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "modified": "2024-09-12T02:58:12.989062+0000", 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "last_up_change": "2024-09-12T02:56:53.715732+0000", 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "last_in_change": "2024-09-12T02:56:43.361756+0000", 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_num": 5801984, 2024-09-12T02:58:14.762 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_set": [ 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "noscrub", 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "pglog_hardlimit", 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "purged_snapdirs", 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_deletes", 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "sortbitwise" 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_version": 6, 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "full_ratio": 0.94999998807907104, 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-12T02:58:14.763 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_snapshot": "", 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_max": 4, 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "max_osd": 8, 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "require_min_compat_client": "luminous", 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "min_compat_client": "luminous", 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "require_osd_release": "squid", 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "allow_crimson": false, 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "pools": [ 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 1, 2024-09-12T02:58:14.764 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": ".mgr", 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:56:53.830004+0000", 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:58:14.765 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 1, 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 1, 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 1, 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 1, 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 1, 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:58:14.766 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:58:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "18", 2024-09-12T02:58:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:58:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:58:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:58:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:58:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:58:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:58:14.767 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:58:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:58:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:58:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:58:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:58:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:58:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:58:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:58:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:58:14.768 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.769 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:58:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:58:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:58:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:58:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:58:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:58:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:58:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:58:14.770 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_max": 32, 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 1 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": {} 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-12T02:58:14.771 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 8, 2024-09-12T02:58:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 8, 2024-09-12T02:58:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 0.25, 2024-09-12T02:58:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 2, 2024-09-12T02:58:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 2, 2024-09-12T02:58:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:58:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-12T02:58:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:58:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.772 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 2, 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_metadata", 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:57:02.599829+0000", 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-12T02:58:14.773 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-12T02:58:14.774 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "21", 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:58:14.775 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:58:14.776 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:58:14.777 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_bias": 4, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 16, 2024-09-12T02:58:14.778 INFO:teuthology.orchestra.run.smithi063.stdout: "recovery_priority": 5 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": "cephfs" 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5, 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5, 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.5, 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.5, 2024-09-12T02:58:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 3, 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data", 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:57:03.211064+0000", 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 1, 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool", 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 1, 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 2, 2024-09-12T02:58:14.780 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 1, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 0, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 64, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 64, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 64, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 64, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 64, 2024-09-12T02:58:14.781 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "22", 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:58:14.782 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:58:14.783 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "", 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:58:14.784 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 0, 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.05000000074505806 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-12T02:58:14.785 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "read_balance": { 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "score_type": "Fair distribution", 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "score_acting": 1.5, 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "score_stable": 1.5, 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "optimal_score": 1, 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_acting": 1.5, 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "raw_score_stable": 1.5, 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity_weighted": 1, 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity": 1, 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: "average_primary_affinity_weighted": 1 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.786 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "pool": 4, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_name": "cephfs_data_ec", 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "create_time": "2024-09-12T02:57:06.889005+0000", 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "flags": 5, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "flags_names": "hashpspool,ec_overwrites", 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "type": 3, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 4, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "min_size": 3, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_rule": 1, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_count": 0, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_target": 0, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_barrier": 0, 2024-09-12T02:58:14.787 INFO:teuthology.orchestra.run.smithi063.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "is_stretch_pool": false, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "object_hash": 2, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_autoscale_mode": "off", 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num": 32, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num": 32, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_placement_num_target": 32, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_target": 32, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_pending": 32, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "last_pg_merge_meta": { 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "source_pgid": "0.0", 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "ready_epoch": 0, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_started": 0, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "last_epoch_clean": 0, 2024-09-12T02:58:14.788 INFO:teuthology.orchestra.run.smithi063.stdout: "source_version": "0'0", 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "target_version": "0'0" 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "last_change": "26", 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend": "0", 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "last_force_op_resend_preluminous": "0", 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "auid": 0, 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_mode": "selfmanaged", 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_seq": 0, 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "snap_epoch": 0, 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "pool_snaps": [], 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps": "[]", 2024-09-12T02:58:14.789 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_bytes": 0, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "quota_max_objects": 0, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "tiers": [], 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "tier_of": -1, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "read_tier": -1, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "write_tier": -1, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_mode": "none", 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_bytes": 0, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "target_max_objects": 0, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_flush_age": 0, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "cache_min_evict_age": 0, 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profile": "cephfs_data_ec", 2024-09-12T02:58:14.790 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_params": { 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "none" 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_period": 0, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_count": 0, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "use_gmt_hitset": true, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "min_read_recency_for_promote": 0, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "min_write_recency_for_promote": 0, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_grade_decay_rate": 0, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "hit_set_search_last_n": 0, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "grade_table": [], 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "stripe_width": 8192, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "expected_num_objects": 0, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "fast_read": false, 2024-09-12T02:58:14.791 INFO:teuthology.orchestra.run.smithi063.stdout: "options": { 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_num_min": 64, 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "target_size_ratio": 0.89999997615814209 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "application_metadata": { 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs": { 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "data": "cephfs" 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "osds": [ 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.792 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "5c33857f-3772-4c5f-9025-2157ac056da1", 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 15, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.793 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6824", 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6825", 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.794 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6826", 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6827", 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.795 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6830", 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6831", 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.796 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6828", 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6829", 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3662141659 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6825/3662141659", 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6827/3662141659", 2024-09-12T02:58:14.797 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6831/3662141659", 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6829/3662141659", 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "9a1b1d8b-fd3f-4b94-8135-941da7cb2797", 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 0.420135498046875, 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:14.798 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 13, 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 27, 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6800", 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6801", 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6802", 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6803", 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6806", 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:14.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6807", 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6804", 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:14.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6805", 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 866448188 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6801/866448188", 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6803/866448188", 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6807/866448188", 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6805/866448188", 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:14.803 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "f23c8af2-7fa2-4e43-99de-7bf2670b72ce", 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 15, 2024-09-12T02:58:14.804 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6816", 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6817", 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:14.805 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6818", 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6819", 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:14.806 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6822", 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6823", 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:14.807 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6820", 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6821", 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4130213561 2024-09-12T02:58:14.808 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6817/4130213561", 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6819/4130213561", 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6823/4130213561", 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6821/4130213561", 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0b6a2786-33e7-4286-92f4-e8d25573149a", 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 15, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:14.810 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6808", 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6809", 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:14.811 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6810", 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6811", 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:14.812 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6814", 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6815", 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:14.813 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6812", 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.63:6813", 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2574114576 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.63:6809/2574114576", 2024-09-12T02:58:14.814 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.63:6811/2574114576", 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.63:6815/2574114576", 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.63:6813/2574114576", 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "cdd5dfe1-3893-42ee-8706-50ef5c92ac9f", 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:14.815 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6808", 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6809", 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6810", 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6811", 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6814", 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:14.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6815", 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6812", 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:14.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6813", 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 946317737 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6809/946317737", 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6811/946317737", 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6815/946317737", 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6813/946317737", 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:14.820 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "442157e7-0a20-45b7-a3b6-f4a930643516", 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:58:14.821 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6824", 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6825", 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:14.822 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6826", 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6827", 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:14.823 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6830", 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.824 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6831", 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6828", 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.825 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6829", 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4151470176 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6825/4151470176", 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6827/4151470176", 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6831/4151470176", 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6829/4151470176", 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "0f1cd9bc-aafa-4004-b7e5-6ea6e409d398", 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:14.827 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6816", 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6817", 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:14.828 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6818", 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6819", 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.829 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6822", 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6823", 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6820", 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6821", 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 2029574290 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6817/2029574290", 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6819/2029574290", 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6823/2029574290", 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6821/2029574290", 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.832 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "uuid": "ac41ac05-d082-43f8-93ec-ba27bf53fd08", 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "up": 1, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "in": 1, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "weight": 1, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_affinity": 1, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_begin": 0, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "last_clean_end": 0, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "up_from": 14, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "up_thru": 40, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "down_at": 0, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "lost_at": 0, 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addrs": { 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6800", 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6801", 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addrs": { 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6802", 2024-09-12T02:58:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6803", 2024-09-12T02:58:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:14.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addrs": { 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6806", 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6807", 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addrs": { 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "addrvec": [ 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v2", 2024-09-12T02:58:14.837 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6804", 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "172.21.15.119:6805", 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 3494373582 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "public_addr": "172.21.15.119:6801/3494373582", 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_addr": "172.21.15.119:6803/3494373582", 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_back_addr": "172.21.15.119:6807/3494373582", 2024-09-12T02:58:14.838 INFO:teuthology.orchestra.run.smithi063.stdout: "heartbeat_front_addr": "172.21.15.119:6805/3494373582", 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "state": [ 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "exists", 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "up" 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_xinfo": [ 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 0, 2024-09-12T02:58:14.839 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.481445+0000", 2024-09-12T02:58:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 1, 2024-09-12T02:58:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.975485+0000", 2024-09-12T02:58:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:14.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 2, 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.719623+0000", 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 3, 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.227734+0000", 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 4, 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:14.843 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:49.777737+0000", 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 5, 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:14.844 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.183864+0000", 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 6, 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:14.845 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:50.071981+0000", 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": 7, 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "down_stamp": "0.000000", 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_probability": 0, 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "laggy_interval": 0, 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "features": 4540701547738038271, 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "old_weight": 0, 2024-09-12T02:58:14.846 INFO:teuthology.orchestra.run.smithi063.stdout: "last_purged_snaps_scrub": "2024-09-12T02:56:49.830810+0000", 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "dead_epoch": 0 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap": [], 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_items": [ 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.d", 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 7, 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 1 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.19", 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 3, 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "3.36", 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:58:14.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 5, 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "pgid": "4.3", 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "mappings": [ 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "from": 1, 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: "to": 2 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:14.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: ], 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_upmap_primaries": [], 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "pg_temp": [], 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "primary_temp": [], 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklist": {}, 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "range_blocklist": {}, 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "erasure_code_profiles": { 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "cephfs_data_ec": { 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-device-class": "", 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-num-failure-domains": "0", 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-osds-per-failure-domain": "0", 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-root": "default", 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "jerasure-per-chunk-alignment": "false", 2024-09-12T02:58:14.850 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "2", 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van", 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "w": "8" 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "default": { 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "crush-failure-domain": "osd", 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "k": "2", 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "m": "1", 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "plugin": "jerasure", 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "technique": "reed_sol_van" 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:14.851 INFO:teuthology.orchestra.run.smithi063.stdout: "removed_snaps_queue": [], 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "new_removed_snaps": [], 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "new_purged_snaps": [], 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "crush_node_flags": {}, 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "device_class_flags": {}, 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode": { 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_enabled": false, 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_bucket_count": 0, 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "degraded_stretch_mode": 0, 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "recovering_stretch_mode": 0, 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: "stretch_mode_bucket": 0 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:14.852 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:14.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d700678c0 msgr2=0x7f3d70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d700678c0 0x7f3d70069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0b2000 tx=0x7f3d7c008040 comp rx=0 tx=0).stop 2024-09-12T02:58:14.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9006ec90 msgr2=0x7f3d9014d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:14.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9006ec90 0x7f3d9014d6e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400e9b0 tx=0x7f3d8400ee70 comp rx=0 tx=0).stop 2024-09-12T02:58:14.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 shutdown_connections 2024-09-12T02:58:14.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9015b5c0 0x7f3d901f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d700678c0 0x7f3d70069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d90154c90 0x7f3d9014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 --2- 172.21.15.63:0/2687866927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d9006ec90 0x7f3d9014d6e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:14.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 >> 172.21.15.63:0/2687866927 conn(0x7f3d9006bcc0 msgr2=0x7f3d900cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:14.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 shutdown_connections 2024-09-12T02:58:14.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:14.761+0000 7f3d98000640 1 -- 172.21.15.63:0/2687866927 wait complete. 2024-09-12T02:58:14.856 INFO:tasks.thrashosds.thrasher:j is {'epoch': 44, 'fsid': '20b0bc3b-ca7e-4b63-a9bc-3526f84b65da', 'created': '2024-09-12T02:56:41.049401+0000', 'modified': '2024-09-12T02:58:12.989062+0000', 'last_up_change': '2024-09-12T02:56:53.715732+0000', 'last_in_change': '2024-09-12T02:56:43.361756+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:56:53.830004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:57:02.599829+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:57:03.211064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T02:57:06.889005+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}], 'osds': [{'osd': 0, 'uuid': '5c33857f-3772-4c5f-9025-2157ac056da1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6824', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6825', 'nonce': 3662141659}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6826', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6827', 'nonce': 3662141659}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6830', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6831', 'nonce': 3662141659}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6828', 'nonce': 3662141659}, {'type': 'v1', 'addr': '172.21.15.63:6829', 'nonce': 3662141659}]}, 'public_addr': '172.21.15.63:6825/3662141659', 'cluster_addr': '172.21.15.63:6827/3662141659', 'heartbeat_back_addr': '172.21.15.63:6831/3662141659', 'heartbeat_front_addr': '172.21.15.63:6829/3662141659', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '9a1b1d8b-fd3f-4b94-8135-941da7cb2797', 'up': 1, 'in': 1, 'weight': 0.420135498046875, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6800', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6801', 'nonce': 866448188}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6802', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6803', 'nonce': 866448188}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6806', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6807', 'nonce': 866448188}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6804', 'nonce': 866448188}, {'type': 'v1', 'addr': '172.21.15.63:6805', 'nonce': 866448188}]}, 'public_addr': '172.21.15.63:6801/866448188', 'cluster_addr': '172.21.15.63:6803/866448188', 'heartbeat_back_addr': '172.21.15.63:6807/866448188', 'heartbeat_front_addr': '172.21.15.63:6805/866448188', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f23c8af2-7fa2-4e43-99de-7bf2670b72ce', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6816', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6817', 'nonce': 4130213561}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6818', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6819', 'nonce': 4130213561}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6822', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6823', 'nonce': 4130213561}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6820', 'nonce': 4130213561}, {'type': 'v1', 'addr': '172.21.15.63:6821', 'nonce': 4130213561}]}, 'public_addr': '172.21.15.63:6817/4130213561', 'cluster_addr': '172.21.15.63:6819/4130213561', 'heartbeat_back_addr': '172.21.15.63:6823/4130213561', 'heartbeat_front_addr': '172.21.15.63:6821/4130213561', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '0b6a2786-33e7-4286-92f4-e8d25573149a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6808', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6809', 'nonce': 2574114576}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6810', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6811', 'nonce': 2574114576}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6814', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6815', 'nonce': 2574114576}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6812', 'nonce': 2574114576}, {'type': 'v1', 'addr': '172.21.15.63:6813', 'nonce': 2574114576}]}, 'public_addr': '172.21.15.63:6809/2574114576', 'cluster_addr': '172.21.15.63:6811/2574114576', 'heartbeat_back_addr': '172.21.15.63:6815/2574114576', 'heartbeat_front_addr': '172.21.15.63:6813/2574114576', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'cdd5dfe1-3893-42ee-8706-50ef5c92ac9f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6808', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6809', 'nonce': 946317737}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6810', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6811', 'nonce': 946317737}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6814', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6815', 'nonce': 946317737}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6812', 'nonce': 946317737}, {'type': 'v1', 'addr': '172.21.15.119:6813', 'nonce': 946317737}]}, 'public_addr': '172.21.15.119:6809/946317737', 'cluster_addr': '172.21.15.119:6811/946317737', 'heartbeat_back_addr': '172.21.15.119:6815/946317737', 'heartbeat_front_addr': '172.21.15.119:6813/946317737', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '442157e7-0a20-45b7-a3b6-f4a930643516', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6824', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6825', 'nonce': 4151470176}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6826', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6827', 'nonce': 4151470176}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6830', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6831', 'nonce': 4151470176}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6828', 'nonce': 4151470176}, {'type': 'v1', 'addr': '172.21.15.119:6829', 'nonce': 4151470176}]}, 'public_addr': '172.21.15.119:6825/4151470176', 'cluster_addr': '172.21.15.119:6827/4151470176', 'heartbeat_back_addr': '172.21.15.119:6831/4151470176', 'heartbeat_front_addr': '172.21.15.119:6829/4151470176', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0f1cd9bc-aafa-4004-b7e5-6ea6e409d398', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6816', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6817', 'nonce': 2029574290}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6818', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6819', 'nonce': 2029574290}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6822', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6823', 'nonce': 2029574290}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6820', 'nonce': 2029574290}, {'type': 'v1', 'addr': '172.21.15.119:6821', 'nonce': 2029574290}]}, 'public_addr': '172.21.15.119:6817/2029574290', 'cluster_addr': '172.21.15.119:6819/2029574290', 'heartbeat_back_addr': '172.21.15.119:6823/2029574290', 'heartbeat_front_addr': '172.21.15.119:6821/2029574290', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'ac41ac05-d082-43f8-93ec-ba27bf53fd08', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6800', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6801', 'nonce': 3494373582}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6802', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6803', 'nonce': 3494373582}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6806', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6807', 'nonce': 3494373582}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6804', 'nonce': 3494373582}, {'type': 'v1', 'addr': '172.21.15.119:6805', 'nonce': 3494373582}]}, 'public_addr': '172.21.15.119:6801/3494373582', 'cluster_addr': '172.21.15.119:6803/3494373582', 'heartbeat_back_addr': '172.21.15.119:6807/3494373582', 'heartbeat_front_addr': '172.21.15.119:6805/3494373582', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.481445+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.975485+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.719623+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.227734+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:49.777737+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.183864+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:50.071981+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-12T02:56:49.830810+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.d', 'mappings': [{'from': 7, 'to': 1}]}, {'pgid': '3.19', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '3.36', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '4.3', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'cephfs_data_ec': {'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'jerasure-per-chunk-alignment': 'false', 'k': '2', 'm': '2', 'plugin': 'jerasure', 'technique': 'reed_sol_van', 'w': '8'}, 'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-12T02:58:14.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:58:14.857 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:14.849+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.107313125999994, 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.858 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:14.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.861 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:14.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:14.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.964117787999996, 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.865 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:14.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:14.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:14.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.964097261999996, 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.871 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:14.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.963986449000004, 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:14.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:14.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:14.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.963964923000006, 2024-09-12T02:58:14.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:14.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.898978276999998, 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.888 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:14.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:14.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.676874753999996, 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.894 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:14.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:14.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.899 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.676737763000006, 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.900 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:14.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.675620561000002, 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.906 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:14.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:14.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:14.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:14.911 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.675548448000001, 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.912 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:14.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.916 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:14.917 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.675324463999999, 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:14.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:14.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.675254480999996, 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:14.923 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:14.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:14.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.675148844000006, 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.929 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:14.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:14.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.674958747000005, 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.935 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:14.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:14.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.940 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.674891959999997, 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:14.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:14.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.946 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 78.099542362999998, 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:14.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.000842929000001, 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:14.952 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:14.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:14.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.957 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.000757687000004, 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:14.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:14.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:14.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:14.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:14.963 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.000620573000006, 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.965 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:14.966 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:14.967 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:14.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:14.969 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.000450674000007, 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:14.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:14.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:14.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:14.973 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:14.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:14.976 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:14.973+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:15.013 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T02:58:15.076 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:15.071+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:15.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.125+0000 7f07cb200640 1 Processor -- start 2024-09-12T02:58:15.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07cb200640 1 -- start start 2024-09-12T02:58:15.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07cb200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07cc154b00 0x7f07cc0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07cb200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0c8eb0 0x7f07cc071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07cb200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc15dec0 con 0x7f07cc0cb670 2024-09-12T02:58:15.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07cb200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f07cc15ead0 con 0x7f07cc154b00 2024-09-12T02:58:15.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07cb200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f07cc15e1a0 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07ca800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f07cc0cb670 0x7f07cc15a8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41330/0 (socket says 172.21.15.63:41330) 2024-09-12T02:58:15.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07c9e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07cc154b00 0x7f07cc0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07ca800640 1 -- 172.21.15.63:0/3058399653 learned_addr learned my addr 172.21.15.63:0/3058399653 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:15.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07c9400640 1 --2- 172.21.15.63:0/3058399653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0c8eb0 0x7f07cc071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07c8a00640 1 -- 172.21.15.63:0/3058399653 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164490758 0 0) 0x7f07cc15dec0 con 0x7f07cc0cb670 2024-09-12T02:58:15.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07c9e00640 1 -- 172.21.15.63:0/3058399653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0c8eb0 msgr2=0x7f07cc071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:15.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07c9e00640 1 --2- 172.21.15.63:0/3058399653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0c8eb0 0x7f07cc071450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07c9e00640 1 -- 172.21.15.63:0/3058399653 >> v1:172.21.15.63:6789/0 conn(0x7f07cc0cb670 legacy=0x7f07cc15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.129+0000 7f07c9e00640 1 -- 172.21.15.63:0/3058399653 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc15e480 con 0x7f07cc154b00 2024-09-12T02:58:15.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.133+0000 7f07c9e00640 1 --2- 172.21.15.63:0/3058399653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc154b00 0x7f07cc0c97c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0097c0 tx=0x7f07bc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655c4ecb8903a03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.133+0000 7f07c8a00640 1 -- 172.21.15.63:0/3058399653 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0b5070 con 0x7f07cc154b00 2024-09-12T02:58:15.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.133+0000 7f07c8a00640 1 -- 172.21.15.63:0/3058399653 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07bc0a8990 con 0x7f07cc154b00 2024-09-12T02:58:15.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.133+0000 7f07c8a00640 1 -- 172.21.15.63:0/3058399653 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0a8d60 con 0x7f07cc154b00 2024-09-12T02:58:15.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 -- 172.21.15.63:0/3058399653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc154b00 msgr2=0x7f07cc0c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 --2- 172.21.15.63:0/3058399653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc154b00 0x7f07cc0c97c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0097c0 tx=0x7f07bc01ec90 comp rx=0 tx=0).stop 2024-09-12T02:58:15.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 -- 172.21.15.63:0/3058399653 shutdown_connections 2024-09-12T02:58:15.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 --2- 172.21.15.63:0/3058399653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0c8eb0 0x7f07cc071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 --2- 172.21.15.63:0/3058399653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc154b00 0x7f07cc0c97c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 -- 172.21.15.63:0/3058399653 >> 172.21.15.63:0/3058399653 conn(0x7f07cc06f6e0 msgr2=0x7f07cc06faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:15.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 -- 172.21.15.63:0/3058399653 shutdown_connections 2024-09-12T02:58:15.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 -- 172.21.15.63:0/3058399653 wait complete. 2024-09-12T02:58:15.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 Processor -- start 2024-09-12T02:58:15.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.137+0000 7f07cb200640 1 -- start start 2024-09-12T02:58:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07cb200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc0c8eb0 0x7f07cc14b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07cb200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0cb670 0x7f07cc0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07cb200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc154b00 0x7f07cc0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07cb200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc15afb0 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07cb200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc0c8b70 con 0x7f07cc154b00 2024-09-12T02:58:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07cb200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f07cc15b130 con 0x7f07cc0cb670 2024-09-12T02:58:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc0c8eb0 0x7f07cc14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc0c8eb0 0x7f07cc14b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37816/0 (socket says 172.21.15.63:37816) 2024-09-12T02:58:15.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9e00640 1 -- 172.21.15.63:0/1969254466 learned_addr learned my addr 172.21.15.63:0/1969254466 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:15.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9400640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0cb670 0x7f07cc0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07ca800640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc154b00 0x7f07cc0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9e00640 1 -- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0cb670 msgr2=0x7f07cc0afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9e00640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0cb670 0x7f07cc0afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9e00640 1 -- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc154b00 msgr2=0x7f07cc0b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9e00640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc154b00 0x7f07cc0b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9e00640 1 -- 172.21.15.63:0/1969254466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc0cc260 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c9e00640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc0c8eb0 0x7f07cc14b040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0b3040 tx=0x7f07bc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c2000640 1 -- 172.21.15.63:0/1969254466 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0c0070 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c2000640 1 -- 172.21.15.63:0/1969254466 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07bc004230 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07cc0cdc90 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07c2000640 1 -- 172.21.15.63:0/1969254466 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0b5040 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.141+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07cc0ce250 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.145+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07cc0c97c0 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.145+0000 7f07c2000640 1 -- 172.21.15.63:0/1969254466 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07bc0c3070 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.145+0000 7f07c2000640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07ac0678c0 0x7f07ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.149+0000 7f07c2000640 1 -- 172.21.15.63:0/1969254466 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6648+0+0 (secure 0 0 0) 0x7f07bc1228e0 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.149+0000 7f07c9400640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07ac0678c0 0x7f07ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.149+0000 7f07c9400640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07ac0678c0 0x7f07ac069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0c8740 tx=0x7f07b8009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.149+0000 7f07c2000640 1 -- 172.21.15.63:0/1969254466 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f07bc0187f0 con 0x7f07cc0c8eb0 2024-09-12T02:58:15.177 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:15.173+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:15.187 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:15.187 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:15.187 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:15.187 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:15.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.185+0000 7f501ce00640 1 Processor -- start 2024-09-12T02:58:15.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.185+0000 7f501ce00640 1 -- start start 2024-09-12T02:58:15.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f501ce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50180c8990 0x7f50180c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f501ce00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50180c8d70 0x7f5018070420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f501ce00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5018067ba0 con 0x7f5018159300 2024-09-12T02:58:15.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f501ce00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f50180c7780 con 0x7f50180c8990 2024-09-12T02:58:15.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f501ce00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5018070960 con 0x7f50180c8d70 2024-09-12T02:58:15.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5016a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50180c8d70 0x7f5018070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5017e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5018159300 0x7f5018152370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41332/0 (socket says 172.21.15.63:41332) 2024-09-12T02:58:15.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5017e00640 1 -- 172.21.15.63:0/2961436872 learned_addr learned my addr 172.21.15.63:0/2961436872 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:15.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5017400640 1 --2- 172.21.15.63:0/2961436872 >> v2:172.21.15.63:3300/0 conn(0x7f50180c8990 0x7f50180c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5017400640 1 -- 172.21.15.63:0/2961436872 >> v2:172.21.15.119:3300/0 conn(0x7f50180c8d70 msgr2=0x7f5018070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:15.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5016000640 1 -- 172.21.15.63:0/2961436872 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558485039 0 0) 0x7f5018067ba0 con 0x7f5018159300 2024-09-12T02:58:15.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5017400640 1 --2- 172.21.15.63:0/2961436872 >> v2:172.21.15.119:3300/0 conn(0x7f50180c8d70 0x7f5018070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5017400640 1 -- 172.21.15.63:0/2961436872 >> v1:172.21.15.63:6789/0 conn(0x7f5018159300 legacy=0x7f5018152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5017400640 1 -- 172.21.15.63:0/2961436872 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5018067e40 con 0x7f50180c8990 2024-09-12T02:58:15.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.189+0000 7f5016a00640 1 --2- 172.21.15.63:0/2961436872 >> v2:172.21.15.119:3300/0 conn(0x7f50180c8d70 0x7f5018070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:15.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f5017400640 1 --2- 172.21.15.63:0/2961436872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50180c8990 0x7f50180c7240 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f50180c34a0 tx=0x7f500801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c114f3c389a2eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f5016000640 1 -- 172.21.15.63:0/2961436872 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080b0070 con 0x7f50180c8990 2024-09-12T02:58:15.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f5016000640 1 -- 172.21.15.63:0/2961436872 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50080ab600 con 0x7f50180c8990 2024-09-12T02:58:15.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f5016000640 1 -- 172.21.15.63:0/2961436872 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080ab9d0 con 0x7f50180c8990 2024-09-12T02:58:15.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f501ce00640 1 -- 172.21.15.63:0/2961436872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50180c8990 msgr2=0x7f50180c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f501ce00640 1 --2- 172.21.15.63:0/2961436872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50180c8990 0x7f50180c7240 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f50180c34a0 tx=0x7f500801c3f0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f501ce00640 1 -- 172.21.15.63:0/2961436872 shutdown_connections 2024-09-12T02:58:15.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f501ce00640 1 --2- 172.21.15.63:0/2961436872 >> v2:172.21.15.119:3300/0 conn(0x7f50180c8d70 0x7f5018070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f501ce00640 1 --2- 172.21.15.63:0/2961436872 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50180c8990 0x7f50180c7240 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f501ce00640 1 -- 172.21.15.63:0/2961436872 >> 172.21.15.63:0/2961436872 conn(0x7f501806f900 msgr2=0x7f501806fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:15.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f501ce00640 1 -- 172.21.15.63:0/2961436872 shutdown_connections 2024-09-12T02:58:15.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.193+0000 7f501ce00640 1 -- 172.21.15.63:0/2961436872 wait complete. 2024-09-12T02:58:15.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.197+0000 7f501ce00640 1 Processor -- start 2024-09-12T02:58:15.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.197+0000 7f501ce00640 1 -- start start 2024-09-12T02:58:15.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.197+0000 7f501ce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50180c8990 0x7f50181570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.197+0000 7f501ce00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50180c8d70 0x7f50180729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.197+0000 7f501ce00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5018159300 0x7f50181f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.197+0000 7f501ce00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f501806d860 con 0x7f5018159300 2024-09-12T02:58:15.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.197+0000 7f501ce00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f501806d6e0 con 0x7f50180c8990 2024-09-12T02:58:15.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.197+0000 7f501ce00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f50181657b0 con 0x7f50180c8d70 2024-09-12T02:58:15.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5018159300 0x7f50181f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5016a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50180c8d70 0x7f50180729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50180c8990 0x7f50181570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5018159300 0x7f50181f3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37836/0 (socket says 172.21.15.63:37836) 2024-09-12T02:58:15.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017e00640 1 -- 172.21.15.63:0/1060280412 learned_addr learned my addr 172.21.15.63:0/1060280412 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:15.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017e00640 1 -- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50180c8d70 msgr2=0x7f50180729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017e00640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50180c8d70 0x7f50180729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017e00640 1 -- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50180c8990 msgr2=0x7f50181570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017e00640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50180c8990 0x7f50181570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017e00640 1 -- 172.21.15.63:0/1060280412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50181f7600 con 0x7f5018159300 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017400640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50180c8990 0x7f50181570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f5017e00640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5018159300 0x7f50181f3c90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f501000c780 tx=0x7f501000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f500f400640 1 -- 172.21.15.63:0/1060280412 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010018070 con 0x7f5018159300 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f500f400640 1 -- 172.21.15.63:0/1060280412 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501000a640 con 0x7f5018159300 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f500f400640 1 -- 172.21.15.63:0/1060280412 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501000aa30 con 0x7f5018159300 2024-09-12T02:58:15.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50181f78b0 con 0x7f5018159300 2024-09-12T02:58:15.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5018153440 con 0x7f5018159300 2024-09-12T02:58:15.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.201+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50180c7240 con 0x7f5018159300 2024-09-12T02:58:15.208 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:15.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.205+0000 7f500f400640 1 -- 172.21.15.63:0/1060280412 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f501000abd0 con 0x7f5018159300 2024-09-12T02:58:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.205+0000 7f500f400640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ff80678c0 0x7f4ff8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.205+0000 7f500f400640 1 -- 172.21.15.63:0/1060280412 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6648+0+0 (secure 0 0 0) 0x7f5010085510 con 0x7f5018159300 2024-09-12T02:58:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.205+0000 7f5017400640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ff80678c0 0x7f4ff8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.205+0000 7f5017400640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ff80678c0 0x7f4ff8069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f50080ad000 tx=0x7f50080a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.213+0000 7f500f400640 1 -- 172.21.15.63:0/1060280412 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f50100555b0 con 0x7f5018159300 2024-09-12T02:58:15.278 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:15.275+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:15.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.333+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07cc1e4060 con 0x7f07ac0678c0 2024-09-12T02:58:15.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.353+0000 7f07c2000640 1 -- 172.21.15.63:0/1969254466 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332655 (secure 0 0 0) 0x7f07cc1e4060 con 0x7f07ac0678c0 2024-09-12T02:58:15.361 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:58:15.363 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:58:15.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.357+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07ac0678c0 msgr2=0x7f07ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.357+0000 7f07cb200640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07ac0678c0 0x7f07ac069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0c8740 tx=0x7f07b8009190 comp rx=0 tx=0).stop 2024-09-12T02:58:15.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.357+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc0c8eb0 msgr2=0x7f07cc14b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.357+0000 7f07cb200640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc0c8eb0 0x7f07cc14b040 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0b3040 tx=0x7f07bc01ba30 comp rx=0 tx=0).stop 2024-09-12T02:58:15.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.361+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 shutdown_connections 2024-09-12T02:58:15.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.361+0000 7f07cb200640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07cc154b00 0x7f07cc0b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.361+0000 7f07cb200640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07ac0678c0 0x7f07ac069d80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.361+0000 7f07cb200640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07cc0cb670 0x7f07cc0afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.361+0000 7f07cb200640 1 --2- 172.21.15.63:0/1969254466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07cc0c8eb0 0x7f07cc14b040 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.361+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 >> 172.21.15.63:0/1969254466 conn(0x7f07cc06f6e0 msgr2=0x7f07cc0c3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:15.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.361+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 shutdown_connections 2024-09-12T02:58:15.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.361+0000 7f07cb200640 1 -- 172.21.15.63:0/1969254466 wait complete. 2024-09-12T02:58:15.373 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:15.373 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:15.374 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:15.374 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:15.379 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:15.375+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:15.384 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-09-12T02:58:13.772372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":90,"num_keys_recovered":1,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221192,"kb_used_data":4964,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753528,"statfs":{"total":773094113280,"available":772867612672,"internally_reserved":0,"allocated":5083136,"data_stored":2992010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":90,"num_keys_recovered":1,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.803364"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":56,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335594+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:58:07.335594+0000","last_peered":"2024-09-12T02:58:07.335594+0000","last_clean":"2024-09-12T02:58:07.335594+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:58:07.335594+0000","last_undegraded":"2024-09-12T02:58:07.335594+0000","last_fullsized":"2024-09-12T02:58:07.335594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333191+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:58:07.333191+0000","last_peered":"2024-09-12T02:58:07.333191+0000","last_clean":"2024-09-12T02:58:07.333191+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:58:07.333191+0000","last_undegraded":"2024-09-12T02:58:07.333191+0000","last_fullsized":"2024-09-12T02:58:07.333191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333495+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:58:07.333495+0000","last_peered":"2024-09-12T02:58:07.333495+0000","last_clean":"2024-09-12T02:58:07.333495+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:58:07.333495+0000","last_undegraded":"2024-09-12T02:58:07.333495+0000","last_fullsized":"2024-09-12T02:58:07.333495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333332+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:58:07.333332+0000","last_peered":"2024-09-12T02:58:07.333332+0000","last_clean":"2024-09-12T02:58:07.333332+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:58:07.333332+0000","last_undegraded":"2024-09-12T02:58:07.333332+0000","last_fullsized":"2024-09-12T02:58:07.333332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":50,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335507+0000","last_change":"2024-09-12T02:57:04.882473+0000","last_active":"2024-09-12T02:58:07.335507+0000","last_peered":"2024-09-12T02:58:07.335507+0000","last_clean":"2024-09-12T02:58:07.335507+0000","last_became_active":"2024-09-12T02:57:04.882182+0000","last_became_peered":"2024-09-12T02:57:04.882182+0000","last_unstale":"2024-09-12T02:58:07.335507+0000","last_undegraded":"2024-09-12T02:58:07.335507+0000","last_fullsized":"2024-09-12T02:58:07.335507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":64,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.994517+0000","last_change":"2024-09-12T02:58:04.912028+0000","last_active":"2024-09-12T02:58:12.994517+0000","last_peered":"2024-09-12T02:58:12.994517+0000","last_clean":"2024-09-12T02:58:12.994517+0000","last_became_active":"2024-09-12T02:58:04.910772+0000","last_became_peered":"2024-09-12T02:58:04.910772+0000","last_unstale":"2024-09-12T02:58:12.994517+0000","last_undegraded":"2024-09-12T02:58:12.994517+0000","last_fullsized":"2024-09-12T02:58:12.994517+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:12.643176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0,3],"acting":[4,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996789+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:58:12.996789+0000","last_peered":"2024-09-12T02:58:12.996789+0000","last_clean":"2024-09-12T02:58:12.996789+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:58:12.996789+0000","last_undegraded":"2024-09-12T02:58:12.996789+0000","last_fullsized":"2024-09-12T02:58:12.996789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.049312+0000","last_change":"2024-09-12T02:57:04.875312+0000","last_active":"2024-09-12T02:58:13.049312+0000","last_peered":"2024-09-12T02:58:13.049312+0000","last_clean":"2024-09-12T02:58:13.049312+0000","last_became_active":"2024-09-12T02:57:04.863748+0000","last_became_peered":"2024-09-12T02:57:04.863748+0000","last_unstale":"2024-09-12T02:58:13.049312+0000","last_undegraded":"2024-09-12T02:58:13.049312+0000","last_fullsized":"2024-09-12T02:58:13.049312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:39.786346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995702+0000","last_change":"2024-09-12T02:58:04.911785+0000","last_active":"2024-09-12T02:58:12.995702+0000","last_peered":"2024-09-12T02:58:12.995702+0000","last_clean":"2024-09-12T02:58:12.995702+0000","last_became_active":"2024-09-12T02:58:04.910102+0000","last_became_peered":"2024-09-12T02:58:04.910102+0000","last_unstale":"2024-09-12T02:58:12.995702+0000","last_undegraded":"2024-09-12T02:58:12.995702+0000","last_fullsized":"2024-09-12T02:58:12.995702+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:19.453937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.997539+0000","last_change":"2024-09-12T02:57:03.832933+0000","last_active":"2024-09-12T02:58:12.997539+0000","last_peered":"2024-09-12T02:58:12.997539+0000","last_clean":"2024-09-12T02:58:12.997539+0000","last_became_active":"2024-09-12T02:57:03.832253+0000","last_became_peered":"2024-09-12T02:57:03.832253+0000","last_unstale":"2024-09-12T02:58:12.997539+0000","last_undegraded":"2024-09-12T02:58:12.997539+0000","last_fullsized":"2024-09-12T02:58:12.997539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.046204+0000","last_change":"2024-09-12T02:57:04.880036+0000","last_active":"2024-09-12T02:58:13.046204+0000","last_peered":"2024-09-12T02:58:13.046204+0000","last_clean":"2024-09-12T02:58:13.046204+0000","last_became_active":"2024-09-12T02:57:04.879490+0000","last_became_peered":"2024-09-12T02:57:04.879490+0000","last_unstale":"2024-09-12T02:58:13.046204+0000","last_undegraded":"2024-09-12T02:58:13.046204+0000","last_fullsized":"2024-09-12T02:58:13.046204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:49.579939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":50,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.994828+0000","last_change":"2024-09-12T02:57:08.890508+0000","last_active":"2024-09-12T02:58:12.994828+0000","last_peered":"2024-09-12T02:58:12.994828+0000","last_clean":"2024-09-12T02:58:12.994828+0000","last_became_active":"2024-09-12T02:57:08.886515+0000","last_became_peered":"2024-09-12T02:57:08.886515+0000","last_unstale":"2024-09-12T02:58:12.994828+0000","last_undegraded":"2024-09-12T02:58:12.994828+0000","last_fullsized":"2024-09-12T02:58:12.994828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:28.963220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.044824+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:58:13.044824+0000","last_peered":"2024-09-12T02:58:13.044824+0000","last_clean":"2024-09-12T02:58:13.044824+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:58:13.044824+0000","last_undegraded":"2024-09-12T02:58:13.044824+0000","last_fullsized":"2024-09-12T02:58:13.044824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.997253+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:58:12.997253+0000","last_peered":"2024-09-12T02:58:12.997253+0000","last_clean":"2024-09-12T02:58:12.997253+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:58:12.997253+0000","last_undegraded":"2024-09-12T02:58:12.997253+0000","last_fullsized":"2024-09-12T02:58:12.997253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995688+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:58:12.995688+0000","last_peered":"2024-09-12T02:58:12.995688+0000","last_clean":"2024-09-12T02:58:12.995688+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:58:12.995688+0000","last_undegraded":"2024-09-12T02:58:12.995688+0000","last_fullsized":"2024-09-12T02:58:12.995688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334128+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:58:07.334128+0000","last_peered":"2024-09-12T02:58:07.334128+0000","last_clean":"2024-09-12T02:58:07.334128+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:58:07.334128+0000","last_undegraded":"2024-09-12T02:58:07.334128+0000","last_fullsized":"2024-09-12T02:58:07.334128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333285+0000","last_change":"2024-09-12T02:58:04.908275+0000","last_active":"2024-09-12T02:58:07.333285+0000","last_peered":"2024-09-12T02:58:07.333285+0000","last_clean":"2024-09-12T02:58:07.333285+0000","last_became_active":"2024-09-12T02:58:04.907988+0000","last_became_peered":"2024-09-12T02:58:04.907988+0000","last_unstale":"2024-09-12T02:58:07.333285+0000","last_undegraded":"2024-09-12T02:58:07.333285+0000","last_fullsized":"2024-09-12T02:58:07.333285+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:23.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":50,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995328+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:58:12.995328+0000","last_peered":"2024-09-12T02:58:12.995328+0000","last_clean":"2024-09-12T02:58:12.995328+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:58:12.995328+0000","last_undegraded":"2024-09-12T02:58:12.995328+0000","last_fullsized":"2024-09-12T02:58:12.995328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":56,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335189+0000","last_change":"2024-09-12T02:58:04.900619+0000","last_active":"2024-09-12T02:58:07.335189+0000","last_peered":"2024-09-12T02:58:07.335189+0000","last_clean":"2024-09-12T02:58:07.335189+0000","last_became_active":"2024-09-12T02:58:04.900300+0000","last_became_peered":"2024-09-12T02:58:04.900300+0000","last_unstale":"2024-09-12T02:58:07.335189+0000","last_undegraded":"2024-09-12T02:58:07.335189+0000","last_fullsized":"2024-09-12T02:58:07.335189+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:38.826721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":54,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:58:10.232586+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:58:10.232586+0000","last_peered":"2024-09-12T02:58:10.232586+0000","last_clean":"2024-09-12T02:58:10.232586+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:58:10.232586+0000","last_undegraded":"2024-09-12T02:58:10.232586+0000","last_fullsized":"2024-09-12T02:58:10.232586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:58:10.233034+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:58:10.233034+0000","last_peered":"2024-09-12T02:58:10.233034+0000","last_clean":"2024-09-12T02:58:10.233034+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:58:10.233034+0000","last_undegraded":"2024-09-12T02:58:10.233034+0000","last_fullsized":"2024-09-12T02:58:10.233034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995424+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:58:12.995424+0000","last_peered":"2024-09-12T02:58:12.995424+0000","last_clean":"2024-09-12T02:58:12.995424+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:58:12.995424+0000","last_undegraded":"2024-09-12T02:58:12.995424+0000","last_fullsized":"2024-09-12T02:58:12.995424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996530+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:58:12.996530+0000","last_peered":"2024-09-12T02:58:12.996530+0000","last_clean":"2024-09-12T02:58:12.996530+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:58:12.996530+0000","last_undegraded":"2024-09-12T02:58:12.996530+0000","last_fullsized":"2024-09-12T02:58:12.996530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.997256+0000","last_change":"2024-09-12T02:58:04.912695+0000","last_active":"2024-09-12T02:58:12.997256+0000","last_peered":"2024-09-12T02:58:12.997256+0000","last_clean":"2024-09-12T02:58:12.997256+0000","last_became_active":"2024-09-12T02:58:04.912233+0000","last_became_peered":"2024-09-12T02:58:04.912233+0000","last_unstale":"2024-09-12T02:58:12.997256+0000","last_undegraded":"2024-09-12T02:58:12.997256+0000","last_fullsized":"2024-09-12T02:58:12.997256+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:48.065804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,5],"acting":[4,3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335270+0000","last_change":"2024-09-12T02:58:04.910644+0000","last_active":"2024-09-12T02:58:07.335270+0000","last_peered":"2024-09-12T02:58:07.335270+0000","last_clean":"2024-09-12T02:58:07.335270+0000","last_became_active":"2024-09-12T02:58:04.910354+0000","last_became_peered":"2024-09-12T02:58:04.910354+0000","last_unstale":"2024-09-12T02:58:07.335270+0000","last_undegraded":"2024-09-12T02:58:07.335270+0000","last_fullsized":"2024-09-12T02:58:07.335270+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:33.761782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.046537+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:58:13.046537+0000","last_peered":"2024-09-12T02:58:13.046537+0000","last_clean":"2024-09-12T02:58:13.046537+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:58:13.046537+0000","last_undegraded":"2024-09-12T02:58:13.046537+0000","last_fullsized":"2024-09-12T02:58:13.046537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":50,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.994975+0000","last_change":"2024-09-12T02:57:09.038564+0000","last_active":"2024-09-12T02:58:12.994975+0000","last_peered":"2024-09-12T02:58:12.994975+0000","last_clean":"2024-09-12T02:58:12.994975+0000","last_became_active":"2024-09-12T02:57:09.036310+0000","last_became_peered":"2024-09-12T02:57:09.036310+0000","last_unstale":"2024-09-12T02:58:12.994975+0000","last_undegraded":"2024-09-12T02:58:12.994975+0000","last_fullsized":"2024-09-12T02:58:12.994975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.627698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334946+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:58:07.334946+0000","last_peered":"2024-09-12T02:58:07.334946+0000","last_clean":"2024-09-12T02:58:07.334946+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:58:07.334946+0000","last_undegraded":"2024-09-12T02:58:07.334946+0000","last_fullsized":"2024-09-12T02:58:07.334946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'2","reported_seq":46,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.046105+0000","last_change":"2024-09-12T02:58:04.914680+0000","last_active":"2024-09-12T02:58:13.046105+0000","last_peered":"2024-09-12T02:58:13.046105+0000","last_clean":"2024-09-12T02:58:13.046105+0000","last_became_active":"2024-09-12T02:58:04.904308+0000","last_became_peered":"2024-09-12T02:58:04.904308+0000","last_unstale":"2024-09-12T02:58:13.046105+0000","last_undegraded":"2024-09-12T02:58:13.046105+0000","last_fullsized":"2024-09-12T02:58:13.046105+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:02.835639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.332618+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:58:07.332618+0000","last_peered":"2024-09-12T02:58:07.332618+0000","last_clean":"2024-09-12T02:58:07.332618+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:58:07.332618+0000","last_undegraded":"2024-09-12T02:58:07.332618+0000","last_fullsized":"2024-09-12T02:58:07.332618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.332920+0000","last_change":"2024-09-12T02:58:04.903750+0000","last_active":"2024-09-12T02:58:07.332920+0000","last_peered":"2024-09-12T02:58:07.332920+0000","last_clean":"2024-09-12T02:58:07.332920+0000","last_became_active":"2024-09-12T02:58:04.903396+0000","last_became_peered":"2024-09-12T02:58:04.903396+0000","last_unstale":"2024-09-12T02:58:07.332920+0000","last_undegraded":"2024-09-12T02:58:07.332920+0000","last_fullsized":"2024-09-12T02:58:07.332920+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.997062+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:58:12.997062+0000","last_peered":"2024-09-12T02:58:12.997062+0000","last_clean":"2024-09-12T02:58:12.997062+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:58:12.997062+0000","last_undegraded":"2024-09-12T02:58:12.997062+0000","last_fullsized":"2024-09-12T02:58:12.997062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334694+0000","last_change":"2024-09-12T02:57:48.057463+0000","last_active":"2024-09-12T02:58:07.334694+0000","last_peered":"2024-09-12T02:58:07.334694+0000","last_clean":"2024-09-12T02:58:07.334694+0000","last_became_active":"2024-09-12T02:57:48.057061+0000","last_became_peered":"2024-09-12T02:57:48.057061+0000","last_unstale":"2024-09-12T02:58:07.334694+0000","last_undegraded":"2024-09-12T02:58:07.334694+0000","last_fullsized":"2024-09-12T02:58:07.334694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.916390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.046502+0000","last_change":"2024-09-12T02:57:04.861898+0000","last_active":"2024-09-12T02:58:13.046502+0000","last_peered":"2024-09-12T02:58:13.046502+0000","last_clean":"2024-09-12T02:58:13.046502+0000","last_became_active":"2024-09-12T02:57:04.858339+0000","last_became_peered":"2024-09-12T02:57:04.858339+0000","last_unstale":"2024-09-12T02:58:13.046502+0000","last_undegraded":"2024-09-12T02:58:13.046502+0000","last_fullsized":"2024-09-12T02:58:13.046502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:04.722580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334076+0000","last_change":"2024-09-12T02:58:04.902570+0000","last_active":"2024-09-12T02:58:07.334076+0000","last_peered":"2024-09-12T02:58:07.334076+0000","last_clean":"2024-09-12T02:58:07.334076+0000","last_became_active":"2024-09-12T02:58:04.902287+0000","last_became_peered":"2024-09-12T02:58:04.902287+0000","last_unstale":"2024-09-12T02:58:07.334076+0000","last_undegraded":"2024-09-12T02:58:07.334076+0000","last_fullsized":"2024-09-12T02:58:07.334076+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:31.616979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996849+0000","last_change":"2024-09-12T02:58:04.905089+0000","last_active":"2024-09-12T02:58:12.996849+0000","last_peered":"2024-09-12T02:58:12.996849+0000","last_clean":"2024-09-12T02:58:12.996849+0000","last_became_active":"2024-09-12T02:58:04.904448+0000","last_became_peered":"2024-09-12T02:58:04.904448+0000","last_unstale":"2024-09-12T02:58:12.996849+0000","last_undegraded":"2024-09-12T02:58:12.996849+0000","last_fullsized":"2024-09-12T02:58:12.996849+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:21.425284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,0],"acting":[7,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996161+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:58:12.996161+0000","last_peered":"2024-09-12T02:58:12.996161+0000","last_clean":"2024-09-12T02:58:12.996161+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:58:12.996161+0000","last_undegraded":"2024-09-12T02:58:12.996161+0000","last_fullsized":"2024-09-12T02:58:12.996161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.047948+0000","last_change":"2024-09-12T02:57:03.802797+0000","last_active":"2024-09-12T02:58:13.047948+0000","last_peered":"2024-09-12T02:58:13.047948+0000","last_clean":"2024-09-12T02:58:13.047948+0000","last_became_active":"2024-09-12T02:57:03.798969+0000","last_became_peered":"2024-09-12T02:57:03.798969+0000","last_unstale":"2024-09-12T02:58:13.047948+0000","last_undegraded":"2024-09-12T02:58:13.047948+0000","last_fullsized":"2024-09-12T02:58:13.047948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:21.025589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.997264+0000","last_change":"2024-09-12T02:58:04.903223+0000","last_active":"2024-09-12T02:58:12.997264+0000","last_peered":"2024-09-12T02:58:12.997264+0000","last_clean":"2024-09-12T02:58:12.997264+0000","last_became_active":"2024-09-12T02:58:04.902698+0000","last_became_peered":"2024-09-12T02:58:04.902698+0000","last_unstale":"2024-09-12T02:58:12.997264+0000","last_undegraded":"2024-09-12T02:58:12.997264+0000","last_fullsized":"2024-09-12T02:58:12.997264+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:09.765370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":52,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:58:10.232651+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:58:10.232651+0000","last_peered":"2024-09-12T02:58:10.232651+0000","last_clean":"2024-09-12T02:58:10.232651+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:58:10.232651+0000","last_undegraded":"2024-09-12T02:58:10.232651+0000","last_fullsized":"2024-09-12T02:58:10.232651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333286+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:58:07.333286+0000","last_peered":"2024-09-12T02:58:07.333286+0000","last_clean":"2024-09-12T02:58:07.333286+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:58:07.333286+0000","last_undegraded":"2024-09-12T02:58:07.333286+0000","last_fullsized":"2024-09-12T02:58:07.333286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.997523+0000","last_change":"2024-09-12T02:58:04.902418+0000","last_active":"2024-09-12T02:58:12.997523+0000","last_peered":"2024-09-12T02:58:12.997523+0000","last_clean":"2024-09-12T02:58:12.997523+0000","last_became_active":"2024-09-12T02:58:04.901884+0000","last_became_peered":"2024-09-12T02:58:04.901884+0000","last_unstale":"2024-09-12T02:58:12.997523+0000","last_undegraded":"2024-09-12T02:58:12.997523+0000","last_fullsized":"2024-09-12T02:58:12.997523+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:47.476695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,3],"acting":[7,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":50,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333454+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:58:07.333454+0000","last_peered":"2024-09-12T02:58:07.333454+0000","last_clean":"2024-09-12T02:58:07.333454+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:58:07.333454+0000","last_undegraded":"2024-09-12T02:58:07.333454+0000","last_fullsized":"2024-09-12T02:58:07.333454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996634+0000","last_change":"2024-09-12T02:58:04.903530+0000","last_active":"2024-09-12T02:58:12.996634+0000","last_peered":"2024-09-12T02:58:12.996634+0000","last_clean":"2024-09-12T02:58:12.996634+0000","last_became_active":"2024-09-12T02:58:04.902890+0000","last_became_peered":"2024-09-12T02:58:04.902890+0000","last_unstale":"2024-09-12T02:58:12.996634+0000","last_undegraded":"2024-09-12T02:58:12.996634+0000","last_fullsized":"2024-09-12T02:58:12.996634+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:14.525948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335093+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:58:07.335093+0000","last_peered":"2024-09-12T02:58:07.335093+0000","last_clean":"2024-09-12T02:58:07.335093+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:58:07.335093+0000","last_undegraded":"2024-09-12T02:58:07.335093+0000","last_fullsized":"2024-09-12T02:58:07.335093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333194+0000","last_change":"2024-09-12T02:57:04.882517+0000","last_active":"2024-09-12T02:58:07.333194+0000","last_peered":"2024-09-12T02:58:07.333194+0000","last_clean":"2024-09-12T02:58:07.333194+0000","last_became_active":"2024-09-12T02:57:04.882159+0000","last_became_peered":"2024-09-12T02:57:04.882159+0000","last_unstale":"2024-09-12T02:58:07.333194+0000","last_undegraded":"2024-09-12T02:58:07.333194+0000","last_fullsized":"2024-09-12T02:58:07.333194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.048456+0000","last_change":"2024-09-12T02:57:03.798773+0000","last_active":"2024-09-12T02:58:13.048456+0000","last_peered":"2024-09-12T02:58:13.048456+0000","last_clean":"2024-09-12T02:58:13.048456+0000","last_became_active":"2024-09-12T02:57:03.797799+0000","last_became_peered":"2024-09-12T02:57:03.797799+0000","last_unstale":"2024-09-12T02:58:13.048456+0000","last_undegraded":"2024-09-12T02:58:13.048456+0000","last_fullsized":"2024-09-12T02:58:13.048456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":213,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996728+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:58:12.996728+0000","last_peered":"2024-09-12T02:58:12.996728+0000","last_clean":"2024-09-12T02:58:12.996728+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:58:12.996728+0000","last_undegraded":"2024-09-12T02:58:12.996728+0000","last_fullsized":"2024-09-12T02:58:12.996728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.044752+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:58:13.044752+0000","last_peered":"2024-09-12T02:58:13.044752+0000","last_clean":"2024-09-12T02:58:13.044752+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:58:13.044752+0000","last_undegraded":"2024-09-12T02:58:13.044752+0000","last_fullsized":"2024-09-12T02:58:13.044752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:58:10.232851+0000","last_change":"2024-09-12T02:57:47.799311+0000","last_active":"2024-09-12T02:58:10.232851+0000","last_peered":"2024-09-12T02:58:10.232851+0000","last_clean":"2024-09-12T02:58:10.232851+0000","last_became_active":"2024-09-12T02:57:47.798962+0000","last_became_peered":"2024-09-12T02:57:47.798962+0000","last_unstale":"2024-09-12T02:58:10.232851+0000","last_undegraded":"2024-09-12T02:58:10.232851+0000","last_fullsized":"2024-09-12T02:58:10.232851+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:50.572922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333007+0000","last_change":"2024-09-12T02:57:03.798239+0000","last_active":"2024-09-12T02:58:07.333007+0000","last_peered":"2024-09-12T02:58:07.333007+0000","last_clean":"2024-09-12T02:58:07.333007+0000","last_became_active":"2024-09-12T02:57:03.797935+0000","last_became_peered":"2024-09-12T02:57:03.797935+0000","last_unstale":"2024-09-12T02:58:07.333007+0000","last_undegraded":"2024-09-12T02:58:07.333007+0000","last_fullsized":"2024-09-12T02:58:07.333007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.044478+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:58:13.044478+0000","last_peered":"2024-09-12T02:58:13.044478+0000","last_clean":"2024-09-12T02:58:13.044478+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:58:13.044478+0000","last_undegraded":"2024-09-12T02:58:13.044478+0000","last_fullsized":"2024-09-12T02:58:13.044478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.049558+0000","last_change":"2024-09-12T02:57:04.858809+0000","last_active":"2024-09-12T02:58:13.049558+0000","last_peered":"2024-09-12T02:58:13.049558+0000","last_clean":"2024-09-12T02:58:13.049558+0000","last_became_active":"2024-09-12T02:57:04.858048+0000","last_became_peered":"2024-09-12T02:57:04.858048+0000","last_unstale":"2024-09-12T02:58:13.049558+0000","last_undegraded":"2024-09-12T02:58:13.049558+0000","last_fullsized":"2024-09-12T02:58:13.049558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:59.698440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-12T02:58:10.233026+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:58:10.233026+0000","last_peered":"2024-09-12T02:58:10.233026+0000","last_clean":"2024-09-12T02:58:10.233026+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:58:10.233026+0000","last_undegraded":"2024-09-12T02:58:10.233026+0000","last_fullsized":"2024-09-12T02:58:10.233026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334944+0000","last_change":"2024-09-12T02:57:08.874656+0000","last_active":"2024-09-12T02:58:07.334944+0000","last_peered":"2024-09-12T02:58:07.334944+0000","last_clean":"2024-09-12T02:58:07.334944+0000","last_became_active":"2024-09-12T02:57:08.874202+0000","last_became_peered":"2024-09-12T02:57:08.874202+0000","last_unstale":"2024-09-12T02:58:07.334944+0000","last_undegraded":"2024-09-12T02:58:07.334944+0000","last_fullsized":"2024-09-12T02:58:07.334944+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.794828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.997256+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:58:12.997256+0000","last_peered":"2024-09-12T02:58:12.997256+0000","last_clean":"2024-09-12T02:58:12.997256+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:58:12.997256+0000","last_undegraded":"2024-09-12T02:58:12.997256+0000","last_fullsized":"2024-09-12T02:58:12.997256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":56,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333700+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:58:07.333700+0000","last_peered":"2024-09-12T02:58:07.333700+0000","last_clean":"2024-09-12T02:58:07.333700+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:58:07.333700+0000","last_undegraded":"2024-09-12T02:58:07.333700+0000","last_fullsized":"2024-09-12T02:58:07.333700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":50,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.044571+0000","last_change":"2024-09-12T02:57:09.030839+0000","last_active":"2024-09-12T02:58:13.044571+0000","last_peered":"2024-09-12T02:58:13.044571+0000","last_clean":"2024-09-12T02:58:13.044571+0000","last_became_active":"2024-09-12T02:57:09.029808+0000","last_became_peered":"2024-09-12T02:57:09.029808+0000","last_unstale":"2024-09-12T02:58:13.044571+0000","last_undegraded":"2024-09-12T02:58:13.044571+0000","last_fullsized":"2024-09-12T02:58:13.044571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:15.866966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996340+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:58:12.996340+0000","last_peered":"2024-09-12T02:58:12.996340+0000","last_clean":"2024-09-12T02:58:12.996340+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:58:12.996340+0000","last_undegraded":"2024-09-12T02:58:12.996340+0000","last_fullsized":"2024-09-12T02:58:12.996340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995617+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:58:12.995617+0000","last_peered":"2024-09-12T02:58:12.995617+0000","last_clean":"2024-09-12T02:58:12.995617+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:58:12.995617+0000","last_undegraded":"2024-09-12T02:58:12.995617+0000","last_fullsized":"2024-09-12T02:58:12.995617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.994534+0000","last_change":"2024-09-12T02:58:04.910740+0000","last_active":"2024-09-12T02:58:12.994534+0000","last_peered":"2024-09-12T02:58:12.994534+0000","last_clean":"2024-09-12T02:58:12.994534+0000","last_became_active":"2024-09-12T02:58:04.910161+0000","last_became_peered":"2024-09-12T02:58:04.910161+0000","last_unstale":"2024-09-12T02:58:12.994534+0000","last_undegraded":"2024-09-12T02:58:12.994534+0000","last_fullsized":"2024-09-12T02:58:12.994534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:31.485991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996390+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:58:12.996390+0000","last_peered":"2024-09-12T02:58:12.996390+0000","last_clean":"2024-09-12T02:58:12.996390+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:58:12.996390+0000","last_undegraded":"2024-09-12T02:58:12.996390+0000","last_fullsized":"2024-09-12T02:58:12.996390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":77,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.332871+0000","last_change":"2024-09-12T02:58:04.930543+0000","last_active":"2024-09-12T02:58:07.332871+0000","last_peered":"2024-09-12T02:58:07.332871+0000","last_clean":"2024-09-12T02:58:07.332871+0000","last_became_active":"2024-09-12T02:58:04.903386+0000","last_became_peered":"2024-09-12T02:58:04.903386+0000","last_unstale":"2024-09-12T02:58:07.332871+0000","last_undegraded":"2024-09-12T02:58:07.332871+0000","last_fullsized":"2024-09-12T02:58:07.332871+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:12.801139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334995+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:58:07.334995+0000","last_peered":"2024-09-12T02:58:07.334995+0000","last_clean":"2024-09-12T02:58:07.334995+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:58:07.334995+0000","last_undegraded":"2024-09-12T02:58:07.334995+0000","last_fullsized":"2024-09-12T02:58:07.334995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.046458+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:58:13.046458+0000","last_peered":"2024-09-12T02:58:13.046458+0000","last_clean":"2024-09-12T02:58:13.046458+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:58:13.046458+0000","last_undegraded":"2024-09-12T02:58:13.046458+0000","last_fullsized":"2024-09-12T02:58:13.046458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045013+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:58:13.045013+0000","last_peered":"2024-09-12T02:58:13.045013+0000","last_clean":"2024-09-12T02:58:13.045013+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:58:13.045013+0000","last_undegraded":"2024-09-12T02:58:13.045013+0000","last_fullsized":"2024-09-12T02:58:13.045013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334767+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:58:07.334767+0000","last_peered":"2024-09-12T02:58:07.334767+0000","last_clean":"2024-09-12T02:58:07.334767+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:58:07.334767+0000","last_undegraded":"2024-09-12T02:58:07.334767+0000","last_fullsized":"2024-09-12T02:58:07.334767+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996837+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:58:12.996837+0000","last_peered":"2024-09-12T02:58:12.996837+0000","last_clean":"2024-09-12T02:58:12.996837+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:58:12.996837+0000","last_undegraded":"2024-09-12T02:58:12.996837+0000","last_fullsized":"2024-09-12T02:58:12.996837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.047685+0000","last_change":"2024-09-12T02:57:03.802047+0000","last_active":"2024-09-12T02:58:13.047685+0000","last_peered":"2024-09-12T02:58:13.047685+0000","last_clean":"2024-09-12T02:58:13.047685+0000","last_became_active":"2024-09-12T02:57:03.797936+0000","last_became_peered":"2024-09-12T02:57:03.797936+0000","last_unstale":"2024-09-12T02:58:13.047685+0000","last_undegraded":"2024-09-12T02:58:13.047685+0000","last_fullsized":"2024-09-12T02:58:13.047685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:10.176640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334140+0000","last_change":"2024-09-12T02:58:04.909623+0000","last_active":"2024-09-12T02:58:07.334140+0000","last_peered":"2024-09-12T02:58:07.334140+0000","last_clean":"2024-09-12T02:58:07.334140+0000","last_became_active":"2024-09-12T02:58:04.904318+0000","last_became_peered":"2024-09-12T02:58:04.904318+0000","last_unstale":"2024-09-12T02:58:07.334140+0000","last_undegraded":"2024-09-12T02:58:07.334140+0000","last_fullsized":"2024-09-12T02:58:07.334140+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:58.275293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":50,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333771+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:58:07.333771+0000","last_peered":"2024-09-12T02:58:07.333771+0000","last_clean":"2024-09-12T02:58:07.333771+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:58:07.333771+0000","last_undegraded":"2024-09-12T02:58:07.333771+0000","last_fullsized":"2024-09-12T02:58:07.333771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335219+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:58:07.335219+0000","last_peered":"2024-09-12T02:58:07.335219+0000","last_clean":"2024-09-12T02:58:07.335219+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:58:07.335219+0000","last_undegraded":"2024-09-12T02:58:07.335219+0000","last_fullsized":"2024-09-12T02:58:07.335219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045399+0000","last_change":"2024-09-12T02:57:09.031080+0000","last_active":"2024-09-12T02:58:13.045399+0000","last_peered":"2024-09-12T02:58:13.045399+0000","last_clean":"2024-09-12T02:58:13.045399+0000","last_became_active":"2024-09-12T02:57:09.029892+0000","last_became_peered":"2024-09-12T02:57:09.029892+0000","last_unstale":"2024-09-12T02:58:13.045399+0000","last_undegraded":"2024-09-12T02:58:13.045399+0000","last_fullsized":"2024-09-12T02:58:13.045399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996467+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:58:12.996467+0000","last_peered":"2024-09-12T02:58:12.996467+0000","last_clean":"2024-09-12T02:58:12.996467+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:58:12.996467+0000","last_undegraded":"2024-09-12T02:58:12.996467+0000","last_fullsized":"2024-09-12T02:58:12.996467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'12","reported_seq":68,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045670+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:58:13.045670+0000","last_peered":"2024-09-12T02:58:13.045670+0000","last_clean":"2024-09-12T02:58:13.045670+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:58:13.045670+0000","last_undegraded":"2024-09-12T02:58:13.045670+0000","last_fullsized":"2024-09-12T02:58:13.045670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6119,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333561+0000","last_change":"2024-09-12T02:58:04.908021+0000","last_active":"2024-09-12T02:58:07.333561+0000","last_peered":"2024-09-12T02:58:07.333561+0000","last_clean":"2024-09-12T02:58:07.333561+0000","last_became_active":"2024-09-12T02:58:04.907573+0000","last_became_peered":"2024-09-12T02:58:04.907573+0000","last_unstale":"2024-09-12T02:58:07.333561+0000","last_undegraded":"2024-09-12T02:58:07.333561+0000","last_fullsized":"2024-09-12T02:58:07.333561+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:46.363546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2,5],"acting":[0,6,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995968+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:58:12.995968+0000","last_peered":"2024-09-12T02:58:12.995968+0000","last_clean":"2024-09-12T02:58:12.995968+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:58:12.995968+0000","last_undegraded":"2024-09-12T02:58:12.995968+0000","last_fullsized":"2024-09-12T02:58:12.995968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.046679+0000","last_change":"2024-09-12T02:58:04.918019+0000","last_active":"2024-09-12T02:58:13.046679+0000","last_peered":"2024-09-12T02:58:13.046679+0000","last_clean":"2024-09-12T02:58:13.046679+0000","last_became_active":"2024-09-12T02:58:04.899262+0000","last_became_peered":"2024-09-12T02:58:04.899262+0000","last_unstale":"2024-09-12T02:58:13.046679+0000","last_undegraded":"2024-09-12T02:58:13.046679+0000","last_fullsized":"2024-09-12T02:58:13.046679+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:49.413845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":64,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995301+0000","last_change":"2024-09-12T02:58:04.912717+0000","last_active":"2024-09-12T02:58:12.995301+0000","last_peered":"2024-09-12T02:58:12.995301+0000","last_clean":"2024-09-12T02:58:12.995301+0000","last_became_active":"2024-09-12T02:58:04.912313+0000","last_became_peered":"2024-09-12T02:58:04.912313+0000","last_unstale":"2024-09-12T02:58:12.995301+0000","last_undegraded":"2024-09-12T02:58:12.995301+0000","last_fullsized":"2024-09-12T02:58:12.995301+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:38.808602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,3],"acting":[4,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":50,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335592+0000","last_change":"2024-09-12T02:57:04.882349+0000","last_active":"2024-09-12T02:58:07.335592+0000","last_peered":"2024-09-12T02:58:07.335592+0000","last_clean":"2024-09-12T02:58:07.335592+0000","last_became_active":"2024-09-12T02:57:04.882060+0000","last_became_peered":"2024-09-12T02:57:04.882060+0000","last_unstale":"2024-09-12T02:58:07.335592+0000","last_undegraded":"2024-09-12T02:58:07.335592+0000","last_fullsized":"2024-09-12T02:58:07.335592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.049525+0000","last_change":"2024-09-12T02:57:03.811429+0000","last_active":"2024-09-12T02:58:13.049525+0000","last_peered":"2024-09-12T02:58:13.049525+0000","last_clean":"2024-09-12T02:58:13.049525+0000","last_became_active":"2024-09-12T02:57:03.810672+0000","last_became_peered":"2024-09-12T02:57:03.810672+0000","last_unstale":"2024-09-12T02:58:13.049525+0000","last_undegraded":"2024-09-12T02:58:13.049525+0000","last_fullsized":"2024-09-12T02:58:13.049525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.332756+0000","last_change":"2024-09-12T02:58:04.907023+0000","last_active":"2024-09-12T02:58:07.332756+0000","last_peered":"2024-09-12T02:58:07.332756+0000","last_clean":"2024-09-12T02:58:07.332756+0000","last_became_active":"2024-09-12T02:58:04.906653+0000","last_became_peered":"2024-09-12T02:58:04.906653+0000","last_unstale":"2024-09-12T02:58:07.332756+0000","last_undegraded":"2024-09-12T02:58:07.332756+0000","last_fullsized":"2024-09-12T02:58:07.332756+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:09.077484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.049552+0000","last_change":"2024-09-12T02:57:50.001684+0000","last_active":"2024-09-12T02:58:13.049552+0000","last_peered":"2024-09-12T02:58:13.049552+0000","last_clean":"2024-09-12T02:58:13.049552+0000","last_became_active":"2024-09-12T02:57:50.000771+0000","last_became_peered":"2024-09-12T02:57:50.000771+0000","last_unstale":"2024-09-12T02:58:13.049552+0000","last_undegraded":"2024-09-12T02:58:13.049552+0000","last_fullsized":"2024-09-12T02:58:13.049552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:46.843465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.046267+0000","last_change":"2024-09-12T02:57:03.812106+0000","last_active":"2024-09-12T02:58:13.046267+0000","last_peered":"2024-09-12T02:58:13.046267+0000","last_clean":"2024-09-12T02:58:13.046267+0000","last_became_active":"2024-09-12T02:57:03.810041+0000","last_became_peered":"2024-09-12T02:57:03.810041+0000","last_unstale":"2024-09-12T02:58:13.046267+0000","last_undegraded":"2024-09-12T02:58:13.046267+0000","last_fullsized":"2024-09-12T02:58:13.046267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333718+0000","last_change":"2024-09-12T02:57:09.030507+0000","last_active":"2024-09-12T02:58:07.333718+0000","last_peered":"2024-09-12T02:58:07.333718+0000","last_clean":"2024-09-12T02:58:07.333718+0000","last_became_active":"2024-09-12T02:57:09.029459+0000","last_became_peered":"2024-09-12T02:57:09.029459+0000","last_unstale":"2024-09-12T02:58:07.333718+0000","last_undegraded":"2024-09-12T02:58:07.333718+0000","last_fullsized":"2024-09-12T02:58:07.333718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:26.031705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334896+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:58:07.334896+0000","last_peered":"2024-09-12T02:58:07.334896+0000","last_clean":"2024-09-12T02:58:07.334896+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:58:07.334896+0000","last_undegraded":"2024-09-12T02:58:07.334896+0000","last_fullsized":"2024-09-12T02:58:07.334896+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.332966+0000","last_change":"2024-09-12T02:58:04.906224+0000","last_active":"2024-09-12T02:58:07.332966+0000","last_peered":"2024-09-12T02:58:07.332966+0000","last_clean":"2024-09-12T02:58:07.332966+0000","last_became_active":"2024-09-12T02:58:04.905949+0000","last_became_peered":"2024-09-12T02:58:04.905949+0000","last_unstale":"2024-09-12T02:58:07.332966+0000","last_undegraded":"2024-09-12T02:58:07.332966+0000","last_fullsized":"2024-09-12T02:58:07.332966+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045905+0000","last_change":"2024-09-12T02:57:03.807210+0000","last_active":"2024-09-12T02:58:13.045905+0000","last_peered":"2024-09-12T02:58:13.045905+0000","last_clean":"2024-09-12T02:58:13.045905+0000","last_became_active":"2024-09-12T02:57:03.805335+0000","last_became_peered":"2024-09-12T02:57:03.805335+0000","last_unstale":"2024-09-12T02:58:13.045905+0000","last_undegraded":"2024-09-12T02:58:13.045905+0000","last_fullsized":"2024-09-12T02:58:13.045905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:15.639371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045990+0000","last_change":"2024-09-12T02:57:08.895753+0000","last_active":"2024-09-12T02:58:13.045990+0000","last_peered":"2024-09-12T02:58:13.045990+0000","last_clean":"2024-09-12T02:58:13.045990+0000","last_became_active":"2024-09-12T02:57:08.894542+0000","last_became_peered":"2024-09-12T02:57:08.894542+0000","last_unstale":"2024-09-12T02:58:13.045990+0000","last_undegraded":"2024-09-12T02:58:13.045990+0000","last_fullsized":"2024-09-12T02:58:13.045990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:03.770688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335105+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:58:07.335105+0000","last_peered":"2024-09-12T02:58:07.335105+0000","last_clean":"2024-09-12T02:58:07.335105+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:58:07.335105+0000","last_undegraded":"2024-09-12T02:58:07.335105+0000","last_fullsized":"2024-09-12T02:58:07.335105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333805+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:58:07.333805+0000","last_peered":"2024-09-12T02:58:07.333805+0000","last_clean":"2024-09-12T02:58:07.333805+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:58:07.333805+0000","last_undegraded":"2024-09-12T02:58:07.333805+0000","last_fullsized":"2024-09-12T02:58:07.333805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045022+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:58:13.045022+0000","last_peered":"2024-09-12T02:58:13.045022+0000","last_clean":"2024-09-12T02:58:13.045022+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:58:13.045022+0000","last_undegraded":"2024-09-12T02:58:13.045022+0000","last_fullsized":"2024-09-12T02:58:13.045022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":50,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335129+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:58:07.335129+0000","last_peered":"2024-09-12T02:58:07.335129+0000","last_clean":"2024-09-12T02:58:07.335129+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:58:07.335129+0000","last_undegraded":"2024-09-12T02:58:07.335129+0000","last_fullsized":"2024-09-12T02:58:07.335129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.332599+0000","last_change":"2024-09-12T02:57:08.873190+0000","last_active":"2024-09-12T02:58:07.332599+0000","last_peered":"2024-09-12T02:58:07.332599+0000","last_clean":"2024-09-12T02:58:07.332599+0000","last_became_active":"2024-09-12T02:57:08.872526+0000","last_became_peered":"2024-09-12T02:57:08.872526+0000","last_unstale":"2024-09-12T02:58:07.332599+0000","last_undegraded":"2024-09-12T02:58:07.332599+0000","last_fullsized":"2024-09-12T02:58:07.332599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:15.257391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334227+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:58:07.334227+0000","last_peered":"2024-09-12T02:58:07.334227+0000","last_clean":"2024-09-12T02:58:07.334227+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:58:07.334227+0000","last_undegraded":"2024-09-12T02:58:07.334227+0000","last_fullsized":"2024-09-12T02:58:07.334227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.994879+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:58:12.994879+0000","last_peered":"2024-09-12T02:58:12.994879+0000","last_clean":"2024-09-12T02:58:12.994879+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:58:12.994879+0000","last_undegraded":"2024-09-12T02:58:12.994879+0000","last_fullsized":"2024-09-12T02:58:12.994879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":46,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334513+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:58:07.334513+0000","last_peered":"2024-09-12T02:58:07.334513+0000","last_clean":"2024-09-12T02:58:07.334513+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:58:07.334513+0000","last_undegraded":"2024-09-12T02:58:07.334513+0000","last_fullsized":"2024-09-12T02:58:07.334513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045998+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:58:13.045998+0000","last_peered":"2024-09-12T02:58:13.045998+0000","last_clean":"2024-09-12T02:58:13.045998+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:58:13.045998+0000","last_undegraded":"2024-09-12T02:58:13.045998+0000","last_fullsized":"2024-09-12T02:58:13.045998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333194+0000","last_change":"2024-09-12T02:57:04.841244+0000","last_active":"2024-09-12T02:58:07.333194+0000","last_peered":"2024-09-12T02:58:07.333194+0000","last_clean":"2024-09-12T02:58:07.333194+0000","last_became_active":"2024-09-12T02:57:04.837935+0000","last_became_peered":"2024-09-12T02:57:04.837935+0000","last_unstale":"2024-09-12T02:58:07.333194+0000","last_undegraded":"2024-09-12T02:58:07.333194+0000","last_fullsized":"2024-09-12T02:58:07.333194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:50.023694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.047528+0000","last_change":"2024-09-12T02:57:04.874054+0000","last_active":"2024-09-12T02:58:13.047528+0000","last_peered":"2024-09-12T02:58:13.047528+0000","last_clean":"2024-09-12T02:58:13.047528+0000","last_became_active":"2024-09-12T02:57:04.867372+0000","last_became_peered":"2024-09-12T02:57:04.867372+0000","last_unstale":"2024-09-12T02:58:13.047528+0000","last_undegraded":"2024-09-12T02:58:13.047528+0000","last_fullsized":"2024-09-12T02:58:13.047528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:06.010582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":50,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335038+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:58:07.335038+0000","last_peered":"2024-09-12T02:58:07.335038+0000","last_clean":"2024-09-12T02:58:07.335038+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:58:07.335038+0000","last_undegraded":"2024-09-12T02:58:07.335038+0000","last_fullsized":"2024-09-12T02:58:07.335038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334375+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:58:07.334375+0000","last_peered":"2024-09-12T02:58:07.334375+0000","last_clean":"2024-09-12T02:58:07.334375+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:58:07.334375+0000","last_undegraded":"2024-09-12T02:58:07.334375+0000","last_fullsized":"2024-09-12T02:58:07.334375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334615+0000","last_change":"2024-09-12T02:58:04.899523+0000","last_active":"2024-09-12T02:58:07.334615+0000","last_peered":"2024-09-12T02:58:07.334615+0000","last_clean":"2024-09-12T02:58:07.334615+0000","last_became_active":"2024-09-12T02:58:04.899174+0000","last_became_peered":"2024-09-12T02:58:04.899174+0000","last_unstale":"2024-09-12T02:58:07.334615+0000","last_undegraded":"2024-09-12T02:58:07.334615+0000","last_fullsized":"2024-09-12T02:58:07.334615+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:26.441144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045981+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:58:13.045981+0000","last_peered":"2024-09-12T02:58:13.045981+0000","last_clean":"2024-09-12T02:58:13.045981+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:58:13.045981+0000","last_undegraded":"2024-09-12T02:58:13.045981+0000","last_fullsized":"2024-09-12T02:58:13.045981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334863+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:58:07.334863+0000","last_peered":"2024-09-12T02:58:07.334863+0000","last_clean":"2024-09-12T02:58:07.334863+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:58:07.334863+0000","last_undegraded":"2024-09-12T02:58:07.334863+0000","last_fullsized":"2024-09-12T02:58:07.334863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045464+0000","last_change":"2024-09-12T02:57:04.874760+0000","last_active":"2024-09-12T02:58:13.045464+0000","last_peered":"2024-09-12T02:58:13.045464+0000","last_clean":"2024-09-12T02:58:13.045464+0000","last_became_active":"2024-09-12T02:57:04.861196+0000","last_became_peered":"2024-09-12T02:57:04.861196+0000","last_unstale":"2024-09-12T02:58:13.045464+0000","last_undegraded":"2024-09-12T02:58:13.045464+0000","last_fullsized":"2024-09-12T02:58:13.045464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333580+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:58:07.333580+0000","last_peered":"2024-09-12T02:58:07.333580+0000","last_clean":"2024-09-12T02:58:07.333580+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:58:07.333580+0000","last_undegraded":"2024-09-12T02:58:07.333580+0000","last_fullsized":"2024-09-12T02:58:07.333580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.047372+0000","last_change":"2024-09-12T02:57:04.879052+0000","last_active":"2024-09-12T02:58:13.047372+0000","last_peered":"2024-09-12T02:58:13.047372+0000","last_clean":"2024-09-12T02:58:13.047372+0000","last_became_active":"2024-09-12T02:57:04.877672+0000","last_became_peered":"2024-09-12T02:57:04.877672+0000","last_unstale":"2024-09-12T02:58:13.047372+0000","last_undegraded":"2024-09-12T02:58:13.047372+0000","last_fullsized":"2024-09-12T02:58:13.047372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":50,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334792+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:58:07.334792+0000","last_peered":"2024-09-12T02:58:07.334792+0000","last_clean":"2024-09-12T02:58:07.334792+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:58:07.334792+0000","last_undegraded":"2024-09-12T02:58:07.334792+0000","last_fullsized":"2024-09-12T02:58:07.334792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045450+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:58:13.045450+0000","last_peered":"2024-09-12T02:58:13.045450+0000","last_clean":"2024-09-12T02:58:13.045450+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:58:13.045450+0000","last_undegraded":"2024-09-12T02:58:13.045450+0000","last_fullsized":"2024-09-12T02:58:13.045450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996963+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:58:12.996963+0000","last_peered":"2024-09-12T02:58:12.996963+0000","last_clean":"2024-09-12T02:58:12.996963+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:58:12.996963+0000","last_undegraded":"2024-09-12T02:58:12.996963+0000","last_fullsized":"2024-09-12T02:58:12.996963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333613+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:58:07.333613+0000","last_peered":"2024-09-12T02:58:07.333613+0000","last_clean":"2024-09-12T02:58:07.333613+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:58:07.333613+0000","last_undegraded":"2024-09-12T02:58:07.333613+0000","last_fullsized":"2024-09-12T02:58:07.333613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045683+0000","last_change":"2024-09-12T02:57:04.867799+0000","last_active":"2024-09-12T02:58:13.045683+0000","last_peered":"2024-09-12T02:58:13.045683+0000","last_clean":"2024-09-12T02:58:13.045683+0000","last_became_active":"2024-09-12T02:57:04.863800+0000","last_became_peered":"2024-09-12T02:57:04.863800+0000","last_unstale":"2024-09-12T02:58:13.045683+0000","last_undegraded":"2024-09-12T02:58:13.045683+0000","last_fullsized":"2024-09-12T02:58:13.045683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045205+0000","last_change":"2024-09-12T02:57:04.864906+0000","last_active":"2024-09-12T02:58:13.045205+0000","last_peered":"2024-09-12T02:58:13.045205+0000","last_clean":"2024-09-12T02:58:13.045205+0000","last_became_active":"2024-09-12T02:57:04.863556+0000","last_became_peered":"2024-09-12T02:57:04.863556+0000","last_unstale":"2024-09-12T02:58:13.045205+0000","last_undegraded":"2024-09-12T02:58:13.045205+0000","last_fullsized":"2024-09-12T02:58:13.045205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995220+0000","last_change":"2024-09-12T02:58:04.909956+0000","last_active":"2024-09-12T02:58:12.995220+0000","last_peered":"2024-09-12T02:58:12.995220+0000","last_clean":"2024-09-12T02:58:12.995220+0000","last_became_active":"2024-09-12T02:58:04.909411+0000","last_became_peered":"2024-09-12T02:58:04.909411+0000","last_unstale":"2024-09-12T02:58:12.995220+0000","last_undegraded":"2024-09-12T02:58:12.995220+0000","last_fullsized":"2024-09-12T02:58:12.995220+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:16.782988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":50,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.333727+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:58:07.333727+0000","last_peered":"2024-09-12T02:58:07.333727+0000","last_clean":"2024-09-12T02:58:07.333727+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:58:07.333727+0000","last_undegraded":"2024-09-12T02:58:07.333727+0000","last_fullsized":"2024-09-12T02:58:07.333727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334030+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:58:07.334030+0000","last_peered":"2024-09-12T02:58:07.334030+0000","last_clean":"2024-09-12T02:58:07.334030+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:58:07.334030+0000","last_undegraded":"2024-09-12T02:58:07.334030+0000","last_fullsized":"2024-09-12T02:58:07.334030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995745+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:58:12.995745+0000","last_peered":"2024-09-12T02:58:12.995745+0000","last_clean":"2024-09-12T02:58:12.995745+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:58:12.995745+0000","last_undegraded":"2024-09-12T02:58:12.995745+0000","last_fullsized":"2024-09-12T02:58:12.995745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045445+0000","last_change":"2024-09-12T02:57:04.864295+0000","last_active":"2024-09-12T02:58:13.045445+0000","last_peered":"2024-09-12T02:58:13.045445+0000","last_clean":"2024-09-12T02:58:13.045445+0000","last_became_active":"2024-09-12T02:57:04.863563+0000","last_became_peered":"2024-09-12T02:57:04.863563+0000","last_unstale":"2024-09-12T02:58:13.045445+0000","last_undegraded":"2024-09-12T02:58:13.045445+0000","last_fullsized":"2024-09-12T02:58:13.045445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:50.982994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":59,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.045868+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:58:13.045868+0000","last_peered":"2024-09-12T02:58:13.045868+0000","last_clean":"2024-09-12T02:58:13.045868+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:58:13.045868+0000","last_undegraded":"2024-09-12T02:58:13.045868+0000","last_fullsized":"2024-09-12T02:58:13.045868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996987+0000","last_change":"2024-09-12T02:57:04.881172+0000","last_active":"2024-09-12T02:58:12.996987+0000","last_peered":"2024-09-12T02:58:12.996987+0000","last_clean":"2024-09-12T02:58:12.996987+0000","last_became_active":"2024-09-12T02:57:04.880660+0000","last_became_peered":"2024-09-12T02:57:04.880660+0000","last_unstale":"2024-09-12T02:58:12.996987+0000","last_undegraded":"2024-09-12T02:58:12.996987+0000","last_fullsized":"2024-09-12T02:58:12.996987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:15.389185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.332719+0000","last_change":"2024-09-12T02:57:04.876735+0000","last_active":"2024-09-12T02:58:07.332719+0000","last_peered":"2024-09-12T02:58:07.332719+0000","last_clean":"2024-09-12T02:58:07.332719+0000","last_became_active":"2024-09-12T02:57:04.876321+0000","last_became_peered":"2024-09-12T02:57:04.876321+0000","last_unstale":"2024-09-12T02:58:07.332719+0000","last_undegraded":"2024-09-12T02:58:07.332719+0000","last_fullsized":"2024-09-12T02:58:07.332719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.995912+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:58:12.995912+0000","last_peered":"2024-09-12T02:58:12.995912+0000","last_clean":"2024-09-12T02:58:12.995912+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:58:12.995912+0000","last_undegraded":"2024-09-12T02:58:12.995912+0000","last_fullsized":"2024-09-12T02:58:12.995912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.047212+0000","last_change":"2024-09-12T02:57:04.878277+0000","last_active":"2024-09-12T02:58:13.047212+0000","last_peered":"2024-09-12T02:58:13.047212+0000","last_clean":"2024-09-12T02:58:13.047212+0000","last_became_active":"2024-09-12T02:57:04.876816+0000","last_became_peered":"2024-09-12T02:57:04.876816+0000","last_unstale":"2024-09-12T02:58:13.047212+0000","last_undegraded":"2024-09-12T02:58:13.047212+0000","last_fullsized":"2024-09-12T02:58:13.047212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996400+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:58:12.996400+0000","last_peered":"2024-09-12T02:58:12.996400+0000","last_clean":"2024-09-12T02:58:12.996400+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:58:12.996400+0000","last_undegraded":"2024-09-12T02:58:12.996400+0000","last_fullsized":"2024-09-12T02:58:12.996400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":56,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:13.049041+0000","last_change":"2024-09-12T02:57:04.876472+0000","last_active":"2024-09-12T02:58:13.049041+0000","last_peered":"2024-09-12T02:58:13.049041+0000","last_clean":"2024-09-12T02:58:13.049041+0000","last_became_active":"2024-09-12T02:57:04.867264+0000","last_became_peered":"2024-09-12T02:57:04.867264+0000","last_unstale":"2024-09-12T02:58:13.049041+0000","last_undegraded":"2024-09-12T02:58:13.049041+0000","last_fullsized":"2024-09-12T02:58:13.049041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":50,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.334724+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:58:07.334724+0000","last_peered":"2024-09-12T02:58:07.334724+0000","last_clean":"2024-09-12T02:58:07.334724+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:58:07.334724+0000","last_undegraded":"2024-09-12T02:58:07.334724+0000","last_fullsized":"2024-09-12T02:58:07.334724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-12T02:58:07.335185+0000","last_change":"2024-09-12T02:58:04.912670+0000","last_active":"2024-09-12T02:58:07.335185+0000","last_peered":"2024-09-12T02:58:07.335185+0000","last_clean":"2024-09-12T02:58:07.335185+0000","last_became_active":"2024-09-12T02:58:04.912393+0000","last_became_peered":"2024-09-12T02:58:04.912393+0000","last_unstale":"2024-09-12T02:58:07.335185+0000","last_undegraded":"2024-09-12T02:58:07.335185+0000","last_fullsized":"2024-09-12T02:58:07.335185+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:36.583669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T02:58:12.996455+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:58:12.996455+0000","last_peered":"2024-09-12T02:58:12.996455+0000","last_clean":"2024-09-12T02:58:12.996455+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:58:12.996455+0000","last_undegraded":"2024-09-12T02:58:12.996455+0000","last_fullsized":"2024-09-12T02:58:12.996455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6917,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":90,"num_keys_recovered":1,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":483328,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":218688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":809784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542165,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":816486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":238503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":225626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542163,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":232510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":225606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:58:15.389 INFO:tasks.thrashosds.thrasher:Setting 4.4 to [5, 7, 4, 6] 2024-09-12T02:58:15.389 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.4', '5', '7', '4', '6'] 2024-09-12T02:58:15.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.4 5 7 4 6 2024-09-12T02:58:15.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:15.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.409+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7f50180c5550 con 0x7f5018159300 2024-09-12T02:58:15.480 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:15.475+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:15.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde8a00640 1 Processor -- start 2024-09-12T02:58:15.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde8a00640 1 -- start start 2024-09-12T02:58:15.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde8a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efde4154c30 0x7efde415a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde8a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde4070c20 con 0x7efde40c73f0 2024-09-12T02:58:15.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde8a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde4070f00 con 0x7efde4070730 2024-09-12T02:58:15.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde8a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7efde406c800 con 0x7efde4154c30 2024-09-12T02:58:15.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde1e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efde4154c30 0x7efde415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde1e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efde4154c30 0x7efde415a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37848/0 (socket says 172.21.15.63:37848) 2024-09-12T02:58:15.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde1e00640 1 -- 172.21.15.63:0/2042835448 learned_addr learned my addr 172.21.15.63:0/2042835448 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:15.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde1e00640 1 -- 172.21.15.63:0/2042835448 >> v1:172.21.15.119:6789/0 conn(0x7efde4070730 legacy=0x7efde40c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde1e00640 1 -- 172.21.15.63:0/2042835448 >> v1:172.21.15.63:6789/0 conn(0x7efde40c73f0 legacy=0x7efde40c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.561+0000 7efde1e00640 1 -- 172.21.15.63:0/2042835448 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde406cae0 con 0x7efde4154c30 2024-09-12T02:58:15.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.565+0000 7efde1e00640 1 --2- 172.21.15.63:0/2042835448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde4154c30 0x7efde415a950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009e50 tx=0x7efdd401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e71a6de153f8fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.565+0000 7efde1400640 1 -- 172.21.15.63:0/2042835448 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd40b4070 con 0x7efde4154c30 2024-09-12T02:58:15.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.565+0000 7efde1400640 1 -- 172.21.15.63:0/2042835448 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd40af400 con 0x7efde4154c30 2024-09-12T02:58:15.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.565+0000 7efde1400640 1 -- 172.21.15.63:0/2042835448 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd40af7d0 con 0x7efde4154c30 2024-09-12T02:58:15.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.565+0000 7efde8a00640 1 -- 172.21.15.63:0/2042835448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde4154c30 msgr2=0x7efde415a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.565+0000 7efde8a00640 1 --2- 172.21.15.63:0/2042835448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde4154c30 0x7efde415a950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009e50 tx=0x7efdd401f210 comp rx=0 tx=0).stop 2024-09-12T02:58:15.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.565+0000 7efde8a00640 1 -- 172.21.15.63:0/2042835448 shutdown_connections 2024-09-12T02:58:15.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.565+0000 7efde8a00640 1 --2- 172.21.15.63:0/2042835448 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde4154c30 0x7efde415a950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.565+0000 7efde8a00640 1 -- 172.21.15.63:0/2042835448 >> 172.21.15.63:0/2042835448 conn(0x7efde40cd2b0 msgr2=0x7efde40cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:15.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.569+0000 7efde8a00640 1 -- 172.21.15.63:0/2042835448 shutdown_connections 2024-09-12T02:58:15.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.569+0000 7efde8a00640 1 -- 172.21.15.63:0/2042835448 wait complete. 2024-09-12T02:58:15.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.569+0000 7efde8a00640 1 Processor -- start 2024-09-12T02:58:15.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.569+0000 7efde8a00640 1 -- start start 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde8a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efde4070730 0x7efde41e5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde8a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde40c73f0 0x7efde41e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde8a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efde4154c30 0x7efde4158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde8a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efde4155010 con 0x7efde40c73f0 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde8a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efde415ae90 con 0x7efde4154c30 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde8a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7efde40c9160 con 0x7efde4070730 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efdd9400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde40c73f0 0x7efde41e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efdd9400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde40c73f0 0x7efde41e57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37858/0 (socket says 172.21.15.63:37858) 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efdd9400640 1 -- 172.21.15.63:0/3410714694 learned_addr learned my addr 172.21.15.63:0/3410714694 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde1e00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efde4070730 0x7efde41e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde2800640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efde4154c30 0x7efde4158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efdd9400640 1 -- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efde4070730 msgr2=0x7efde41e5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efdd9400640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efde4070730 0x7efde41e5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efdd9400640 1 -- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efde4154c30 msgr2=0x7efde4158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efdd9400640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efde4154c30 0x7efde4158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efdd9400640 1 -- 172.21.15.63:0/3410714694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde414aaa0 con 0x7efde40c73f0 2024-09-12T02:58:15.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efdd9400640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde40c73f0 0x7efde41e57a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c530 tx=0x7efdcc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efddaa00640 1 -- 172.21.15.63:0/3410714694 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc016020 con 0x7efde40c73f0 2024-09-12T02:58:15.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efddaa00640 1 -- 172.21.15.63:0/3410714694 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc005220 con 0x7efde40c73f0 2024-09-12T02:58:15.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41f12d0 con 0x7efde40c73f0 2024-09-12T02:58:15.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efddaa00640 1 -- 172.21.15.63:0/3410714694 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc007030 con 0x7efde40c73f0 2024-09-12T02:58:15.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde41e4d40 con 0x7efde40c73f0 2024-09-12T02:58:15.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.572+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde406d2e0 con 0x7efde40c73f0 2024-09-12T02:58:15.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.576+0000 7efddaa00640 1 -- 172.21.15.63:0/3410714694 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efdcc0071d0 con 0x7efde40c73f0 2024-09-12T02:58:15.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.576+0000 7efddaa00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efdc00678c0 0x7efdc0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.576+0000 7efddaa00640 1 -- 172.21.15.63:0/3410714694 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6648+0+0 (secure 0 0 0) 0x7efdcc0857f0 con 0x7efde40c73f0 2024-09-12T02:58:15.581 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:15.575+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:15.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.576+0000 7efde1e00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efdc00678c0 0x7efdc0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.576+0000 7efde1e00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efdc00678c0 0x7efdc0069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efdd40b1000 tx=0x7efdd40aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.580+0000 7efddaa00640 1 -- 172.21.15.63:0/3410714694 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efdcc020020 con 0x7efde40c73f0 2024-09-12T02:58:15.605 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:15.605 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:15.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:15.605 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:15.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'39)", 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.648771878000005, 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047813200000000004, 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955738+0000", 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3099999999999998e-07 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955742+0000", 2024-09-12T02:58:15.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955753+0000", 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1321000000000001e-05 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955759+0000", 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1070000000000001e-06 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955810+0000", 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0711000000000003e-05 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955823+0000", 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2605999999999999e-05 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960475+0000", 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004652354 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960518+0000", 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3316999999999999e-05 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'39)", 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.647249083000005, 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039674089999999999, 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957261+0000", 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8400000000000004e-07 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957334+0000", 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3613000000000001e-05 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957347+0000", 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3349e-05 2024-09-12T02:58:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957353+0000", 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1089999999999997e-06 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957405+0000", 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2206000000000001e-05 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957427+0000", 2024-09-12T02:58:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2155999999999999e-05 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961190+0000", 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037629849999999999 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961227+0000", 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7307e-05 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.645004044999993, 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004389858, 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959506+0000", 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8599999999999998e-07 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959510+0000", 2024-09-12T02:58:15.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7339999999999999e-06 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959523+0000", 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2773e-05 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959528+0000", 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9740000000000001e-06 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960547+0000", 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010187359999999999 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960560+0000", 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3223e-05 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963855+0000", 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032949910000000002 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963895+0000", 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9740999999999998e-05 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.637451292999998, 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021753509999999998, 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6599999999999996e-07 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967141+0000", 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2319999999999998e-05 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967152+0000", 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1432e-05 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967158+0000", 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8019999999999997e-06 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967207+0000", 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9075e-05 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967224+0000", 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7427000000000001e-05 2024-09-12T02:58:15.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969194+0000", 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019695590000000001 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969233+0000", 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9169999999999999e-05 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.636053109000002, 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003562614, 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7899999999999998e-07 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968495+0000", 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8025000000000003e-05 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968507+0000", 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2758999999999999e-05 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968513+0000", 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3009999999999997e-06 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968585+0000", 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2139999999999997e-05 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968599+0000", 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4752999999999999e-05 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.971980+0000", 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033801059999999999 2024-09-12T02:58:15.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972018+0000", 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8850999999999998e-05 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:74 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'48, mlcod=17'44)", 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.634383154999995, 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022444370000000002, 2024-09-12T02:58:15.628 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7100000000000001e-07 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970131+0000", 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4850000000000003e-06 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970144+0000", 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2595999999999999e-05 2024-09-12T02:58:15.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970149+0000", 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.395e-06 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970209+0000", 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9905999999999999e-05 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970225+0000", 2024-09-12T02:58:15.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6177000000000001e-05 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972340+0000", 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002114917 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972370+0000", 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.029e-05 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.632 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:83 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'50)", 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.618402179, 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002809059, 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:15.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:15.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6000000000000004e-07 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986112+0000", 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8019999999999999e-06 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986123+0000", 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0953e-05 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986128+0000", 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7849999999999999e-06 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986166+0000", 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7923000000000003e-05 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986180+0000", 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4211e-05 2024-09-12T02:58:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988884+0000", 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027039640000000001 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988916+0000", 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1860999999999999e-05 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:84 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'50)", 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.617405367000003, 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002347909, 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8899999999999999e-07 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987155+0000", 2024-09-12T02:58:15.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0776000000000003e-05 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987167+0000", 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2215000000000001e-05 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987172+0000", 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.04e-06 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987232+0000", 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9595000000000001e-05 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987246+0000", 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3757000000000001e-05 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989417+0000", 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021715329999999998 2024-09-12T02:58:15.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989451+0000", 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4304000000000002e-05 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:90 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'60, mlcod=17'57)", 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.608869463999994, 2024-09-12T02:58:15.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027093489999999998, 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:15.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995640+0000", 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9699999999999995e-07 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995794+0000", 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015367199999999999 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995805+0000", 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1061e-05 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995810+0000", 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4589999999999997e-06 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995856+0000", 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6127000000000001e-05 2024-09-12T02:58:15.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995870+0000", 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3854e-05 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998315+0000", 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024450930000000002 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998349+0000", 2024-09-12T02:58:15.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3386000000000002e-05 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:105 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'67, mlcod=17'64)", 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 79.426594346000002, 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026337050000000001, 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4300000000000003e-07 2024-09-12T02:58:15.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177930+0000", 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4735999999999999e-05 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177942+0000", 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2349e-05 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177949+0000", 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6599999999999998e-06 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178003+0000", 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3535999999999997e-05 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178018+0000", 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5227e-05 2024-09-12T02:58:15.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180517+0000", 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024996419999999998 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180548+0000", 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0911999999999998e-05 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:158 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'112, mlcod=18'109)", 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.149355360000001, 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026267230000000001, 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.58e-07 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455235+0000", 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1242000000000006e-05 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455245+0000", 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.995e-06 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455250+0000", 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7079999999999996e-06 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455297+0000", 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6885000000000003e-05 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455311+0000", 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4354e-05 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457734+0000", 2024-09-12T02:58:15.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024232540000000001 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457780+0000", 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5827e-05 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:159 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'113, mlcod=18'109)", 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.148634372000004, 2024-09-12T02:58:15.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046885809999999998, 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:15.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5300000000000004e-07 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455879+0000", 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8650000000000003e-06 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455889+0000", 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0139999999999999e-05 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455894+0000", 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2959999999999998e-06 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455944+0000", 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9774999999999997e-05 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455962+0000", 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8009999999999999e-05 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460534+0000", 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045721299999999998 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460563+0000", 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8812000000000001e-05 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.660 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:4 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.752486016999995, 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073449359999999998, 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852025+0000", 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2280000000000001e-06 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852034+0000", 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1619999999999997e-06 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852060+0000", 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5714000000000001e-05 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852073+0000", 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3199e-05 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852384+0000", 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031071499999999998 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852627+0000", 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024345000000000001 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852778+0000", 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015093999999999999 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857277+0000", 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044991120000000004 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859269+0000", 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019915879999999999 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:15.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3817999999999999e-05 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859368+0000", 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5009999999999998e-05 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.752394608000003, 2024-09-12T02:58:15.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012795443, 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852115+0000", 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.54e-07 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852120+0000", 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2299999999999999e-06 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852132+0000", 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1746000000000001e-05 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852140+0000", 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2300000000000008e-06 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854507+0000", 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023667369999999998 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854587+0000", 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0024000000000005e-05 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854730+0000", 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014253599999999999 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859376+0000", 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046468200000000003 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864800+0000", 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054233670000000001 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864864+0000", 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4397e-05 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864910+0000", 2024-09-12T02:58:15.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5602000000000001e-05 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:28 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.752336360000001, 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011320167000000001, 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.672 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:15.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1600000000000001e-07 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852188+0000", 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.506e-05 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852199+0000", 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0677e-05 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852206+0000", 2024-09-12T02:58:15.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8279999999999997e-06 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852418+0000", 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021227799999999999 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852545+0000", 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012638499999999999 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:15.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852774+0000", 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0002299 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856085+0000", 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033103569999999999 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863371+0000", 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072860260000000001 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863444+0000", 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.305e-05 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863493+0000", 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8890000000000001e-05 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.677 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.752274299000007, 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012832368, 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:15.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5700000000000002e-07 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852262+0000", 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7135e-05 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852366+0000", 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103606 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852378+0000", 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2204999999999999e-05 2024-09-12T02:58:15.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854980+0000", 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026019860000000001 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855096+0000", 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115887 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:15.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855213+0000", 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116916 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859383+0000", 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041700089999999997 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864993+0000", 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056103209999999997 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865043+0000", 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9481999999999998e-05 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865067+0000", 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4164000000000001e-05 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.683 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.752061897000004, 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012817586000000001, 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852448+0000", 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5600000000000005e-07 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852453+0000", 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9019999999999998e-06 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852462+0000", 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9069999999999996e-06 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852469+0000", 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.374e-06 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853604+0000", 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011349299999999999 2024-09-12T02:58:15.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853717+0000", 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112797 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853836+0000", 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011936500000000001 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859663+0000", 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058266209999999997 2024-09-12T02:58:15.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865167+0000", 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055044849999999999 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865226+0000", 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8718000000000003e-05 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865265+0000", 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8730999999999999e-05 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.752030297999994, 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012748110999999999, 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.689 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6699999999999999e-07 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852492+0000", 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.291e-05 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852500+0000", 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1580000000000005e-06 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852506+0000", 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5330000000000002e-06 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856830+0000", 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004324194 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856959+0000", 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012862099999999999 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865227+0000", 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082682280000000007 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.749708206999998, 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045219450000000003, 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:15.693 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854802+0000", 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:15.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854814+0000", 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1759999999999999e-05 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854836+0000", 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2039999999999999e-05 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854855+0000", 2024-09-12T02:58:15.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.929e-05 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854975+0000", 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119561 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043479110000000003 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.696 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:2 2.f e25/19 2:f1f69726:::400.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.746392009999994, 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032847000000000002, 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:15.697 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858118+0000", 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1540000000000001e-06 2024-09-12T02:58:15.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858126+0000", 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7759999999999997e-06 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858138+0000", 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2184999999999999e-05 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858145+0000", 2024-09-12T02:58:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858282+0000", 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013642799999999999 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858297+0000", 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5328e-05 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:15.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861346+0000", 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030492729999999999 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861402+0000", 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5220999999999999e-05 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:15.701 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:15.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:15.703 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:15.699+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:15.772 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:15.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.780+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pg-upmap", "pgid": "4.4", "id": [5, 7, 4, 6]} v 0) -- 0x7efde41e6570 con 0x7efde40c73f0 2024-09-12T02:58:15.803 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:15.800+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:15.861 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:15.861 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:15.861 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:15.861 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:15.878 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:15.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa760c00640 1 Processor -- start 2024-09-12T02:58:15.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa760c00640 1 -- start start 2024-09-12T02:58:15.924 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:15.920+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:15.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa760c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 0x7fa75c0c7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa760c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75c155040 con 0x7fa75c154c60 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa760c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75c15e9d0 con 0x7fa75c0c6850 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa760c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c0c8dc0 con 0x7fa75c067a00 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa75b400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa75c154c60 0x7fa75c06ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41352/0 (socket says 172.21.15.63:41352) 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa75b400640 1 -- 172.21.15.63:0/4162552771 learned_addr learned my addr 172.21.15.63:0/4162552771 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa75aa00640 1 --2- 172.21.15.63:0/4162552771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 0x7fa75c0c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa75a000640 1 -- 172.21.15.63:0/4162552771 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475695012 0 0) 0x7fa74c001120 con 0x7fa75c154c60 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa75a000640 1 -- 172.21.15.63:0/4162552771 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa740003530 con 0x7fa75c154c60 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa75aa00640 1 -- 172.21.15.63:0/4162552771 >> v1:172.21.15.119:6789/0 conn(0x7fa75c0c6850 legacy=0x7fa75c165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa75aa00640 1 -- 172.21.15.63:0/4162552771 >> v1:172.21.15.63:6789/0 conn(0x7fa75c154c60 legacy=0x7fa75c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa75a000640 1 -- 172.21.15.63:0/4162552771 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841696958 0 0) 0x7fa75c15e9d0 con 0x7fa75c0c6850 2024-09-12T02:58:15.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.920+0000 7fa75aa00640 1 -- 172.21.15.63:0/4162552771 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c0c8b00 con 0x7fa75c067a00 2024-09-12T02:58:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.924+0000 7fa75aa00640 1 --2- 172.21.15.63:0/4162552771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 0x7fa75c0c7340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7480097f0 tx=0x7fa74801ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4541b40ca421bec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.924+0000 7fa75a000640 1 -- 172.21.15.63:0/4162552771 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480b5070 con 0x7fa75c067a00 2024-09-12T02:58:15.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.924+0000 7fa75a000640 1 -- 172.21.15.63:0/4162552771 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7480a89d0 con 0x7fa75c067a00 2024-09-12T02:58:15.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.924+0000 7fa75a000640 1 -- 172.21.15.63:0/4162552771 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480a8d80 con 0x7fa75c067a00 2024-09-12T02:58:15.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.924+0000 7fa760c00640 1 -- 172.21.15.63:0/4162552771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 msgr2=0x7fa75c0c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.924+0000 7fa760c00640 1 --2- 172.21.15.63:0/4162552771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 0x7fa75c0c7340 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7480097f0 tx=0x7fa74801ecd0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.924+0000 7fa760c00640 1 -- 172.21.15.63:0/4162552771 shutdown_connections 2024-09-12T02:58:15.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.924+0000 7fa760c00640 1 --2- 172.21.15.63:0/4162552771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 0x7fa75c0c7340 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.924+0000 7fa760c00640 1 -- 172.21.15.63:0/4162552771 >> 172.21.15.63:0/4162552771 conn(0x7fa75c06f8e0 msgr2=0x7fa75c06fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:15.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.928+0000 7fa760c00640 1 -- 172.21.15.63:0/4162552771 shutdown_connections 2024-09-12T02:58:15.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.928+0000 7fa760c00640 1 -- 172.21.15.63:0/4162552771 wait complete. 2024-09-12T02:58:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.928+0000 7fa760c00640 1 Processor -- start 2024-09-12T02:58:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.928+0000 7fa760c00640 1 -- start start 2024-09-12T02:58:15.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa760c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 0x7fa75c1f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa760c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75c0c6850 0x7fa75c0cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa760c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa75c154c60 0x7fa75c0c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa760c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c070400 con 0x7fa75c0c6850 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa760c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c073df0 con 0x7fa75c154c60 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa760c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c0706e0 con 0x7fa75c067a00 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75c0c6850 0x7fa75c0cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75c0c6850 0x7fa75c0cb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37870/0 (socket says 172.21.15.63:37870) 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75aa00640 1 -- 172.21.15.63:0/2949836844 learned_addr learned my addr 172.21.15.63:0/2949836844 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75b400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 0x7fa75c1f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75be00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa75c154c60 0x7fa75c0c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75aa00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 msgr2=0x7fa75c1f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75aa00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa75c067a00 0x7fa75c1f08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75aa00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa75c154c60 msgr2=0x7fa75c0c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:15.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75aa00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa75c154c60 0x7fa75c0c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:15.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75aa00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c0c46a0 con 0x7fa75c0c6850 2024-09-12T02:58:15.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75be00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa75c154c60 0x7fa75c0c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa75aa00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75c0c6850 0x7fa75c0cb930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa7480097f0 tx=0x7fa74801ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7480b5040 con 0x7fa75c0c6850 2024-09-12T02:58:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7480bf070 con 0x7fa75c0c6850 2024-09-12T02:58:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c0c6060 con 0x7fa75c0c6850 2024-09-12T02:58:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748003620 con 0x7fa75c0c6850 2024-09-12T02:58:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c0c4960 con 0x7fa75c0c6850 2024-09-12T02:58:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.932+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fa75c0c9040 con 0x7fa75c0c6850 2024-09-12T02:58:15.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7480037c0 con 0x7fa75c0c6850 2024-09-12T02:58:15.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa753400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa73c0678c0 0x7fa73c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6648+0+0 (secure 0 0 0) 0x7fa748123720 con 0x7fa75c0c6850 2024-09-12T02:58:15.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v44) ==== 54+0+16 (secure 0 0 0) 0x7fa748018830 con 0x7fa75c0c6850 2024-09-12T02:58:15.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa75b400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa73c0678c0 0x7fa73c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa75c0c4b30 0x7fa75c148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa75c14a2c0 con 0x7fa75c0c4b30 2024-09-12T02:58:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa75be00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa75c0c4b30 0x7fa75c148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa75b400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa73c0678c0 0x7fa73c069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa74c005890 tx=0x7fa74c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.936+0000 7fa75be00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa75c0c4b30 0x7fa75c148030 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.940+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa75c14a2c0 con 0x7fa75c0c4b30 2024-09-12T02:58:15.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.956+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa75c14eaa0 con 0x7fa75c0c4b30 2024-09-12T02:58:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.960+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa75c14eaa0 con 0x7fa75c0c4b30 2024-09-12T02:58:15.963 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.960+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa75c15bcb0 0x7fa75c1f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.960+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fa75c0cbe70 con 0x7fa75c15bcb0 2024-09-12T02:58:15.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.960+0000 7fa75b400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa75c15bcb0 0x7fa75c1f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.960+0000 7fa75b400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa75c15bcb0 0x7fa75c1f3430 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.960+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa75c0cbe70 con 0x7fa75c15bcb0 2024-09-12T02:58:15.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.976+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa75c1f3970 con 0x7fa75c15bcb0 2024-09-12T02:58:15.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.976+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa75c1f3970 con 0x7fa75c15bcb0 2024-09-12T02:58:15.982 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:15.982 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:15.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.976+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa75c0626e0 0x7fa75c062ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:15.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.976+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fa75c150470 con 0x7fa75c0626e0 2024-09-12T02:58:15.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.980+0000 7fa75aa00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa75c0626e0 0x7fa75c062ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:15.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.980+0000 7fa75aa00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa75c0626e0 0x7fa75c062ac0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:15.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.980+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa75c150470 con 0x7fa75c0626e0 2024-09-12T02:58:15.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.992+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa75c150980 con 0x7fa75c0626e0 2024-09-12T02:58:16.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.996+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa75c150980 con 0x7fa75c0626e0 2024-09-12T02:58:16.000 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:16.001 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:16.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.996+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa75c0633c0 0x7fa75c14f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:16.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.996+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fa75c14fd40 con 0x7fa75c0633c0 2024-09-12T02:58:16.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.996+0000 7fa75be00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa75c0633c0 0x7fa75c14f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:16.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:15.996+0000 7fa75be00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa75c0633c0 0x7fa75c14f800 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:16.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.000+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa75c14fd40 con 0x7fa75c0633c0 2024-09-12T02:58:16.005 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:16.003+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:16.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.012+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa75c150220 con 0x7fa75c0633c0 2024-09-12T02:58:16.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.016+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa75c150220 con 0x7fa75c0633c0 2024-09-12T02:58:16.019 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:16.019 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:16.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.016+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa75c02cb60 0x7fa75c02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:16.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.016+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fa75c14fd40 con 0x7fa75c02cb60 2024-09-12T02:58:16.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.016+0000 7fa75b400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa75c02cb60 0x7fa75c02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:16.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.016+0000 7fa75b400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa75c02cb60 0x7fa75c02cfc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:16.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.016+0000 7efddaa00640 1 -- 172.21.15.63:0/3410714694 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pg-upmap", "pgid": "4.4", "id": [5, 7, 4, 6]}]=0 set 4.4 pg_upmap mapping to [5,7,4,6] v45) ==== 132+0+0 (secure 0 0 0) 0x7efdcc0074c0 con 0x7efde40c73f0 2024-09-12T02:58:16.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.016+0000 7f500f400640 1 -- 172.21.15.63:0/1060280412 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v45) ==== 97+0+0 (secure 0 0 0) 0x7f50100598b0 con 0x7f5018159300 2024-09-12T02:58:16.021 INFO:teuthology.orchestra.run.smithi063.stderr:set 4.4 pg_upmap mapping to [5,7,4,6] 2024-09-12T02:58:16.024 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-12T02:58:16.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa75c14fd40 con 0x7fa75c02cb60 2024-09-12T02:58:16.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ff80678c0 msgr2=0x7f4ff8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ff80678c0 0x7f4ff8069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f50080ad000 tx=0x7f50080a6000 comp rx=0 tx=0).stop 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5018159300 msgr2=0x7f50181f3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5018159300 0x7f50181f3c90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f501000c780 tx=0x7f501000cc40 comp rx=0 tx=0).stop 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 shutdown_connections 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5018159300 0x7f50181f3c90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ff80678c0 0x7f4ff8069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50180c8d70 0x7f50180729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 --2- 172.21.15.63:0/1060280412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50180c8990 0x7f50181570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 >> 172.21.15.63:0/1060280412 conn(0x7f501806f900 msgr2=0x7f5018161160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:16.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efdc00678c0 msgr2=0x7efdc0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efdc00678c0 0x7efdc0069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efdd40b1000 tx=0x7efdd40aa000 comp rx=0 tx=0).stop 2024-09-12T02:58:16.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde40c73f0 msgr2=0x7efde41e57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde40c73f0 0x7efde41e57a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c530 tx=0x7efdcc00c9f0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 shutdown_connections 2024-09-12T02:58:16.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7f501ce00640 1 -- 172.21.15.63:0/1060280412 wait complete. 2024-09-12T02:58:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 shutdown_connections 2024-09-12T02:58:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efde4154c30 0x7efde4158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efde40c73f0 0x7efde41e57a0 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c530 tx=0x7efdcc00c9f0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efdc00678c0 0x7efdc0069d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 --2- 172.21.15.63:0/3410714694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efde4070730 0x7efde41e5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.020+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 >> 172.21.15.63:0/3410714694 conn(0x7efde40cd2b0 msgr2=0x7efde406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.024+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 shutdown_connections 2024-09-12T02:58:16.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.024+0000 7efde8a00640 1 -- 172.21.15.63:0/3410714694 wait complete. 2024-09-12T02:58:16.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.040+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa75c14fd40 con 0x7fa75c02cb60 2024-09-12T02:58:16.048 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.044+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa75c14fd40 con 0x7fa75c02cb60 2024-09-12T02:58:16.049 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:16.049 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:16.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.044+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa75c204810 0x7fa75c206c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:16.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.044+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fa75c02da10 con 0x7fa75c204810 2024-09-12T02:58:16.049 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.044+0000 7fa75aa00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa75c204810 0x7fa75c206c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:16.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.048+0000 7fa75aa00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa75c204810 0x7fa75c206c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:16.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.048+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa75c02da10 con 0x7fa75c204810 2024-09-12T02:58:16.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.064+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa75c02da10 con 0x7fa75c204810 2024-09-12T02:58:16.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.068+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa75c02da10 con 0x7fa75c204810 2024-09-12T02:58:16.072 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:16.073 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:16.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.068+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa75c207650 0x7fa75c209a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:16.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.068+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fa75c20c810 con 0x7fa75c207650 2024-09-12T02:58:16.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.068+0000 7fa75be00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa75c207650 0x7fa75c209a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:16.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.068+0000 7fa75be00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa75c207650 0x7fa75c209a40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:16.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.072+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa75c20c810 con 0x7fa75c207650 2024-09-12T02:58:16.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.084+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa75c209f80 con 0x7fa75c207650 2024-09-12T02:58:16.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.088+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa75c209f80 con 0x7fa75c207650 2024-09-12T02:58:16.093 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:16.093 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:16.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.088+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa75c20a600 0x7fa75c20c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:16.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.088+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fa75c20f840 con 0x7fa75c20a600 2024-09-12T02:58:16.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.088+0000 7fa75b400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa75c20a600 0x7fa75c20c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:16.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.092+0000 7fa75b400640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa75c20a600 0x7fa75c20c9f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:16.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.092+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa75c20f840 con 0x7fa75c20a600 2024-09-12T02:58:16.105 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:16.100+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:16.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.104+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fa75c20d200 con 0x7fa75c20a600 2024-09-12T02:58:16.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.108+0000 7fa753400640 1 -- 172.21.15.63:0/2949836844 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa75c20d200 con 0x7fa75c20a600 2024-09-12T02:58:16.114 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.108+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa75c0c4b30 msgr2=0x7fa75c148030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.108+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa75c0c4b30 0x7fa75c148030 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.108+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa75c15bcb0 msgr2=0x7fa75c1f3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.108+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa75c15bcb0 0x7fa75c1f3430 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.108+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa75c0626e0 msgr2=0x7fa75c062ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.108+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa75c0626e0 0x7fa75c062ac0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa75c0633c0 msgr2=0x7fa75c14f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa75c0633c0 0x7fa75c14f800 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa75c02cb60 msgr2=0x7fa75c02cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa75c02cb60 0x7fa75c02cfc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa75c204810 msgr2=0x7fa75c206c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa75c204810 0x7fa75c206c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa75be00640 1 -- 172.21.15.63:0/2949836844 reap_dead start 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa75be00640 1 -- 172.21.15.63:0/2949836844 reap_dead start 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa75c207650 msgr2=0x7fa75c209a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa75c207650 0x7fa75c209a40 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa75c20a600 msgr2=0x7fa75c20c9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa75c20a600 0x7fa75c20c9f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa75be00640 1 -- 172.21.15.63:0/2949836844 reap_dead start 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa73c0678c0 msgr2=0x7fa73c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa73c0678c0 0x7fa73c069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa74c005890 tx=0x7fa74c009040 comp rx=0 tx=0).stop 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75c0c6850 msgr2=0x7fa75c0cb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:16.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75c0c6850 0x7fa75c0cb930 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa7480097f0 tx=0x7fa74801ba70 comp rx=0 tx=0).stop 2024-09-12T02:58:16.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 shutdown_connections 2024-09-12T02:58:16.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75c0c6850 0x7fa75c0cb930 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 --2- 172.21.15.63:0/2949836844 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa73c0678c0 0x7fa73c069d80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:16.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 >> 172.21.15.63:0/2949836844 conn(0x7fa75c06f8e0 msgr2=0x7fa75c071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:16.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 shutdown_connections 2024-09-12T02:58:16.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:16.112+0000 7fa760c00640 1 -- 172.21.15.63:0/2949836844 wait complete. 2024-09-12T02:58:16.117 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:16.117 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:16.135 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:16.226 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:16.224+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:16.307 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:16.303+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:16.340 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:16.340 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:16.357 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:16.408 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:16.403+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:16.509 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:16.507+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:16.551 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:16.551 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:16.567 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:16.610 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:16.607+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:16.711 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:16.708+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:16.731 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:16.731 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:16.747 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:16.834 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:16.832+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:16.913 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:16.911+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:16.948 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:16.948 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:16.965 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:17.055 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:17.052+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:17.115 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:17.111+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:17.162 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:17.162 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:17.178 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:17.217 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:17.211+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:17.317 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:17.312+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:17.371 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:17.372 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:17.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:17.430 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:17.428+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:17.519 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:17.519+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:17.577 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:17.577 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:17.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:17.638 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:17.635+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:17.720 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:17.716+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:17.724 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:17.725 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:17.740 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:17.825 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:17.823+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:17.905 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:17.905 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:17.919 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:17.962 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:17.959+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:18.023 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:18.020+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:18.054 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T02:58:18.089 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:18.089 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:18.103 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:58:18.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:18.149 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:18.147+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:18.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca94c00640 1 Processor -- start 2024-09-12T02:58:18.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca94c00640 1 -- start start 2024-09-12T02:58:18.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca94c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca90154ae0 0x7fca900c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca94c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca90070d10 con 0x7fca900b2180 2024-09-12T02:58:18.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca94c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca90070ff0 con 0x7fca90154700 2024-09-12T02:58:18.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca94c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fca9015b610 con 0x7fca90154ae0 2024-09-12T02:58:18.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca8ea00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca90154ae0 0x7fca900c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca8f400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fca90154700 0x7fca9006c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:57300/0 (socket says 172.21.15.63:57300) 2024-09-12T02:58:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca8f400640 1 -- 172.21.15.63:0/2024372118 learned_addr learned my addr 172.21.15.63:0/2024372118 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca8ea00640 1 -- 172.21.15.63:0/2024372118 >> v1:172.21.15.119:6789/0 conn(0x7fca90154700 legacy=0x7fca9006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca8ea00640 1 -- 172.21.15.63:0/2024372118 >> v1:172.21.15.63:6789/0 conn(0x7fca900b2180 legacy=0x7fca900c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.204+0000 7fca8ea00640 1 -- 172.21.15.63:0/2024372118 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9015b330 con 0x7fca90154ae0 2024-09-12T02:58:18.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca8ea00640 1 --2- 172.21.15.63:0/2024372118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca90154ae0 0x7fca900c1ec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0097c0 tx=0x7fca7c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e6fca3a610c4db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca8e000640 1 -- 172.21.15.63:0/2024372118 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0aa620 con 0x7fca90154ae0 2024-09-12T02:58:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca8e000640 1 -- 172.21.15.63:0/2024372118 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca7c0af070 con 0x7fca90154ae0 2024-09-12T02:58:18.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca8e000640 1 -- 172.21.15.63:0/2024372118 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0aa9e0 con 0x7fca90154ae0 2024-09-12T02:58:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca94c00640 1 -- 172.21.15.63:0/2024372118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca90154ae0 msgr2=0x7fca900c1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca94c00640 1 --2- 172.21.15.63:0/2024372118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca90154ae0 0x7fca900c1ec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0097c0 tx=0x7fca7c01c4a0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca94c00640 1 -- 172.21.15.63:0/2024372118 shutdown_connections 2024-09-12T02:58:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca94c00640 1 --2- 172.21.15.63:0/2024372118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca90154ae0 0x7fca900c1ec0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca94c00640 1 -- 172.21.15.63:0/2024372118 >> 172.21.15.63:0/2024372118 conn(0x7fca90070180 msgr2=0x7fca90070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:18.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca94c00640 1 -- 172.21.15.63:0/2024372118 shutdown_connections 2024-09-12T02:58:18.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.208+0000 7fca94c00640 1 -- 172.21.15.63:0/2024372118 wait complete. 2024-09-12T02:58:18.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca94c00640 1 Processor -- start 2024-09-12T02:58:18.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca94c00640 1 -- start start 2024-09-12T02:58:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca94c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca900b2180 0x7fca900c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca94c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca90154700 0x7fca901599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca94c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca90154ae0 0x7fca90159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca94c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fca900c9580 con 0x7fca900b2180 2024-09-12T02:58:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca94c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca900c9400 con 0x7fca90154ae0 2024-09-12T02:58:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca94c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fca900c9700 con 0x7fca90154700 2024-09-12T02:58:18.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca8f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca900b2180 0x7fca900c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca8f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca900b2180 0x7fca900c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37884/0 (socket says 172.21.15.63:37884) 2024-09-12T02:58:18.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca8f400640 1 -- 172.21.15.63:0/2426553427 learned_addr learned my addr 172.21.15.63:0/2426553427 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:18.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca8fe00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca90154ae0 0x7fca90159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.212+0000 7fca8ea00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca90154700 0x7fca901599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca8f400640 1 -- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca90154700 msgr2=0x7fca901599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca8f400640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca90154700 0x7fca901599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca8f400640 1 -- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca90154ae0 msgr2=0x7fca90159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca8f400640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca90154ae0 0x7fca90159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca8f400640 1 -- 172.21.15.63:0/2426553427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9014f710 con 0x7fca900b2180 2024-09-12T02:58:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca8fe00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca90154ae0 0x7fca90159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca8f400640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca900b2180 0x7fca900c6a40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fca8000c530 tx=0x7fca8000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca87400640 1 -- 172.21.15.63:0/2426553427 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80017070 con 0x7fca900b2180 2024-09-12T02:58:18.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca87400640 1 -- 172.21.15.63:0/2426553427 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca80005cf0 con 0x7fca900b2180 2024-09-12T02:58:18.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca87400640 1 -- 172.21.15.63:0/2426553427 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80007270 con 0x7fca900b2180 2024-09-12T02:58:18.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9014f9f0 con 0x7fca900b2180 2024-09-12T02:58:18.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca900c5840 con 0x7fca900b2180 2024-09-12T02:58:18.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca9006c160 con 0x7fca900b2180 2024-09-12T02:58:18.221 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:18.222 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:18.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.216+0000 7fca87400640 1 -- 172.21.15.63:0/2426553427 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fca8001a070 con 0x7fca900b2180 2024-09-12T02:58:18.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.220+0000 7fca87400640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fca700678c0 0x7fca70069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.220+0000 7fca87400640 1 -- 172.21.15.63:0/2426553427 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6685+0+0 (secure 0 0 0) 0x7fca80085750 con 0x7fca900b2180 2024-09-12T02:58:18.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.220+0000 7fca8ea00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fca700678c0 0x7fca70069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.224 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:18.220+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:18.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.220+0000 7fca8ea00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fca700678c0 0x7fca70069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0ae000 tx=0x7fca7c0b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.224+0000 7fca87400640 1 -- 172.21.15.63:0/2426553427 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fca800558c0 con 0x7fca900b2180 2024-09-12T02:58:18.236 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T02:58:18.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.300+0000 7ff9bcc00640 1 Processor -- start 2024-09-12T02:58:18.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.300+0000 7ff9bcc00640 1 -- start start 2024-09-12T02:58:18.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9bcc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9b8152850 0x7ff9b8158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9bcc00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b8070060 con 0x7ff9b80c8140 2024-09-12T02:58:18.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9bcc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b80c5140 con 0x7ff9b80c8990 2024-09-12T02:58:18.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9bcc00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b80c3190 con 0x7ff9b8152850 2024-09-12T02:58:18.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9b6a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff9b80c8140 0x7ff9b80ce040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41374/0 (socket says 172.21.15.63:41374) 2024-09-12T02:58:18.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9b6a00640 1 -- 172.21.15.63:0/118440008 learned_addr learned my addr 172.21.15.63:0/118440008 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:18.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9b7400640 1 --2- 172.21.15.63:0/118440008 >> v2:172.21.15.119:3300/0 conn(0x7ff9b8152850 0x7ff9b8158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9b7400640 1 -- 172.21.15.63:0/118440008 >> v1:172.21.15.119:6789/0 conn(0x7ff9b80c8990 legacy=0x7ff9b8162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9b7400640 1 -- 172.21.15.63:0/118440008 >> v1:172.21.15.63:6789/0 conn(0x7ff9b80c8140 legacy=0x7ff9b80ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9b6000640 1 -- 172.21.15.63:0/118440008 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 679103859 0 0) 0x7ff9b8070060 con 0x7ff9b80c8140 2024-09-12T02:58:18.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.304+0000 7ff9b7400640 1 -- 172.21.15.63:0/118440008 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b80c3470 con 0x7ff9b8152850 2024-09-12T02:58:18.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9b7400640 1 --2- 172.21.15.63:0/118440008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8152850 0x7ff9b8158410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009740 tx=0x7ff9a801c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68c40182156fa949 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9b6000640 1 -- 172.21.15.63:0/118440008 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80b0070 con 0x7ff9b8152850 2024-09-12T02:58:18.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9b6000640 1 -- 172.21.15.63:0/118440008 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a80ab600 con 0x7ff9b8152850 2024-09-12T02:58:18.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9b6000640 1 -- 172.21.15.63:0/118440008 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80ab9d0 con 0x7ff9b8152850 2024-09-12T02:58:18.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9bcc00640 1 -- 172.21.15.63:0/118440008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8152850 msgr2=0x7ff9b8158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/118440008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8152850 0x7ff9b8158410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009740 tx=0x7ff9a801c2d0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9bcc00640 1 -- 172.21.15.63:0/118440008 shutdown_connections 2024-09-12T02:58:18.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/118440008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b8152850 0x7ff9b8158410 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9bcc00640 1 -- 172.21.15.63:0/118440008 >> 172.21.15.63:0/118440008 conn(0x7ff9b8067a00 msgr2=0x7ff9b8067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:18.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9bcc00640 1 -- 172.21.15.63:0/118440008 shutdown_connections 2024-09-12T02:58:18.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9bcc00640 1 -- 172.21.15.63:0/118440008 wait complete. 2024-09-12T02:58:18.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.308+0000 7ff9bcc00640 1 Processor -- start 2024-09-12T02:58:18.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9bcc00640 1 -- start start 2024-09-12T02:58:18.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9bcc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b80c8140 0x7ff9b81577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9bcc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80c8990 0x7ff9b806d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9bcc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b8152850 0x7ff9b806dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9bcc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b80ce8d0 con 0x7ff9b80c8140 2024-09-12T02:58:18.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9bcc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b80ce750 con 0x7ff9b80c8990 2024-09-12T02:58:18.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9bcc00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b806fc30 con 0x7ff9b8152850 2024-09-12T02:58:18.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b80c8140 0x7ff9b81577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b6a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80c8990 0x7ff9b806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b80c8140 0x7ff9b81577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37888/0 (socket says 172.21.15.63:37888) 2024-09-12T02:58:18.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7400640 1 -- 172.21.15.63:0/3971919393 learned_addr learned my addr 172.21.15.63:0/3971919393 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:18.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7e00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b8152850 0x7ff9b806dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7400640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b8152850 msgr2=0x7ff9b806dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9b8152850 0x7ff9b806dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7400640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80c8990 msgr2=0x7ff9b806d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9b80c8990 0x7ff9b806d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7400640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b81f3bb0 con 0x7ff9b80c8140 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9b7400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b80c8140 0x7ff9b81577c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80ae040 tx=0x7ff9a801ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80b0050 con 0x7ff9b80c8140 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a80bc070 con 0x7ff9b80c8140 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80b5a50 con 0x7ff9b80c8140 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b81f3e70 con 0x7ff9b80c8140 2024-09-12T02:58:18.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.312+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b81558f0 con 0x7ff9b80c8140 2024-09-12T02:58:18.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7ff9b8069870 con 0x7ff9b80c8140 2024-09-12T02:58:18.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9a80ab4a0 con 0x7ff9b80c8140 2024-09-12T02:58:18.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9af400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9980678c0 0x7ff998069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6685+0+0 (secure 0 0 0) 0x7ff9a81208f0 con 0x7ff9b80c8140 2024-09-12T02:58:18.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9b6a00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9980678c0 0x7ff998069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v46) ==== 54+0+16 (secure 0 0 0) 0x7ff9a8015f50 con 0x7ff9b80c8140 2024-09-12T02:58:18.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7ff9b806d170 0x7ff9b814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9b80ce1e0 con 0x7ff9b806d170 2024-09-12T02:58:18.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9b7e00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7ff9b806d170 0x7ff9b814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.316+0000 7ff9b6a00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9980678c0 0x7ff998069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80c7b30 tx=0x7ff9a4007df0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.320+0000 7ff9b7e00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7ff9b806d170 0x7ff9b814d830 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.320+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9b80ce1e0 con 0x7ff9b806d170 2024-09-12T02:58:18.325 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:18.323+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:18.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.336+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff9b80008e0 con 0x7ff9b806d170 2024-09-12T02:58:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.336+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff9b80008e0 con 0x7ff9b806d170 2024-09-12T02:58:18.341 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:18.342 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:18.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.336+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7ff9b8159d40 0x7ff9b81f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.336+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7ff9b8157d00 con 0x7ff9b8159d40 2024-09-12T02:58:18.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.336+0000 7ff9b7400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7ff9b8159d40 0x7ff9b81f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.340+0000 7ff9b7400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7ff9b8159d40 0x7ff9b81f66a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.340+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9b8157d00 con 0x7ff9b8159d40 2024-09-12T02:58:18.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.352+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff9b80cdb50 con 0x7ff9b8159d40 2024-09-12T02:58:18.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.356+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff9b80cdb50 con 0x7ff9b8159d40 2024-09-12T02:58:18.360 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:18.361 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:18.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.356+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff9b81f70f0 0x7ff9b80626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.356+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7ff9b81f74d0 con 0x7ff9b81f70f0 2024-09-12T02:58:18.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.356+0000 7ff9b6a00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff9b81f70f0 0x7ff9b80626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.356+0000 7ff9b6a00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff9b81f70f0 0x7ff9b80626e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.356+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9b81f74d0 con 0x7ff9b81f70f0 2024-09-12T02:58:18.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.376+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff9b8062ef0 con 0x7ff9b81f70f0 2024-09-12T02:58:18.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.376+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff9b8062ef0 con 0x7ff9b81f70f0 2024-09-12T02:58:18.381 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:18.382 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:18.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.376+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7ff9b8153d50 0x7ff9b81541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.376+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7ff9b815c6c0 con 0x7ff9b8153d50 2024-09-12T02:58:18.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.376+0000 7ff9b7e00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7ff9b8153d50 0x7ff9b81541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.380+0000 7ff9b7e00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7ff9b8153d50 0x7ff9b81541b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.380+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9b815c6c0 con 0x7ff9b8153d50 2024-09-12T02:58:18.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.392+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff9b81549c0 con 0x7ff9b8153d50 2024-09-12T02:58:18.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.396+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff9b81549c0 con 0x7ff9b8153d50 2024-09-12T02:58:18.399 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:18.399 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:18.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.396+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7ff9b802cb60 0x7ff9b802cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.396+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7ff9b815c6c0 con 0x7ff9b802cb60 2024-09-12T02:58:18.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.396+0000 7ff9b7400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7ff9b802cb60 0x7ff9b802cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.396+0000 7ff9b7400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7ff9b802cb60 0x7ff9b802cfc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.401 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:18.401 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:18.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.396+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9b815c6c0 con 0x7ff9b802cb60 2024-09-12T02:58:18.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.412+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff9b815c6c0 con 0x7ff9b802cb60 2024-09-12T02:58:18.416 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T02:58:18.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.412+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff9b815c6c0 con 0x7ff9b802cb60 2024-09-12T02:58:18.417 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:18.418 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:18.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.412+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7ff9b8207a20 0x7ff9b8209e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.412+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7ff9b802da10 con 0x7ff9b8207a20 2024-09-12T02:58:18.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.412+0000 7ff9b6a00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7ff9b8207a20 0x7ff9b8209e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.416+0000 7ff9b6a00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7ff9b8207a20 0x7ff9b8209e10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.416+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9b802da10 con 0x7ff9b8207a20 2024-09-12T02:58:18.426 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:18.420+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:18.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.424+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7fca900c79c0 con 0x7fca900b2180 2024-09-12T02:58:18.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.428+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff9b8062ec0 con 0x7ff9b8207a20 2024-09-12T02:58:18.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.432+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff9b8062ec0 con 0x7ff9b8207a20 2024-09-12T02:58:18.437 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.432+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7ff9b820a860 0x7ff9b820cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.432+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7ff9b8154b50 con 0x7ff9b820a860 2024-09-12T02:58:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.432+0000 7ff9b7e00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7ff9b820a860 0x7ff9b820cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.436+0000 7ff9b7e00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7ff9b820a860 0x7ff9b820cc50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.436+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9b8154b50 con 0x7ff9b820a860 2024-09-12T02:58:18.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.448+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff9b8154b50 con 0x7ff9b820a860 2024-09-12T02:58:18.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.452+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff9b8154b50 con 0x7ff9b820a860 2024-09-12T02:58:18.455 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:18.456 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:18.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.452+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7ff9b820d6a0 0x7ff9b820fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:18.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.452+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7ff9b8212a60 con 0x7ff9b820d6a0 2024-09-12T02:58:18.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.452+0000 7ff9b7400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7ff9b820d6a0 0x7ff9b820fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:18.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.452+0000 7ff9b7400640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7ff9b820d6a0 0x7ff9b820fa90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:18.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.452+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9b8212a60 con 0x7ff9b820d6a0 2024-09-12T02:58:18.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7ff9b806caf0 con 0x7ff9b820d6a0 2024-09-12T02:58:18.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9af400640 1 -- 172.21.15.63:0/3971919393 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7ff9b806caf0 con 0x7ff9b820d6a0 2024-09-12T02:58:18.473 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7ff9b806d170 msgr2=0x7ff9b814d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7ff9b806d170 0x7ff9b814d830 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7ff9b8159d40 msgr2=0x7ff9b81f66a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7ff9b8159d40 0x7ff9b81f66a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff9b81f70f0 msgr2=0x7ff9b80626e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff9b81f70f0 0x7ff9b80626e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7ff9b8153d50 msgr2=0x7ff9b81541b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7ff9b8153d50 0x7ff9b81541b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7ff9b802cb60 msgr2=0x7ff9b802cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7ff9b802cb60 0x7ff9b802cfc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7ff9b8207a20 msgr2=0x7ff9b8209e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7ff9b8207a20 0x7ff9b8209e10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7ff9b820a860 msgr2=0x7ff9b820cc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7ff9b820a860 0x7ff9b820cc50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7ff9b820d6a0 msgr2=0x7ff9b820fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7ff9b820d6a0 0x7ff9b820fa90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9b7e00640 1 -- 172.21.15.63:0/3971919393 reap_dead start 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9b7e00640 1 -- 172.21.15.63:0/3971919393 reap_dead start 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9b7e00640 1 -- 172.21.15.63:0/3971919393 reap_dead start 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9b7e00640 1 -- 172.21.15.63:0/3971919393 reap_dead start 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9b7e00640 1 -- 172.21.15.63:0/3971919393 reap_dead start 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9980678c0 msgr2=0x7ff998069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9980678c0 0x7ff998069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80c7b30 tx=0x7ff9a4007df0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b80c8140 msgr2=0x7ff9b81577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:18.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b80c8140 0x7ff9b81577c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80ae040 tx=0x7ff9a801ab10 comp rx=0 tx=0).stop 2024-09-12T02:58:18.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 shutdown_connections 2024-09-12T02:58:18.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff9980678c0 0x7ff998069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 --2- 172.21.15.63:0/3971919393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff9b80c8140 0x7ff9b81577c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:18.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 >> 172.21.15.63:0/3971919393 conn(0x7ff9b8067a00 msgr2=0x7ff9b8156850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:18.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 shutdown_connections 2024-09-12T02:58:18.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:18.468+0000 7ff9bcc00640 1 -- 172.21.15.63:0/3971919393 wait complete. 2024-09-12T02:58:18.527 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:18.523+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:18.577 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:18.577 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:18.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:18.577 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:18.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.577 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:18.577 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:18.577 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 68.721803913000002, 2024-09-12T02:58:18.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00551893, 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:18.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853808+0000", 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4959999999999999e-06 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853827+0000", 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8675999999999999e-05 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853869+0000", 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2347e-05 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853889+0000", 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0248999999999999e-05 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854115+0000", 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022562600000000001 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854168+0000", 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3476000000000001e-05 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859207+0000", 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050389550000000003 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859324+0000", 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117105 2024-09-12T02:58:18.581 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 68.720601174999999, 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077810020000000004, 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:18.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855011+0000", 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3259999999999998e-06 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855026+0000", 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5023e-05 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855055+0000", 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9298e-05 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0525000000000001e-05 2024-09-12T02:58:18.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855570+0000", 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000494539 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855624+0000", 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3656999999999998e-05 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862687+0000", 2024-09-12T02:58:18.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007063593 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862789+0000", 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010204099999999999 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 68.720479565999995, 2024-09-12T02:58:18.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077503839999999999, 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855131+0000", 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5230000000000001e-06 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855143+0000", 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1412e-05 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0043000000000001e-05 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855176+0000", 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3429e-05 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856069+0000", 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00089251 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856116+0000", 2024-09-12T02:58:18.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6826999999999997e-05 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862797+0000", 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066810050000000003 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862880+0000", 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3634999999999995e-05 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 68.719374282000004, 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065292639999999999, 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856237+0000", 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.103e-06 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856252+0000", 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4813e-05 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856279+0000", 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7254e-05 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856297+0000", 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7929000000000001e-05 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856462+0000", 2024-09-12T02:58:18.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016488700000000001 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856508+0000", 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5787000000000001e-05 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862657+0000", 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061494210000000004 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862764+0000", 2024-09-12T02:58:18.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010707 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 68.718627015999999, 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005857943, 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:18.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:18.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856984+0000", 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3799999999999999e-06 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856997+0000", 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2896e-05 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857022+0000", 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5554999999999998e-05 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857043+0000", 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0919000000000001e-05 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857162+0000", 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118526 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857225+0000", 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3578999999999996e-05 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862772+0000", 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055470789999999999 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862840+0000", 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8009000000000006e-05 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:18.599 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.661499507, 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00045081800000000002, 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:18.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914111+0000", 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1699999999999997e-07 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914116+0000", 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.259e-06 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:18.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914129+0000", 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3451e-05 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914140+0000", 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0721e-05 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914241+0000", 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000100843 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:18.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914561+0000", 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031982700000000001 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 13.658007605, 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000219385, 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:18.603 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:18.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5800000000000001e-07 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917605+0000", 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1379999999999999e-06 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917611+0000", 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9179999999999999e-06 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:18.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917620+0000", 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0389999999999993e-06 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917681+0000", 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0482999999999997e-05 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917821+0000", 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014054900000000001 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.606 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:18.607 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.607 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:18.607 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:18.607 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:18.608 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:18.628 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:18.624+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:18.729 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:18.724+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:18.773 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:18.773 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:18.773 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:18.773 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:18.788 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:18.837 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:18.835+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:18.908 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:18.909 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:18.909 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:18.909 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:18.909 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:18.924 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:18.930 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:18.928+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:19.031 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:19.028+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:19.046 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca87400640 1 -- 172.21.15.63:0/2426553427 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v47) ==== 91+0+0 (secure 0 0 0) 0x7fca80059bc0 con 0x7fca900b2180 2024-09-12T02:58:19.046 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fca700678c0 msgr2=0x7fca70069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fca700678c0 0x7fca70069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0ae000 tx=0x7fca7c0b5040 comp rx=0 tx=0).stop 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca900b2180 msgr2=0x7fca900c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca900b2180 0x7fca900c6a40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fca8000c530 tx=0x7fca8000c9f0 comp rx=0 tx=0).stop 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 shutdown_connections 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca90154ae0 0x7fca90159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fca700678c0 0x7fca70069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca90154700 0x7fca901599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 --2- 172.21.15.63:0/2426553427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca900b2180 0x7fca900c6a40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:19.050 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.044+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 >> 172.21.15.63:0/2426553427 conn(0x7fca90070180 msgr2=0x7fca9014c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:19.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.048+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 shutdown_connections 2024-09-12T02:58:19.052 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:19.048+0000 7fca94c00640 1 -- 172.21.15.63:0/2426553427 wait complete. 2024-09-12T02:58:19.098 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.242540250000005, 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.099 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:19.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:19.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.242407041999996, 2024-09-12T02:58:19.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:19.106 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.106 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.106 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.106 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:19.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:19.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:19.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:19.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.242302292000005, 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.112 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.114 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:19.115 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:19.115 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.115 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.115 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.115 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:19.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:19.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.116 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.116 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:19.116 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:19.116 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.116 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.117 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.117 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:19.117 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:19.117 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.117 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:19.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:19.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:19.118 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.118 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.118 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.118 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:19.118 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:19.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.119 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.119 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:19.119 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:19.119 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.119 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.120 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:19.121 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.242156473999998, 2024-09-12T02:58:19.121 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:19.121 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.121 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.121 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.121 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.121 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.122 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.123 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:19.124 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:19.125 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:19.126 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.242083292000004, 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.127 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:19.128 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.129 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.130 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:19.131 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.132 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.242023305999993, 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.133 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.134 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.135 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:19.136 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.137 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.138 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.24196096, 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:19.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.142 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.241903444000002, 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:19.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:19.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:19.147 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.239735819000003, 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:19.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:19.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.236577303999994, 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.152 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:19.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:19.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing_reply(2.14 epoch 25/19 rep_tid 7 lcod 25'5)", 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.230116358999993, 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010494969999999999, 2024-09-12T02:58:19.156 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.157 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.157 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:19.157 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:19.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864694+0000", 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864695+0000", 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.7300000000000001e-07 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864699+0000", 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.33e-06 2024-09-12T02:58:19.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864715+0000", 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6116e-05 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864727+0000", 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1759e-05 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865572+0000", 2024-09-12T02:58:19.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00084520699999999995 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865744+0000", 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000171612 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:19.160 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.228868430999995, 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:19.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:19.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:19.166 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.209979480000001, 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.167 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:19.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:19.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:19.171 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 58.481577674, 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:19.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:19.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 56.725741092, 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.177 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:19.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:19.182 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.843652128000002, 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.183 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:19.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:19.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:19.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 34.159694514999998, 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:19.189 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:19.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:19.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:19.195 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 34.159589224000001, 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:19.201 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 31.467026074, 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:19.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:19.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:19.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:46 2.6 e28/19 2:654134d2:::mds0_openfiles.0:head v 28'2, mlcod=0'0)", 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 31.206832176999999, 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0015286869999999999, 2024-09-12T02:58:19.207 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887978+0000", 2024-09-12T02:58:19.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887979+0000", 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4000000000000002e-07 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.887986+0000", 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1999999999999997e-06 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888007+0000", 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1075999999999999e-05 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888022+0000", 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5316e-05 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888142+0000", 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011911100000000001 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.888187+0000", 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5225000000000002e-05 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889432+0000", 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012450709999999999 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.889507+0000", 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5148000000000006e-05 2024-09-12T02:58:19.211 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.212 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.212 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:19.213 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:19.214 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:19.208+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:19.315 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:19.310+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:19.342 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:19.342 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:19.342 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:19.342 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:19.356 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:19.441 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:19.438+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:19.516 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:19.512+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:19.521 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:19.522 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:19.522 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:19.522 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:19.522 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:19.537 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:19.629 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:19.626+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.959364043999997, 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:19.710 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.711 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:19.712 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.713 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.714 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:19.715 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.716 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.816168705999999, 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.717 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.718 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:19.719 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:19.720 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.721 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:19.722 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.816148179999999, 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:19.723 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.724 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:19.725 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.726 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.727 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:19.728 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.816037367000007, 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:19.729 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.730 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:19.731 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:19.732 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.733 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.734 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.816015840999995, 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:19.735 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.736 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:19.737 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:19.738 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.739 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.740 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.751029195000001, 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.741 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.742 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:19.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.743 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.743 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.743 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:19.743 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:19.743 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.744 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:19.745 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:19.746 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.747 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.528925672, 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:19.748 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.749 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.750 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.751 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.528788680999995, 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.754 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:19.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:19.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:19.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.759 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.527671479000006, 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:19.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.761 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:19.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:19.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:19.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:19.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.764 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:19.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:19.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:19.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:19.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.527599366000004, 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.767 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:19.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.772 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.527375382000002, 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:19.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.778 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.527305398999999, 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:19.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:19.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.784 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.527199761999995, 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:19.785 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.786 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.787 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.788 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:19.789 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.527009664999994, 2024-09-12T02:58:19.790 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.791 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.792 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.793 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.794 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:19.795 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:19.796 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 83.526942878, 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.797 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.798 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.799 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.800 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:19.801 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 82.951593281000001, 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:19.802 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.803 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:19.804 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:19.805 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:19.806 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.807 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.808 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.852893847000004, 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:19.809 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.810 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.810 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.810 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.810 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:19.810 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.810 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.810 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.810 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.810 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.811 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:19.812 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:19.813 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.814 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.852808605000007, 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:19.815 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.816 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.817 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.818 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.819 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.852671490999995, 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.820 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:19.821 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.822 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.823 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:19.824 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.852501591999996, 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:19.827 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:19.828 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.829 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.830 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:19.830 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:19.830 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:19.831 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:19.826+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:19.832 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:19.932 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:19.930+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:20.033 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:20.030+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:20.053 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:20.053 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:20.053 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:20.053 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:20.069 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:20.135 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:20.130+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:20.236 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:20.230+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:20.267 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:20.267 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:20.267 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:20.290 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:20.337 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:20.330+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:20.438 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:20.432+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:20.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:20.510 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:20.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:20.510 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'39)", 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.553037016999994, 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047813200000000004, 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955738+0000", 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3099999999999998e-07 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955742+0000", 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955753+0000", 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1321000000000001e-05 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955759+0000", 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1070000000000001e-06 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955810+0000", 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0711000000000003e-05 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955823+0000", 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2605999999999999e-05 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960475+0000", 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004652354 2024-09-12T02:58:20.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960518+0000", 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3316999999999999e-05 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'39)", 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.551514221999994, 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039674089999999999, 2024-09-12T02:58:20.515 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957261+0000", 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8400000000000004e-07 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957334+0000", 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3613000000000001e-05 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957347+0000", 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3349e-05 2024-09-12T02:58:20.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957353+0000", 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1089999999999997e-06 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957405+0000", 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2206000000000001e-05 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957427+0000", 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2155999999999999e-05 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961190+0000", 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037629849999999999 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961227+0000", 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7307e-05 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:20.519 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.549269183999996, 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004389858, 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959506+0000", 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8599999999999998e-07 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959510+0000", 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7339999999999999e-06 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959523+0000", 2024-09-12T02:58:20.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2773e-05 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959528+0000", 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9740000000000001e-06 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960547+0000", 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010187359999999999 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960560+0000", 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3223e-05 2024-09-12T02:58:20.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963855+0000", 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032949910000000002 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963895+0000", 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9740999999999998e-05 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.523 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.541716432000001, 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021753509999999998, 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6599999999999996e-07 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967141+0000", 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2319999999999998e-05 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967152+0000", 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1432e-05 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967158+0000", 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8019999999999997e-06 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967207+0000", 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9075e-05 2024-09-12T02:58:20.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967224+0000", 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7427000000000001e-05 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969194+0000", 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019695590000000001 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969233+0000", 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9169999999999999e-05 2024-09-12T02:58:20.527 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.540318248000005, 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003562614, 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7899999999999998e-07 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968495+0000", 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8025000000000003e-05 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968507+0000", 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2758999999999999e-05 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968513+0000", 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3009999999999997e-06 2024-09-12T02:58:20.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968585+0000", 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2139999999999997e-05 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968599+0000", 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4752999999999999e-05 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.971980+0000", 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033801059999999999 2024-09-12T02:58:20.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972018+0000", 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8850999999999998e-05 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:74 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'48, mlcod=17'44)", 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.538648293999998, 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022444370000000002, 2024-09-12T02:58:20.532 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7100000000000001e-07 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970131+0000", 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4850000000000003e-06 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970144+0000", 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2595999999999999e-05 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970149+0000", 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.395e-06 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970209+0000", 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9905999999999999e-05 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970225+0000", 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6177000000000001e-05 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972340+0000", 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002114917 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972370+0000", 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.029e-05 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.536 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:83 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'50)", 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.522667318000003, 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002809059, 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6000000000000004e-07 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986112+0000", 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8019999999999999e-06 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986123+0000", 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0953e-05 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986128+0000", 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7849999999999999e-06 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986166+0000", 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7923000000000003e-05 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986180+0000", 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4211e-05 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988884+0000", 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027039640000000001 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988916+0000", 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1860999999999999e-05 2024-09-12T02:58:20.540 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:84 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'50)", 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.521670506000007, 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002347909, 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8899999999999999e-07 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987155+0000", 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0776000000000003e-05 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987167+0000", 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2215000000000001e-05 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987172+0000", 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.04e-06 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987232+0000", 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9595000000000001e-05 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987246+0000", 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3757000000000001e-05 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989417+0000", 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021715329999999998 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989451+0000", 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4304000000000002e-05 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:90 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'60, mlcod=17'57)", 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.513134602999997, 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027093489999999998, 2024-09-12T02:58:20.545 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995640+0000", 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9699999999999995e-07 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995794+0000", 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015367199999999999 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995805+0000", 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1061e-05 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995810+0000", 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4589999999999997e-06 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995856+0000", 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6127000000000001e-05 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995870+0000", 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3854e-05 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998315+0000", 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024450930000000002 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998349+0000", 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3386000000000002e-05 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.549 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:105 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'67, mlcod=17'64)", 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.330859485000005, 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026337050000000001, 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4300000000000003e-07 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177930+0000", 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4735999999999999e-05 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177942+0000", 2024-09-12T02:58:20.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2349e-05 2024-09-12T02:58:20.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177949+0000", 2024-09-12T02:58:20.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6599999999999998e-06 2024-09-12T02:58:20.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178003+0000", 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3535999999999997e-05 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178018+0000", 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5227e-05 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180517+0000", 2024-09-12T02:58:20.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024996419999999998 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180548+0000", 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0911999999999998e-05 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.554 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:158 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'112, mlcod=18'109)", 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.053620499000004, 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026267230000000001, 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.58e-07 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455235+0000", 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1242000000000006e-05 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455245+0000", 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.995e-06 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455250+0000", 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7079999999999996e-06 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455297+0000", 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6885000000000003e-05 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455311+0000", 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4354e-05 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457734+0000", 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024232540000000001 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457780+0000", 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5827e-05 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:159 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'113, mlcod=18'109)", 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.052899511000007, 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046885809999999998, 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5300000000000004e-07 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455879+0000", 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8650000000000003e-06 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455889+0000", 2024-09-12T02:58:20.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0139999999999999e-05 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455894+0000", 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2959999999999998e-06 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455944+0000", 2024-09-12T02:58:20.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9774999999999997e-05 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455962+0000", 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8009999999999999e-05 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460534+0000", 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045721299999999998 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460563+0000", 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8812000000000001e-05 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:4 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.656751155999999, 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073449359999999998, 2024-09-12T02:58:20.565 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852025+0000", 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2280000000000001e-06 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852034+0000", 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1619999999999997e-06 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852060+0000", 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5714000000000001e-05 2024-09-12T02:58:20.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852073+0000", 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3199e-05 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852384+0000", 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031071499999999998 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852627+0000", 2024-09-12T02:58:20.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024345000000000001 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852778+0000", 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015093999999999999 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857277+0000", 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044991120000000004 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859269+0000", 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019915879999999999 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3817999999999999e-05 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859368+0000", 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5009999999999998e-05 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.570 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.656659747000006, 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012795443, 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852115+0000", 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.54e-07 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852120+0000", 2024-09-12T02:58:20.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2299999999999999e-06 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852132+0000", 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1746000000000001e-05 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852140+0000", 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2300000000000008e-06 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854507+0000", 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023667369999999998 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854587+0000", 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0024000000000005e-05 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854730+0000", 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014253599999999999 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859376+0000", 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046468200000000003 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864800+0000", 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054233670000000001 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864864+0000", 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4397e-05 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864910+0000", 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5602000000000001e-05 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:28 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.656601499000004, 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011320167000000001, 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.576 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1600000000000001e-07 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852188+0000", 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.506e-05 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852199+0000", 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0677e-05 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852206+0000", 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8279999999999997e-06 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852418+0000", 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021227799999999999 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852545+0000", 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012638499999999999 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852774+0000", 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0002299 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856085+0000", 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033103569999999999 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863371+0000", 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072860260000000001 2024-09-12T02:58:20.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863444+0000", 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.305e-05 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863493+0000", 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8890000000000001e-05 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.656539437999996, 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012832368, 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5700000000000002e-07 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852262+0000", 2024-09-12T02:58:20.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7135e-05 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852366+0000", 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103606 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852378+0000", 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2204999999999999e-05 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854980+0000", 2024-09-12T02:58:20.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026019860000000001 2024-09-12T02:58:20.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855096+0000", 2024-09-12T02:58:20.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115887 2024-09-12T02:58:20.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855213+0000", 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116916 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859383+0000", 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041700089999999997 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:20.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864993+0000", 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056103209999999997 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865043+0000", 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9481999999999998e-05 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865067+0000", 2024-09-12T02:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4164000000000001e-05 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.656327035999993, 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012817586000000001, 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.588 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852448+0000", 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5600000000000005e-07 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852453+0000", 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9019999999999998e-06 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852462+0000", 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9069999999999996e-06 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852469+0000", 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.374e-06 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853604+0000", 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011349299999999999 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853717+0000", 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112797 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:20.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853836+0000", 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011936500000000001 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859663+0000", 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058266209999999997 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865167+0000", 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055044849999999999 2024-09-12T02:58:20.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865226+0000", 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8718000000000003e-05 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865265+0000", 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8730999999999999e-05 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.594 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.656295436999997, 2024-09-12T02:58:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012748110999999999, 2024-09-12T02:58:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.595 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6699999999999999e-07 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852492+0000", 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.291e-05 2024-09-12T02:58:20.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852500+0000", 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1580000000000005e-06 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852506+0000", 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5330000000000002e-06 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856830+0000", 2024-09-12T02:58:20.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004324194 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856959+0000", 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012862099999999999 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865227+0000", 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082682280000000007 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.653973346000001, 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045219450000000003, 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854802+0000", 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854814+0000", 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1759999999999999e-05 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854836+0000", 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2039999999999999e-05 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854855+0000", 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.929e-05 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854975+0000", 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119561 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043479110000000003 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.603 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:2 2.f e25/19 2:f1f69726:::400.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 70.650657148999997, 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032847000000000002, 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858118+0000", 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1540000000000001e-06 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858126+0000", 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7759999999999997e-06 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858138+0000", 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2184999999999999e-05 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858145+0000", 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858282+0000", 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013642799999999999 2024-09-12T02:58:20.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858297+0000", 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5328e-05 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861346+0000", 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030492729999999999 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:20.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861402+0000", 2024-09-12T02:58:20.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5220999999999999e-05 2024-09-12T02:58:20.608 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.608 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.608 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.608 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:20.608 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:20.609 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:20.610 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:20.606+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:20.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.640+0000 7f0c66000640 1 Processor -- start 2024-09-12T02:58:20.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.640+0000 7f0c66000640 1 -- start start 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c66000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0c601517d0 0x7f0c6015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c66000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c60070520 con 0x7f0c6015e340 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c66000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c600c9180 con 0x7f0c600c9470 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c66000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0c6006f6f0 con 0x7f0c601517d0 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c5ea00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0c6015e340 0x7f0c600ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41376/0 (socket says 172.21.15.63:41376) 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c5ea00640 1 -- 172.21.15.63:0/1746901188 learned_addr learned my addr 172.21.15.63:0/1746901188 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c5f400640 1 --2- 172.21.15.63:0/1746901188 >> v2:172.21.15.119:3300/0 conn(0x7f0c601517d0 0x7f0c6015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c5e000640 1 -- 172.21.15.63:0/1746901188 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308732531 0 0) 0x7f0c60070520 con 0x7f0c6015e340 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c5e000640 1 -- 172.21.15.63:0/1746901188 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c44003530 con 0x7f0c6015e340 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c5f400640 1 -- 172.21.15.63:0/1746901188 >> v1:172.21.15.119:6789/0 conn(0x7f0c600c9470 legacy=0x7f0c60165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c5f400640 1 -- 172.21.15.63:0/1746901188 >> v1:172.21.15.63:6789/0 conn(0x7f0c6015e340 legacy=0x7f0c600ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.644+0000 7f0c5f400640 1 -- 172.21.15.63:0/1746901188 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6006ffa0 con 0x7f0c601517d0 2024-09-12T02:58:20.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c5f400640 1 --2- 172.21.15.63:0/1746901188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c601517d0 0x7f0c6015de00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0c500097c0 tx=0x7f0c5001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2781123cf7a52874 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c5e000640 1 -- 172.21.15.63:0/1746901188 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c500b5070 con 0x7f0c601517d0 2024-09-12T02:58:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c5e000640 1 -- 172.21.15.63:0/1746901188 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c500a8990 con 0x7f0c601517d0 2024-09-12T02:58:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c5e000640 1 -- 172.21.15.63:0/1746901188 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c500a8d40 con 0x7f0c601517d0 2024-09-12T02:58:20.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c66000640 1 -- 172.21.15.63:0/1746901188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c601517d0 msgr2=0x7f0c6015de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c66000640 1 --2- 172.21.15.63:0/1746901188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c601517d0 0x7f0c6015de00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0c500097c0 tx=0x7f0c5001ec90 comp rx=0 tx=0).stop 2024-09-12T02:58:20.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c66000640 1 -- 172.21.15.63:0/1746901188 shutdown_connections 2024-09-12T02:58:20.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c66000640 1 --2- 172.21.15.63:0/1746901188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c601517d0 0x7f0c6015de00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c66000640 1 -- 172.21.15.63:0/1746901188 >> 172.21.15.63:0/1746901188 conn(0x7f0c60067a00 msgr2=0x7f0c60067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:20.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c66000640 1 -- 172.21.15.63:0/1746901188 shutdown_connections 2024-09-12T02:58:20.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.648+0000 7f0c66000640 1 -- 172.21.15.63:0/1746901188 wait complete. 2024-09-12T02:58:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c66000640 1 Processor -- start 2024-09-12T02:58:20.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c66000640 1 -- start start 2024-09-12T02:58:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c66000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c600c9470 0x7f0c600c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c66000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c601517d0 0x7f0c6014cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c66000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c6015e340 0x7f0c60149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c66000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0c60070240 con 0x7f0c601517d0 2024-09-12T02:58:20.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c66000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0c600c8cf0 con 0x7f0c600c9470 2024-09-12T02:58:20.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c66000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6006fc00 con 0x7f0c6015e340 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c601517d0 0x7f0c6014cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c600c9470 0x7f0c600c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c601517d0 0x7f0c6014cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37898/0 (socket says 172.21.15.63:37898) 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5ea00640 1 -- 172.21.15.63:0/3792870658 learned_addr learned my addr 172.21.15.63:0/3792870658 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5fe00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c6015e340 0x7f0c60149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5ea00640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c6015e340 msgr2=0x7f0c60149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5ea00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c6015e340 0x7f0c60149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5ea00640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c600c9470 msgr2=0x7f0c600c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5ea00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c600c9470 0x7f0c600c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5ea00640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c601561d0 con 0x7f0c601517d0 2024-09-12T02:58:20.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.652+0000 7f0c5ea00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c601517d0 0x7f0c6014cfc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00c4d0 tx=0x7f0c4c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.656+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c017070 con 0x7f0c601517d0 2024-09-12T02:58:20.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.656+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c4c005cf0 con 0x7f0c601517d0 2024-09-12T02:58:20.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.656+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c007270 con 0x7f0c601517d0 2024-09-12T02:58:20.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.656+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c601564b0 con 0x7f0c601517d0 2024-09-12T02:58:20.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.656+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c60156a70 con 0x7f0c601517d0 2024-09-12T02:58:20.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.656+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f0c6006ec50 con 0x7f0c601517d0 2024-09-12T02:58:20.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.656+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c4c01a070 con 0x7f0c601517d0 2024-09-12T02:58:20.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.656+0000 7f0c57400640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c400678c0 0x7f0c40069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.656+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6685+0+0 (secure 0 0 0) 0x7f0c4c085480 con 0x7f0c601517d0 2024-09-12T02:58:20.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.660+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v47) ==== 54+0+16 (secure 0 0 0) 0x7f0c4c087a20 con 0x7f0c601517d0 2024-09-12T02:58:20.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.660+0000 7f0c5f400640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c400678c0 0x7f0c40069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.660+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f0c6014d500 0x7f0c600c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.660+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c600ca440 con 0x7f0c6014d500 2024-09-12T02:58:20.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.660+0000 7f0c5fe00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f0c6014d500 0x7f0c600c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.660+0000 7f0c5f400640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c400678c0 0x7f0c40069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c500b2000 tx=0x7f0c500aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.660+0000 7f0c5fe00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f0c6014d500 0x7f0c600c3170 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.660+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c600ca440 con 0x7f0c6014d500 2024-09-12T02:58:20.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.688+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c600ca160 con 0x7f0c6014d500 2024-09-12T02:58:20.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.692+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c600ca160 con 0x7f0c6014d500 2024-09-12T02:58:20.697 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.692+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0c601f0ae0 0x7f0c601f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.692+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f0c600c9ba0 con 0x7f0c601f0ae0 2024-09-12T02:58:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.692+0000 7f0c5f400640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0c601f0ae0 0x7f0c601f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.696+0000 7f0c5f400640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0c601f0ae0 0x7f0c601f15b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.696+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c600c9ba0 con 0x7f0c601f0ae0 2024-09-12T02:58:20.710 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:20.708+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:20.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.724+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c600c4650 con 0x7f0c601f0ae0 2024-09-12T02:58:20.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.724+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c600c4650 con 0x7f0c601f0ae0 2024-09-12T02:58:20.730 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:20.730 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:20.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.728+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f0c601f44f0 0x7f0c601f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.728+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f0c601f4e10 con 0x7f0c601f44f0 2024-09-12T02:58:20.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.728+0000 7f0c5ea00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f0c601f44f0 0x7f0c601f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.728+0000 7f0c5ea00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f0c601f44f0 0x7f0c601f48d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.728+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c601f4e10 con 0x7f0c601f44f0 2024-09-12T02:58:20.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.756+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c60062930 con 0x7f0c601f44f0 2024-09-12T02:58:20.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.756+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c60062930 con 0x7f0c601f44f0 2024-09-12T02:58:20.762 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:20.762 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:20.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.756+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0c60063410 0x7f0c6014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.756+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f0c6014e530 con 0x7f0c60063410 2024-09-12T02:58:20.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.756+0000 7f0c5fe00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0c60063410 0x7f0c6014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.760+0000 7f0c5fe00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0c60063410 0x7f0c6014dff0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.760+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c6014e530 con 0x7f0c60063410 2024-09-12T02:58:20.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.772+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c6014ea10 con 0x7f0c60063410 2024-09-12T02:58:20.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.776+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c6014ea10 con 0x7f0c60063410 2024-09-12T02:58:20.780 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:20.781 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:20.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.776+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f0c6002c650 0x7f0c6002ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.776+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f0c6014e530 con 0x7f0c6002c650 2024-09-12T02:58:20.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.776+0000 7f0c5f400640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f0c6002c650 0x7f0c6002ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.776+0000 7f0c5f400640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f0c6002c650 0x7f0c6002ca90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.780+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c6014e530 con 0x7f0c6002c650 2024-09-12T02:58:20.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.792+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c6014e530 con 0x7f0c6002c650 2024-09-12T02:58:20.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.796+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c6014e530 con 0x7f0c6002c650 2024-09-12T02:58:20.802 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:20.802 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:20.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.796+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f0c6002d4e0 0x7f0c602073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.796+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f0c6014e530 con 0x7f0c6002d4e0 2024-09-12T02:58:20.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.800+0000 7f0c5ea00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f0c6002d4e0 0x7f0c602073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.800+0000 7f0c5ea00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f0c6002d4e0 0x7f0c602073b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.800+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c6014e530 con 0x7f0c6002d4e0 2024-09-12T02:58:20.811 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:20.808+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.828+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c6014e530 con 0x7f0c6002d4e0 2024-09-12T02:58:20.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.832+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c6014e530 con 0x7f0c6002d4e0 2024-09-12T02:58:20.835 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:20.836 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:20.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.832+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0c6002d940 0x7f0c60209e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.832+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f0c6020cbe0 con 0x7f0c6002d940 2024-09-12T02:58:20.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.832+0000 7f0c5fe00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0c6002d940 0x7f0c60209e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.832+0000 7f0c5fe00640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0c6002d940 0x7f0c60209e10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.836+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c6020cbe0 con 0x7f0c6002d940 2024-09-12T02:58:20.859 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:20.859 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:20.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.860+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c6020a350 con 0x7f0c6002d940 2024-09-12T02:58:20.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.864+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c6020a350 con 0x7f0c6002d940 2024-09-12T02:58:20.869 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.864+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f0c6020a9d0 0x7f0c6020cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.864+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f0c6020fb90 con 0x7f0c6020a9d0 2024-09-12T02:58:20.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.868+0000 7f0c5f400640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f0c6020a9d0 0x7f0c6020cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:20.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.868+0000 7f0c5f400640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f0c6020a9d0 0x7f0c6020cdc0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:20.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.868+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c6020fb90 con 0x7f0c6020a9d0 2024-09-12T02:58:20.882 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:20.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.888+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f0c6020d380 con 0x7f0c6020a9d0 2024-09-12T02:58:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c57400640 1 -- 172.21.15.63:0/3792870658 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f0c6020d380 con 0x7f0c6020a9d0 2024-09-12T02:58:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:20.895 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:20.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f0c6014d500 msgr2=0x7f0c600c3170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f0c6014d500 0x7f0c600c3170 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0c601f0ae0 msgr2=0x7f0c601f15b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f0c601f0ae0 0x7f0c601f15b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f0c601f44f0 msgr2=0x7f0c601f48d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f0c601f44f0 0x7f0c601f48d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0c60063410 msgr2=0x7f0c6014dff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f0c60063410 0x7f0c6014dff0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f0c6002c650 msgr2=0x7f0c6002ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f0c6002c650 0x7f0c6002ca90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f0c6002d4e0 msgr2=0x7f0c602073b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f0c6002d4e0 0x7f0c602073b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0c6002d940 msgr2=0x7f0c60209e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f0c6002d940 0x7f0c60209e10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f0c6020a9d0 msgr2=0x7f0c6020cdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f0c6020a9d0 0x7f0c6020cdc0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c5fe00640 1 -- 172.21.15.63:0/3792870658 reap_dead start 2024-09-12T02:58:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c5fe00640 1 -- 172.21.15.63:0/3792870658 reap_dead start 2024-09-12T02:58:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c5fe00640 1 -- 172.21.15.63:0/3792870658 reap_dead start 2024-09-12T02:58:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c5fe00640 1 -- 172.21.15.63:0/3792870658 reap_dead start 2024-09-12T02:58:20.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c400678c0 msgr2=0x7f0c40069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0c400678c0 0x7f0c40069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0c500b2000 tx=0x7f0c500aa070 comp rx=0 tx=0).stop 2024-09-12T02:58:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c5fe00640 1 -- 172.21.15.63:0/3792870658 reap_dead start 2024-09-12T02:58:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c601517d0 msgr2=0x7f0c6014cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c601517d0 0x7f0c6014cfc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00c4d0 tx=0x7f0c4c00c990 comp rx=0 tx=0).stop 2024-09-12T02:58:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 shutdown_connections 2024-09-12T02:58:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 --2- 172.21.15.63:0/3792870658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0c601517d0 0x7f0c6014cfc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 >> 172.21.15.63:0/3792870658 conn(0x7f0c60067a00 msgr2=0x7f0c6015b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 shutdown_connections 2024-09-12T02:58:20.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:20.892+0000 7f0c66000640 1 -- 172.21.15.63:0/3792870658 wait complete. 2024-09-12T02:58:20.913 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:20.906+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:21.014 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:21.008+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:21.065 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T02:58:21.065 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T02:58:21.065 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-12T02:58:21.065 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T02:58:21.066 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T02:58:21.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-12T02:58:21.082 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T02:58:21.114 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:21.112+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:21.118 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:21.118 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:21.140 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:21.231 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:21.228+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:21.293 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:21.293 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T02:58:21.293 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.308+0000 7fa46ee00640 1 Processor -- start 2024-09-12T02:58:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.308+0000 7fa46ee00640 1 -- start start 2024-09-12T02:58:21.316 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:21.310+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:21.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46ee00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa46806f410 0x7fa46806f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:21.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46ee00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46815b870 con 0x7fa4680ca7a0 2024-09-12T02:58:21.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46ee00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4680c7d30 con 0x7fa4680c9480 2024-09-12T02:58:21.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46ee00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa46806e120 con 0x7fa46806f410 2024-09-12T02:58:21.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46da00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa46806f410 0x7fa46806f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:21.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46d000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa4680ca7a0 0x7fa46815b160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41384/0 (socket says 172.21.15.63:41384) 2024-09-12T02:58:21.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46d000640 1 -- 172.21.15.63:0/2292815822 learned_addr learned my addr 172.21.15.63:0/2292815822 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:21.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa467e00640 1 -- 172.21.15.63:0/2292815822 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 857332745 0 0) 0x7fa46815b870 con 0x7fa4680ca7a0 2024-09-12T02:58:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa467e00640 1 -- 172.21.15.63:0/2292815822 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa450003530 con 0x7fa4680ca7a0 2024-09-12T02:58:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46da00640 1 -- 172.21.15.63:0/2292815822 >> v1:172.21.15.119:6789/0 conn(0x7fa4680c9480 legacy=0x7fa46806c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa467e00640 1 -- 172.21.15.63:0/2292815822 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791189624 0 0) 0x7fa4680c7d30 con 0x7fa4680c9480 2024-09-12T02:58:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46da00640 1 -- 172.21.15.63:0/2292815822 >> v1:172.21.15.63:6789/0 conn(0x7fa4680ca7a0 legacy=0x7fa46815b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:21.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.312+0000 7fa46da00640 1 -- 172.21.15.63:0/2292815822 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46806e400 con 0x7fa46806f410 2024-09-12T02:58:21.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa46da00640 1 --2- 172.21.15.63:0/2292815822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46806f410 0x7fa46806f7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0097c0 tx=0x7fa45c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2973f3d851784a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:21.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa467e00640 1 -- 172.21.15.63:0/2292815822 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0b5070 con 0x7fa46806f410 2024-09-12T02:58:21.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa467e00640 1 -- 172.21.15.63:0/2292815822 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45c0a8990 con 0x7fa46806f410 2024-09-12T02:58:21.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa467e00640 1 -- 172.21.15.63:0/2292815822 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0a8d40 con 0x7fa46806f410 2024-09-12T02:58:21.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa46ee00640 1 -- 172.21.15.63:0/2292815822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46806f410 msgr2=0x7fa46806f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:21.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa46ee00640 1 --2- 172.21.15.63:0/2292815822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46806f410 0x7fa46806f7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0097c0 tx=0x7fa45c01ec90 comp rx=0 tx=0).stop 2024-09-12T02:58:21.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa46ee00640 1 -- 172.21.15.63:0/2292815822 shutdown_connections 2024-09-12T02:58:21.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa46ee00640 1 --2- 172.21.15.63:0/2292815822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa46806f410 0x7fa46806f7f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:21.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa46ee00640 1 -- 172.21.15.63:0/2292815822 >> 172.21.15.63:0/2292815822 conn(0x7fa4680c9af0 msgr2=0x7fa4680c9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:21.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa46ee00640 1 -- 172.21.15.63:0/2292815822 shutdown_connections 2024-09-12T02:58:21.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.320+0000 7fa46ee00640 1 -- 172.21.15.63:0/2292815822 wait complete. 2024-09-12T02:58:21.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46ee00640 1 Processor -- start 2024-09-12T02:58:21.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46ee00640 1 -- start start 2024-09-12T02:58:21.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46ee00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa46806f410 0x7fa46806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:21.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46ee00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4680c9480 0x7fa4681f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:21.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46ee00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4680ca7a0 0x7fa4681f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:21.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46ee00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa4680c79f0 con 0x7fa4680c9480 2024-09-12T02:58:21.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46ee00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa46815a910 con 0x7fa4680ca7a0 2024-09-12T02:58:21.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46ee00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa46806bcc0 con 0x7fa46806f410 2024-09-12T02:58:21.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4680c9480 0x7fa4681f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:21.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46da00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa46806f410 0x7fa46806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46da00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa46806f410 0x7fa46806d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:42674/0 (socket says 172.21.15.63:42674) 2024-09-12T02:58:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4680c9480 0x7fa4681f0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37914/0 (socket says 172.21.15.63:37914) 2024-09-12T02:58:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46da00640 1 -- 172.21.15.63:0/1250050490 learned_addr learned my addr 172.21.15.63:0/1250050490 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46e400640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4680ca7a0 0x7fa4681f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46d000640 1 -- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa46806f410 msgr2=0x7fa46806d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46d000640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa46806f410 0x7fa46806d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46d000640 1 -- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4680ca7a0 msgr2=0x7fa4681f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:21.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46d000640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4680ca7a0 0x7fa4681f35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:21.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.324+0000 7fa46d000640 1 -- 172.21.15.63:0/1250050490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4680b1d00 con 0x7fa4680c9480 2024-09-12T02:58:21.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.328+0000 7fa46d000640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4680c9480 0x7fa4681f0060 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa45400c430 tx=0x7fa45400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:21.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.328+0000 7fa465600640 1 -- 172.21.15.63:0/1250050490 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454017070 con 0x7fa4680c9480 2024-09-12T02:58:21.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.328+0000 7fa465600640 1 -- 172.21.15.63:0/1250050490 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa454005cf0 con 0x7fa4680c9480 2024-09-12T02:58:21.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.328+0000 7fa465600640 1 -- 172.21.15.63:0/1250050490 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4540072d0 con 0x7fa4680c9480 2024-09-12T02:58:21.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.328+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa468150850 con 0x7fa4680c9480 2024-09-12T02:58:21.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.328+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4680cc240 con 0x7fa4680c9480 2024-09-12T02:58:21.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.328+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46806f7f0 con 0x7fa4680c9480 2024-09-12T02:58:21.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.332+0000 7fa465600640 1 -- 172.21.15.63:0/1250050490 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa45401a070 con 0x7fa4680c9480 2024-09-12T02:58:21.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.332+0000 7fa465600640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa4480678c0 0x7fa448069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:21.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.332+0000 7fa465600640 1 -- 172.21.15.63:0/1250050490 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6685+0+0 (secure 0 0 0) 0x7fa454085370 con 0x7fa4680c9480 2024-09-12T02:58:21.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.332+0000 7fa46da00640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa4480678c0 0x7fa448069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:21.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.332+0000 7fa46da00640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa4480678c0 0x7fa448069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa45c01ecd0 tx=0x7fa45c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:21.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.340+0000 7fa465600640 1 -- 172.21.15.63:0/1250050490 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa454055470 con 0x7fa4680c9480 2024-09-12T02:58:21.388 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:21.388 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:21.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:21.416 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:21.410+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:21.517 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:21.514+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:21.618 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:21.614+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:21.674 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:21.675 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:21.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:21.688+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7fa46806fba0 con 0x7fa4680c9480 2024-09-12T02:58:21.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:21.742 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:21.740+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:21.820 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:21.816+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:21.921 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:21.916+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:21.928 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:21.928 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:21.950 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:22.022 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:22.018+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:22.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.056+0000 7fa465600640 1 -- 172.21.15.63:0/1250050490 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v48) ==== 101+0+0 (secure 0 0 0) 0x7fa454059770 con 0x7fa4680c9480 2024-09-12T02:58:22.061 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-12T02:58:22.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa4480678c0 msgr2=0x7fa448069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:22.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa4480678c0 0x7fa448069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa45c01ecd0 tx=0x7fa45c008040 comp rx=0 tx=0).stop 2024-09-12T02:58:22.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4680c9480 msgr2=0x7fa4681f0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:22.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4680c9480 0x7fa4681f0060 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa45400c430 tx=0x7fa45400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:58:22.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 shutdown_connections 2024-09-12T02:58:22.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4680ca7a0 0x7fa4681f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:22.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa4680c9480 0x7fa4681f0060 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa45400c430 tx=0x7fa45400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:58:22.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa4480678c0 0x7fa448069d80 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa45c01ecd0 tx=0x7fa45c008040 comp rx=0 tx=0).stop 2024-09-12T02:58:22.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 --2- 172.21.15.63:0/1250050490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa46806f410 0x7fa46806d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:22.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 >> 172.21.15.63:0/1250050490 conn(0x7fa4680c9af0 msgr2=0x7fa468159770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:22.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 shutdown_connections 2024-09-12T02:58:22.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:22.060+0000 7fa46ee00640 1 -- 172.21.15.63:0/1250050490 wait complete. 2024-09-12T02:58:22.123 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:22.120+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:22.173 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:22.173 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:22.188 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:22.230 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:22.228+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:22.324 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:22.320+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:22.426 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:22.422+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:22.440 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:22.440 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:22.461 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:22.527 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:22.522+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:22.628 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:22.624+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:22.649 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:22.649 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:22.665 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:22.754 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:22.752+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:22.830 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:22.826+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:22.892 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:22.892 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:22.914 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:22.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:22.958 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:22.956+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:23.032 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:23.026+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:23.046 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:23.046 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:23.061 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:23.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.116+0000 7fa2ed400640 1 Processor -- start 2024-09-12T02:58:23.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.116+0000 7fa2ed400640 1 -- start start 2024-09-12T02:58:23.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.116+0000 7fa2ed400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2e81590b0 0x7fa2e80c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.116+0000 7fa2ed400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa2e80c8f40 0x7fa2e80c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2ed400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2e80c6970 con 0x7fa2e8152640 2024-09-12T02:58:23.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2ed400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e8071f60 con 0x7fa2e81590b0 2024-09-12T02:58:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2ed400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e80c8160 con 0x7fa2e80c8f40 2024-09-12T02:58:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2dfe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2e81590b0 0x7fa2e80c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2dfe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa2e81590b0 0x7fa2e80c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37922/0 (socket says 172.21.15.63:37922) 2024-09-12T02:58:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2dfe00640 1 -- 172.21.15.63:0/2796002769 learned_addr learned my addr 172.21.15.63:0/2796002769 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2e7200640 1 --2- 172.21.15.63:0/2796002769 >> v2:172.21.15.119:3300/0 conn(0x7fa2e80c8f40 0x7fa2e80c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2dfe00640 1 -- 172.21.15.63:0/2796002769 >> v2:172.21.15.119:3300/0 conn(0x7fa2e80c8f40 msgr2=0x7fa2e80c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2dfe00640 1 --2- 172.21.15.63:0/2796002769 >> v2:172.21.15.119:3300/0 conn(0x7fa2e80c8f40 0x7fa2e80c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2dfe00640 1 -- 172.21.15.63:0/2796002769 >> v1:172.21.15.63:6789/0 conn(0x7fa2e8152640 legacy=0x7fa2e8071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2dfe00640 1 -- 172.21.15.63:0/2796002769 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e8159500 con 0x7fa2e81590b0 2024-09-12T02:58:23.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.120+0000 7fa2e5e00640 1 -- 172.21.15.63:0/2796002769 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564517055 0 0) 0x7fa2e80c6970 con 0x7fa2e8152640 2024-09-12T02:58:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2dfe00640 1 --2- 172.21.15.63:0/2796002769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e81590b0 0x7fa2e80c8a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8156200 tx=0x7fa2d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ebfe50f95f589 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2e5e00640 1 -- 172.21.15.63:0/2796002769 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00ab610 con 0x7fa2e81590b0 2024-09-12T02:58:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2e5e00640 1 -- 172.21.15.63:0/2796002769 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d00b0070 con 0x7fa2e81590b0 2024-09-12T02:58:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2e5e00640 1 -- 172.21.15.63:0/2796002769 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00ab9d0 con 0x7fa2e81590b0 2024-09-12T02:58:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 -- 172.21.15.63:0/2796002769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e81590b0 msgr2=0x7fa2e80c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 --2- 172.21.15.63:0/2796002769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e81590b0 0x7fa2e80c8a00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8156200 tx=0x7fa2d001c520 comp rx=0 tx=0).stop 2024-09-12T02:58:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 -- 172.21.15.63:0/2796002769 shutdown_connections 2024-09-12T02:58:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 --2- 172.21.15.63:0/2796002769 >> v2:172.21.15.119:3300/0 conn(0x7fa2e80c8f40 0x7fa2e80c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 --2- 172.21.15.63:0/2796002769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e81590b0 0x7fa2e80c8a00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 -- 172.21.15.63:0/2796002769 >> 172.21.15.63:0/2796002769 conn(0x7fa2e806f3d0 msgr2=0x7fa2e806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 -- 172.21.15.63:0/2796002769 shutdown_connections 2024-09-12T02:58:23.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 -- 172.21.15.63:0/2796002769 wait complete. 2024-09-12T02:58:23.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 Processor -- start 2024-09-12T02:58:23.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.124+0000 7fa2ed400640 1 -- start start 2024-09-12T02:58:23.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2ed400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2e80c8f40 0x7fa2e81f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2ed400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e8152640 0x7fa2e80cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2ed400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2e81590b0 0x7fa2e81f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2ed400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e8074290 con 0x7fa2e8152640 2024-09-12T02:58:23.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2ed400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e80c7df0 con 0x7fa2e80c8f40 2024-09-12T02:58:23.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2ed400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e8152a20 con 0x7fa2e81590b0 2024-09-12T02:58:23.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e6800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2e80c8f40 0x7fa2e81f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e7200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2e81590b0 0x7fa2e81f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2dfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e8152640 0x7fa2e80cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e6800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2e80c8f40 0x7fa2e81f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:45232/0 (socket says 172.21.15.63:45232) 2024-09-12T02:58:23.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e6800640 1 -- 172.21.15.63:0/3901530080 learned_addr learned my addr 172.21.15.63:0/3901530080 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e6800640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2e81590b0 msgr2=0x7fa2e81f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e6800640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2e81590b0 0x7fa2e81f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e6800640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e8152640 msgr2=0x7fa2e80cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e6800640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e8152640 0x7fa2e80cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e6800640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e80c1aa0 con 0x7fa2e80c8f40 2024-09-12T02:58:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2dfe00640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2e8152640 0x7fa2e80cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2e6800640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2e80c8f40 0x7fa2e81f3d20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800c4d0 tx=0x7fa2d800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8017070 con 0x7fa2e80c8f40 2024-09-12T02:58:23.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d8005480 con 0x7fa2e80c8f40 2024-09-12T02:58:23.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8003840 con 0x7fa2e80c8f40 2024-09-12T02:58:23.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e80c2890 con 0x7fa2e80c8f40 2024-09-12T02:58:23.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e80c2b50 con 0x7fa2e80c8f40 2024-09-12T02:58:23.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.128+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fa2e80c85f0 con 0x7fa2e80c8f40 2024-09-12T02:58:23.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa2d801a070 con 0x7fa2e80c8f40 2024-09-12T02:58:23.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2dea00640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa2c40678f0 0x7fa2c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6685+0+0 (secure 0 0 0) 0x7fa2d8085ac0 con 0x7fa2e80c8f40 2024-09-12T02:58:23.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v48) ==== 54+0+16 (secure 0 0 0) 0x7fa2d8021070 con 0x7fa2e80c8f40 2024-09-12T02:58:23.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2dfe00640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa2c40678f0 0x7fa2c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa2e80c2080 0x7fa2e8149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2e80c70a0 con 0x7fa2e80c2080 2024-09-12T02:58:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2e7200640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa2e80c2080 0x7fa2e8149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2dfe00640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa2c40678f0 0x7fa2c4069db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00af000 tx=0x7fa2d00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.132+0000 7fa2e7200640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa2e80c2080 0x7fa2e8149e00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.136+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e80c70a0 con 0x7fa2e80c2080 2024-09-12T02:58:23.149 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:23.146+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:23.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.148+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa2e806dce0 con 0x7fa2e80c2080 2024-09-12T02:58:23.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.152+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa2e806dce0 con 0x7fa2e80c2080 2024-09-12T02:58:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.152+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa2e814a340 0x7fa2e8146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.152+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fa2e806da00 con 0x7fa2e814a340 2024-09-12T02:58:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.152+0000 7fa2e6800640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa2e814a340 0x7fa2e8146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.152+0000 7fa2e6800640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa2e814a340 0x7fa2e8146b80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.152+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e806da00 con 0x7fa2e814a340 2024-09-12T02:58:23.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.168+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa2e8071aa0 con 0x7fa2e814a340 2024-09-12T02:58:23.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.172+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa2e8071aa0 con 0x7fa2e814a340 2024-09-12T02:58:23.174 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:23.175 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:23.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.172+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa2e81577d0 0x7fa2e8157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.172+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fa2e8158130 con 0x7fa2e81577d0 2024-09-12T02:58:23.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.172+0000 7fa2dfe00640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa2e81577d0 0x7fa2e8157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.172+0000 7fa2dfe00640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa2e81577d0 0x7fa2e8157bf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.172+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e8158130 con 0x7fa2e81577d0 2024-09-12T02:58:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.188+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa2e80629b0 con 0x7fa2e81577d0 2024-09-12T02:58:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.192+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa2e80629b0 con 0x7fa2e81577d0 2024-09-12T02:58:23.195 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.192+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa2e80c9d70 0x7fa2e80ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.192+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fa2e8153b30 con 0x7fa2e80c9d70 2024-09-12T02:58:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.192+0000 7fa2e7200640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa2e80c9d70 0x7fa2e80ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.192+0000 7fa2e7200640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa2e80c9d70 0x7fa2e80ca1d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.192+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e8153b30 con 0x7fa2e80c9d70 2024-09-12T02:58:23.222 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:23.222 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:23.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.220+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa2e8153b30 con 0x7fa2e80c9d70 2024-09-12T02:58:23.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.224+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa2e8153b30 con 0x7fa2e80c9d70 2024-09-12T02:58:23.227 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:23.227 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:23.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.224+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa2e802c650 0x7fa2e802cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.224+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fa2e80cac20 con 0x7fa2e802c650 2024-09-12T02:58:23.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.224+0000 7fa2e6800640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa2e802c650 0x7fa2e802cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.224+0000 7fa2e6800640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa2e802c650 0x7fa2e802cab0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.224+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e80cac20 con 0x7fa2e802c650 2024-09-12T02:58:23.233 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:23.230+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:23.236 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:23.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.240+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa2e80cac20 con 0x7fa2e802c650 2024-09-12T02:58:23.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.240+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa2e80cac20 con 0x7fa2e802c650 2024-09-12T02:58:23.245 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.240+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa2e802d500 0x7fa2e8209c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.240+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fa2e802d960 con 0x7fa2e802d500 2024-09-12T02:58:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.240+0000 7fa2dfe00640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa2e802d500 0x7fa2e8209c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.240+0000 7fa2dfe00640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa2e802d500 0x7fa2e8209c80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.244+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e802d960 con 0x7fa2e802d500 2024-09-12T02:58:23.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.260+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa2e802dba0 con 0x7fa2e802d500 2024-09-12T02:58:23.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.260+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa2d00b0040 con 0x7fa2e802d500 2024-09-12T02:58:23.265 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:23.266 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:23.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.260+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa2e820a6d0 0x7fa2e820cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.260+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fa2e820f890 con 0x7fa2e820a6d0 2024-09-12T02:58:23.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.264+0000 7fa2e7200640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa2e820a6d0 0x7fa2e820cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.264+0000 7fa2e7200640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa2e820a6d0 0x7fa2e820cac0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.264+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e820f890 con 0x7fa2e820a6d0 2024-09-12T02:58:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.276+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa2e820d000 con 0x7fa2e820a6d0 2024-09-12T02:58:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.280+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa2e820d000 con 0x7fa2e820a6d0 2024-09-12T02:58:23.283 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:23.284 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:23.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.280+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa2e820d720 0x7fa2e820fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:23.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.280+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fa2e82129b0 con 0x7fa2e820d720 2024-09-12T02:58:23.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.280+0000 7fa2e6800640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa2e820d720 0x7fa2e820fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.280+0000 7fa2e6800640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa2e820d720 0x7fa2e820fb10 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.280+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2e82129b0 con 0x7fa2e820d720 2024-09-12T02:58:23.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.308+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa2e8000960 con 0x7fa2e820d720 2024-09-12T02:58:23.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2dea00640 1 -- 172.21.15.63:0/3901530080 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa2e8000960 con 0x7fa2e820d720 2024-09-12T02:58:23.314 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:23.315 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:23.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa2e80c2080 msgr2=0x7fa2e8149e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa2e80c2080 0x7fa2e8149e00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa2e814a340 msgr2=0x7fa2e8146b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa2e814a340 0x7fa2e8146b80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa2e81577d0 msgr2=0x7fa2e8157bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa2e81577d0 0x7fa2e8157bf0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa2e80c9d70 msgr2=0x7fa2e80ca1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa2e80c9d70 0x7fa2e80ca1d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa2e802c650 msgr2=0x7fa2e802cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa2e802c650 0x7fa2e802cab0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa2e802d500 msgr2=0x7fa2e8209c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fa2e802d500 0x7fa2e8209c80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa2e820a6d0 msgr2=0x7fa2e820cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa2e820a6d0 0x7fa2e820cac0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa2e820d720 msgr2=0x7fa2e820fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa2e820d720 0x7fa2e820fb10 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2e7200640 1 -- 172.21.15.63:0/3901530080 reap_dead start 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2e7200640 1 -- 172.21.15.63:0/3901530080 reap_dead start 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa2c40678f0 msgr2=0x7fa2c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa2c40678f0 0x7fa2c4069db0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00af000 tx=0x7fa2d00a7000 comp rx=0 tx=0).stop 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2e80c8f40 msgr2=0x7fa2e81f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 --2- 172.21.15.63:0/3901530080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2e80c8f40 0x7fa2e81f3d20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800c4d0 tx=0x7fa2d800c990 comp rx=0 tx=0).stop 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2e7200640 1 -- 172.21.15.63:0/3901530080 reap_dead start 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2e7200640 1 -- 172.21.15.63:0/3901530080 reap_dead start 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2e7200640 1 -- 172.21.15.63:0/3901530080 reap_dead start 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 shutdown_connections 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 >> 172.21.15.63:0/3901530080 conn(0x7fa2e806f3d0 msgr2=0x7fa2e81496f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:23.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 shutdown_connections 2024-09-12T02:58:23.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:23.312+0000 7fa2ed400640 1 -- 172.21.15.63:0/3901530080 wait complete. 2024-09-12T02:58:23.334 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:23.330+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.546284849000003, 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.400 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:58:23.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:58:23.405 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.541524070999998, 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.406 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:58:23.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:58:23.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.541386208999995, 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:58:23.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:58:23.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:23.415 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.541300092, 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.540576259999995, 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:58:23.419 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:58:23.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:58:23.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.540417392999998, 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:23.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.539963775000004, 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:58:23.428 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.429 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:58:23.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.536729781000005, 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.432 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.434 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.435 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPush(2.6 41/40 [PushOp(2:654134d2:::mds0_openfiles.0:head, version: 28'2, data_included: [], data_size: 0, omap_header_size: 42, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:654134d2:::mds0_openfiles.0:head@28'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 18.491346951000001, 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00050712800000000003, 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.436 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906694+0000", 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1620000000000001e-06 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906711+0000", 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6974e-05 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906734+0000", 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3862999999999998e-05 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906757+0000", 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2765e-05 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906918+0000", 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000160326 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906935+0000", 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7215e-05 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.440 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.907200+0000", 2024-09-12T02:58:23.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026482300000000002 2024-09-12T02:58:23.440 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.440 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.440 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.440 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.440 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.440 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:23.441 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:58:23.442 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:23.436+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:23.542 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:23.540+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:23.611 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:23.611 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:23.611 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:23.611 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:23.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T02:58:23.643 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:23.640+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:23.743 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:23.740+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:23.744 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:23.744 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:23.744 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:23.745 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:23.745 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:23.758 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T02:58:23.844 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:23.838+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:23.878 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.023513109999996, 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00551893, 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853808+0000", 2024-09-12T02:58:23.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4959999999999999e-06 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853827+0000", 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8675999999999999e-05 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853869+0000", 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2347e-05 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853889+0000", 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0248999999999999e-05 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854115+0000", 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022562600000000001 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854168+0000", 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3476000000000001e-05 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859207+0000", 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050389550000000003 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859324+0000", 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117105 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.022310372000007, 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077810020000000004, 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:23.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855011+0000", 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3259999999999998e-06 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855026+0000", 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5023e-05 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855055+0000", 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9298e-05 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0525000000000001e-05 2024-09-12T02:58:23.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855570+0000", 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000494539 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855624+0000", 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3656999999999998e-05 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862687+0000", 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007063593 2024-09-12T02:58:23.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862789+0000", 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010204099999999999 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.022188763000003, 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077503839999999999, 2024-09-12T02:58:23.888 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855131+0000", 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5230000000000001e-06 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855143+0000", 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1412e-05 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0043000000000001e-05 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855176+0000", 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3429e-05 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856069+0000", 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00089251 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856116+0000", 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6826999999999997e-05 2024-09-12T02:58:23.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862797+0000", 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066810050000000003 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862880+0000", 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3634999999999995e-05 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.893 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:23.893 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:23.893 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.021083478999998, 2024-09-12T02:58:23.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065292639999999999, 2024-09-12T02:58:23.893 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.893 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.893 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.893 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856237+0000", 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.103e-06 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856252+0000", 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4813e-05 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856279+0000", 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7254e-05 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856297+0000", 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7929000000000001e-05 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856462+0000", 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016488700000000001 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856508+0000", 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5787000000000001e-05 2024-09-12T02:58:23.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862657+0000", 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061494210000000004 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862764+0000", 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010707 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.020336212999993, 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005857943, 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:23.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856984+0000", 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3799999999999999e-06 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856997+0000", 2024-09-12T02:58:23.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2896e-05 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857022+0000", 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5554999999999998e-05 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857043+0000", 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0919000000000001e-05 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857162+0000", 2024-09-12T02:58:23.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118526 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857225+0000", 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3578999999999996e-05 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862772+0000", 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055470789999999999 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862840+0000", 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8009000000000006e-05 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 18.963208703999999, 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00045081800000000002, 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.902 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914111+0000", 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1699999999999997e-07 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914116+0000", 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.259e-06 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914129+0000", 2024-09-12T02:58:23.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3451e-05 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914140+0000", 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0721e-05 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914241+0000", 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000100843 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914561+0000", 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031982700000000001 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 18.959716801999999, 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000219385, 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:23.906 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5800000000000001e-07 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917605+0000", 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1379999999999999e-06 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917611+0000", 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9179999999999999e-06 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917620+0000", 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0389999999999993e-06 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917681+0000", 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0482999999999997e-05 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917821+0000", 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014054900000000001 2024-09-12T02:58:23.909 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.910 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.910 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.910 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:23.910 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:23.910 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:23.911 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:23.945 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:23.940+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:24.046 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:24.042+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:24.078 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:24.078 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:24.078 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:24.078 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:24.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T02:58:24.093 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:24.147 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:24.144+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:24.248 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:24.242+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:24.256 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:24.257 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:24.257 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:24.257 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:24.257 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:24.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.256+0000 7f4f53e00640 1 Processor -- start 2024-09-12T02:58:24.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.256+0000 7f4f53e00640 1 -- start start 2024-09-12T02:58:24.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.256+0000 7f4f53e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4f540c8140 0x7f4f54158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:24.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.256+0000 7f4f53e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f540c8990 0x7f4f54070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:24.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.256+0000 7f4f53e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f54070060 con 0x7f4f54152850 2024-09-12T02:58:24.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.256+0000 7f4f53e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4f540c5140 con 0x7f4f540c8140 2024-09-12T02:58:24.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.256+0000 7f4f53e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4f540c3190 con 0x7f4f540c8990 2024-09-12T02:58:24.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f52a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4f54152850 0x7f4f540ce040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:44778/0 (socket says 172.21.15.63:44778) 2024-09-12T02:58:24.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f52a00640 1 -- 172.21.15.63:0/217622076 learned_addr learned my addr 172.21.15.63:0/217622076 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:24.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f4be00640 1 --2- 172.21.15.63:0/217622076 >> v2:172.21.15.119:3300/0 conn(0x7f4f540c8140 0x7f4f54158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:24.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f53400640 1 --2- 172.21.15.63:0/217622076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f540c8990 0x7f4f54070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:24.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f52000640 1 -- 172.21.15.63:0/217622076 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172285882 0 0) 0x7f4f54070060 con 0x7f4f54152850 2024-09-12T02:58:24.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f52000640 1 -- 172.21.15.63:0/217622076 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f38003530 con 0x7f4f54152850 2024-09-12T02:58:24.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f4be00640 1 -- 172.21.15.63:0/217622076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f540c8990 msgr2=0x7f4f54070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:24.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f4be00640 1 --2- 172.21.15.63:0/217622076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f540c8990 0x7f4f54070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:24.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f4be00640 1 -- 172.21.15.63:0/217622076 >> v1:172.21.15.63:6789/0 conn(0x7f4f54152850 legacy=0x7f4f540ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:24.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.260+0000 7f4f4be00640 1 -- 172.21.15.63:0/217622076 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f540c3470 con 0x7f4f540c8140 2024-09-12T02:58:24.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f4be00640 1 --2- 172.21.15.63:0/217622076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f540c8140 0x7f4f54158410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0097c0 tx=0x7f4f3c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d3545a5d40ac5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:24.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f52000640 1 -- 172.21.15.63:0/217622076 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0b5070 con 0x7f4f540c8140 2024-09-12T02:58:24.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f52000640 1 -- 172.21.15.63:0/217622076 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f3c0a8990 con 0x7f4f540c8140 2024-09-12T02:58:24.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f52000640 1 -- 172.21.15.63:0/217622076 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0a8d40 con 0x7f4f540c8140 2024-09-12T02:58:24.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f53e00640 1 -- 172.21.15.63:0/217622076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f540c8140 msgr2=0x7f4f54158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:24.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f53e00640 1 --2- 172.21.15.63:0/217622076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f540c8140 0x7f4f54158410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0097c0 tx=0x7f4f3c01ec90 comp rx=0 tx=0).stop 2024-09-12T02:58:24.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f53e00640 1 -- 172.21.15.63:0/217622076 shutdown_connections 2024-09-12T02:58:24.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f53e00640 1 --2- 172.21.15.63:0/217622076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f540c8990 0x7f4f54070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:24.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f53e00640 1 --2- 172.21.15.63:0/217622076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f540c8140 0x7f4f54158410 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:24.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f53e00640 1 -- 172.21.15.63:0/217622076 >> 172.21.15.63:0/217622076 conn(0x7f4f54067a00 msgr2=0x7f4f54067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:24.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f53e00640 1 -- 172.21.15.63:0/217622076 shutdown_connections 2024-09-12T02:58:24.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.264+0000 7f4f53e00640 1 -- 172.21.15.63:0/217622076 wait complete. 2024-09-12T02:58:24.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 Processor -- start 2024-09-12T02:58:24.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 -- start start 2024-09-12T02:58:24.272 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540c8140 0x7f4f5415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f540c8990 0x7f4f540c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f54152850 0x7f4f541572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4f540ce750 con 0x7f4f540c8140 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4f540c4b60 con 0x7f4f540c8990 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4f540ce8d0 con 0x7f4f54152850 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f52a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540c8140 0x7f4f5415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f52a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540c8140 0x7f4f5415a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38174/0 (socket says 172.21.15.63:38174) 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f52a00640 1 -- 172.21.15.63:0/160428619 learned_addr learned my addr 172.21.15.63:0/160428619 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f4be00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f540c8990 0x7f4f540c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53400640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f54152850 0x7f4f541572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:24.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f52a00640 1 -- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f54152850 msgr2=0x7f4f541572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f52a00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f54152850 0x7f4f541572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f52a00640 1 -- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f540c8990 msgr2=0x7f4f540c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f52a00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f540c8990 0x7f4f540c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f52a00640 1 -- 172.21.15.63:0/160428619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f541f0000 con 0x7f4f540c8140 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f52a00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540c8140 0x7f4f5415a2c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400c3c0 tx=0x7f4f4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f4aa00640 1 -- 172.21.15.63:0/160428619 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44015e30 con 0x7f4f540c8140 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f4aa00640 1 -- 172.21.15.63:0/160428619 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f44019030 con 0x7f4f540c8140 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f541f02c0 con 0x7f4f540c8140 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f4aa00640 1 -- 172.21.15.63:0/160428619 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44005ae0 con 0x7f4f540c8140 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.268+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f541f0880 con 0x7f4f540c8140 2024-09-12T02:58:24.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.272+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f54069870 con 0x7f4f540c8140 2024-09-12T02:58:24.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.272+0000 7f4f4aa00640 1 -- 172.21.15.63:0/160428619 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f44005c80 con 0x7f4f540c8140 2024-09-12T02:58:24.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.272+0000 7f4f4aa00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f300678c0 0x7f4f30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:24.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.276+0000 7f4f4aa00640 1 -- 172.21.15.63:0/160428619 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6685+0+0 (secure 0 0 0) 0x7f4f4408dca0 con 0x7f4f540c8140 2024-09-12T02:58:24.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.276+0000 7f4f4be00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f300678c0 0x7f4f30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:24.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.276+0000 7f4f4be00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f300678c0 0x7f4f30069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0b2000 tx=0x7f4f3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:24.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.280+0000 7f4f4aa00640 1 -- 172.21.15.63:0/160428619 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f4405dd20 con 0x7f4f540c8140 2024-09-12T02:58:24.349 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:24.344+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:24.438 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:24.439 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:24.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:24.439 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:24.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.439 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:24.439 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:24.439 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.582493721999995, 2024-09-12T02:58:24.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:24.439 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:24.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:24.441 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:24.442 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.582360514000001, 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:24.445 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:24.447 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.448 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.449 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:24.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.582255763999996, 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:24.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.456 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.582109946000003, 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:24.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:24.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.582036763999994, 2024-09-12T02:58:24.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:24.467 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.581976777999998, 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.581914432000005, 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.473 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:24.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:24.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.581856916000007, 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.477 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.579689290999994, 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.485 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.576530775999998, 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:24.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.487 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:24.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.568821903, 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:24.490 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.491 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:24.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.495 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 65.549932952000006, 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:24.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:24.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:24.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 63.821531145999998, 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.500 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:24.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 62.065694563999998, 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:24.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:24.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:24.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:24.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:24.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 61.1836056, 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:24.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:24.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:24.517 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 39.499647987000003, 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.518 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:24.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:24.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.523 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 39.499542695999999, 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:24.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:24.529 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 36.806979546000001, 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:24.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:24.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:24.534 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5447~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.1276210000000004, 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003274795, 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307146+0000", 2024-09-12T02:58:24.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.123e-06 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307162+0000", 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5729000000000001e-05 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307197+0000", 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5179999999999999e-05 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307214+0000", 2024-09-12T02:58:24.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7295999999999998e-05 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307371+0000", 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000156293 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307532+0000", 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016189399999999999 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307741+0000", 2024-09-12T02:58:24.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208493 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.309426+0000", 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016850299999999999 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310212+0000", 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000786494 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310299+0000", 2024-09-12T02:58:24.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6178000000000001e-05 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310418+0000", 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000119085 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:24.540 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 4.1275078230000002, 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037307600000000001, 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:24.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307257+0000", 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2699999999999999e-06 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307266+0000", 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2160000000000006e-06 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307286+0000", 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0537e-05 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307299+0000", 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3297e-05 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308569+0000", 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001269121 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308706+0000", 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013719099999999999 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308921+0000", 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021543199999999999 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310051+0000", 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001129901 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310836+0000", 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00078529800000000003 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310922+0000", 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5488000000000005e-05 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310987+0000", 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5009e-05 2024-09-12T02:58:24.545 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.546 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.546 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.546 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:24.546 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:24.546 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:24.516+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7f4f5406fc30 con 0x7f4f540c8140 2024-09-12T02:58:24.547 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:24.548 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:24.544+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:24.648 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:24.642+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:24.675 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:24.675 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:24.675 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:24.675 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:24.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:24.748 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:24.744+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:24.849 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:24.844+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:24.856 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:24.856 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:24.856 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:24.856 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:24.856 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:24.870 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:24.950 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:24.948+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:24.995 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:24.995 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:24.995 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:24.995 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:24.995 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.995 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.244772999000006, 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:24.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:24.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.998 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:24.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.002 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.101577660999993, 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:25.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:25.005 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.008 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.101557134999993, 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.009 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:25.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.014 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.101446322000001, 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.015 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:25.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.101424796000003, 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.021 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:25.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:25.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:25.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.036438149999995, 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:25.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:25.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.814334626999994, 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.033 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:25.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:25.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:25.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:25.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.814197636000003, 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.039 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:25.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:25.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.813080434, 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:25.045 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.050 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.813008320999998, 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:25.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.056 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.812784336999997, 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:25.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.812714353999993, 2024-09-12T02:58:25.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:25.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.812608717000003, 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.069 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:25.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.074 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.812418620000003, 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:25.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:25.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.812351832999994, 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:25.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:25.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.086 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 88.237002235999995, 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.087 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 75.138302801999998, 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.092 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.093 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:25.094 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.095 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.096 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:25.097 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 75.138217560000001, 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.098 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.099 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.100 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.101 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:25.102 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.103 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 75.138080446000004, 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.104 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:25.105 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.106 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.107 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.108 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 75.137910547000004, 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:25.109 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.110 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.111 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:25.112 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:25.113 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:25.116 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:25.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.060+0000 7f4f4aa00640 1 -- 172.21.15.63:0/160428619 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v49) ==== 87+0+0 (secure 0 0 0) 0x7f4f44064020 con 0x7f4f540c8140 2024-09-12T02:58:25.116 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-12T02:58:25.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.060+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f300678c0 msgr2=0x7f4f30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.060+0000 7f4f53e00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f300678c0 0x7f4f30069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0b2000 tx=0x7f4f3c008040 comp rx=0 tx=0).stop 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.060+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540c8140 msgr2=0x7f4f5415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.060+0000 7f4f53e00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540c8140 0x7f4f5415a2c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400c3c0 tx=0x7f4f4400c880 comp rx=0 tx=0).stop 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.064+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 shutdown_connections 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.064+0000 7f4f53e00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4f300678c0 0x7f4f30069d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.064+0000 7f4f53e00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4f54152850 0x7f4f541572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.064+0000 7f4f53e00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f540c8990 0x7f4f540c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.064+0000 7f4f53e00640 1 --2- 172.21.15.63:0/160428619 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f540c8140 0x7f4f5415a2c0 secure :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400c3c0 tx=0x7f4f4400c880 comp rx=0 tx=0).stop 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.064+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 >> 172.21.15.63:0/160428619 conn(0x7f4f54067a00 msgr2=0x7f4f540c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.064+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 shutdown_connections 2024-09-12T02:58:25.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.064+0000 7f4f53e00640 1 -- 172.21.15.63:0/160428619 wait complete. 2024-09-12T02:58:25.118 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:25.112+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:25.216 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:25.210+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:25.316 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:25.312+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:25.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:25.399 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:25.399 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:25.399 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:25.418 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:25.414+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:25.424 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:25.518 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:25.516+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:25.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.568+0000 7fdb80e00640 1 Processor -- start 2024-09-12T02:58:25.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.568+0000 7fdb80e00640 1 -- start start 2024-09-12T02:58:25.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb80e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdb7c152850 0x7fdb7c158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb80e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb7c0c8990 0x7fdb7c070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb80e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7c070060 con 0x7fdb7c0c8140 2024-09-12T02:58:25.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb80e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7c0c5140 con 0x7fdb7c152850 2024-09-12T02:58:25.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb80e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7c0c3190 con 0x7fdb7c0c8990 2024-09-12T02:58:25.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb7b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdb7c152850 0x7fdb7c158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb7b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdb7c152850 0x7fdb7c158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38176/0 (socket says 172.21.15.63:38176) 2024-09-12T02:58:25.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb7b400640 1 -- 172.21.15.63:0/4263803920 learned_addr learned my addr 172.21.15.63:0/4263803920 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:25.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb7be00640 1 --2- 172.21.15.63:0/4263803920 >> v2:172.21.15.119:3300/0 conn(0x7fdb7c0c8990 0x7fdb7c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb7b400640 1 -- 172.21.15.63:0/4263803920 >> v2:172.21.15.119:3300/0 conn(0x7fdb7c0c8990 msgr2=0x7fdb7c070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:25.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb7b400640 1 --2- 172.21.15.63:0/4263803920 >> v2:172.21.15.119:3300/0 conn(0x7fdb7c0c8990 0x7fdb7c070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb7b400640 1 -- 172.21.15.63:0/4263803920 >> v1:172.21.15.119:6789/0 conn(0x7fdb7c0c8140 legacy=0x7fdb7c0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb7b400640 1 -- 172.21.15.63:0/4263803920 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c0c3470 con 0x7fdb7c152850 2024-09-12T02:58:25.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.572+0000 7fdb7be00640 1 --2- 172.21.15.63:0/4263803920 >> v2:172.21.15.119:3300/0 conn(0x7fdb7c0c8990 0x7fdb7c070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:25.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.576+0000 7fdb7b400640 1 --2- 172.21.15.63:0/4263803920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb7c152850 0x7fdb7c158410 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c070230 tx=0x7fdb6c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742278fcb5e22f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.576+0000 7fdb7a000640 1 -- 172.21.15.63:0/4263803920 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0b0070 con 0x7fdb7c152850 2024-09-12T02:58:25.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.576+0000 7fdb7a000640 1 -- 172.21.15.63:0/4263803920 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6c0ab600 con 0x7fdb7c152850 2024-09-12T02:58:25.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.576+0000 7fdb7a000640 1 -- 172.21.15.63:0/4263803920 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0ab9d0 con 0x7fdb7c152850 2024-09-12T02:58:25.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 -- 172.21.15.63:0/4263803920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb7c152850 msgr2=0x7fdb7c158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 --2- 172.21.15.63:0/4263803920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb7c152850 0x7fdb7c158410 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c070230 tx=0x7fdb6c01c520 comp rx=0 tx=0).stop 2024-09-12T02:58:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 -- 172.21.15.63:0/4263803920 shutdown_connections 2024-09-12T02:58:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 --2- 172.21.15.63:0/4263803920 >> v2:172.21.15.119:3300/0 conn(0x7fdb7c0c8990 0x7fdb7c070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 --2- 172.21.15.63:0/4263803920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb7c152850 0x7fdb7c158410 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 -- 172.21.15.63:0/4263803920 >> 172.21.15.63:0/4263803920 conn(0x7fdb7c067a00 msgr2=0x7fdb7c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 -- 172.21.15.63:0/4263803920 shutdown_connections 2024-09-12T02:58:25.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 -- 172.21.15.63:0/4263803920 wait complete. 2024-09-12T02:58:25.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 Processor -- start 2024-09-12T02:58:25.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.580+0000 7fdb80e00640 1 -- start start 2024-09-12T02:58:25.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb80e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb7c0c8140 0x7fdb7c156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb80e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb7c0c8990 0x7fdb7c14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb80e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb7c152850 0x7fdb7c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb80e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c06fdb0 con 0x7fdb7c0c8990 2024-09-12T02:58:25.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb80e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c06fc30 con 0x7fdb7c0c8140 2024-09-12T02:58:25.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb80e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7c1655b0 con 0x7fdb7c152850 2024-09-12T02:58:25.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb7c0c8990 0x7fdb7c14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb7c152850 0x7fdb7c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb7c0c8140 0x7fdb7c156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb7c152850 0x7fdb7c14ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:43178/0 (socket says 172.21.15.63:43178) 2024-09-12T02:58:25.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7be00640 1 -- 172.21.15.63:0/985283600 learned_addr learned my addr 172.21.15.63:0/985283600 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:25.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7b400640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb7c152850 msgr2=0x7fdb7c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7b400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb7c152850 0x7fdb7c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7b400640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb7c0c8990 msgr2=0x7fdb7c14a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7b400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb7c0c8990 0x7fdb7c14a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7b400640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c0c64f0 con 0x7fdb7c0c8140 2024-09-12T02:58:25.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb7b400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb7c0c8140 0x7fdb7c156d50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c06fbc0 tx=0x7fdb6c0192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0b0040 con 0x7fdb7c0c8140 2024-09-12T02:58:25.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6c0b4420 con 0x7fdb7c0c8140 2024-09-12T02:58:25.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7c0c67b0 con 0x7fdb7c0c8140 2024-09-12T02:58:25.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0b47f0 con 0x7fdb7c0c8140 2024-09-12T02:58:25.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.584+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7c0c7310 con 0x7fdb7c0c8140 2024-09-12T02:58:25.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.588+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fdb7c069870 con 0x7fdb7c0c8140 2024-09-12T02:58:25.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.588+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb6c0b4990 con 0x7fdb7c0c8140 2024-09-12T02:58:25.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb73400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fdb5c0678c0 0x7fdb5c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6685+0+0 (secure 0 0 0) 0x7fdb6c120450 con 0x7fdb7c0c8140 2024-09-12T02:58:25.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v49) ==== 54+0+16 (secure 0 0 0) 0x7fdb6c016110 con 0x7fdb7c0c8140 2024-09-12T02:58:25.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb7aa00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fdb5c0678c0 0x7fdb5c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fdb7c149d40 0x7fdb7c14d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb7c158410 con 0x7fdb7c149d40 2024-09-12T02:58:25.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb7be00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fdb7c149d40 0x7fdb7c14d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb7aa00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fdb5c0678c0 0x7fdb5c069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c157a50 tx=0x7fdb68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb7be00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fdb7c149d40 0x7fdb7c14d300 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.592+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb7c158410 con 0x7fdb7c149d40 2024-09-12T02:58:25.619 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:25.616+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.624+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fdb7c0cc990 con 0x7fdb7c149d40 2024-09-12T02:58:25.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.624+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fdb7c0cc990 con 0x7fdb7c149d40 2024-09-12T02:58:25.630 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:25.631 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:25.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.628+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fdb7c1476d0 0x7fdb7c147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.628+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fdb7c156460 con 0x7fdb7c1476d0 2024-09-12T02:58:25.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.628+0000 7fdb7b400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fdb7c1476d0 0x7fdb7c147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.628+0000 7fdb7b400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fdb7c1476d0 0x7fdb7c147af0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.628+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb7c156460 con 0x7fdb7c1476d0 2024-09-12T02:58:25.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.656+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fdb7c14d840 con 0x7fdb7c1476d0 2024-09-12T02:58:25.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.660+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fdb7c14d840 con 0x7fdb7c1476d0 2024-09-12T02:58:25.664 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:25.664 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:25.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.660+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fdb7c06e330 0x7fdb7c06e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.660+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fdb7c157400 con 0x7fdb7c06e330 2024-09-12T02:58:25.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.660+0000 7fdb7aa00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fdb7c06e330 0x7fdb7c06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.660+0000 7fdb7aa00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fdb7c06e330 0x7fdb7c06e750 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.664+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb68001450 con 0x7fdb7c06e330 2024-09-12T02:58:25.669 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:25.669 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:25.694 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:25.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.688+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fdb7c0626e0 con 0x7fdb7c06e330 2024-09-12T02:58:25.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.692+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fdb7c0626e0 con 0x7fdb7c06e330 2024-09-12T02:58:25.697 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:25.697 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.692+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fdb7c0631c0 0x7fdb7c14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.692+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fdb7c063600 con 0x7fdb7c0631c0 2024-09-12T02:58:25.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.692+0000 7fdb7be00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fdb7c0631c0 0x7fdb7c14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.696+0000 7fdb7be00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fdb7c0631c0 0x7fdb7c14bb60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.696+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb7c063600 con 0x7fdb7c0631c0 2024-09-12T02:58:25.719 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:25.718+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:25.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.724+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fdb7c14c370 con 0x7fdb7c0631c0 2024-09-12T02:58:25.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.724+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fdb7c14c370 con 0x7fdb7c0631c0 2024-09-12T02:58:25.729 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:25.729 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:25.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.724+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fdb7c02c650 0x7fdb7c02cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.724+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fdb7c02cff0 con 0x7fdb7c02c650 2024-09-12T02:58:25.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.724+0000 7fdb7b400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fdb7c02c650 0x7fdb7c02cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.728+0000 7fdb7b400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fdb7c02c650 0x7fdb7c02cab0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.728+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb7c02cff0 con 0x7fdb7c02c650 2024-09-12T02:58:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.756+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fdb7c02cff0 con 0x7fdb7c02c650 2024-09-12T02:58:25.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.760+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fdb7c02cff0 con 0x7fdb7c02c650 2024-09-12T02:58:25.765 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:25.765 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:25.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.760+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fdb7c02d670 0x7fdb7c209970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.760+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fdb7c20c740 con 0x7fdb7c02d670 2024-09-12T02:58:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.760+0000 7fdb7aa00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fdb7c02d670 0x7fdb7c209970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.764+0000 7fdb7aa00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fdb7c02d670 0x7fdb7c209970 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.764+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb7c20c740 con 0x7fdb7c02d670 2024-09-12T02:58:25.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.792+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fdb7c209eb0 con 0x7fdb7c02d670 2024-09-12T02:58:25.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.796+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fdb7c209eb0 con 0x7fdb7c02d670 2024-09-12T02:58:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:25.799 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:25.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.796+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fdb7c20a550 0x7fdb7c20a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.796+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fdb7c20faf0 con 0x7fdb7c20a550 2024-09-12T02:58:25.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.796+0000 7fdb7be00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fdb7c20a550 0x7fdb7c20a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.796+0000 7fdb7be00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fdb7c20a550 0x7fdb7c20a9b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.800+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb7c20faf0 con 0x7fdb7c20a550 2024-09-12T02:58:25.820 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:25.814+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:25.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.824+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fdb7c20b000 con 0x7fdb7c20a550 2024-09-12T02:58:25.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.828+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fdb7c20b000 con 0x7fdb7c20a550 2024-09-12T02:58:25.833 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.828+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fdb7c20b720 0x7fdb7c20bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.828+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fdb7c20c190 con 0x7fdb7c20b720 2024-09-12T02:58:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.828+0000 7fdb7b400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fdb7c20b720 0x7fdb7c20bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:25.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.832+0000 7fdb7b400640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fdb7c20b720 0x7fdb7c20bba0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:25.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.832+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb7c20c190 con 0x7fdb7c20b720 2024-09-12T02:58:25.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.860+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fdb7c20c160 con 0x7fdb7c20b720 2024-09-12T02:58:25.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb73400640 1 -- 172.21.15.63:0/985283600 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fdb7c20c160 con 0x7fdb7c20b720 2024-09-12T02:58:25.867 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fdb7c149d40 msgr2=0x7fdb7c14d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fdb7c149d40 0x7fdb7c14d300 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fdb7c1476d0 msgr2=0x7fdb7c147af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fdb7c1476d0 0x7fdb7c147af0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fdb7c06e330 msgr2=0x7fdb7c06e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fdb7c06e330 0x7fdb7c06e750 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fdb7c0631c0 msgr2=0x7fdb7c14bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fdb7c0631c0 0x7fdb7c14bb60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fdb7c02c650 msgr2=0x7fdb7c02cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fdb7c02c650 0x7fdb7c02cab0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fdb7c02d670 msgr2=0x7fdb7c209970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fdb7c02d670 0x7fdb7c209970 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fdb7c20a550 msgr2=0x7fdb7c20a9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fdb7c20a550 0x7fdb7c20a9b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fdb7c20b720 msgr2=0x7fdb7c20bba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fdb7c20b720 0x7fdb7c20bba0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb7be00640 1 -- 172.21.15.63:0/985283600 reap_dead start 2024-09-12T02:58:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb7be00640 1 -- 172.21.15.63:0/985283600 reap_dead start 2024-09-12T02:58:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb7be00640 1 -- 172.21.15.63:0/985283600 reap_dead start 2024-09-12T02:58:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb7be00640 1 -- 172.21.15.63:0/985283600 reap_dead start 2024-09-12T02:58:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb7be00640 1 -- 172.21.15.63:0/985283600 reap_dead start 2024-09-12T02:58:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fdb5c0678c0 msgr2=0x7fdb5c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fdb5c0678c0 0x7fdb5c069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c157a50 tx=0x7fdb68009040 comp rx=0 tx=0).stop 2024-09-12T02:58:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb7c0c8140 msgr2=0x7fdb7c156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb7c0c8140 0x7fdb7c156d50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c06fbc0 tx=0x7fdb6c0192c0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 shutdown_connections 2024-09-12T02:58:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fdb5c0678c0 0x7fdb5c069d80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 --2- 172.21.15.63:0/985283600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb7c0c8140 0x7fdb7c156d50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 >> 172.21.15.63:0/985283600 conn(0x7fdb7c067a00 msgr2=0x7fdb7c0ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 shutdown_connections 2024-09-12T02:58:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:25.864+0000 7fdb80e00640 1 -- 172.21.15.63:0/985283600 wait complete. 2024-09-12T02:58:25.940 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:25.941 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:25.941 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:25.936+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:25.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:26.022 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:26.018+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:26.123 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:26.120+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:26.223 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:26.220+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:26.247 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:26.247 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:26.271 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:26.319 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T02:58:26.319 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T02:58:26.319 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-12T02:58:26.319 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-12T02:58:26.324 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:26.318+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:26.426 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:26.422+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:26.526 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:26.524+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:26.557 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:26.558 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:26.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:26.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.596+0000 7f6f50c00640 1 Processor -- start 2024-09-12T02:58:26.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.596+0000 7f6f50c00640 1 -- start start 2024-09-12T02:58:26.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.596+0000 7f6f50c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f4c06bcc0 0x7f6f4c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.596+0000 7f6f50c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f4c15aa80 con 0x7f6f4c15e7a0 2024-09-12T02:58:26.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.596+0000 7f6f50c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f4c0c4c40 con 0x7f6f4c1549f0 2024-09-12T02:58:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.596+0000 7f6f50c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f6f4c15ebf0 con 0x7f6f4c06bcc0 2024-09-12T02:58:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.596+0000 7f6f4a800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6f4c15e7a0 0x7f6f4c165210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:44786/0 (socket says 172.21.15.63:44786) 2024-09-12T02:58:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.596+0000 7f6f4a800640 1 -- 172.21.15.63:0/3660040718 learned_addr learned my addr 172.21.15.63:0/3660040718 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.596+0000 7f6f49400640 1 --2- 172.21.15.63:0/3660040718 >> v2:172.21.15.63:3300/0 conn(0x7f6f4c06bcc0 0x7f6f4c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.600+0000 7f6f49400640 1 -- 172.21.15.63:0/3660040718 >> v1:172.21.15.119:6789/0 conn(0x7f6f4c1549f0 legacy=0x7f6f4c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.600+0000 7f6f49400640 1 -- 172.21.15.63:0/3660040718 >> v1:172.21.15.63:6789/0 conn(0x7f6f4c15e7a0 legacy=0x7f6f4c165210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:26.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.600+0000 7f6f49400640 1 -- 172.21.15.63:0/3660040718 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c15ad20 con 0x7f6f4c06bcc0 2024-09-12T02:58:26.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f49400640 1 --2- 172.21.15.63:0/3660040718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f4c06bcc0 0x7f6f4c15e260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f380097c0 tx=0x7f6f3801bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d70b6112fc0fc01 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:26.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f48a00640 1 -- 172.21.15.63:0/3660040718 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f380a8680 con 0x7f6f4c06bcc0 2024-09-12T02:58:26.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f48a00640 1 -- 172.21.15.63:0/3660040718 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f380a8820 con 0x7f6f4c06bcc0 2024-09-12T02:58:26.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f48a00640 1 -- 172.21.15.63:0/3660040718 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f380a8680 con 0x7f6f4c06bcc0 2024-09-12T02:58:26.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f50c00640 1 -- 172.21.15.63:0/3660040718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f4c06bcc0 msgr2=0x7f6f4c15e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f50c00640 1 --2- 172.21.15.63:0/3660040718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f4c06bcc0 0x7f6f4c15e260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f380097c0 tx=0x7f6f3801bec0 comp rx=0 tx=0).stop 2024-09-12T02:58:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f50c00640 1 -- 172.21.15.63:0/3660040718 shutdown_connections 2024-09-12T02:58:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f50c00640 1 --2- 172.21.15.63:0/3660040718 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f4c06bcc0 0x7f6f4c15e260 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f50c00640 1 -- 172.21.15.63:0/3660040718 >> 172.21.15.63:0/3660040718 conn(0x7f6f4c072960 msgr2=0x7f6f4c072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f50c00640 1 -- 172.21.15.63:0/3660040718 shutdown_connections 2024-09-12T02:58:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.604+0000 7f6f50c00640 1 -- 172.21.15.63:0/3660040718 wait complete. 2024-09-12T02:58:26.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f50c00640 1 Processor -- start 2024-09-12T02:58:26.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f50c00640 1 -- start start 2024-09-12T02:58:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f50c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f4c06bcc0 0x7f6f4c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f50c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f4c1549f0 0x7f6f4c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f50c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f4c15e7a0 0x7f6f4c15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f50c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c0cd050 con 0x7f6f4c1549f0 2024-09-12T02:58:26.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f50c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c06c350 con 0x7f6f4c15e7a0 2024-09-12T02:58:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f50c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4c0cd1d0 con 0x7f6f4c06bcc0 2024-09-12T02:58:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f49400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f4c1549f0 0x7f6f4c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f49400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f4c1549f0 0x7f6f4c15ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38198/0 (socket says 172.21.15.63:38198) 2024-09-12T02:58:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f49e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f4c06bcc0 0x7f6f4c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f49400640 1 -- 172.21.15.63:0/1512933985 learned_addr learned my addr 172.21.15.63:0/1512933985 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.608+0000 7f6f4a800640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f4c15e7a0 0x7f6f4c15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f49400640 1 -- 172.21.15.63:0/1512933985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f4c06bcc0 msgr2=0x7f6f4c0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:26.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f49400640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f4c06bcc0 0x7f6f4c0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:26.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f49400640 1 -- 172.21.15.63:0/1512933985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f4c15e7a0 msgr2=0x7f6f4c15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:26.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f49400640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f4c15e7a0 0x7f6f4c15cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:26.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f49400640 1 -- 172.21.15.63:0/1512933985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c153d60 con 0x7f6f4c1549f0 2024-09-12T02:58:26.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f49e00640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f4c06bcc0 0x7f6f4c0cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:26.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f49400640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f4c1549f0 0x7f6f4c15ca90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6f380aa040 tx=0x7f6f3801a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f42000640 1 -- 172.21.15.63:0/1512933985 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f380a8680 con 0x7f6f4c1549f0 2024-09-12T02:58:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f42000640 1 -- 172.21.15.63:0/1512933985 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f380b1b10 con 0x7f6f4c1549f0 2024-09-12T02:58:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f42000640 1 -- 172.21.15.63:0/1512933985 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f380bc450 con 0x7f6f4c1549f0 2024-09-12T02:58:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f50c00640 1 -- 172.21.15.63:0/1512933985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4c154040 con 0x7f6f4c1549f0 2024-09-12T02:58:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f50c00640 1 -- 172.21.15.63:0/1512933985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f4c15c2b0 con 0x7f6f4c1549f0 2024-09-12T02:58:26.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.612+0000 7f6f50c00640 1 -- 172.21.15.63:0/1512933985 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f4c0c8650 con 0x7f6f4c1549f0 2024-09-12T02:58:26.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.616+0000 7f6f42000640 1 -- 172.21.15.63:0/1512933985 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f380a6070 con 0x7f6f4c1549f0 2024-09-12T02:58:26.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.616+0000 7f6f42000640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6f2c067910 0x7f6f2c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.616+0000 7f6f42000640 1 -- 172.21.15.63:0/1512933985 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6685+0+0 (secure 0 0 0) 0x7f6f381203d0 con 0x7f6f4c1549f0 2024-09-12T02:58:26.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.616+0000 7f6f42000640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f6f2c0712b0 0x7f6f2c073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.616+0000 7f6f42000640 1 -- 172.21.15.63:0/1512933985 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f380afec0 con 0x7f6f2c0712b0 2024-09-12T02:58:26.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.616+0000 7f6f42000640 1 -- 172.21.15.63:0/1512933985 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f6f38120780 con 0x7f6f4c1549f0 2024-09-12T02:58:26.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.616+0000 7f6f49e00640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6f2c067910 0x7f6f2c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.620+0000 7f6f4a800640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f6f2c0712b0 0x7f6f2c073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.620+0000 7f6f49e00640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6f2c067910 0x7f6f2c069dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c007fd0 tx=0x7f6f3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:26.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.620+0000 7f6f4a800640 1 --2- 172.21.15.63:0/1512933985 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f6f2c0712b0 0x7f6f2c073750 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:26.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.620+0000 7f6f42000640 1 -- 172.21.15.63:0/1512933985 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f380afec0 con 0x7f6f2c0712b0 2024-09-12T02:58:26.627 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:26.622+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:26.674 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-12T02:58:26.674 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-12T02:58:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-12T02:58:26.686 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T02:58:26.687 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T02:58:26.687 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-12T02:58:26.730 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:26.728+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:26.828 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:26.822+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:26.843 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:26.843 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:26.869 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:26.930 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:26.928+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:26.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.960+0000 7f9dada00640 1 Processor -- start 2024-09-12T02:58:26.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.960+0000 7f9dada00640 1 -- start start 2024-09-12T02:58:26.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9dada00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9da815bdd0 0x7f9da80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9dada00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9da80c7a80 0x7f9da815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9dada00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da806c800 con 0x7f9da8072f60 2024-09-12T02:58:26.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9dada00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f9da815caa0 con 0x7f9da80c7a80 2024-09-12T02:58:26.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9dada00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9da80c98c0 con 0x7f9da815bdd0 2024-09-12T02:58:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9da7400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9da80c7a80 0x7f9da815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9dad000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9da8072f60 0x7f9da8073370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:59834/0 (socket says 172.21.15.63:59834) 2024-09-12T02:58:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9dad000640 1 -- 172.21.15.63:0/3048540897 learned_addr learned my addr 172.21.15.63:0/3048540897 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9da7e00640 1 --2- 172.21.15.63:0/3048540897 >> v2:172.21.15.119:3300/0 conn(0x7f9da815bdd0 0x7f9da80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9da7e00640 1 -- 172.21.15.63:0/3048540897 >> v2:172.21.15.63:3300/0 conn(0x7f9da80c7a80 msgr2=0x7f9da815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9da7e00640 1 --2- 172.21.15.63:0/3048540897 >> v2:172.21.15.63:3300/0 conn(0x7f9da80c7a80 0x7f9da815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:26.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9da7e00640 1 -- 172.21.15.63:0/3048540897 >> v1:172.21.15.119:6789/0 conn(0x7f9da8072f60 legacy=0x7f9da8073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:26.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9da6a00640 1 -- 172.21.15.63:0/3048540897 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879659948 0 0) 0x7f9da806c800 con 0x7f9da8072f60 2024-09-12T02:58:26.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.964+0000 7f9da7e00640 1 -- 172.21.15.63:0/3048540897 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da806cae0 con 0x7f9da815bdd0 2024-09-12T02:58:26.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9da7e00640 1 --2- 172.21.15.63:0/3048540897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da815bdd0 0x7f9da80ca610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9da80c9a50 tx=0x7f9d9801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd789b433c53dfad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:26.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9da6a00640 1 -- 172.21.15.63:0/3048540897 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d980ab650 con 0x7f9da815bdd0 2024-09-12T02:58:26.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9da6a00640 1 -- 172.21.15.63:0/3048540897 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d980b0070 con 0x7f9da815bdd0 2024-09-12T02:58:26.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9da6a00640 1 -- 172.21.15.63:0/3048540897 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d980aba10 con 0x7f9da815bdd0 2024-09-12T02:58:26.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9dada00640 1 -- 172.21.15.63:0/3048540897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da815bdd0 msgr2=0x7f9da80ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:26.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9dada00640 1 --2- 172.21.15.63:0/3048540897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da815bdd0 0x7f9da80ca610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9da80c9a50 tx=0x7f9d9801c450 comp rx=0 tx=0).stop 2024-09-12T02:58:26.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9dada00640 1 -- 172.21.15.63:0/3048540897 shutdown_connections 2024-09-12T02:58:26.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9dada00640 1 --2- 172.21.15.63:0/3048540897 >> v2:172.21.15.63:3300/0 conn(0x7f9da80c7a80 0x7f9da815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:26.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9dada00640 1 --2- 172.21.15.63:0/3048540897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da815bdd0 0x7f9da80ca610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:26.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9dada00640 1 -- 172.21.15.63:0/3048540897 >> 172.21.15.63:0/3048540897 conn(0x7f9da80c9af0 msgr2=0x7f9da80c9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:26.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9dada00640 1 -- 172.21.15.63:0/3048540897 shutdown_connections 2024-09-12T02:58:26.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.972+0000 7f9dada00640 1 -- 172.21.15.63:0/3048540897 wait complete. 2024-09-12T02:58:26.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9dada00640 1 Processor -- start 2024-09-12T02:58:26.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9dada00640 1 -- start start 2024-09-12T02:58:26.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9dada00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da8072f60 0x7f9da81552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9dada00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9da80c7a80 0x7f9da81f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9dada00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9da815bdd0 0x7f9da8154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9dada00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9da815c6f0 con 0x7f9da80c7a80 2024-09-12T02:58:26.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9dada00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9da8164eb0 con 0x7f9da8072f60 2024-09-12T02:58:26.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9dada00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9da81545b0 con 0x7f9da815bdd0 2024-09-12T02:58:26.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9da80c7a80 0x7f9da81f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9da80c7a80 0x7f9da81f47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38210/0 (socket says 172.21.15.63:38210) 2024-09-12T02:58:26.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7400640 1 -- 172.21.15.63:0/2950567357 learned_addr learned my addr 172.21.15.63:0/2950567357 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:26.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9dad000640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9da815bdd0 0x7f9da8154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7e00640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da8072f60 0x7f9da81552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7e00640 1 -- 172.21.15.63:0/2950567357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9da815bdd0 msgr2=0x7f9da8154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:26.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7e00640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9da815bdd0 0x7f9da8154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:26.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7e00640 1 -- 172.21.15.63:0/2950567357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9da80c7a80 msgr2=0x7f9da81f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:26.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7e00640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9da80c7a80 0x7f9da81f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:26.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7e00640 1 -- 172.21.15.63:0/2950567357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da8155e40 con 0x7f9da8072f60 2024-09-12T02:58:26.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.976+0000 7f9da7400640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9da80c7a80 0x7f9da81f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:26.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.980+0000 7f9da7e00640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9da8072f60 0x7f9da81552f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d980ac000 tx=0x7f9d9801ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:26.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.980+0000 7f9d9fe00640 1 -- 172.21.15.63:0/2950567357 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d980abe60 con 0x7f9da8072f60 2024-09-12T02:58:26.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.980+0000 7f9d9fe00640 1 -- 172.21.15.63:0/2950567357 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d98004220 con 0x7f9da8072f60 2024-09-12T02:58:26.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.980+0000 7f9d9fe00640 1 -- 172.21.15.63:0/2950567357 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d980b9810 con 0x7f9da8072f60 2024-09-12T02:58:26.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.980+0000 7f9dada00640 1 -- 172.21.15.63:0/2950567357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da8153110 con 0x7f9da8072f60 2024-09-12T02:58:26.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.980+0000 7f9dada00640 1 -- 172.21.15.63:0/2950567357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da81536d0 con 0x7f9da8072f60 2024-09-12T02:58:26.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.980+0000 7f9dada00640 1 -- 172.21.15.63:0/2950567357 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9da8154ed0 con 0x7f9da8072f60 2024-09-12T02:58:26.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.984+0000 7f9d9fe00640 1 -- 172.21.15.63:0/2950567357 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d980b99b0 con 0x7f9da8072f60 2024-09-12T02:58:26.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.984+0000 7f9d9fe00640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9d880678c0 0x7f9d88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.984+0000 7f9d9fe00640 1 -- 172.21.15.63:0/2950567357 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6685+0+0 (secure 0 0 0) 0x7f9d98125230 con 0x7f9da8072f60 2024-09-12T02:58:26.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.984+0000 7f9d9fe00640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f9d88071160 0x7f9d88073600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:26.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.984+0000 7f9d9fe00640 1 -- 172.21.15.63:0/2950567357 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d88073cd0 con 0x7f9d88071160 2024-09-12T02:58:26.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.984+0000 7f9d9fe00640 1 -- 172.21.15.63:0/2950567357 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f9d981255e0 con 0x7f9da8072f60 2024-09-12T02:58:26.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.984+0000 7f9da7400640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9d880678c0 0x7f9d88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.984+0000 7f9dad000640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f9d88071160 0x7f9d88073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:26.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.988+0000 7f9dad000640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f9d88071160 0x7f9d88073600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:26.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.988+0000 7f9da7400640 1 --2- 172.21.15.63:0/2950567357 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9d880678c0 0x7f9d88069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9da8149530 tx=0x7f9d94009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:26.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:26.988+0000 7f9d9fe00640 1 -- 172.21.15.63:0/2950567357 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d88073cd0 con 0x7f9d88071160 2024-09-12T02:58:27.030 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:27.028+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-12T02:58:27.041 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-12T02:58:27.042 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-12T02:58:27.051 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T02:58:27.052 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T02:58:27.052 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-12T02:58:27.116 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:27.116 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:27.118 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T02:58:27.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:27.142 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:27.136+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:27.232 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:27.226+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:27.334 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:27.328+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:27.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbf000640 1 Processor -- start 2024-09-12T02:58:27.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbf000640 1 -- start start 2024-09-12T02:58:27.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbf000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2bb80c8bf0 0x7f2bb80c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbf000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb806e980 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbf000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb806ec40 con 0x7f2bb806fc30 2024-09-12T02:58:27.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbf000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb806ef20 con 0x7f2bb80c8bf0 2024-09-12T02:58:27.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbdc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2bb80c8bf0 0x7f2bb80c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbdc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2bb80c8bf0 0x7f2bb80c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:56748/0 (socket says 172.21.15.63:56748) 2024-09-12T02:58:27.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbdc00640 1 -- 172.21.15.63:0/355102952 learned_addr learned my addr 172.21.15.63:0/355102952 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:27.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbdc00640 1 -- 172.21.15.63:0/355102952 >> v1:172.21.15.119:6789/0 conn(0x7f2bb806fc30 legacy=0x7f2bb80caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbdc00640 1 -- 172.21.15.63:0/355102952 >> v1:172.21.15.63:6789/0 conn(0x7f2bb80c8fd0 legacy=0x7f2bb806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.340+0000 7f2bbdc00640 1 -- 172.21.15.63:0/355102952 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb815ab80 con 0x7f2bb80c8bf0 2024-09-12T02:58:27.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bbdc00640 1 --2- 172.21.15.63:0/355102952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb80c8bf0 0x7f2bb80c9440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009870 tx=0x7f2bac01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0b9a88dd6eec9a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bb7e00640 1 -- 172.21.15.63:0/355102952 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0b5070 con 0x7f2bb80c8bf0 2024-09-12T02:58:27.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bb7e00640 1 -- 172.21.15.63:0/355102952 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bac0a8a10 con 0x7f2bb80c8bf0 2024-09-12T02:58:27.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bb7e00640 1 -- 172.21.15.63:0/355102952 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0a8de0 con 0x7f2bb80c8bf0 2024-09-12T02:58:27.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bbf000640 1 -- 172.21.15.63:0/355102952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb80c8bf0 msgr2=0x7f2bb80c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bbf000640 1 --2- 172.21.15.63:0/355102952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb80c8bf0 0x7f2bb80c9440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009870 tx=0x7f2bac01ed10 comp rx=0 tx=0).stop 2024-09-12T02:58:27.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bbf000640 1 -- 172.21.15.63:0/355102952 shutdown_connections 2024-09-12T02:58:27.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bbf000640 1 --2- 172.21.15.63:0/355102952 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb80c8bf0 0x7f2bb80c9440 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bbf000640 1 -- 172.21.15.63:0/355102952 >> 172.21.15.63:0/355102952 conn(0x7f2bb8067a00 msgr2=0x7f2bb8067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:27.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bbf000640 1 -- 172.21.15.63:0/355102952 shutdown_connections 2024-09-12T02:58:27.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.348+0000 7f2bbf000640 1 -- 172.21.15.63:0/355102952 wait complete. 2024-09-12T02:58:27.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.352+0000 7f2bbf000640 1 Processor -- start 2024-09-12T02:58:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.352+0000 7f1485200640 1 Processor -- start 2024-09-12T02:58:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.352+0000 7f2bbf000640 1 -- start start 2024-09-12T02:58:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.352+0000 7f1485200640 1 -- start start 2024-09-12T02:58:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.352+0000 7f2bbf000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb806fc30 0x7f2bb8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbf000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bb80c8bf0 0x7f2bb8153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.352+0000 7f1485200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14800c79f0 0x7f148015b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.352+0000 7f1485200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14801519b0 0x7f14800c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.352+0000 7f1485200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f148015aaf0 con 0x7f14801515d0 2024-09-12T02:58:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.352+0000 7f1485200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f148006e550 con 0x7f14800c79f0 2024-09-12T02:58:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f1485200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f148006dfb0 con 0x7f14801519b0 2024-09-12T02:58:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbf000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bb80c8fd0 0x7f2bb8153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbf000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb815a830 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbf000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb815b140 con 0x7f2bb806fc30 2024-09-12T02:58:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbf000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb815b660 con 0x7f2bb80c8bf0 2024-09-12T02:58:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbd200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bb80c8bf0 0x7f2bb8153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbe600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bb80c8fd0 0x7f2bb8153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbdc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb806fc30 0x7f2bb8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbdc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb806fc30 0x7f2bb8155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:56760/0 (socket says 172.21.15.63:56760) 2024-09-12T02:58:27.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbd200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bb80c8bf0 0x7f2bb8153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:43208/0 (socket says 172.21.15.63:43208) 2024-09-12T02:58:27.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbdc00640 1 -- 172.21.15.63:0/2034003698 learned_addr learned my addr 172.21.15.63:0/2034003698 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:27.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147f400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f14801515d0 0x7f14800c83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:44804/0 (socket says 172.21.15.63:44804) 2024-09-12T02:58:27.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147f400640 1 -- 172.21.15.63:0/2158633795 learned_addr learned my addr 172.21.15.63:0/2158633795 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:27.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147ea00640 1 --2- 172.21.15.63:0/2158633795 >> v2:172.21.15.119:3300/0 conn(0x7f14800c79f0 0x7f148015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147fe00640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14801519b0 0x7f14800c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3160967304 0 0) 0x7f148015aaf0 con 0x7f14801515d0 2024-09-12T02:58:27.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1464003530 con 0x7f14801515d0 2024-09-12T02:58:27.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbe600640 1 -- 172.21.15.63:0/2034003698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bb80c8bf0 msgr2=0x7f2bb8153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbe600640 1 --2- 172.21.15.63:0/2034003698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bb80c8bf0 0x7f2bb8153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbe600640 1 -- 172.21.15.63:0/2034003698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb806fc30 msgr2=0x7f2bb8155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbe600640 1 --2- 172.21.15.63:0/2034003698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bb806fc30 0x7f2bb8155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbe600640 1 -- 172.21.15.63:0/2034003698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb80b28c0 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2478562985 0 0) 0x7f1464003530 con 0x7f14801515d0 2024-09-12T02:58:27.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14801519b0 msgr2=0x7f14800c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bbe600640 1 --2- 172.21.15.63:0/2034003698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bb80c8fd0 0x7f2bb8153b40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c760 tx=0x7f2bb000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14801519b0 0x7f14800c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 >> v2:172.21.15.119:3300/0 conn(0x7f14800c79f0 msgr2=0x7f148015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 --2- 172.21.15.63:0/2158633795 >> v2:172.21.15.119:3300/0 conn(0x7f14800c79f0 0x7f148015b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148006e270 con 0x7f14801515d0 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f1470001680 con 0x7f14801515d0 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 >> v1:172.21.15.63:6789/0 conn(0x7f14801515d0 legacy=0x7f14800c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14801519b0 0x7f14640039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1464003f40 0x7f1464004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1464004d50 0x7f14640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f148006e550 con 0x7f1464003f40 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f148006dfb0 con 0x7f1464004d50 2024-09-12T02:58:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f146400b9d0 con 0x7f14801519b0 2024-09-12T02:58:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147ea00640 1 --2- 172.21.15.63:0/2158633795 >> v2:172.21.15.119:3300/0 conn(0x7f14800c79f0 0x7f148015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147ea00640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1464003f40 0x7f1464004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bb5600640 1 -- 172.21.15.63:0/2034003698 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0016020 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147f400640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14801519b0 0x7f14640039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f147fe00640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1464004d50 0x7f14640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.356+0000 7f2bb5600640 1 -- 172.21.15.63:0/2034003698 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb0006d60 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.360+0000 7f2bbf000640 1 -- 172.21.15.63:0/2034003698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb80c4250 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.360+0000 7f2bb5600640 1 -- 172.21.15.63:0/2034003698 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0016020 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.360+0000 7f2bbf000640 1 -- 172.21.15.63:0/2034003698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb81553e0 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.360+0000 7f147ea00640 1 -- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14801519b0 msgr2=0x7f14640039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.360+0000 7f147ea00640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14801519b0 0x7f14640039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.360+0000 7f147ea00640 1 -- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1464004d50 msgr2=0x7f14640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.360+0000 7f147ea00640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1464004d50 0x7f14640051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.360+0000 7f147ea00640 1 -- 172.21.15.63:0/2158633795 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148006e270 con 0x7f1464003f40 2024-09-12T02:58:27.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.360+0000 7f2bbf000640 1 -- 172.21.15.63:0/2034003698 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bb80c4770 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f2bb5600640 1 -- 172.21.15.63:0/2034003698 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2bb0003980 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f147ea00640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1464003f40 0x7f1464004810 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f146c009c90 tx=0x7f146c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419ea78ea79ba499 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c009860 con 0x7f1464003f40 2024-09-12T02:58:27.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f2bb5600640 1 --2- 172.21.15.63:0/2034003698 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2b98067ac0 0x7f2b98069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c004020 con 0x7f1464003f40 2024-09-12T02:58:27.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f147e000640 1 -- 172.21.15.63:0/2158633795 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c004450 con 0x7f1464003f40 2024-09-12T02:58:27.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f2bb5600640 1 -- 172.21.15.63:0/2034003698 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6685+0+0 (secure 0 0 0) 0x7f2bb0054620 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f2bbdc00640 1 --2- 172.21.15.63:0/2034003698 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2b98067ac0 0x7f2b98069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f2bb5600640 1 --2- 172.21.15.63:0/2034003698 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f2b98072160 0x7f2b98074600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f2bb5600640 1 -- 172.21.15.63:0/2034003698 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b98074cd0 con 0x7f2b98072160 2024-09-12T02:58:27.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f2bb5600640 1 -- 172.21.15.63:0/2034003698 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f2bb0052fb0 con 0x7f2bb80c8fd0 2024-09-12T02:58:27.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f1485200640 1 -- 172.21.15.63:0/2158633795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1464003f40 msgr2=0x7f1464004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.364+0000 7f1485200640 1 --2- 172.21.15.63:0/2158633795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1464003f40 0x7f1464004810 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f146c009c90 tx=0x7f146c01cc30 comp rx=0 tx=0).stop 2024-09-12T02:58:27.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.368+0000 7f2bbdc00640 1 --2- 172.21.15.63:0/2034003698 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2b98067ac0 0x7f2b98069f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009870 tx=0x7f2bac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.368+0000 7f2bbd200640 1 --2- 172.21.15.63:0/2034003698 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f2b98072160 0x7f2b98074600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.368+0000 7f147fe00640 1 -- 172.21.15.63:0/2158633795 reap_dead start 2024-09-12T02:58:27.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.368+0000 7f1485200640 1 -- 172.21.15.63:0/2158633795 shutdown_connections 2024-09-12T02:58:27.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.368+0000 7f1485200640 1 -- 172.21.15.63:0/2158633795 >> 172.21.15.63:0/2158633795 conn(0x7f14800c9af0 msgr2=0x7f14800c9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:27.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.368+0000 7f2bbd200640 1 --2- 172.21.15.63:0/2034003698 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f2b98072160 0x7f2b98074600 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.368+0000 7f2bb5600640 1 -- 172.21.15.63:0/2034003698 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b98074cd0 con 0x7f2b98072160 2024-09-12T02:58:27.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.368+0000 7f1485200640 1 -- 172.21.15.63:0/2158633795 shutdown_connections 2024-09-12T02:58:27.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.368+0000 7f1485200640 1 -- 172.21.15.63:0/2158633795 wait complete. 2024-09-12T02:58:27.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.372+0000 7f1485200640 1 Processor -- start 2024-09-12T02:58:27.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.372+0000 7f1485200640 1 -- start start 2024-09-12T02:58:27.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.372+0000 7f1485200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14800cc1d0 0x7f14801524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.372+0000 7f1485200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14800cc5b0 0x7f14801541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.372+0000 7f1485200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f148014c4a0 0x7f1480154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.372+0000 7f147f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14800cc1d0 0x7f14801524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f1485200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f148006fd30 con 0x7f14800cc1d0 2024-09-12T02:58:27.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f1485200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f148015b070 con 0x7f148014c4a0 2024-09-12T02:58:27.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f1485200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f14800c8ac0 con 0x7f14800cc5b0 2024-09-12T02:58:27.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f148014c4a0 0x7f1480154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147fe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f148014c4a0 0x7f1480154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:56778/0 (socket says 172.21.15.63:56778) 2024-09-12T02:58:27.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14800cc1d0 0x7f14801524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38242/0 (socket says 172.21.15.63:38242) 2024-09-12T02:58:27.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147fe00640 1 -- 172.21.15.63:0/4184146656 learned_addr learned my addr 172.21.15.63:0/4184146656 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:27.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147ea00640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14800cc5b0 0x7f14801541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147fe00640 1 -- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14800cc5b0 msgr2=0x7f14801541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147fe00640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14800cc5b0 0x7f14801541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147fe00640 1 -- 172.21.15.63:0/4184146656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14800cc1d0 msgr2=0x7f14801524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147ea00640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14800cc5b0 0x7f14801541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:27.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147fe00640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14800cc1d0 0x7f14801524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147fe00640 1 -- 172.21.15.63:0/4184146656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14801531c0 con 0x7f148014c4a0 2024-09-12T02:58:27.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f147fe00640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f148014c4a0 0x7f1480154730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1478011bf0 tx=0x7f14780070e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f1477400640 1 -- 172.21.15.63:0/4184146656 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147800fdc0 con 0x7f148014c4a0 2024-09-12T02:58:27.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f1477400640 1 -- 172.21.15.63:0/4184146656 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147801d070 con 0x7f148014c4a0 2024-09-12T02:58:27.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f1477400640 1 -- 172.21.15.63:0/4184146656 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1478015670 con 0x7f148014c4a0 2024-09-12T02:58:27.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14801f43e0 con 0x7f148014c4a0 2024-09-12T02:58:27.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.376+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1480153710 con 0x7f148014c4a0 2024-09-12T02:58:27.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.380+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14580052a0 con 0x7f148014c4a0 2024-09-12T02:58:27.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.380+0000 7f1477400640 1 -- 172.21.15.63:0/4184146656 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1478015810 con 0x7f148014c4a0 2024-09-12T02:58:27.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.384+0000 7f1477400640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14600678f0 0x7f1460069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.384+0000 7f1477400640 1 -- 172.21.15.63:0/4184146656 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6685+0+0 (secure 0 0 0) 0x7f1478054800 con 0x7f148014c4a0 2024-09-12T02:58:27.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.384+0000 7f147f400640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14600678f0 0x7f1460069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.384+0000 7f147f400640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14600678f0 0x7f1460069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1470000c10 tx=0x7f1470001cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.396+0000 7f1477400640 1 -- 172.21.15.63:0/4184146656 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1478010040 con 0x7f148014c4a0 2024-09-12T02:58:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-12T02:58:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-12T02:58:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-12T02:58:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-12T02:58:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-12T02:58:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-12T02:58:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-12T02:58:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-12T02:58:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-12T02:58:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-12T02:58:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-12T02:58:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-12T02:58:27.425 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:27.425 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:27.434 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T02:58:27.434 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T02:58:27.435 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-12T02:58:27.435 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:27.430+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:27.450 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:27.542 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:27.540+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:27.636 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:27.632+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:27.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb3000640 1 Processor -- start 2024-09-12T02:58:27.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb3000640 1 -- start start 2024-09-12T02:58:27.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb3000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcdac154700 0x7fcdac06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb3000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdac0b2180 0x7fcdac0c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb3000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdac070d10 con 0x7fcdac154ae0 2024-09-12T02:58:27.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb3000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fcdac15b610 con 0x7fcdac154700 2024-09-12T02:58:27.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb3000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fcdac070ff0 con 0x7fcdac0b2180 2024-09-12T02:58:27.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb1c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcdac154700 0x7fcdac06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb1c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcdac154700 0x7fcdac06c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38256/0 (socket says 172.21.15.63:38256) 2024-09-12T02:58:27.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb1c00640 1 -- 172.21.15.63:0/2881577080 learned_addr learned my addr 172.21.15.63:0/2881577080 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:27.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb1c00640 1 -- 172.21.15.63:0/2881577080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdac0b2180 msgr2=0x7fcdac0c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb1c00640 1 --2- 172.21.15.63:0/2881577080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdac0b2180 0x7fcdac0c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb1c00640 1 -- 172.21.15.63:0/2881577080 >> v1:172.21.15.119:6789/0 conn(0x7fcdac154ae0 legacy=0x7fcdac0c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:27.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.724+0000 7fcdb1c00640 1 -- 172.21.15.63:0/2881577080 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac15b330 con 0x7fcdac154700 2024-09-12T02:58:27.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdb1c00640 1 --2- 172.21.15.63:0/2881577080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac154700 0x7fcdac06c160 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b10c70488ea724 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdabe00640 1 -- 172.21.15.63:0/2881577080 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0aa660 con 0x7fcdac154700 2024-09-12T02:58:27.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdabe00640 1 -- 172.21.15.63:0/2881577080 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0af070 con 0x7fcdac154700 2024-09-12T02:58:27.736 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:27.736 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdabe00640 1 -- 172.21.15.63:0/2881577080 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0aaa20 con 0x7fcdac154700 2024-09-12T02:58:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdb3000640 1 -- 172.21.15.63:0/2881577080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac154700 msgr2=0x7fcdac06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdb3000640 1 --2- 172.21.15.63:0/2881577080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac154700 0x7fcdac06c160 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c01c520 comp rx=0 tx=0).stop 2024-09-12T02:58:27.737 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdb3000640 1 -- 172.21.15.63:0/2881577080 shutdown_connections 2024-09-12T02:58:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdb3000640 1 --2- 172.21.15.63:0/2881577080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdac0b2180 0x7fcdac0c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdb3000640 1 --2- 172.21.15.63:0/2881577080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac154700 0x7fcdac06c160 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdb3000640 1 -- 172.21.15.63:0/2881577080 >> 172.21.15.63:0/2881577080 conn(0x7fcdac070180 msgr2=0x7fcdac070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdb3000640 1 -- 172.21.15.63:0/2881577080 shutdown_connections 2024-09-12T02:58:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.732+0000 7fcdb3000640 1 -- 172.21.15.63:0/2881577080 wait complete. 2024-09-12T02:58:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.736+0000 7fcdb3000640 1 Processor -- start 2024-09-12T02:58:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.736+0000 7fcdb3000640 1 -- start start 2024-09-12T02:58:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.736+0000 7fcdb3000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdac0b2180 0x7fcdac15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb3000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac154700 0x7fcdac14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb3000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac154ae0 0x7fcdac14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb3000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac06e4e0 con 0x7fcdac154700 2024-09-12T02:58:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb3000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac06e360 con 0x7fcdac154ae0 2024-09-12T02:58:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb3000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fcdac0c9400 con 0x7fcdac0b2180 2024-09-12T02:58:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac154700 0x7fcdac14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb2600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac154ae0 0x7fcdac14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdac0b2180 0x7fcdac15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdac0b2180 0x7fcdac15b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:43258/0 (socket says 172.21.15.63:43258) 2024-09-12T02:58:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1c00640 1 -- 172.21.15.63:0/922539876 learned_addr learned my addr 172.21.15.63:0/922539876 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb2600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac154ae0 0x7fcdac14ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:56782/0 (socket says 172.21.15.63:56782) 2024-09-12T02:58:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1200640 1 -- 172.21.15.63:0/922539876 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdac0b2180 msgr2=0x7fcdac15b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1200640 1 --2- 172.21.15.63:0/922539876 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdac0b2180 0x7fcdac15b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1200640 1 -- 172.21.15.63:0/922539876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac154ae0 msgr2=0x7fcdac14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1200640 1 --2- 172.21.15.63:0/922539876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdac154ae0 0x7fcdac14ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1200640 1 -- 172.21.15.63:0/922539876 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac15bcd0 con 0x7fcdac154700 2024-09-12T02:58:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb1200640 1 --2- 172.21.15.63:0/922539876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac154700 0x7fcdac14a7d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcda000b440 tx=0x7fcda000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcda9600640 1 -- 172.21.15.63:0/922539876 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011830 con 0x7fcdac154700 2024-09-12T02:58:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcda9600640 1 -- 172.21.15.63:0/922539876 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda0016070 con 0x7fcdac154700 2024-09-12T02:58:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcda9600640 1 -- 172.21.15.63:0/922539876 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0011c10 con 0x7fcdac154700 2024-09-12T02:58:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb3000640 1 -- 172.21.15.63:0/922539876 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdac0c2910 con 0x7fcdac154700 2024-09-12T02:58:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.740+0000 7fcdb3000640 1 -- 172.21.15.63:0/922539876 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdac14b250 con 0x7fcdac154700 2024-09-12T02:58:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.744+0000 7fcdb3000640 1 -- 172.21.15.63:0/922539876 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcdac0cdf90 con 0x7fcdac154700 2024-09-12T02:58:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.744+0000 7fcda9600640 1 -- 172.21.15.63:0/922539876 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcda001b460 con 0x7fcdac154700 2024-09-12T02:58:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcda9600640 1 --2- 172.21.15.63:0/922539876 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcd90067940 0x7fcd90069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcda9600640 1 -- 172.21.15.63:0/922539876 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6685+0+0 (secure 0 0 0) 0x7fcda0086680 con 0x7fcdac154700 2024-09-12T02:58:27.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcda9600640 1 --2- 172.21.15.63:0/922539876 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcd900712e0 0x7fcd90073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:27.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcda9600640 1 -- 172.21.15.63:0/922539876 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcda000fe50 con 0x7fcd900712e0 2024-09-12T02:58:27.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcda9600640 1 -- 172.21.15.63:0/922539876 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fcda0086a30 con 0x7fcdac154700 2024-09-12T02:58:27.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcdb1c00640 1 --2- 172.21.15.63:0/922539876 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcd90067940 0x7fcd90069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcdb2600640 1 --2- 172.21.15.63:0/922539876 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcd900712e0 0x7fcd90073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:27.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcdb1c00640 1 --2- 172.21.15.63:0/922539876 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcd90067940 0x7fcd90069e00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcdb2600640 1 --2- 172.21.15.63:0/922539876 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcd900712e0 0x7fcd90073780 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.748+0000 7fcda9600640 1 -- 172.21.15.63:0/922539876 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcda000fe50 con 0x7fcd900712e0 2024-09-12T02:58:27.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:27.756+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7f1458005860 con 0x7f148014c4a0 2024-09-12T02:58:27.765 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:27.804 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-12T02:58:27.804 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-12T02:58:27.804 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-12T02:58:27.805 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-12T02:58:27.805 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-12T02:58:27.805 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-12T02:58:27.805 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-12T02:58:27.805 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-12T02:58:27.805 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-12T02:58:27.805 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-12T02:58:27.805 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-12T02:58:27.805 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-12T02:58:27.814 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T02:58:27.814 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T02:58:27.814 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-12T02:58:27.858 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:27.856+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:27.899 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:27.962 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:27.960+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:28.039 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:28.038+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:28.050 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:28.050 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:28.077 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:28.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.092+0000 7feacd400640 1 Processor -- start 2024-09-12T02:58:28.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.092+0000 7feacd400640 1 -- start start 2024-09-12T02:58:28.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.092+0000 7f1477400640 1 -- 172.21.15.63:0/4184146656 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v50) ==== 97+0+0 (secure 0 0 0) 0x7f1478056760 con 0x7f148014c4a0 2024-09-12T02:58:28.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.092+0000 7feacd400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feacd400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feac815e820 0x7feac80c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feacd400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac80c7cb0 con 0x7feac8073fd0 2024-09-12T02:58:28.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feacd400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7feac80c7f90 con 0x7feac815e820 2024-09-12T02:58:28.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feacd400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7feac80c8270 con 0x7feac8157c80 2024-09-12T02:58:28.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feac7e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feac7e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:43272/0 (socket says 172.21.15.63:43272) 2024-09-12T02:58:28.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feac7e00640 1 -- 172.21.15.63:0/4149209847 learned_addr learned my addr 172.21.15.63:0/4149209847 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:28.100 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-12T02:58:28.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feac7e00640 1 -- 172.21.15.63:0/4149209847 >> v2:172.21.15.119:3300/0 conn(0x7feac815e820 msgr2=0x7feac80c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:28.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feac7e00640 1 --2- 172.21.15.63:0/4149209847 >> v2:172.21.15.119:3300/0 conn(0x7feac815e820 0x7feac80c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feac7e00640 1 -- 172.21.15.63:0/4149209847 >> v1:172.21.15.119:6789/0 conn(0x7feac8073fd0 legacy=0x7feac815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:28.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.096+0000 7feac7e00640 1 -- 172.21.15.63:0/4149209847 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac80c8550 con 0x7feac8157c80 2024-09-12T02:58:28.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7feac7e00640 1 --2- 172.21.15.63:0/4149209847 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c8a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feab0013150 tx=0x7feab0024c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=425907053c54e119 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7feac6a00640 1 -- 172.21.15.63:0/4149209847 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab00adbd0 con 0x7feac8157c80 2024-09-12T02:58:28.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feac6a00640 1 -- 172.21.15.63:0/4149209847 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab00add70 con 0x7feac8157c80 2024-09-12T02:58:28.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feac6a00640 1 -- 172.21.15.63:0/4149209847 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab00112f0 con 0x7feac8157c80 2024-09-12T02:58:28.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feacd400640 1 -- 172.21.15.63:0/4149209847 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 msgr2=0x7feac80c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feacd400640 1 --2- 172.21.15.63:0/4149209847 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c8a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feab0013150 tx=0x7feab0024c50 comp rx=0 tx=0).stop 2024-09-12T02:58:28.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feacd400640 1 -- 172.21.15.63:0/4149209847 shutdown_connections 2024-09-12T02:58:28.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feacd400640 1 --2- 172.21.15.63:0/4149209847 >> v2:172.21.15.119:3300/0 conn(0x7feac815e820 0x7feac80c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feacd400640 1 --2- 172.21.15.63:0/4149209847 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c8a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feacd400640 1 -- 172.21.15.63:0/4149209847 >> 172.21.15.63:0/4149209847 conn(0x7feac806d900 msgr2=0x7feac806f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feacd400640 1 -- 172.21.15.63:0/4149209847 shutdown_connections 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.104+0000 7feacd400640 1 -- 172.21.15.63:0/4149209847 wait complete. 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14600678f0 msgr2=0x7f1460069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14600678f0 0x7f1460069db0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1470000c10 tx=0x7f1470001cf0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f148014c4a0 msgr2=0x7f1480154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f148014c4a0 0x7f1480154730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1478011bf0 tx=0x7f14780070e0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 shutdown_connections 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f148014c4a0 0x7f1480154730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14600678f0 0x7f1460069db0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14800cc5b0 0x7f14801541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 --2- 172.21.15.63:0/4184146656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14800cc1d0 0x7f14801524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 >> 172.21.15.63:0/4184146656 conn(0x7f14800c9af0 msgr2=0x7f14800c7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:28.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 shutdown_connections 2024-09-12T02:58:28.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.100+0000 7f1485200640 1 -- 172.21.15.63:0/4184146656 wait complete. 2024-09-12T02:58:28.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.108+0000 7feacd400640 1 Processor -- start 2024-09-12T02:58:28.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.108+0000 7feacd400640 1 -- start start 2024-09-12T02:58:28.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.108+0000 7feacd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac8073fd0 0x7feac80c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feacd400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feacd400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feac815e820 0x7feac8151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac8073fd0 0x7feac80c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:43278/0 (socket says 172.21.15.63:43278) 2024-09-12T02:58:28.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7400640 1 -- 172.21.15.63:0/507563089 learned_addr learned my addr 172.21.15.63:0/507563089 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:28.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feacd400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7feac80c2fe0 con 0x7feac8073fd0 2024-09-12T02:58:28.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feacca00640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feac815e820 0x7feac8151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feacd400640 1 -- 172.21.15.63:0/507563089 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feac80c2e60 con 0x7feac815e820 2024-09-12T02:58:28.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feacd400640 1 -- 172.21.15.63:0/507563089 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7feac8158060 con 0x7feac8157c80 2024-09-12T02:58:28.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7400640 1 -- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feac815e820 msgr2=0x7feac8151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7400640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feac815e820 0x7feac8151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7400640 1 -- 172.21.15.63:0/507563089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac8073fd0 msgr2=0x7feac80c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7400640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feac8073fd0 0x7feac80c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7400640 1 -- 172.21.15.63:0/507563089 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac81f32b0 con 0x7feac8157c80 2024-09-12T02:58:28.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feacca00640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feac815e820 0x7feac8151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feac7400640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feac8157c80 0x7feac80c5390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feab800c440 tx=0x7feab800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feabfe00640 1 -- 172.21.15.63:0/507563089 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8016020 con 0x7feac8157c80 2024-09-12T02:58:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feacd400640 1 -- 172.21.15.63:0/507563089 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac81eefe0 con 0x7feac8157c80 2024-09-12T02:58:28.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.112+0000 7feacd400640 1 -- 172.21.15.63:0/507563089 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feac81f2fd0 con 0x7feac8157c80 2024-09-12T02:58:28.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.116+0000 7feabfe00640 1 -- 172.21.15.63:0/507563089 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab8012830 con 0x7feac8157c80 2024-09-12T02:58:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.116+0000 7feabfe00640 1 -- 172.21.15.63:0/507563089 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8016020 con 0x7feac8157c80 2024-09-12T02:58:28.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.116+0000 7feacd400640 1 -- 172.21.15.63:0/507563089 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feaa0001040 con 0x7feac8157c80 2024-09-12T02:58:28.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.120+0000 7feabfe00640 1 -- 172.21.15.63:0/507563089 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feab8019020 con 0x7feac8157c80 2024-09-12T02:58:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.124+0000 7feabfe00640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feaa4067cc0 0x7feaa406a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.124+0000 7feac7e00640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feaa4067cc0 0x7feaa406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.124+0000 7feabfe00640 1 -- 172.21.15.63:0/507563089 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(50..50 src has 1..50) ==== 6685+0+0 (secure 0 0 0) 0x7feab8012630 con 0x7feac8157c80 2024-09-12T02:58:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.124+0000 7feabfe00640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feaa40722e0 0x7feaa4074780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.124+0000 7feabfe00640 1 -- 172.21.15.63:0/507563089 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feaa4074e50 con 0x7feaa40722e0 2024-09-12T02:58:28.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.124+0000 7feabfe00640 1 -- 172.21.15.63:0/507563089 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7feab8052a00 con 0x7feac8157c80 2024-09-12T02:58:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.124+0000 7feac7e00640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feaa4067cc0 0x7feaa406a180 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7feab00b6000 tx=0x7feab00af070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.124+0000 7feacca00640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feaa40722e0 0x7feaa4074780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.124+0000 7feacca00640 1 --2- 172.21.15.63:0/507563089 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feaa40722e0 0x7feaa4074780 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.128+0000 7feabfe00640 1 -- 172.21.15.63:0/507563089 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feaa4074e50 con 0x7feaa40722e0 2024-09-12T02:58:28.140 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:28.134+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:28.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.140+0000 7f1479600640 1 Processor -- start 2024-09-12T02:58:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.140+0000 7f1479600640 1 -- start start 2024-09-12T02:58:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1479600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14740cd6b0 0x7f1474162890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1479600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f14740cdbc0 0x7f1474162dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1479600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f147415fc40 con 0x7f1474158e20 2024-09-12T02:58:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1479600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f147406bd60 con 0x7f14740cdbc0 2024-09-12T02:58:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1479600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f147415f710 con 0x7f14740cd6b0 2024-09-12T02:58:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1472000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14740cd6b0 0x7f1474162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1472000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14740cd6b0 0x7f1474162890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:56804/0 (socket says 172.21.15.63:56804) 2024-09-12T02:58:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1472000640 1 -- 172.21.15.63:0/1234712188 learned_addr learned my addr 172.21.15.63:0/1234712188 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1473400640 1 --2- 172.21.15.63:0/1234712188 >> v2:172.21.15.63:3300/0 conn(0x7f14740cdbc0 0x7f1474162dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1472000640 1 -- 172.21.15.63:0/1234712188 >> v2:172.21.15.63:3300/0 conn(0x7f14740cdbc0 msgr2=0x7f1474162dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1472000640 1 --2- 172.21.15.63:0/1234712188 >> v2:172.21.15.63:3300/0 conn(0x7f14740cdbc0 0x7f1474162dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1472000640 1 -- 172.21.15.63:0/1234712188 >> v1:172.21.15.119:6789/0 conn(0x7f1474158e20 legacy=0x7f147406ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1472000640 1 -- 172.21.15.63:0/1234712188 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147406bfb0 con 0x7f14740cd6b0 2024-09-12T02:58:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.144+0000 7f1473400640 1 --2- 172.21.15.63:0/1234712188 >> v2:172.21.15.63:3300/0 conn(0x7f14740cdbc0 0x7f1474162dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:58:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1472000640 1 --2- 172.21.15.63:0/1234712188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14740cd6b0 0x7f1474162890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14740c7760 tx=0x7f146401c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c8841d79916065d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1471600640 1 -- 172.21.15.63:0/1234712188 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640b0070 con 0x7f14740cd6b0 2024-09-12T02:58:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1471600640 1 -- 172.21.15.63:0/1234712188 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14640ab600 con 0x7f14740cd6b0 2024-09-12T02:58:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1471600640 1 -- 172.21.15.63:0/1234712188 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640ab9d0 con 0x7f14740cd6b0 2024-09-12T02:58:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1479600640 1 -- 172.21.15.63:0/1234712188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14740cd6b0 msgr2=0x7f1474162890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1479600640 1 --2- 172.21.15.63:0/1234712188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14740cd6b0 0x7f1474162890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14740c7760 tx=0x7f146401c520 comp rx=0 tx=0).stop 2024-09-12T02:58:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1479600640 1 -- 172.21.15.63:0/1234712188 shutdown_connections 2024-09-12T02:58:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1479600640 1 --2- 172.21.15.63:0/1234712188 >> v2:172.21.15.63:3300/0 conn(0x7f14740cdbc0 0x7f1474162dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1479600640 1 --2- 172.21.15.63:0/1234712188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14740cd6b0 0x7f1474162890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.152+0000 7f1479600640 1 -- 172.21.15.63:0/1234712188 >> 172.21.15.63:0/1234712188 conn(0x7f1474072960 msgr2=0x7f1474072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.156+0000 7f1479600640 1 -- 172.21.15.63:0/1234712188 shutdown_connections 2024-09-12T02:58:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.156+0000 7f1479600640 1 -- 172.21.15.63:0/1234712188 wait complete. 2024-09-12T02:58:28.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.156+0000 7f1479600640 1 Processor -- start 2024-09-12T02:58:28.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.156+0000 7f1479600640 1 -- start start 2024-09-12T02:58:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1479600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14740cd6b0 0x7f147415ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1479600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14740cdbc0 0x7f14740cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1479600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1474158e20 0x7f14740cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14740cd6b0 0x7f147415ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14740cd6b0 0x7f147415ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:43288/0 (socket says 172.21.15.63:43288) 2024-09-12T02:58:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472a00640 1 -- 172.21.15.63:0/3884809208 learned_addr learned my addr 172.21.15.63:0/3884809208 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f147406ca00 con 0x7f14740cdbc0 2024-09-12T02:58:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f147406c880 con 0x7f1474158e20 2024-09-12T02:58:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f147406c290 con 0x7f14740cd6b0 2024-09-12T02:58:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1473400640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1474158e20 0x7f14740cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472000640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14740cdbc0 0x7f14740cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472a00640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1474158e20 msgr2=0x7f14740cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472a00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1474158e20 0x7f14740cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472a00640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14740cdbc0 msgr2=0x7f14740cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472a00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14740cdbc0 0x7f14740cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472a00640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1474145020 con 0x7f14740cd6b0 2024-09-12T02:58:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.160+0000 7f1472000640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14740cdbc0 0x7f14740cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:58:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.164+0000 7f1472a00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14740cd6b0 0x7f147415ad40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c500 tx=0x7f145c00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.164+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c016020 con 0x7f14740cd6b0 2024-09-12T02:58:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.164+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145c005220 con 0x7f14740cd6b0 2024-09-12T02:58:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.164+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c007030 con 0x7f14740cd6b0 2024-09-12T02:58:28.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.164+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147415a640 con 0x7f14740cd6b0 2024-09-12T02:58:28.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.164+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1474145fc0 con 0x7f14740cd6b0 2024-09-12T02:58:28.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.164+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f147406ead0 con 0x7f14740cd6b0 2024-09-12T02:58:28.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.168+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f145c0071f0 con 0x7f14740cd6b0 2024-09-12T02:58:28.173 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-12T02:58:28.173 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-12T02:58:28.174 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-12T02:58:28.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.168+0000 7f146aa00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14500678c0 0x7f1450069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.168+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(50..50 src has 1..50) ==== 6685+0+0 (secure 0 0 0) 0x7f145c086710 con 0x7f14740cd6b0 2024-09-12T02:58:28.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.168+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v50) ==== 54+0+16 (secure 0 0 0) 0x7f145c020020 con 0x7f14740cd6b0 2024-09-12T02:58:28.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.168+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f1474159560 0x7f14740c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.168+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1474145570 con 0x7f1474159560 2024-09-12T02:58:28.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.168+0000 7f1472000640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14500678c0 0x7f1450069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.172+0000 7f1473400640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f1474159560 0x7f14740c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.172+0000 7f1472000640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14500678c0 0x7f1450069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f14640ad000 tx=0x7f1464008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.172+0000 7f1473400640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f1474159560 0x7f14740c8640 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.172+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f146c007ce0 con 0x7f1474159560 2024-09-12T02:58:28.181 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T02:58:28.181 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T02:58:28.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-12T02:58:28.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.200+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f1474161a60 con 0x7f1474159560 2024-09-12T02:58:28.210 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:28.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.204+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f146c00d650 con 0x7f1474159560 2024-09-12T02:58:28.210 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.204+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f1474146200 0x7f147415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.204+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f14740c4b60 con 0x7f1474146200 2024-09-12T02:58:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.204+0000 7f1472a00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f1474146200 0x7f147415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.204+0000 7f1472a00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f1474146200 0x7f147415fe50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.208+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14740c4b60 con 0x7f1474146200 2024-09-12T02:58:28.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.232+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f147406c660 con 0x7f1474146200 2024-09-12T02:58:28.240 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:28.236+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:28.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.236+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f147406c660 con 0x7f1474146200 2024-09-12T02:58:28.241 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:28.241 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:28.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.236+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f14741608a0 0x7f14740626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.236+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f14740c8120 con 0x7f14741608a0 2024-09-12T02:58:28.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.236+0000 7f1472000640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f14741608a0 0x7f14740626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.240+0000 7f1472000640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f14741608a0 0x7f14740626e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.240+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14740c8120 con 0x7f14741608a0 2024-09-12T02:58:28.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.272+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f1474062ef0 con 0x7f14741608a0 2024-09-12T02:58:28.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.272+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f1474062ef0 con 0x7f14741608a0 2024-09-12T02:58:28.277 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:28.278 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:28.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.272+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f14740cb3b0 0x7f14740cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.272+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f14740c8120 con 0x7f14740cb3b0 2024-09-12T02:58:28.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.276+0000 7f1473400640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f14740cb3b0 0x7f14740cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.276+0000 7f1473400640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f14740cb3b0 0x7f14740cb7f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.276+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14740c8120 con 0x7f14740cb3b0 2024-09-12T02:58:28.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.308+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f14740c8120 con 0x7f14740cb3b0 2024-09-12T02:58:28.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.308+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f14740c8120 con 0x7f14740cb3b0 2024-09-12T02:58:28.313 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.308+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f147402cb60 0x7f147402cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.308+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f14740c7df0 con 0x7f147402cb60 2024-09-12T02:58:28.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.312+0000 7f1472a00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f147402cb60 0x7f147402cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.312+0000 7f1472a00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f147402cb60 0x7f147402cfc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.312+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14740c7df0 con 0x7f147402cb60 2024-09-12T02:58:28.342 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:28.336+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:28.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.340+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f14740c7df0 con 0x7f147402cb60 2024-09-12T02:58:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:28.346 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:28.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.344+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f14740c7df0 con 0x7f147402cb60 2024-09-12T02:58:28.348 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:28.348 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:28.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.344+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f1474214400 0x7f14742167f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.344+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7f14740c78b0 con 0x7f1474214400 2024-09-12T02:58:28.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.344+0000 7f1472000640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f1474214400 0x7f14742167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.344+0000 7f1472000640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f1474214400 0x7f14742167f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.348+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1464004260 con 0x7f1474214400 2024-09-12T02:58:28.371 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:28.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.376+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f147402da10 con 0x7f1474214400 2024-09-12T02:58:28.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.380+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f147402da10 con 0x7f1474214400 2024-09-12T02:58:28.385 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.380+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1474217240 0x7f1474219630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.380+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7f14740634c0 con 0x7f1474217240 2024-09-12T02:58:28.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.380+0000 7f1473400640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1474217240 0x7f1474219630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.384+0000 7f1473400640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1474217240 0x7f1474219630 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.384+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14740634c0 con 0x7f1474217240 2024-09-12T02:58:28.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.400+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f147402db90 con 0x7f1474217240 2024-09-12T02:58:28.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.408+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f147402db90 con 0x7f1474217240 2024-09-12T02:58:28.411 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:28.411 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:28.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.408+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f147421a080 0x7f147421c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.408+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7f147421f240 con 0x7f147421a080 2024-09-12T02:58:28.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.408+0000 7f1472a00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f147421a080 0x7f147421c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.408+0000 7f1472a00640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f147421a080 0x7f147421c470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.408+0000 7f6bc5a00640 1 Processor -- start 2024-09-12T02:58:28.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.408+0000 7f6bc5a00640 1 -- start start 2024-09-12T02:58:28.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f147421f240 con 0x7f147421a080 2024-09-12T02:58:28.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bc5a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6bc00cc770 0x7f6bc006f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bc5a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc015ee70 con 0x7f6bc01590b0 2024-09-12T02:58:28.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bc5a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc015f150 con 0x7f6bc00ccb50 2024-09-12T02:58:28.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bc5a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc015f430 con 0x7f6bc00cc770 2024-09-12T02:58:28.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bc5000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6bc01590b0 0x7f6bc00c6ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:44818/0 (socket says 172.21.15.63:44818) 2024-09-12T02:58:28.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bc5000640 1 -- 172.21.15.63:0/1675620204 learned_addr learned my addr 172.21.15.63:0/1675620204 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:28.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bbfe00640 1 --2- 172.21.15.63:0/1675620204 >> v2:172.21.15.63:3300/0 conn(0x7f6bc00cc770 0x7f6bc006f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bbfe00640 1 -- 172.21.15.63:0/1675620204 >> v1:172.21.15.119:6789/0 conn(0x7f6bc00ccb50 legacy=0x7f6bc01589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:28.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bbfe00640 1 -- 172.21.15.63:0/1675620204 >> v1:172.21.15.63:6789/0 conn(0x7f6bc01590b0 legacy=0x7f6bc00c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.412+0000 7f6bbfe00640 1 -- 172.21.15.63:0/1675620204 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc015f710 con 0x7f6bc00cc770 2024-09-12T02:58:28.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.416+0000 7f6bbfe00640 1 --2- 172.21.15.63:0/1675620204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc00cc770 0x7f6bc006f150 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00097c0 tx=0x7f6bb001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c10d161d8025cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bbea00640 1 -- 172.21.15.63:0/1675620204 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00b5070 con 0x7f6bc00cc770 2024-09-12T02:58:28.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bbea00640 1 -- 172.21.15.63:0/1675620204 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb00a8970 con 0x7f6bc00cc770 2024-09-12T02:58:28.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bbea00640 1 -- 172.21.15.63:0/1675620204 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00a8d80 con 0x7f6bc00cc770 2024-09-12T02:58:28.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1675620204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc00cc770 msgr2=0x7f6bc006f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bc5a00640 1 --2- 172.21.15.63:0/1675620204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc00cc770 0x7f6bc006f150 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00097c0 tx=0x7f6bb001ec70 comp rx=0 tx=0).stop 2024-09-12T02:58:28.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1675620204 shutdown_connections 2024-09-12T02:58:28.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bc5a00640 1 --2- 172.21.15.63:0/1675620204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc00cc770 0x7f6bc006f150 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1675620204 >> 172.21.15.63:0/1675620204 conn(0x7f6bc006be90 msgr2=0x7f6bc006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:28.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1675620204 shutdown_connections 2024-09-12T02:58:28.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.420+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1675620204 wait complete. 2024-09-12T02:58:28.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.424+0000 7f6bc5a00640 1 Processor -- start 2024-09-12T02:58:28.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.424+0000 7f6bc5a00640 1 -- start start 2024-09-12T02:58:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bc5a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bc00cc770 0x7f6bc01fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bc5a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc00ccb50 0x7f6bc01572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bc5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc01590b0 0x7f6bc015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bbf400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc00ccb50 0x7f6bc01572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bbf400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc00ccb50 0x7f6bc01572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:56828/0 (socket says 172.21.15.63:56828) 2024-09-12T02:58:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bbfe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bc00cc770 0x7f6bc01fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bbfe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bc00cc770 0x7f6bc01fce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:43298/0 (socket says 172.21.15.63:43298) 2024-09-12T02:58:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bc5000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc01590b0 0x7f6bc015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bc5000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc01590b0 0x7f6bc015a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38310/0 (socket says 172.21.15.63:38310) 2024-09-12T02:58:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bbf400640 1 -- 172.21.15.63:0/1735743951 learned_addr learned my addr 172.21.15.63:0/1735743951 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1735743951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc006f810 con 0x7f6bc01590b0 2024-09-12T02:58:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1735743951 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc006f690 con 0x7f6bc00ccb50 2024-09-12T02:58:28.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.428+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1735743951 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc006f990 con 0x7f6bc00cc770 2024-09-12T02:58:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bc5000640 1 -- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bc00cc770 msgr2=0x7f6bc01fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bc5000640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bc00cc770 0x7f6bc01fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bc5000640 1 -- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc00ccb50 msgr2=0x7f6bc01572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bc5000640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc00ccb50 0x7f6bc01572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bc5000640 1 -- 172.21.15.63:0/1735743951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc015b2b0 con 0x7f6bc01590b0 2024-09-12T02:58:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bbf400640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bc00ccb50 0x7f6bc01572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:28.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bc5000640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6bc01590b0 0x7f6bc015a260 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800ca70 tx=0x7f6bb800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bb7e00640 1 -- 172.21.15.63:0/1735743951 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8017070 con 0x7f6bc01590b0 2024-09-12T02:58:28.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bb7e00640 1 -- 172.21.15.63:0/1735743951 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb800aa90 con 0x7f6bc01590b0 2024-09-12T02:58:28.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1735743951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc0159a80 con 0x7f6bc01590b0 2024-09-12T02:58:28.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bb7e00640 1 -- 172.21.15.63:0/1735743951 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8012400 con 0x7f6bc01590b0 2024-09-12T02:58:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.432+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1735743951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc01fda10 con 0x7f6bc01590b0 2024-09-12T02:58:28.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.436+0000 7f6bc5a00640 1 -- 172.21.15.63:0/1735743951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6bc006f150 con 0x7f6bc01590b0 2024-09-12T02:58:28.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.436+0000 7f6bb7e00640 1 -- 172.21.15.63:0/1735743951 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6bb801a070 con 0x7f6bc01590b0 2024-09-12T02:58:28.442 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:28.438+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:28.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bb7e00640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ba0067910 0x7f6ba0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bb7e00640 1 -- 172.21.15.63:0/1735743951 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6685+0+0 (secure 0 0 0) 0x7f6bb8085c70 con 0x7f6bc01590b0 2024-09-12T02:58:28.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bb7e00640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f6ba00712b0 0x7f6ba0073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bb7e00640 1 -- 172.21.15.63:0/1735743951 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ba0073e20 con 0x7f6ba00712b0 2024-09-12T02:58:28.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bb7e00640 1 -- 172.21.15.63:0/1735743951 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f6bb8088290 con 0x7f6bc01590b0 2024-09-12T02:58:28.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bbfe00640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ba0067910 0x7f6ba0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bbf400640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f6ba00712b0 0x7f6ba0073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f147421c9b0 con 0x7f147421a080 2024-09-12T02:58:28.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bbf400640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f6ba00712b0 0x7f6ba0073750 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bbfe00640 1 --2- 172.21.15.63:0/1735743951 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ba0067910 0x7f6ba0069dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00b2000 tx=0x7f6bb00aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.440+0000 7f6bb7e00640 1 -- 172.21.15.63:0/1735743951 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ba0073e20 con 0x7f6ba00712b0 2024-09-12T02:58:28.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f146aa00640 1 -- 172.21.15.63:0/3884809208 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f147421c9b0 con 0x7f147421a080 2024-09-12T02:58:28.450 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:28.450 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:28.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f1474159560 msgr2=0x7f14740c8640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f1474159560 0x7f14740c8640 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f1474146200 msgr2=0x7f147415fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f1474146200 0x7f147415fe50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f14741608a0 msgr2=0x7f14740626e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f14741608a0 0x7f14740626e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f14740cb3b0 msgr2=0x7f14740cb7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f14740cb3b0 0x7f14740cb7f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f147402cb60 msgr2=0x7f147402cfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f147402cb60 0x7f147402cfc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f1474214400 msgr2=0x7f14742167f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7f1474214400 0x7f14742167f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1474217240 msgr2=0x7f1474219630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1474217240 0x7f1474219630 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f147421a080 msgr2=0x7f147421c470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.444+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f147421a080 0x7f147421c470 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14500678c0 msgr2=0x7f1450069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f14500678c0 0x7f1450069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f14640ad000 tx=0x7f1464008040 comp rx=0 tx=0).stop 2024-09-12T02:58:28.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14740cd6b0 msgr2=0x7f147415ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1479600640 1 --2- 172.21.15.63:0/3884809208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14740cd6b0 0x7f147415ad40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f145c00c500 tx=0x7f145c00c9c0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1473400640 1 -- 172.21.15.63:0/3884809208 reap_dead start 2024-09-12T02:58:28.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1473400640 1 -- 172.21.15.63:0/3884809208 reap_dead start 2024-09-12T02:58:28.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1473400640 1 -- 172.21.15.63:0/3884809208 reap_dead start 2024-09-12T02:58:28.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1473400640 1 -- 172.21.15.63:0/3884809208 reap_dead start 2024-09-12T02:58:28.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1473400640 1 -- 172.21.15.63:0/3884809208 reap_dead start 2024-09-12T02:58:28.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 shutdown_connections 2024-09-12T02:58:28.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 >> 172.21.15.63:0/3884809208 conn(0x7f1474072960 msgr2=0x7f1474149250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:28.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 shutdown_connections 2024-09-12T02:58:28.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.448+0000 7f1479600640 1 -- 172.21.15.63:0/3884809208 wait complete. 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-12T02:58:28.501 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-12T02:58:28.502 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-12T02:58:28.513 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T02:58:28.513 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T02:58:28.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-09-12T02:58:28.554 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:28.552+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:28.591 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:28.591 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:28.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:28.591 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.736199979999995, 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011663767, 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853092+0000", 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853098+0000", 2024-09-12T02:58:28.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7509999999999997e-06 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853119+0000", 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.075e-05 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853130+0000", 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1396000000000001e-05 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853240+0000", 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109484 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853398+0000", 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158574 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864754+0000", 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011355568999999999 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.736124341999997, 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065283390000000002, 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:28.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853171+0000", 2024-09-12T02:58:28.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1860000000000002e-06 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853181+0000", 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0239e-05 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853188+0000", 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0389999999999999e-06 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853287+0000", 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9116000000000004e-05 2024-09-12T02:58:28.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853406+0000", 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011876500000000001 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859694+0000", 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006288348 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.733853148999998, 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031174459999999998, 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855439+0000", 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-06 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855447+0000", 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1899999999999995e-06 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855460+0000", 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3521e-05 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855469+0000", 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2709999999999992e-06 2024-09-12T02:58:28.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855540+0000", 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1112000000000006e-05 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855574+0000", 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4823999999999997e-05 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858501+0000", 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002926695 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858554+0000", 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3270999999999999e-05 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.733792789000006, 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030877769999999999, 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855498+0000", 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6199999999999998e-07 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855504+0000", 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7209999999999999e-06 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855512+0000", 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2500000000000006e-06 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855517+0000", 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4079999999999997e-06 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855770+0000", 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025252599999999999 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855787+0000", 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7486000000000002e-05 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858557+0000", 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027699449999999998 2024-09-12T02:58:28.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858585+0000", 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7979000000000001e-05 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.731045300999995, 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034578339999999999, 2024-09-12T02:58:28.609 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858246+0000", 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7199999999999997e-07 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858287+0000", 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106000000000003e-05 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858304+0000", 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7221e-05 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858314+0000", 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3819999999999993e-06 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858531+0000", 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000217538 2024-09-12T02:58:28.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858546+0000", 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4518000000000001e-05 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861647+0000", 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031017060000000001 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861703+0000", 2024-09-12T02:58:28.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5390999999999999e-05 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.730926546000006, 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006126589, 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.614 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:28.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858380+0000", 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5491000000000001e-05 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858397+0000", 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7720999999999999e-05 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858404+0000", 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.669e-06 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858743+0000", 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033907799999999998 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858760+0000", 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864447+0000", 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005686895 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864490+0000", 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3658000000000001e-05 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.730874698999997, 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061037929999999997, 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.619 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858416+0000", 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2300000000000002e-07 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858421+0000", 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5319999999999997e-06 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858429+0000", 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8790000000000003e-06 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1599999999999997e-06 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858911+0000", 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047701999999999998 2024-09-12T02:58:28.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858930+0000", 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8189000000000002e-05 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864493+0000", 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055629099999999999 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864519+0000", 2024-09-12T02:58:28.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6679999999999999e-05 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.729972172999993, 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052338280000000003, 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.623 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859319+0000", 2024-09-12T02:58:28.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3099999999999997e-07 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859326+0000", 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0520000000000004e-06 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859345+0000", 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9466e-05 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859353+0000", 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2009999999999999e-06 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859518+0000", 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000164582 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859536+0000", 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8088999999999999e-05 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864521+0000", 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049850390000000001 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864552+0000", 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0667999999999998e-05 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.627 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.729859110000007, 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026944499999999999, 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859432+0000", 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.068e-06 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859437+0000", 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3569999999999997e-06 2024-09-12T02:58:28.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859457+0000", 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9462000000000001e-05 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859465+0000", 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3990000000000004e-06 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859578+0000", 2024-09-12T02:58:28.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112446 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859700+0000", 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012271299999999999 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:28.631 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.728685768000005, 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039558550000000003, 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:28.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860605+0000", 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3200000000000004e-07 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860613+0000", 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.644e-06 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860632+0000", 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9173000000000001e-05 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860661+0000", 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8589e-05 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860740+0000", 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9216999999999997e-05 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864560+0000", 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038205000000000001 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.724677423000003, 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014506999999999999, 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864614+0000", 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8599999999999997e-07 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864617+0000", 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864630+0000", 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2659e-05 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864636+0000", 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7930000000000003e-06 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864684+0000", 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7926000000000002e-05 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864758+0000", 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4222999999999997e-05 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.722516940999995, 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075281000000000002, 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866774+0000", 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866779+0000", 2024-09-12T02:58:28.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1499999999999998e-06 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866791+0000", 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.238e-05 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866799+0000", 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2559999999999996e-06 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866850+0000", 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1063999999999998e-05 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866862+0000", 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1891e-05 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867492+0000", 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00062994899999999998 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867526+0000", 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4372999999999998e-05 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 67.974619637000004, 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001141305, 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.644 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614672+0000", 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4619999999999999e-06 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614684+0000", 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.204e-05 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614703+0000", 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9415e-05 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614713+0000", 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4720000000000001e-06 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614774+0000", 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1449000000000001e-05 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614790+0000", 2024-09-12T02:58:28.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6112000000000001e-05 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615776+0000", 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098508800000000007 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615812+0000", 2024-09-12T02:58:28.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6266999999999997e-05 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 66.218330565000002, 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001160754, 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.649 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370962+0000", 2024-09-12T02:58:28.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2529999999999999e-06 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371051+0000", 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9019999999999998e-05 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371086+0000", 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5153e-05 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371103+0000", 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7113999999999999e-05 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371265+0000", 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162063 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371314+0000", 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9110000000000002e-05 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372077+0000", 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000762566 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372120+0000", 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3475e-05 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.653 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 65.336516697999997, 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010780609999999999, 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252775+0000", 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252785+0000", 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9650000000000003e-06 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252802+0000", 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7550999999999998e-05 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252813+0000", 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0169e-05 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252883+0000", 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0660000000000004e-05 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252910+0000", 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6889999999999998e-05 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253800+0000", 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00088991299999999999 2024-09-12T02:58:28.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253852+0000", 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1530000000000003e-05 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 43.652352858, 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001011966, 2024-09-12T02:58:28.658 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936939+0000", 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936949+0000", 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0395e-05 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936966+0000", 2024-09-12T02:58:28.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7173e-05 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936977+0000", 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0557000000000001e-05 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937037+0000", 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9672000000000001e-05 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937056+0000", 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9338999999999999e-05 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937870+0000", 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081393600000000002 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937949+0000", 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9418000000000004e-05 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.662 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 43.651380428000003, 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000793828, 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9100000000000003e-07 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937916+0000", 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7309999999999998e-06 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937925+0000", 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4460000000000001e-06 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937934+0000", 2024-09-12T02:58:28.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3039999999999994e-06 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937973+0000", 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9493999999999998e-05 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937984+0000", 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938672+0000", 2024-09-12T02:58:28.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00068768500000000005 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938704+0000", 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1664e-05 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:45 2.14 e27/19 2:2e2fa760:::200.00000001:head v 27'12, mlcod=26'10)", 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 40.959523439999998, 2024-09-12T02:58:28.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00181248, 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.91e-07 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629819+0000", 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1918e-05 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629833+0000", 2024-09-12T02:58:28.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3767999999999999e-05 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629844+0000", 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1326e-05 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629933+0000", 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9419999999999994e-05 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629962+0000", 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8314999999999999e-05 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631512+0000", 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015498 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631579+0000", 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7642000000000001e-05 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.671 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:47 2.14 e47/19 2:2e2fa760:::200.00000001:head v 47'13, mlcod=26'11)", 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.2799883340000004, 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001880287, 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309303+0000", 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.544e-06 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309325+0000", 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2031e-05 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309346+0000", 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1049000000000001e-05 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309359+0000", 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2988e-05 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309439+0000", 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9721999999999993e-05 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309465+0000", 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5884000000000002e-05 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311130+0000", 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001664837 2024-09-12T02:58:28.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311182+0000", 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2231999999999997e-05 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:48 2.14 e47/19 2:292cf221:::200.00000000:head v 47'14, mlcod=26'11)", 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 8.2788545310000003, 2024-09-12T02:58:28.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001320122, 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:28.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5300000000000003e-07 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310443+0000", 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7739999999999999e-06 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310453+0000", 2024-09-12T02:58:28.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8970000000000003e-06 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310460+0000", 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8460000000000002e-06 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310554+0000", 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4036999999999994e-05 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:28.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310577+0000", 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3462999999999999e-05 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311709+0000", 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011311400000000001 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311756+0000", 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7111999999999999e-05 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.680 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.681 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.681 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:28.681 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:28.681 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:28.682 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:28.683 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:28.678+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:28.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.716+0000 7f0933200640 1 Processor -- start 2024-09-12T02:58:28.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.716+0000 7f0933200640 1 -- start start 2024-09-12T02:58:28.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0933200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09340c8bf0 0x7f09340c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0933200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093406e980 con 0x7f09340c8fd0 2024-09-12T02:58:28.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0933200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093406ec40 con 0x7f093406fc30 2024-09-12T02:58:28.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0933200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f093406ef20 con 0x7f09340c8bf0 2024-09-12T02:58:28.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0931400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f09340c8fd0 0x7f093406cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:44828/0 (socket says 172.21.15.63:44828) 2024-09-12T02:58:28.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0931400640 1 -- 172.21.15.63:0/2219350879 learned_addr learned my addr 172.21.15.63:0/2219350879 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:28.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0931e00640 1 --2- 172.21.15.63:0/2219350879 >> v2:172.21.15.63:3300/0 conn(0x7f09340c8bf0 0x7f09340c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0930a00640 1 -- 172.21.15.63:0/2219350879 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707056128 0 0) 0x7f093406e980 con 0x7f09340c8fd0 2024-09-12T02:58:28.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0930a00640 1 -- 172.21.15.63:0/2219350879 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0918003530 con 0x7f09340c8fd0 2024-09-12T02:58:28.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0930a00640 1 -- 172.21.15.63:0/2219350879 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895011634 0 0) 0x7f093406ec40 con 0x7f093406fc30 2024-09-12T02:58:28.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0930a00640 1 -- 172.21.15.63:0/2219350879 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f093406e980 con 0x7f093406fc30 2024-09-12T02:58:28.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0931e00640 1 -- 172.21.15.63:0/2219350879 >> v1:172.21.15.119:6789/0 conn(0x7f093406fc30 legacy=0x7f09340caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0931e00640 1 -- 172.21.15.63:0/2219350879 >> v1:172.21.15.63:6789/0 conn(0x7f09340c8fd0 legacy=0x7f093406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.720+0000 7f0931e00640 1 -- 172.21.15.63:0/2219350879 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093415ab80 con 0x7f09340c8bf0 2024-09-12T02:58:28.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0931e00640 1 --2- 172.21.15.63:0/2219350879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09340c8bf0 0x7f09340c9440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f09240097c0 tx=0x7f092401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9970a054fcc2f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0930a00640 1 -- 172.21.15.63:0/2219350879 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09240b5070 con 0x7f09340c8bf0 2024-09-12T02:58:28.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0930a00640 1 -- 172.21.15.63:0/2219350879 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09240a89b0 con 0x7f09340c8bf0 2024-09-12T02:58:28.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0930a00640 1 -- 172.21.15.63:0/2219350879 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09240a8d60 con 0x7f09340c8bf0 2024-09-12T02:58:28.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0933200640 1 -- 172.21.15.63:0/2219350879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09340c8bf0 msgr2=0x7f09340c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0933200640 1 --2- 172.21.15.63:0/2219350879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09340c8bf0 0x7f09340c9440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f09240097c0 tx=0x7f092401ecd0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0933200640 1 -- 172.21.15.63:0/2219350879 shutdown_connections 2024-09-12T02:58:28.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0933200640 1 --2- 172.21.15.63:0/2219350879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09340c8bf0 0x7f09340c9440 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0933200640 1 -- 172.21.15.63:0/2219350879 >> 172.21.15.63:0/2219350879 conn(0x7f0934067a00 msgr2=0x7f0934067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:28.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0933200640 1 -- 172.21.15.63:0/2219350879 shutdown_connections 2024-09-12T02:58:28.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.724+0000 7f0933200640 1 -- 172.21.15.63:0/2219350879 wait complete. 2024-09-12T02:58:28.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0933200640 1 Processor -- start 2024-09-12T02:58:28.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0933200640 1 -- start start 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0933200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f093406fc30 0x7f09340cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0933200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09340c8bf0 0x7f0934150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0933200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09340c8fd0 0x7f0934155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0933200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f093415a830 con 0x7f09340c8fd0 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0933200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f093415b140 con 0x7f09340c8bf0 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0933200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f093415b660 con 0x7f093406fc30 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f093406fc30 0x7f09340cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09340c8bf0 0x7f0934150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0932800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09340c8fd0 0x7f0934155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f093406fc30 0x7f09340cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:43310/0 (socket says 172.21.15.63:43310) 2024-09-12T02:58:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931e00640 1 -- 172.21.15.63:0/3653702800 learned_addr learned my addr 172.21.15.63:0/3653702800 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:28.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931400640 1 -- 172.21.15.63:0/3653702800 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f093406fc30 msgr2=0x7f09340cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931400640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f093406fc30 0x7f09340cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931400640 1 -- 172.21.15.63:0/3653702800 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09340c8fd0 msgr2=0x7f0934155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931400640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09340c8fd0 0x7f0934155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931400640 1 -- 172.21.15.63:0/3653702800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09341515f0 con 0x7f09340c8bf0 2024-09-12T02:58:28.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0932800640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09340c8fd0 0x7f0934155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:28.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0931400640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09340c8bf0 0x7f0934150cd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0920001ec0 tx=0x7f092000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f092a000640 1 -- 172.21.15.63:0/3653702800 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920017070 con 0x7f09340c8bf0 2024-09-12T02:58:28.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f092a000640 1 -- 172.21.15.63:0/3653702800 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0920005cf0 con 0x7f09340c8bf0 2024-09-12T02:58:28.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f092a000640 1 -- 172.21.15.63:0/3653702800 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920007310 con 0x7f09340c8bf0 2024-09-12T02:58:28.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.728+0000 7f0933200640 1 -- 172.21.15.63:0/3653702800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09340cbec0 con 0x7f09340c8bf0 2024-09-12T02:58:28.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.732+0000 7f0933200640 1 -- 172.21.15.63:0/3653702800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09340cc480 con 0x7f09340c8bf0 2024-09-12T02:58:28.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.732+0000 7f0933200640 1 -- 172.21.15.63:0/3653702800 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09340700e0 con 0x7f09340c8bf0 2024-09-12T02:58:28.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.732+0000 7f092a000640 1 -- 172.21.15.63:0/3653702800 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f092001a070 con 0x7f09340c8bf0 2024-09-12T02:58:28.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f092a000640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f09140678c0 0x7f0914069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f092a000640 1 -- 172.21.15.63:0/3653702800 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6685+0+0 (secure 0 0 0) 0x7f0920085b40 con 0x7f09340c8bf0 2024-09-12T02:58:28.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f092a000640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f09140711d0 0x7f0914073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f0931e00640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f09140678c0 0x7f0914069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f092a000640 1 -- 172.21.15.63:0/3653702800 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f092001be50 con 0x7f09140711d0 2024-09-12T02:58:28.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f092a000640 1 -- 172.21.15.63:0/3653702800 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f0920085ef0 con 0x7f09340c8bf0 2024-09-12T02:58:28.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f0932800640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f09140711d0 0x7f0914073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f0931e00640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f09140678c0 0x7f0914069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09240097c0 tx=0x7f0924008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f0932800640 1 --2- 172.21.15.63:0/3653702800 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f09140711d0 0x7f0914073670 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.736+0000 7f092a000640 1 -- 172.21.15.63:0/3653702800 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f092001be50 con 0x7f09140711d0 2024-09-12T02:58:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-12T02:58:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-12T02:58:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-12T02:58:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-12T02:58:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-12T02:58:28.767 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-12T02:58:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-12T02:58:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-12T02:58:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-12T02:58:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-12T02:58:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-12T02:58:28.768 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-12T02:58:28.777 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T02:58:28.777 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T02:58:28.777 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-12T02:58:28.783 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:28.778+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:28.813 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:28.814 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:28.814 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:28.814 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:28.828 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:28.884 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:28.880+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:28.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.960+0000 7ff972e00640 1 Processor -- start 2024-09-12T02:58:28.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.960+0000 7ff972e00640 1 -- start start 2024-09-12T02:58:28.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff972e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 0x7ff96c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff972e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff96c159070 0x7ff96c0c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff972e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff96c1585d0 con 0x7ff96c0c78a0 2024-09-12T02:58:28.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff972e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff96c0c97a0 con 0x7ff96c159070 2024-09-12T02:58:28.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff972e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c14f440 con 0x7ff96c0c93c0 2024-09-12T02:58:28.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff971a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 0x7ff96c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff972400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff96c0c78a0 0x7ff96c15bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:59882/0 (socket says 172.21.15.63:59882) 2024-09-12T02:58:28.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff972400640 1 -- 172.21.15.63:0/4215262153 learned_addr learned my addr 172.21.15.63:0/4215262153 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:28.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff971a00640 1 --2- 172.21.15.63:0/4215262153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 0x7ff96c06c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:43324/0 (socket says 172.21.15.63:43324) 2024-09-12T02:58:28.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff971a00640 1 -- 172.21.15.63:0/4215262153 >> v2:172.21.15.63:3300/0 conn(0x7ff96c159070 msgr2=0x7ff96c0c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:28.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff971a00640 1 --2- 172.21.15.63:0/4215262153 >> v2:172.21.15.63:3300/0 conn(0x7ff96c159070 0x7ff96c0c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff971a00640 1 -- 172.21.15.63:0/4215262153 >> v1:172.21.15.119:6789/0 conn(0x7ff96c0c78a0 legacy=0x7ff96c15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.964+0000 7ff971a00640 1 -- 172.21.15.63:0/4215262153 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c0c3ed0 con 0x7ff96c0c93c0 2024-09-12T02:58:28.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff971a00640 1 --2- 172.21.15.63:0/4215262153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 0x7ff96c06c6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9600097c0 tx=0x7ff96001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edf25c5ecd5716ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff96be00640 1 -- 172.21.15.63:0/4215262153 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9600b5070 con 0x7ff96c0c93c0 2024-09-12T02:58:28.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff96be00640 1 -- 172.21.15.63:0/4215262153 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9600a8990 con 0x7ff96c0c93c0 2024-09-12T02:58:28.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff96be00640 1 -- 172.21.15.63:0/4215262153 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9600a8d60 con 0x7ff96c0c93c0 2024-09-12T02:58:28.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff972e00640 1 -- 172.21.15.63:0/4215262153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 msgr2=0x7ff96c06c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff972e00640 1 --2- 172.21.15.63:0/4215262153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 0x7ff96c06c6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff9600097c0 tx=0x7ff96001ec90 comp rx=0 tx=0).stop 2024-09-12T02:58:28.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff972e00640 1 -- 172.21.15.63:0/4215262153 shutdown_connections 2024-09-12T02:58:28.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff972e00640 1 --2- 172.21.15.63:0/4215262153 >> v2:172.21.15.63:3300/0 conn(0x7ff96c159070 0x7ff96c0c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff972e00640 1 --2- 172.21.15.63:0/4215262153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 0x7ff96c06c6d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff972e00640 1 -- 172.21.15.63:0/4215262153 >> 172.21.15.63:0/4215262153 conn(0x7ff96c070180 msgr2=0x7ff96c070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:28.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff972e00640 1 -- 172.21.15.63:0/4215262153 shutdown_connections 2024-09-12T02:58:28.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.968+0000 7ff972e00640 1 -- 172.21.15.63:0/4215262153 wait complete. 2024-09-12T02:58:28.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff972e00640 1 Processor -- start 2024-09-12T02:58:28.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff972e00640 1 -- start start 2024-09-12T02:58:28.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff972e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0c78a0 0x7ff96c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff972e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 0x7ff96c0c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff972e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c159070 0x7ff96c0c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff972e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c0b2940 con 0x7ff96c0c78a0 2024-09-12T02:58:28.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff972e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff96c158be0 con 0x7ff96c159070 2024-09-12T02:58:28.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff972e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff96c06e120 con 0x7ff96c0c93c0 2024-09-12T02:58:28.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff971a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0c78a0 0x7ff96c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff971a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0c78a0 0x7ff96c153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38340/0 (socket says 172.21.15.63:38340) 2024-09-12T02:58:28.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff971a00640 1 -- 172.21.15.63:0/401215631 learned_addr learned my addr 172.21.15.63:0/401215631 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:28.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff971000640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 0x7ff96c0c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff972400640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c159070 0x7ff96c0c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff971a00640 1 -- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 msgr2=0x7ff96c0c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff971a00640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff96c0c93c0 0x7ff96c0c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff971a00640 1 -- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c159070 msgr2=0x7ff96c0c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:28.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff971a00640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff96c159070 0x7ff96c0c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:28.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.972+0000 7ff971a00640 1 -- 172.21.15.63:0/401215631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff96c1f1450 con 0x7ff96c0c78a0 2024-09-12T02:58:28.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.976+0000 7ff971a00640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff96c0c78a0 0x7ff96c153b80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff96001c8c0 tx=0x7ff96001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.976+0000 7ff969600640 1 -- 172.21.15.63:0/401215631 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9600b5040 con 0x7ff96c0c78a0 2024-09-12T02:58:28.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.976+0000 7ff969600640 1 -- 172.21.15.63:0/401215631 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9600b0870 con 0x7ff96c0c78a0 2024-09-12T02:58:28.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.976+0000 7ff969600640 1 -- 172.21.15.63:0/401215631 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9600b0c60 con 0x7ff96c0c78a0 2024-09-12T02:58:28.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.976+0000 7ff972e00640 1 -- 172.21.15.63:0/401215631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff96c155bd0 con 0x7ff96c0c78a0 2024-09-12T02:58:28.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.976+0000 7ff972e00640 1 -- 172.21.15.63:0/401215631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff96c1558f0 con 0x7ff96c0c78a0 2024-09-12T02:58:28.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.976+0000 7ff972e00640 1 -- 172.21.15.63:0/401215631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff96c1f1030 con 0x7ff96c0c78a0 2024-09-12T02:58:28.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.976+0000 7ff969600640 1 -- 172.21.15.63:0/401215631 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9600c1020 con 0x7ff96c0c78a0 2024-09-12T02:58:28.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff969600640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff94c0678c0 0x7ff94c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff969600640 1 -- 172.21.15.63:0/401215631 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6685+0+0 (secure 0 0 0) 0x7ff960122f20 con 0x7ff96c0c78a0 2024-09-12T02:58:28.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff969600640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7ff94c0711e0 0x7ff94c073680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:28.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff969600640 1 -- 172.21.15.63:0/401215631 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff96000af30 con 0x7ff94c0711e0 2024-09-12T02:58:28.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff971000640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff94c0678c0 0x7ff94c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff969600640 1 -- 172.21.15.63:0/401215631 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff960125540 con 0x7ff96c0c78a0 2024-09-12T02:58:28.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff972400640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7ff94c0711e0 0x7ff94c073680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:28.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff971000640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff94c0678c0 0x7ff94c069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff96c073d90 tx=0x7ff958006f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff972400640 1 --2- 172.21.15.63:0/401215631 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7ff94c0711e0 0x7ff94c073680 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:28.985 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:28.978+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:28.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:28.980+0000 7ff969600640 1 -- 172.21.15.63:0/401215631 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff96000af30 con 0x7ff94c0711e0 2024-09-12T02:58:28.994 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:28.994 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:28.994 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:28.994 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:28.994 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:29.008 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:29.011 INFO:teuthology.orchestra.run.smithi063.stderr:no valid command found; 10 closest matches: 2024-09-12T02:58:29.011 INFO:teuthology.orchestra.run.smithi063.stderr:0 2024-09-12T02:58:29.011 INFO:teuthology.orchestra.run.smithi063.stderr:1 2024-09-12T02:58:29.011 INFO:teuthology.orchestra.run.smithi063.stderr:2 2024-09-12T02:58:29.011 INFO:teuthology.orchestra.run.smithi063.stderr:abort 2024-09-12T02:58:29.011 INFO:teuthology.orchestra.run.smithi063.stderr:assert 2024-09-12T02:58:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:bench [] [] [] [] 2024-09-12T02:58:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs debug_inject_read_zeros 2024-09-12T02:58:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs files list 2024-09-12T02:58:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:bluefs stats 2024-09-12T02:58:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:bluestore allocator dump block 2024-09-12T02:58:29.012 INFO:teuthology.orchestra.run.smithi063.stderr:Error EINVAL: invalid command 2024-09-12T02:58:29.017 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T02:58:29.017 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-12T02:58:29.093 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:29.090+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:29.173 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.320068215999996, 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.175 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:58:29.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:29.179 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.315307438000005, 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.182 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:58:29.183 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.315169576000002, 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:29.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.315083458999993, 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:58:29.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.192 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.314359627000002, 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:58:29.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.196 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.314200760000006, 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:58:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.313747141999997, 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:58:29.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:58:29.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:29.205 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.310513147999998, 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:29.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.209 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPush(2.6 41/40 [PushOp(2:654134d2:::mds0_openfiles.0:head, version: 28'2, data_included: [], data_size: 0, omap_header_size: 42, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:654134d2:::mds0_openfiles.0:head@28'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 24.265130318000001, 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00050712800000000003, 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.210 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906694+0000", 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1620000000000001e-06 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906711+0000", 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6974e-05 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906734+0000", 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3862999999999998e-05 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906757+0000", 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2765e-05 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906918+0000", 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000160326 2024-09-12T02:58:29.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906935+0000", 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7215e-05 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.907200+0000", 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026482300000000002 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.213 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.214 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.214 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:29.215 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:58:29.215 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:29.210+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:29.315 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:29.310+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:29.385 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:29.385 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:29.385 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:29.400 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T02:58:29.442 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:29.438+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:29.517 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:29.514+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:29.568 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:29.568 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:29.568 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:29.568 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:29.568 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:29.582 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T02:58:29.625 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:29.622+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:29.719 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:29.716+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:29.750 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:14 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.895609038000003, 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00551893, 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853805+0000", 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.752 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853808+0000", 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4959999999999999e-06 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853827+0000", 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8675999999999999e-05 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853869+0000", 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2347e-05 2024-09-12T02:58:29.753 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853889+0000", 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0248999999999999e-05 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854115+0000", 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022562600000000001 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.754 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854168+0000", 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3476000000000001e-05 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859207+0000", 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050389550000000003 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859324+0000", 2024-09-12T02:58:29.755 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117105 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:15 2.15 e25/19 2:a93a17c2:::604.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.8944063, 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077810020000000004, 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.756 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.757 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.757 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.757 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:29.757 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.757 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.757 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855008+0000", 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855011+0000", 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3259999999999998e-06 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.758 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855026+0000", 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5023e-05 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855055+0000", 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9298e-05 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.759 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0525000000000001e-05 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855570+0000", 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000494539 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.760 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855624+0000", 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3656999999999998e-05 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862687+0000", 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.007063593 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862789+0000", 2024-09-12T02:58:29.761 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010204099999999999 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:30 2.15 e25/19 2:aa448500:::500.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.894284690999996, 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077503839999999999, 2024-09-12T02:58:29.762 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855130+0000", 2024-09-12T02:58:29.763 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855131+0000", 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5230000000000001e-06 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855143+0000", 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1412e-05 2024-09-12T02:58:29.764 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0043000000000001e-05 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855176+0000", 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3429e-05 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.765 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856069+0000", 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00089251 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856116+0000", 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6826999999999997e-05 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862797+0000", 2024-09-12T02:58:29.766 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0066810050000000003 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862880+0000", 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3634999999999995e-05 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:20 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.893179407000005, 2024-09-12T02:58:29.767 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065292639999999999, 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856235+0000", 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.768 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856237+0000", 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.103e-06 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856252+0000", 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4813e-05 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856279+0000", 2024-09-12T02:58:29.769 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7254e-05 2024-09-12T02:58:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856297+0000", 2024-09-12T02:58:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7929000000000001e-05 2024-09-12T02:58:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.770 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856462+0000", 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016488700000000001 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856508+0000", 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.5787000000000001e-05 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862657+0000", 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061494210000000004 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.771 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.772 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.772 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862764+0000", 2024-09-12T02:58:29.772 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010707 2024-09-12T02:58:29.772 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.772 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.772 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.772 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.772 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.772 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:21 2.1c e25/19 2:3ed09add:::607.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.892432141, 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.005857943, 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.773 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856982+0000", 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856984+0000", 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3799999999999999e-06 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856997+0000", 2024-09-12T02:58:29.774 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2896e-05 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857022+0000", 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5554999999999998e-05 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857043+0000", 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0919000000000001e-05 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857162+0000", 2024-09-12T02:58:29.775 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118526 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857225+0000", 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3578999999999996e-05 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862772+0000", 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0055470789999999999 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.776 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862840+0000", 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8009000000000006e-05 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:a93a17c2:::604.00000000:head)])", 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 24.835304632, 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00045081800000000002, 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.777 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914110+0000", 2024-09-12T02:58:29.778 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914111+0000", 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1699999999999997e-07 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914116+0000", 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.259e-06 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.779 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914129+0000", 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3451e-05 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914140+0000", 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0721e-05 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914241+0000", 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000100843 2024-09-12T02:58:29.780 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.914561+0000", 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031982700000000001 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPushReply(2.15 41/40 [PushReplyOp(2:aa448500:::500.00000000:head)])", 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 24.831812729999999, 2024-09-12T02:58:29.781 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000219385, 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:29.782 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917602+0000", 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5800000000000001e-07 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917605+0000", 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1379999999999999e-06 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917611+0000", 2024-09-12T02:58:29.783 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.9179999999999999e-06 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917620+0000", 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0389999999999993e-06 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917681+0000", 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.0482999999999997e-05 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.917821+0000", 2024-09-12T02:58:29.784 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014054900000000001 2024-09-12T02:58:29.785 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.785 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.785 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.785 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:29.785 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:29.785 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:29.786 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:29.820 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:29.816+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:29.912 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:29.912 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:29.912 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:29.912 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:29.921 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:29.914+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:29.926 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:30.021 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:30.016+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:30.095 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:30.095 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:30.096 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:30.096 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:30.096 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:30.111 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:30.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T02:58:30.159 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:30.154+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:30.223 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:30.218+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:30.233 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:30.233 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:30.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:30.233 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:30.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.233 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.233 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.379056594999994, 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.235 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:30.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:30.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.378923387, 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.239 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.244 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.378818636999995, 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.246 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:30.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.250 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.378672819000002, 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:30.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:30.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:30.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:30.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.256 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.378599636999994, 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.257 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:30.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.378539650999997, 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:30.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.378477305000004, 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.268 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:30.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.378419789000006, 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:30.272 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.273 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:30.274 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:30.275 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.376252163999993, 2024-09-12T02:58:30.276 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:30.277 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.278 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.279 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.280 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.373093648999998, 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.281 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.282 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.283 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:30.284 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.365384775999999, 2024-09-12T02:58:30.285 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.286 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:30.287 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.288 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.289 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.290 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 71.346495825000005, 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.291 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.292 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:30.293 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.294 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:30.295 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 69.618094018999997, 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.296 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.297 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.298 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.299 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:30.300 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 67.862257436999997, 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.301 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:30.302 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:30.303 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.304 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.305 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.306 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 66.980168473000006, 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.307 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:30.308 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.309 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.309 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.309 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:30.309 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:30.309 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.309 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.309 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.309 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.310 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.311 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.312 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.296210860000002, 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.313 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.314 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:30.315 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:30.316 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.317 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 45.296105568999998, 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.318 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.319 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.320 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.321 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:30.322 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:30.323 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 42.603542419, 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.324 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.325 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.326 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.327 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:30.328 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.329 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5447~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.9241838730000005, 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003274795, 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.330 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307146+0000", 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.123e-06 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307162+0000", 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5729000000000001e-05 2024-09-12T02:58:30.331 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307197+0000", 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5179999999999999e-05 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307214+0000", 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7295999999999998e-05 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.332 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307371+0000", 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000156293 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307532+0000", 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016189399999999999 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307741+0000", 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208493 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.333 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.309426+0000", 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016850299999999999 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310212+0000", 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000786494 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310299+0000", 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6178000000000001e-05 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.334 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310418+0000", 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000119085 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 9.9240706959999994, 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037307600000000001, 2024-09-12T02:58:30.335 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307257+0000", 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2699999999999999e-06 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307266+0000", 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2160000000000006e-06 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307286+0000", 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0537e-05 2024-09-12T02:58:30.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307299+0000", 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3297e-05 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308569+0000", 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001269121 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.338 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308706+0000", 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013719099999999999 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308921+0000", 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021543199999999999 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310051+0000", 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001129901 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.339 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310836+0000", 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00078529800000000003 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310922+0000", 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5488000000000005e-05 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310987+0000", 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5009e-05 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.340 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.341 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.341 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.341 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.341 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:30.342 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:30.343 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:30.340+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:30.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.372+0000 7f5971c00640 1 Processor -- start 2024-09-12T02:58:30.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.372+0000 7f5971c00640 1 -- start start 2024-09-12T02:58:30.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f5971c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f596c152850 0x7f596c158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f5971c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 0x7f596c070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f5971c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c070060 con 0x7f596c0c8140 2024-09-12T02:58:30.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f5971c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f596c0c5140 con 0x7f596c152850 2024-09-12T02:58:30.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f5971c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f596c0c3190 con 0x7f596c0c8990 2024-09-12T02:58:30.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f596be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f596c152850 0x7f596c158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f596be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f596c152850 0x7f596c158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38356/0 (socket says 172.21.15.63:38356) 2024-09-12T02:58:30.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f596be00640 1 -- 172.21.15.63:0/1074364557 learned_addr learned my addr 172.21.15.63:0/1074364557 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:30.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f5971200640 1 --2- 172.21.15.63:0/1074364557 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 0x7f596c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f596be00640 1 -- 172.21.15.63:0/1074364557 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 msgr2=0x7f596c070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:30.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f596be00640 1 --2- 172.21.15.63:0/1074364557 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 0x7f596c070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f596be00640 1 -- 172.21.15.63:0/1074364557 >> v1:172.21.15.63:6789/0 conn(0x7f596c0c8140 legacy=0x7f596c0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.376+0000 7f596be00640 1 -- 172.21.15.63:0/1074364557 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c0c3470 con 0x7f596c152850 2024-09-12T02:58:30.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f596be00640 1 --2- 172.21.15.63:0/1074364557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 0x7f596c158410 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f595c009870 tx=0x7f595c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6974dd3848fd4e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f596b400640 1 -- 172.21.15.63:0/1074364557 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c0b5070 con 0x7f596c152850 2024-09-12T02:58:30.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f596b400640 1 -- 172.21.15.63:0/1074364557 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c0a8a50 con 0x7f596c152850 2024-09-12T02:58:30.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f596b400640 1 -- 172.21.15.63:0/1074364557 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c0a8e20 con 0x7f596c152850 2024-09-12T02:58:30.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f5971c00640 1 -- 172.21.15.63:0/1074364557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 msgr2=0x7f596c158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f5971c00640 1 --2- 172.21.15.63:0/1074364557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 0x7f596c158410 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f595c009870 tx=0x7f595c01ed50 comp rx=0 tx=0).stop 2024-09-12T02:58:30.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f5971c00640 1 -- 172.21.15.63:0/1074364557 shutdown_connections 2024-09-12T02:58:30.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f5971c00640 1 --2- 172.21.15.63:0/1074364557 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 0x7f596c070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f5971c00640 1 --2- 172.21.15.63:0/1074364557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 0x7f596c158410 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.380+0000 7f5971c00640 1 -- 172.21.15.63:0/1074364557 >> 172.21.15.63:0/1074364557 conn(0x7f596c067a00 msgr2=0x7f596c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:30.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.384+0000 7f5971c00640 1 -- 172.21.15.63:0/1074364557 shutdown_connections 2024-09-12T02:58:30.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.384+0000 7f5971c00640 1 -- 172.21.15.63:0/1074364557 wait complete. 2024-09-12T02:58:30.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.384+0000 7f5971c00640 1 Processor -- start 2024-09-12T02:58:30.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.384+0000 7f5971c00640 1 -- start start 2024-09-12T02:58:30.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c0c8140 0x7f596c1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 0x7f596c157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 0x7f596c1f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0ce750 con 0x7f596c152850 2024-09-12T02:58:30.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f596c0c4b60 con 0x7f596c0c8140 2024-09-12T02:58:30.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f596c0ce8d0 con 0x7f596c0c8990 2024-09-12T02:58:30.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 0x7f596c1f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 0x7f596c1f3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38366/0 (socket says 172.21.15.63:38366) 2024-09-12T02:58:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971200640 1 -- 172.21.15.63:0/3679234792 learned_addr learned my addr 172.21.15.63:0/3679234792 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f596be00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c0c8140 0x7f596c1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5963e00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 0x7f596c157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971200640 1 -- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 msgr2=0x7f596c157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971200640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 0x7f596c157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971200640 1 -- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c0c8140 msgr2=0x7f596c1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971200640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c0c8140 0x7f596c1572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971200640 1 -- 172.21.15.63:0/3679234792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c1f1250 con 0x7f596c152850 2024-09-12T02:58:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971200640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 0x7f596c1f3af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5964009dd0 tx=0x7f596400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5968c00640 1 -- 172.21.15.63:0/3679234792 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964018020 con 0x7f596c152850 2024-09-12T02:58:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5968c00640 1 -- 172.21.15.63:0/3679234792 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5964014480 con 0x7f596c152850 2024-09-12T02:58:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5968c00640 1 -- 172.21.15.63:0/3679234792 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964014870 con 0x7f596c152850 2024-09-12T02:58:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c152e90 con 0x7f596c152850 2024-09-12T02:58:30.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c157df0 con 0x7f596c152850 2024-09-12T02:58:30.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.388+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c1534a0 con 0x7f596c152850 2024-09-12T02:58:30.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.392+0000 7f5968c00640 1 -- 172.21.15.63:0/3679234792 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f596401b020 con 0x7f596c152850 2024-09-12T02:58:30.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.392+0000 7f5968c00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f59480678f0 0x7f5948069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.392+0000 7f5968c00640 1 -- 172.21.15.63:0/3679234792 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6685+0+0 (secure 0 0 0) 0x7f5964086ac0 con 0x7f596c152850 2024-09-12T02:58:30.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.396+0000 7f596be00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f59480678f0 0x7f5948069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.396+0000 7f596be00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f59480678f0 0x7f5948069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f595c0b2000 tx=0x7f595c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.404+0000 7f5968c00640 1 -- 172.21.15.63:0/3679234792 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5964022070 con 0x7f596c152850 2024-09-12T02:58:30.443 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:30.440+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:30.481 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:30.514 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:30.514 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:30.514 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:30.514 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:30.528 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:30.578 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:30.574+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:30.646 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:30.644+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:30.648 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:30.648 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:30.648 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:30.648 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:30.648 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:30.662 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:30.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33ea00640 1 Processor -- start 2024-09-12T02:58:30.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33ea00640 1 -- start start 2024-09-12T02:58:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33ea00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33806e0d0 0x7fc338070c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33ea00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc33806d2f0 0x7fc33806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33ea00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33806dc80 con 0x7fc338151480 2024-09-12T02:58:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33ea00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc33806e4d0 con 0x7fc33806d2f0 2024-09-12T02:58:30.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33ea00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc33806ce60 con 0x7fc33806e0d0 2024-09-12T02:58:30.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33d600640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc338151480 0x7fc3380c2a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:44854/0 (socket says 172.21.15.63:44854) 2024-09-12T02:58:30.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33d600640 1 -- 172.21.15.63:0/1300415723 learned_addr learned my addr 172.21.15.63:0/1300415723 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:30.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33e000640 1 --2- 172.21.15.63:0/1300415723 >> v2:172.21.15.119:3300/0 conn(0x7fc33806d2f0 0x7fc33806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33cc00640 1 --2- 172.21.15.63:0/1300415723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33806e0d0 0x7fc338070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33e000640 1 -- 172.21.15.63:0/1300415723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33806e0d0 msgr2=0x7fc338070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:30.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.708+0000 7fc33e000640 1 --2- 172.21.15.63:0/1300415723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33806e0d0 0x7fc338070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.712+0000 7fc33e000640 1 -- 172.21.15.63:0/1300415723 >> v1:172.21.15.63:6789/0 conn(0x7fc338151480 legacy=0x7fc3380c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.712+0000 7fc337e00640 1 -- 172.21.15.63:0/1300415723 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 613285493 0 0) 0x7fc33806dc80 con 0x7fc338151480 2024-09-12T02:58:30.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.712+0000 7fc33e000640 1 -- 172.21.15.63:0/1300415723 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3381575e0 con 0x7fc33806d2f0 2024-09-12T02:58:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc33e000640 1 --2- 172.21.15.63:0/1300415723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 0x7fc33806d740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc330009d90 tx=0x7fc33001c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=198342838afae055 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc337e00640 1 -- 172.21.15.63:0/1300415723 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3300b2070 con 0x7fc33806d2f0 2024-09-12T02:58:30.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc337e00640 1 -- 172.21.15.63:0/1300415723 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3300a5920 con 0x7fc33806d2f0 2024-09-12T02:58:30.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc337e00640 1 -- 172.21.15.63:0/1300415723 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3300a5cf0 con 0x7fc33806d2f0 2024-09-12T02:58:30.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc33ea00640 1 -- 172.21.15.63:0/1300415723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 msgr2=0x7fc33806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc33ea00640 1 --2- 172.21.15.63:0/1300415723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 0x7fc33806d740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc330009d90 tx=0x7fc33001c990 comp rx=0 tx=0).stop 2024-09-12T02:58:30.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc33ea00640 1 -- 172.21.15.63:0/1300415723 shutdown_connections 2024-09-12T02:58:30.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc33ea00640 1 --2- 172.21.15.63:0/1300415723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 0x7fc33806d740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc33ea00640 1 --2- 172.21.15.63:0/1300415723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33806e0d0 0x7fc338070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc33ea00640 1 -- 172.21.15.63:0/1300415723 >> 172.21.15.63:0/1300415723 conn(0x7fc338070180 msgr2=0x7fc338070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:30.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc33ea00640 1 -- 172.21.15.63:0/1300415723 shutdown_connections 2024-09-12T02:58:30.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.716+0000 7fc33ea00640 1 -- 172.21.15.63:0/1300415723 wait complete. 2024-09-12T02:58:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33ea00640 1 Processor -- start 2024-09-12T02:58:30.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33ea00640 1 -- start start 2024-09-12T02:58:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33ea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 0x7fc338156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33ea00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33806e0d0 0x7fc338154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc338151480 0x7fc3380cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33ea00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381572d0 con 0x7fc338151480 2024-09-12T02:58:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33ea00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc338158160 con 0x7fc33806d2f0 2024-09-12T02:58:30.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33ea00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc338151860 con 0x7fc33806e0d0 2024-09-12T02:58:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33d600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 0x7fc338156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33d600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 0x7fc338156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:56888/0 (socket says 172.21.15.63:56888) 2024-09-12T02:58:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33d600640 1 -- 172.21.15.63:0/3884473361 learned_addr learned my addr 172.21.15.63:0/3884473361 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:30.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33e000640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc338151480 0x7fc3380cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33cc00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33806e0d0 0x7fc338154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33d600640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33806e0d0 msgr2=0x7fc338154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33d600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33806e0d0 0x7fc338154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33d600640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc338151480 msgr2=0x7fc3380cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33d600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc338151480 0x7fc3380cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.720+0000 7fc33d600640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33814ce70 con 0x7fc33806d2f0 2024-09-12T02:58:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.724+0000 7fc33e000640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc338151480 0x7fc3380cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:30.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.724+0000 7fc33d600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 0x7fc338156cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0011f0 tx=0x7fc32c00c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.724+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c018070 con 0x7fc33806d2f0 2024-09-12T02:58:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.724+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c0074e0 con 0x7fc33806d2f0 2024-09-12T02:58:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.724+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33814d110 con 0x7fc33806d2f0 2024-09-12T02:58:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.724+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3381f68f0 con 0x7fc33806d2f0 2024-09-12T02:58:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.724+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c004a10 con 0x7fc33806d2f0 2024-09-12T02:58:30.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.724+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fc314005280 con 0x7fc33806d2f0 2024-09-12T02:58:30.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.728+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc32c004bb0 con 0x7fc33806d2f0 2024-09-12T02:58:30.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.728+0000 7fc335600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc3180678c0 0x7fc318069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.728+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6685+0+0 (secure 0 0 0) 0x7fc32c085490 con 0x7fc33806d2f0 2024-09-12T02:58:30.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.728+0000 7fc33cc00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc3180678c0 0x7fc318069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.728+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v50) ==== 54+0+16 (secure 0 0 0) 0x7fc32c087a30 con 0x7fc33806d2f0 2024-09-12T02:58:30.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.728+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fc314000fb0 0x7fc3140045f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.728+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc314004b30 con 0x7fc314000fb0 2024-09-12T02:58:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.728+0000 7fc33e000640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fc314000fb0 0x7fc3140045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.728+0000 7fc33cc00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc3180678c0 0x7fc318069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc338073230 tx=0x7fc324009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.732+0000 7fc33e000640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fc314000fb0 0x7fc3140045f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.732+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc314004b30 con 0x7fc314000fb0 2024-09-12T02:58:30.753 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:30.750+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.756+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7f596c069870 con 0x7f596c152850 2024-09-12T02:58:30.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.760+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc3140050a0 con 0x7fc314000fb0 2024-09-12T02:58:30.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.764+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc3140050a0 con 0x7fc314000fb0 2024-09-12T02:58:30.768 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.764+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fc314001cc0 0x7fc3140029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.764+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fc314002250 con 0x7fc314001cc0 2024-09-12T02:58:30.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.764+0000 7fc33d600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fc314001cc0 0x7fc3140029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.764+0000 7fc33d600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fc314001cc0 0x7fc3140029a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.768+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc314002250 con 0x7fc314001cc0 2024-09-12T02:58:30.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.792+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc3140031b0 con 0x7fc314001cc0 2024-09-12T02:58:30.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.796+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc3140031b0 con 0x7fc314001cc0 2024-09-12T02:58:30.801 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:30.801 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:30.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.796+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fc314009c90 0x7fc31400c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.796+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fc31400ee50 con 0x7fc314009c90 2024-09-12T02:58:30.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.796+0000 7fc33cc00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fc314009c90 0x7fc31400c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.800+0000 7fc33cc00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fc314009c90 0x7fc31400c080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.800+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc31400ee50 con 0x7fc314009c90 2024-09-12T02:58:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.824+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc31400c890 con 0x7fc314009c90 2024-09-12T02:58:30.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.828+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc31400c890 con 0x7fc314009c90 2024-09-12T02:58:30.833 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:30.833 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:30.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.828+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fc31400ca40 0x7fc31400ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.828+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fc31400ec80 con 0x7fc31400ca40 2024-09-12T02:58:30.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.828+0000 7fc33e000640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fc31400ca40 0x7fc31400ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.832+0000 7fc33e000640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fc31400ca40 0x7fc31400ced0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.835 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:30.835 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:30.835 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:30.835 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.084478023000003, 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:30.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.837 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:30.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.839 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:30.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.841 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.842 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.941282685000004, 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.843 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.844 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.848 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.941262159000004, 2024-09-12T02:58:30.849 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.850 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.851 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:30.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.855 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.941151345999998, 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.856 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:30.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:30.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:30.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:30.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.94112982, 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:30.862 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:30.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.876143174000006, 2024-09-12T02:58:30.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:30.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:30.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.654039651000005, 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:30.874 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:30.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.65390266, 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:30.880 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:30.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.652785457999997, 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.886 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:30.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:30.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:30.892 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.652713344999995, 2024-09-12T02:58:30.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:30.893 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.893 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.893 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.893 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.893 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.893 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.893 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:30.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.894 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:30.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:30.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.652489360999994, 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.899 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.652419378000005, 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.906 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:30.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.911 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.652313741, 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.912 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:30.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:30.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:30.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:30.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.916 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:30.917 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.652123644, 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.918 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.652056857000005, 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:30.924 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:30.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:30.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:30.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.076707260000006, 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.931 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:30.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.978007825999995, 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:30.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:30.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.977922583999998, 2024-09-12T02:58:30.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:30.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:30.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:30.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.949 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.977785470000001, 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:30.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:30.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:30.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 80.977615571000001, 2024-09-12T02:58:30.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:30.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:30.959 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.960 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.960 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.960 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:30.960 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:30.960 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.832+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc31400ec80 con 0x7fc31400ca40 2024-09-12T02:58:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.860+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc31400d770 con 0x7fc31400ca40 2024-09-12T02:58:30.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.860+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc31400d770 con 0x7fc31400ca40 2024-09-12T02:58:30.962 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:30.962 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.860+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fc31400dce0 0x7fc314013020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.860+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fc314016040 con 0x7fc31400dce0 2024-09-12T02:58:30.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.860+0000 7fc33d600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fc31400dce0 0x7fc314013020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.864+0000 7fc33d600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fc31400dce0 0x7fc314013020 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.864+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc314016040 con 0x7fc31400dce0 2024-09-12T02:58:30.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.888+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc314013650 con 0x7fc31400dce0 2024-09-12T02:58:30.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.892+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc314013650 con 0x7fc31400dce0 2024-09-12T02:58:30.964 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:30.965 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:30.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.892+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fc314013d70 0x7fc3140141b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.892+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fc314019410 con 0x7fc314013d70 2024-09-12T02:58:30.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.892+0000 7fc33cc00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fc314013d70 0x7fc3140141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.892+0000 7fc33cc00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fc314013d70 0x7fc3140141b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.896+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc314019410 con 0x7fc314013d70 2024-09-12T02:58:30.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.924+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc314018290 con 0x7fc314013d70 2024-09-12T02:58:30.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.928+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc314018290 con 0x7fc314013d70 2024-09-12T02:58:30.966 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.928+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fc3140189b0 0x7fc314018df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.928+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fc31401c7e0 con 0x7fc3140189b0 2024-09-12T02:58:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.928+0000 7fc33e000640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fc3140189b0 0x7fc314018df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.928+0000 7fc33e000640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fc3140189b0 0x7fc314018df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.928+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc31401c7e0 con 0x7fc3140189b0 2024-09-12T02:58:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.956+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc3140146f0 con 0x7fc3140189b0 2024-09-12T02:58:30.968 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:30.956+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.960+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc3140146f0 con 0x7fc3140189b0 2024-09-12T02:58:30.968 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.960+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fc314014e40 0x7fc314015280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.960+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fc3140158d0 con 0x7fc314014e40 2024-09-12T02:58:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.960+0000 7fc33d600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fc314014e40 0x7fc314015280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:30.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.960+0000 7fc33d600640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fc314014e40 0x7fc314015280 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:30.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.964+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3140158d0 con 0x7fc314014e40 2024-09-12T02:58:30.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.988+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fc314015f90 con 0x7fc314014e40 2024-09-12T02:58:30.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.992+0000 7fc335600640 1 -- 172.21.15.63:0/3884473361 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc314015f90 con 0x7fc314014e40 2024-09-12T02:58:30.998 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fc314000fb0 msgr2=0x7fc3140045f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fc314000fb0 0x7fc3140045f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fc314001cc0 msgr2=0x7fc3140029a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fc314001cc0 0x7fc3140029a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fc314009c90 msgr2=0x7fc31400c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fc314009c90 0x7fc31400c080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fc31400ca40 msgr2=0x7fc31400ced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fc31400ca40 0x7fc31400ced0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:30.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fc31400dce0 msgr2=0x7fc314013020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:31.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fc31400dce0 0x7fc314013020 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fc314013d70 msgr2=0x7fc3140141b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:31.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fc314013d70 0x7fc3140141b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fc3140189b0 msgr2=0x7fc314018df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:31.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fc3140189b0 0x7fc314018df0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fc314014e40 msgr2=0x7fc314015280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:31.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fc314014e40 0x7fc314015280 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33e000640 1 -- 172.21.15.63:0/3884473361 reap_dead start 2024-09-12T02:58:31.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33e000640 1 -- 172.21.15.63:0/3884473361 reap_dead start 2024-09-12T02:58:31.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33e000640 1 -- 172.21.15.63:0/3884473361 reap_dead start 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33e000640 1 -- 172.21.15.63:0/3884473361 reap_dead start 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33e000640 1 -- 172.21.15.63:0/3884473361 reap_dead start 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc3180678c0 msgr2=0x7fc318069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc3180678c0 0x7fc318069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc338073230 tx=0x7fc324009190 comp rx=0 tx=0).stop 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 msgr2=0x7fc338156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 0x7fc338156cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0011f0 tx=0x7fc32c00c9b0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 shutdown_connections 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc3180678c0 0x7fc318069d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 --2- 172.21.15.63:0/3884473361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33806d2f0 0x7fc338156cb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 >> 172.21.15.63:0/3884473361 conn(0x7fc338070180 msgr2=0x7fc338163c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 shutdown_connections 2024-09-12T02:58:31.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:30.996+0000 7fc33ea00640 1 -- 172.21.15.63:0/3884473361 wait complete. 2024-09-12T02:58:31.062 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:31.058+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:31.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.096+0000 7f5968c00640 1 -- 172.21.15.63:0/3679234792 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v51) ==== 91+0+0 (secure 0 0 0) 0x7f5964010040 con 0x7f596c152850 2024-09-12T02:58:31.102 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-12T02:58:31.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.100+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f59480678f0 msgr2=0x7f5948069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:31.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.100+0000 7f5971c00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f59480678f0 0x7f5948069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f595c0b2000 tx=0x7f595c009040 comp rx=0 tx=0).stop 2024-09-12T02:58:31.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.100+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 msgr2=0x7f596c1f3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:31.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.100+0000 7f5971c00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 0x7f596c1f3af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5964009dd0 tx=0x7f596400c490 comp rx=0 tx=0).stop 2024-09-12T02:58:31.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.104+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 shutdown_connections 2024-09-12T02:58:31.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.104+0000 7f5971c00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f596c152850 0x7f596c1f3af0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.104+0000 7f5971c00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f59480678f0 0x7f5948069db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.104+0000 7f5971c00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f596c0c8990 0x7f596c157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.104+0000 7f5971c00640 1 --2- 172.21.15.63:0/3679234792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f596c0c8140 0x7f596c1572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:31.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.104+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 >> 172.21.15.63:0/3679234792 conn(0x7f596c067a00 msgr2=0x7f596c070590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:31.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.104+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 shutdown_connections 2024-09-12T02:58:31.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:31.104+0000 7f5971c00640 1 -- 172.21.15.63:0/3679234792 wait complete. 2024-09-12T02:58:31.164 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:31.158+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:31.213 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:31.213 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:31.236 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:31.265 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:31.258+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:31.366 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:31.360+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:31.466 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:31.462+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:31.478 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:31.478 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:31.503 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:31.599 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:31.596+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:31.667 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:31.662+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:31.768 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:31.762+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:31.790 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:31.790 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:31.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:31.914 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:31.912+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:31.970 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:31.968+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:32.071 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:32.068+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:32.104 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:32.104 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:32.129 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:32.171 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:32.166+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:32.273 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:32.268+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:32.374 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:32.370+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:32.415 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:32.415 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:32.438 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:32.475 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:32.470+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:32.575 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:32.570+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:32.676 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:32.674+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:32.727 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:32.727 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:32.751 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:32.777 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:32.770+0000 7f00d663c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 29573) UID: 0 2024-09-12T02:58:32.878 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:32.872+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:32.979 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:32.974+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:32.994 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:32.994 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:33.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:33.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:33.107 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:33.104+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:33.139 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T02:58:33.179 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:33.174+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:33.280 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:33.274+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:33.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb42200640 1 Processor -- start 2024-09-12T02:58:33.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb42200640 1 -- start start 2024-09-12T02:58:33.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb42200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c158e40 0x7fcb3c15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb42200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcb3c0c3170 0x7fcb3c1695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb42200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb3c15fbf0 con 0x7fcb3c159220 2024-09-12T02:58:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb42200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fcb3c070560 con 0x7fcb3c0c3170 2024-09-12T02:58:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb42200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fcb3c06edf0 con 0x7fcb3c158e40 2024-09-12T02:58:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb33e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcb3c159220 0x7fcb3c0ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:49346/0 (socket says 172.21.15.63:49346) 2024-09-12T02:58:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb33e00640 1 -- 172.21.15.63:0/3128296987 learned_addr learned my addr 172.21.15.63:0/3128296987 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.284+0000 7fcb3be00640 1 --2- 172.21.15.63:0/3128296987 >> v2:172.21.15.63:3300/0 conn(0x7fcb3c0c3170 0x7fcb3c1695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.288+0000 7fcb3be00640 1 -- 172.21.15.63:0/3128296987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c158e40 msgr2=0x7fcb3c15f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:33.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.288+0000 7fcb3b400640 1 --2- 172.21.15.63:0/3128296987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c158e40 0x7fcb3c15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.288+0000 7fcb3be00640 1 --2- 172.21.15.63:0/3128296987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c158e40 0x7fcb3c15f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.288+0000 7fcb3be00640 1 -- 172.21.15.63:0/3128296987 >> v1:172.21.15.63:6789/0 conn(0x7fcb3c159220 legacy=0x7fcb3c0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.288+0000 7fcb3be00640 1 -- 172.21.15.63:0/3128296987 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3c0c5310 con 0x7fcb3c0c3170 2024-09-12T02:58:33.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.288+0000 7fcb3b400640 1 --2- 172.21.15.63:0/3128296987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c158e40 0x7fcb3c15f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:58:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb3be00640 1 --2- 172.21.15.63:0/3128296987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c0c3170 0x7fcb3c1695a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009d90 tx=0x7fcb3401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23b59f624344b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb3aa00640 1 -- 172.21.15.63:0/3128296987 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb340b4070 con 0x7fcb3c0c3170 2024-09-12T02:58:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb3aa00640 1 -- 172.21.15.63:0/3128296987 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb340af600 con 0x7fcb3c0c3170 2024-09-12T02:58:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb3aa00640 1 -- 172.21.15.63:0/3128296987 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb340b4070 con 0x7fcb3c0c3170 2024-09-12T02:58:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb42200640 1 -- 172.21.15.63:0/3128296987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c0c3170 msgr2=0x7fcb3c1695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb42200640 1 --2- 172.21.15.63:0/3128296987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c0c3170 0x7fcb3c1695a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009d90 tx=0x7fcb3401f150 comp rx=0 tx=0).stop 2024-09-12T02:58:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb42200640 1 -- 172.21.15.63:0/3128296987 shutdown_connections 2024-09-12T02:58:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb42200640 1 --2- 172.21.15.63:0/3128296987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c0c3170 0x7fcb3c1695a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb42200640 1 --2- 172.21.15.63:0/3128296987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c158e40 0x7fcb3c15f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb42200640 1 -- 172.21.15.63:0/3128296987 >> 172.21.15.63:0/3128296987 conn(0x7fcb3c067a00 msgr2=0x7fcb3c067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:33.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb42200640 1 -- 172.21.15.63:0/3128296987 shutdown_connections 2024-09-12T02:58:33.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.292+0000 7fcb42200640 1 -- 172.21.15.63:0/3128296987 wait complete. 2024-09-12T02:58:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.296+0000 7fcb42200640 1 Processor -- start 2024-09-12T02:58:33.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.296+0000 7fcb42200640 1 -- start start 2024-09-12T02:58:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb42200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3c0c3170 0x7fcb3c0c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb42200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c158e40 0x7fcb3c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb42200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c0c9ec0 0x7fcb3c0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb42200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c15eeb0 con 0x7fcb3c158e40 2024-09-12T02:58:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb42200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3c070280 con 0x7fcb3c0c3170 2024-09-12T02:58:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb42200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fcb3c15f190 con 0x7fcb3c0c9ec0 2024-09-12T02:58:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c158e40 0x7fcb3c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c158e40 0x7fcb3c0cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43892/0 (socket says 172.21.15.63:43892) 2024-09-12T02:58:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33e00640 1 -- 172.21.15.63:0/1062251541 learned_addr learned my addr 172.21.15.63:0/1062251541 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3c0c3170 0x7fcb3c0c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.304 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:33.304 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb3be00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c0c9ec0 0x7fcb3c0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33e00640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c0c9ec0 msgr2=0x7fcb3c0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33e00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb3c0c9ec0 0x7fcb3c0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33e00640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3c0c3170 msgr2=0x7fcb3c0c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33e00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3c0c3170 0x7fcb3c0c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33e00640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3c0ca880 con 0x7fcb3c158e40 2024-09-12T02:58:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb3c0c3170 0x7fcb3c0c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33e00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c158e40 0x7fcb3c0cd330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400c3d0 tx=0x7fcb2400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24017070 con 0x7fcb3c158e40 2024-09-12T02:58:33.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb24005cf0 con 0x7fcb3c158e40 2024-09-12T02:58:33.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3c06f780 con 0x7fcb3c158e40 2024-09-12T02:58:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3c1f51b0 con 0x7fcb3c158e40 2024-09-12T02:58:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.300+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb240072d0 con 0x7fcb3c158e40 2024-09-12T02:58:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.304+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fcb14005280 con 0x7fcb3c158e40 2024-09-12T02:58:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.304+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcb2401a070 con 0x7fcb3c158e40 2024-09-12T02:58:33.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.308+0000 7fcb33400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb18067990 0x7fcb18069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.308+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6685+0+0 (secure 0 0 0) 0x7fcb24085a60 con 0x7fcb3c158e40 2024-09-12T02:58:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.308+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v51) ==== 54+0+16 (secure 0 0 0) 0x7fcb3c0ca880 con 0x7fcb3c158e40 2024-09-12T02:58:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.308+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb18067990 0x7fcb18069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.308+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fcb14000fb0 0x7fcb140045f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.308+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb14005560 con 0x7fcb14000fb0 2024-09-12T02:58:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.308+0000 7fcb3be00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fcb14000fb0 0x7fcb140045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.308+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb18067990 0x7fcb18069e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00af30 tx=0x7fcb2c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.308+0000 7fcb3be00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fcb14000fb0 0x7fcb140045f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.316+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb14005560 con 0x7fcb14000fb0 2024-09-12T02:58:33.332 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.344+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcb14004ef0 con 0x7fcb14000fb0 2024-09-12T02:58:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.348+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcb14004ef0 con 0x7fcb14000fb0 2024-09-12T02:58:33.352 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:33.353 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:33.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.348+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fcb14001cc0 0x7fcb140029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.348+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fcb140021a0 con 0x7fcb14001cc0 2024-09-12T02:58:33.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.348+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fcb14001cc0 0x7fcb140029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.352+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fcb14001cc0 0x7fcb140029a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.352+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb140021a0 con 0x7fcb14001cc0 2024-09-12T02:58:33.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.372+0000 7fa8c5a00640 1 Processor -- start 2024-09-12T02:58:33.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.372+0000 7fa8c5a00640 1 -- start start 2024-09-12T02:58:33.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8c5a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8c0072ad0 0x7fa8c0157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8c5a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8c006ccd0 0x7fa8c0072f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8c5a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c00c9fe0 con 0x7fa8c00c38d0 2024-09-12T02:58:33.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8c5a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c0068110 con 0x7fa8c006ccd0 2024-09-12T02:58:33.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8c5a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c006d120 con 0x7fa8c0072ad0 2024-09-12T02:58:33.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8bea00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8c0072ad0 0x7fa8c0157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8bea00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8c0072ad0 0x7fa8c0157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47864/0 (socket says 172.21.15.63:47864) 2024-09-12T02:58:33.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8bea00640 1 -- 172.21.15.63:0/239120610 learned_addr learned my addr 172.21.15.63:0/239120610 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:33.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8bea00640 1 -- 172.21.15.63:0/239120610 >> v2:172.21.15.63:3300/0 conn(0x7fa8c006ccd0 msgr2=0x7fa8c0072f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:33.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8bea00640 1 --2- 172.21.15.63:0/239120610 >> v2:172.21.15.63:3300/0 conn(0x7fa8c006ccd0 0x7fa8c0072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8bea00640 1 -- 172.21.15.63:0/239120610 >> v1:172.21.15.63:6789/0 conn(0x7fa8c00c38d0 legacy=0x7fa8c0067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:33.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.376+0000 7fa8bea00640 1 -- 172.21.15.63:0/239120610 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c006d360 con 0x7fa8c0072ad0 2024-09-12T02:58:33.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.380+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcb140031b0 con 0x7fcb14001cc0 2024-09-12T02:58:33.384 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:33.380+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:33.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.380+0000 7fa8bea00640 1 --2- 172.21.15.63:0/239120610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c0072ad0 0x7fa8c0157ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa8c006dd90 tx=0x7fa8b001c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c131580298500ee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8bd600640 1 -- 172.21.15.63:0/239120610 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00b1070 con 0x7fa8c0072ad0 2024-09-12T02:58:33.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8bd600640 1 -- 172.21.15.63:0/239120610 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b00ac630 con 0x7fa8c0072ad0 2024-09-12T02:58:33.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8bd600640 1 -- 172.21.15.63:0/239120610 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00a8050 con 0x7fa8c0072ad0 2024-09-12T02:58:33.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcb140031b0 con 0x7fcb14001cc0 2024-09-12T02:58:33.387 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:33.388 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:33.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fcb14003c30 0x7fcb1400bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fcb1400ec30 con 0x7fcb14003c30 2024-09-12T02:58:33.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8c5a00640 1 -- 172.21.15.63:0/239120610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c0072ad0 msgr2=0x7fa8c0157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8c5a00640 1 --2- 172.21.15.63:0/239120610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c0072ad0 0x7fa8c0157ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa8c006dd90 tx=0x7fa8b001c4e0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8c5a00640 1 -- 172.21.15.63:0/239120610 shutdown_connections 2024-09-12T02:58:33.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8c5a00640 1 --2- 172.21.15.63:0/239120610 >> v2:172.21.15.63:3300/0 conn(0x7fa8c006ccd0 0x7fa8c0072f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8c5a00640 1 --2- 172.21.15.63:0/239120610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c0072ad0 0x7fa8c0157ad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8c5a00640 1 -- 172.21.15.63:0/239120610 >> 172.21.15.63:0/239120610 conn(0x7fa8c00c93e0 msgr2=0x7fa8c00c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:33.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8c5a00640 1 -- 172.21.15.63:0/239120610 shutdown_connections 2024-09-12T02:58:33.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fa8c5a00640 1 -- 172.21.15.63:0/239120610 wait complete. 2024-09-12T02:58:33.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fcb33e00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fcb14003c30 0x7fcb1400bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.384+0000 7fcb33e00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fcb14003c30 0x7fcb1400bca0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb1400ec30 con 0x7fcb14003c30 2024-09-12T02:58:33.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8c5a00640 1 Processor -- start 2024-09-12T02:58:33.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8c5a00640 1 -- start start 2024-09-12T02:58:33.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8c5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c006ccd0 0x7fa8c0159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8c5a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c0072ad0 0x7fa8c014acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8c5a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8c00c38d0 0x7fa8c0150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8c5a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01515b0 con 0x7fa8c006ccd0 2024-09-12T02:58:33.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8c5a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c01572d0 con 0x7fa8c0072ad0 2024-09-12T02:58:33.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8c5a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c0164980 con 0x7fa8c00c38d0 2024-09-12T02:58:33.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8bea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c006ccd0 0x7fa8c0159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8bea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c006ccd0 0x7fa8c0159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43916/0 (socket says 172.21.15.63:43916) 2024-09-12T02:58:33.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8bea00640 1 -- 172.21.15.63:0/1732842283 learned_addr learned my addr 172.21.15.63:0/1732842283 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:33.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8bea00640 1 -- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8c00c38d0 msgr2=0x7fa8c0150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8bea00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8c00c38d0 0x7fa8c0150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8bea00640 1 -- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c0072ad0 msgr2=0x7fa8c014acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8bea00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c0072ad0 0x7fa8c014acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.388+0000 7fa8bea00640 1 -- 172.21.15.63:0/1732842283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c01ef9e0 con 0x7fa8c006ccd0 2024-09-12T02:58:33.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.392+0000 7fa8bea00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c006ccd0 0x7fa8c0159d00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa8b001a110 tx=0x7fa8b0019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.396+0000 7fa8b6a00640 1 -- 172.21.15.63:0/1732842283 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00b1050 con 0x7fa8c006ccd0 2024-09-12T02:58:33.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.396+0000 7fa8b6a00640 1 -- 172.21.15.63:0/1732842283 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b00bb070 con 0x7fa8c006ccd0 2024-09-12T02:58:33.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.396+0000 7fa8b6a00640 1 -- 172.21.15.63:0/1732842283 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00a8040 con 0x7fa8c006ccd0 2024-09-12T02:58:33.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.396+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c00cb0f0 con 0x7fa8c006ccd0 2024-09-12T02:58:33.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.396+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c01eff80 con 0x7fa8c006ccd0 2024-09-12T02:58:33.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.396+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8980052a0 con 0x7fa8c006ccd0 2024-09-12T02:58:33.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.400+0000 7fa8b6a00640 1 -- 172.21.15.63:0/1732842283 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa8b00aba40 con 0x7fa8c006ccd0 2024-09-12T02:58:33.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.400+0000 7fa8b6a00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a0067910 0x7fa8a0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.400+0000 7fa8b6a00640 1 -- 172.21.15.63:0/1732842283 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6685+0+0 (secure 0 0 0) 0x7fa8b011ff40 con 0x7fa8c006ccd0 2024-09-12T02:58:33.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.400+0000 7fa8be000640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a0067910 0x7fa8a0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.404+0000 7fa8be000640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a0067910 0x7fa8a0069dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0156e00 tx=0x7fa8ac006bb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.408+0000 7fa8b6a00640 1 -- 172.21.15.63:0/1732842283 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa8b00160d0 con 0x7fa8c006ccd0 2024-09-12T02:58:33.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.412+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcb1400c530 con 0x7fcb14003c30 2024-09-12T02:58:33.420 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:33.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.416+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcb1400c530 con 0x7fcb14003c30 2024-09-12T02:58:33.421 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:33.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.416+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcb1400c530 0x7fcb1400c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.416+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fcb1400cef0 con 0x7fcb1400c530 2024-09-12T02:58:33.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.416+0000 7fcb3be00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcb1400c530 0x7fcb1400c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.420+0000 7fcb3be00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcb1400c530 0x7fcb1400c9b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.420+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb1400cef0 con 0x7fcb1400c530 2024-09-12T02:58:33.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.448+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcb1400cf50 con 0x7fcb1400c530 2024-09-12T02:58:33.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.448+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcb1400cf50 con 0x7fcb1400c530 2024-09-12T02:58:33.454 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:33.454 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:33.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.448+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fcb1400d820 0x7fcb14012e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.452+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fcb14015bd0 con 0x7fcb1400d820 2024-09-12T02:58:33.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.452+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fcb1400d820 0x7fcb14012e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.452+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fcb1400d820 0x7fcb14012e00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.452+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb14015bd0 con 0x7fcb1400d820 2024-09-12T02:58:33.479 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:58:33.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:58:33.484 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:33.480+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:33.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.480+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcb14013590 con 0x7fcb1400d820 2024-09-12T02:58:33.494 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:33.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.488+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcb14013590 con 0x7fcb1400d820 2024-09-12T02:58:33.495 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:33.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.492+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fcb14013cb0 0x7fcb140140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.492+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 11: {"prefix": "get_command_descriptions"}) -- 0x7fcb14018fc0 con 0x7fcb14013cb0 2024-09-12T02:58:33.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.496+0000 7fcb33e00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fcb14013cb0 0x7fcb140140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.496+0000 7fcb33e00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fcb14013cb0 0x7fcb140140d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.496+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.5 v2:172.21.15.119:6824/4151470176 1 ==== command_reply(tid 11: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb14018fc0 con 0x7fcb14013cb0 2024-09-12T02:58:33.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.528+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] -- command(tid 12: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcb14018fc0 con 0x7fcb14013cb0 2024-09-12T02:58:33.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.528+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.5 v2:172.21.15.119:6824/4151470176 2 ==== command_reply(tid 12: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcb14018fc0 con 0x7fcb14013cb0 2024-09-12T02:58:33.533 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5: {} 2024-09-12T02:58:33.533 INFO:teuthology.orchestra.run.smithi063.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T02:58:33.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.528+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fcb14018330 0x7fcb140187b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.528+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "get_command_descriptions"}) -- 0x7fcb1401c360 con 0x7fcb14018330 2024-09-12T02:58:33.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.532+0000 7fcb3be00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fcb14018330 0x7fcb140187b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.532+0000 7fcb3be00640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fcb14018330 0x7fcb140187b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.532+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 13: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb1401c360 con 0x7fcb14018330 2024-09-12T02:58:33.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.560+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 14: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcb14014610 con 0x7fcb14018330 2024-09-12T02:58:33.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.564+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 14: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcb14014610 con 0x7fcb14018330 2024-09-12T02:58:33.569 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.564+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fcb14014b20 0x7fcb14014f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.564+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "get_command_descriptions"}) -- 0x7fcb140154c0 con 0x7fcb14014b20 2024-09-12T02:58:33.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.564+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fcb14014b20 0x7fcb14014f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:33.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.568+0000 7fcb3b400640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fcb14014b20 0x7fcb14014f80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:33.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.568+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 15: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb140154c0 con 0x7fcb14014b20 2024-09-12T02:58:33.581 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:33.576+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:33.585 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:33.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853008+0000", 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729855223000001, 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063063160000000002, 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853008+0000", 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853008+0000", 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853010+0000", 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.956e-06 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853018+0000", 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9750000000000007e-06 2024-09-12T02:58:33.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853037+0000", 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9100999999999999e-05 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853047+0000", 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0009e-05 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853197+0000", 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000150056 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853337+0000", 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140259 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853503+0000", 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000165422 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857417+0000", 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003914084 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859215+0000", 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001798673 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859274+0000", 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8284e-05 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859314+0000", 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0497000000000002e-05 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853093+0000", 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729770137000003, 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063596670000000003, 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.591 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853093+0000", 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853093+0000", 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853094+0000", 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3e-07 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853120+0000", 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6641000000000001e-05 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853134+0000", 2024-09-12T02:58:33.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3839000000000001e-05 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853142+0000", 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.841e-06 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853844+0000", 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00070157499999999996 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853923+0000", 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9788000000000002e-05 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854068+0000", 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014444800000000001 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857421+0000", 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003353609 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.595 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859354+0000", 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001933066 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859401+0000", 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6320999999999999e-05 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859453+0000", 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1808999999999998e-05 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.596 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853156+0000", 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729706836999995, 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080683319999999992, 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853156+0000", 2024-09-12T02:58:33.597 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853156+0000", 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853157+0000", 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4000000000000001e-07 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.598 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853162+0000", 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0309999999999998e-06 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853170+0000", 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1629999999999996e-06 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853177+0000", 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9779999999999999e-06 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.599 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854290+0000", 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011129930000000001 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854411+0000", 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120549 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854563+0000", 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015264900000000001 2024-09-12T02:58:33.600 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859494+0000", 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049306869999999996 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861133+0000", 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001639431 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861196+0000", 2024-09-12T02:58:33.601 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2359000000000004e-05 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861225+0000", 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8751999999999998e-05 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853189+0000", 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729673743000006, 2024-09-12T02:58:33.602 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010822211, 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853189+0000", 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853189+0000", 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.603 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853190+0000", 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6599999999999996e-07 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853193+0000", 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4199999999999999e-06 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.604 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853201+0000", 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3409999999999997e-06 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853206+0000", 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7100000000000004e-06 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854912+0000", 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001705334 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.605 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856238+0000", 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001326558 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856314+0000", 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5444000000000005e-05 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861799+0000", 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054855290000000003 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.606 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863906+0000", 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021071010000000001 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863965+0000", 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8349e-05 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864012+0000", 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6859e-05 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.607 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853215+0000", 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729648303000005, 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010898964000000001, 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.608 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853215+0000", 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853215+0000", 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853215+0000", 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3099999999999998e-07 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.609 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853218+0000", 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.836e-06 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853225+0000", 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3849999999999996e-06 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853231+0000", 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6350000000000003e-06 2024-09-12T02:58:33.610 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856576+0000", 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033451330000000001 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856698+0000", 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121867 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856787+0000", 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8918000000000005e-05 2024-09-12T02:58:33.611 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861840+0000", 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050528229999999997 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864024+0000", 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021840919999999999 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.612 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864072+0000", 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8204999999999997e-05 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864114+0000", 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1638999999999999e-05 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.613 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853238+0000", 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729624946000001, 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010981797999999999, 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853238+0000", 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.614 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853238+0000", 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853239+0000", 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1399999999999997e-07 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853242+0000", 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0410000000000002e-06 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.615 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853303+0000", 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1274999999999999e-05 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853311+0000", 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6899999999999992e-06 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857055+0000", 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003744079 2024-09-12T02:58:33.616 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5790000000000005e-05 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857258+0000", 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012758999999999999 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861872+0000", 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046140269999999997 2024-09-12T02:58:33.617 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864125+0000", 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022524289999999998 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864176+0000", 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1171000000000002e-05 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864220+0000", 2024-09-12T02:58:33.618 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4091999999999997e-05 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853324+0000", 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729539380999995, 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011005320000000001, 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.619 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853324+0000", 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853324+0000", 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853324+0000", 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-09-12T02:58:33.620 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853329+0000", 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1159999999999998e-06 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853338+0000", 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5920000000000001e-06 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853345+0000", 2024-09-12T02:58:33.621 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7070000000000003e-06 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857485+0000", 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041405849999999996 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857555+0000", 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9400000000000006e-05 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857638+0000", 2024-09-12T02:58:33.622 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3676000000000003e-05 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861898+0000", 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042591419999999996 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864232+0000", 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023346899999999999 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.623 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864285+0000", 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2994000000000001e-05 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864329+0000", 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3757999999999997e-05 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853354+0000", 2024-09-12T02:58:33.624 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729508670000001, 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011074278, 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853354+0000", 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853354+0000", 2024-09-12T02:58:33.625 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853355+0000", 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1799999999999995e-07 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853370+0000", 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5542000000000001e-05 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.626 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853379+0000", 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.405e-06 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853385+0000", 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8749999999999997e-06 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857859+0000", 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044746480000000003 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.627 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857903+0000", 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3655000000000001e-05 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857999+0000", 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6358000000000001e-05 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861915+0000", 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039161250000000003 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.628 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864337+0000", 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024215880000000001 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864388+0000", 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0624999999999997e-05 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864429+0000", 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0939000000000002e-05 2024-09-12T02:58:33.629 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853394+0000", 2024-09-12T02:58:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729468685000001, 2024-09-12T02:58:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056117909999999997, 2024-09-12T02:58:33.630 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853394+0000", 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853394+0000", 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.631 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853395+0000", 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5899999999999996e-07 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853398+0000", 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4020000000000002e-06 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853405+0000", 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9600000000000003e-06 2024-09-12T02:58:33.632 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853411+0000", 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5809999999999996e-06 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853577+0000", 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016634000000000001 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853740+0000", 2024-09-12T02:58:33.633 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016266300000000001 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853844+0000", 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103726 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855953+0000", 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021098810000000001 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.634 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858879+0000", 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029252570000000001 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858951+0000", 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1948999999999998e-05 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859006+0000", 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5473000000000002e-05 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.635 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853435+0000", 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.729427790000003, 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057211149999999997, 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853435+0000", 2024-09-12T02:58:33.636 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853435+0000", 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853436+0000", 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9500000000000002e-07 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.637 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853440+0000", 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7780000000000001e-06 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853448+0000", 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2330000000000006e-06 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853454+0000", 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3679999999999998e-06 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.638 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854198+0000", 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074401299999999997 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854270+0000", 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.203e-05 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854434+0000", 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016403000000000001 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.639 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855961+0000", 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001526419 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859063+0000", 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003102058 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859118+0000", 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5000999999999997e-05 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.640 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859156+0000", 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8590000000000002e-05 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:22 2.e e25/19 ondisk, result = 0)", 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858671+0000", 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.724191894000001, 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035054999999999998, 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.641 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858671+0000", 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858671+0000", 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.642 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858672+0000", 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1680000000000001e-06 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858678+0000", 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5690000000000004e-06 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858759+0000", 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0660000000000004e-05 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.643 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858769+0000", 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0052e-05 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858866+0000", 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7079999999999999e-05 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858873+0000", 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4569999999999999e-06 2024-09-12T02:58:33.644 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859022+0000", 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014856400000000001 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:23 2.e e25/19 ondisk, result = 0)", 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858823+0000", 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.724039558000001, 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000343789, 2024-09-12T02:58:33.645 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858823+0000", 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858823+0000", 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.646 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858835+0000", 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1319e-05 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858839+0000", 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2919999999999997e-06 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858872+0000", 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2499000000000002e-05 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.647 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858888+0000", 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6888000000000002e-05 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859051+0000", 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016227200000000001 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859058+0000", 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8379999999999996e-06 2024-09-12T02:58:33.648 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859167+0000", 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109681 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:6 2.10 e25/19 ondisk, result = 0)", 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859115+0000", 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.723747978999995, 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020621499999999999, 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859115+0000", 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859115+0000", 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.650 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859116+0000", 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.11e-06 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859121+0000", 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7360000000000001e-06 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859133+0000", 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2323999999999999e-05 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.651 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859141+0000", 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5909999999999998e-06 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859202+0000", 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1604000000000002e-05 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859210+0000", 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3370000000000002e-06 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.652 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859321+0000", 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000111513 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:7 2.10 e25/19 ondisk, result = 0)", 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859177+0000", 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.723686276999999, 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028307000000000001, 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.653 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859177+0000", 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859177+0000", 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.654 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859177+0000", 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4900000000000001e-07 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859204+0000", 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6341000000000001e-05 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859213+0000", 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4339999999999998e-06 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.655 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859219+0000", 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3400000000000003e-06 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859344+0000", 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000124315 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859350+0000", 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9649999999999996e-06 2024-09-12T02:58:33.656 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859460+0000", 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110226 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:8 2.10 e25/19 ondisk, result = 0)", 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859239+0000", 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.723624533000006, 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026201499999999999, 2024-09-12T02:58:33.657 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859239+0000", 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859239+0000", 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.658 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859239+0000", 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2300000000000002e-07 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859242+0000", 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.022e-06 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859250+0000", 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6939999999999995e-06 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.659 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859255+0000", 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1769999999999997e-06 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859482+0000", 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022756400000000001 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859489+0000", 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0129999999999996e-06 2024-09-12T02:58:33.660 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859501+0000", 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1222e-05 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:9 2.10 e25/19 ondisk, result = 0)", 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.861687+0000", 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.721176541999995, 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120401, 2024-09-12T02:58:33.661 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861687+0000", 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861687+0000", 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.662 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861687+0000", 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7100000000000011e-07 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861692+0000", 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7210000000000002e-06 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861714+0000", 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1484e-05 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.663 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861722+0000", 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4740000000000005e-06 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861786+0000", 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3831000000000006e-05 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861794+0000", 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6140000000000003e-06 2024-09-12T02:58:33.664 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861807+0000", 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3305999999999999e-05 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDPGPushReply(2.10 41/40 [PushReplyOp(2:0d82a743:::600.00000000:head)])", 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:04.922150+0000", 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.660712833000002, 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000204725, 2024-09-12T02:58:33.665 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.922150+0000", 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.922150+0000", 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.922151+0000", 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3600000000000003e-07 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.922155+0000", 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9820000000000002e-06 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.922166+0000", 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1268e-05 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.667 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.922174+0000", 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3490000000000003e-06 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.922223+0000", 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9193000000000001e-05 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.922355+0000", 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013219699999999999 2024-09-12T02:58:33.668 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDPGPushReply(2.10 41/40 [PushReplyOp(2:09401a81:::601.00000000:head)])", 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:04.924949+0000", 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.657913658999998, 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000212203, 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.669 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.924949+0000", 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.924949+0000", 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.924950+0000", 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7300000000000005e-07 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.670 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.924955+0000", 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8779999999999997e-06 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.924971+0000", 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5512999999999999e-05 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.924978+0000", 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5660000000000001e-06 2024-09-12T02:58:33.671 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.925047+0000", 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9154999999999998e-05 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.925162+0000", 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000114318 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.672 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDPGPushReply(2.10 41/40 [PushReplyOp(2:0bd6d154:::602.00000000:head)])", 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:04.927475+0000", 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.655388056, 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022701199999999999, 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927475+0000", 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.673 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927475+0000", 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927476+0000", 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0299999999999998e-07 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927479+0000", 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.518e-06 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.674 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927491+0000", 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2271e-05 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927502+0000", 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0488e-05 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927558+0000", 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5699000000000003e-05 2024-09-12T02:58:33.675 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927702+0000", 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014433299999999999 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDPGPushReply(2.10 41/40 [PushReplyOp(2:0d89b25e:::603.00000000:head)])", 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:04.930142+0000", 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.652721022000001, 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00018439800000000001, 2024-09-12T02:58:33.676 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.930142+0000", 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.930142+0000", 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.677 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.930142+0000", 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6899999999999999e-07 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.930145+0000", 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0469999999999998e-06 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.930153+0000", 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1380000000000007e-06 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.930159+0000", 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8799999999999996e-06 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.930208+0000", 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8594999999999998e-05 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.930326+0000", 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011846899999999999 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.679 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.680 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.680 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:33.680 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:33.680 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:33.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.596+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 16: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fcb140154c0 con 0x7fcb14014b20 2024-09-12T02:58:33.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb33400640 1 -- 172.21.15.63:0/1062251541 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 16: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fcb140154c0 con 0x7fcb14014b20 2024-09-12T02:58:33.681 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fcb14000fb0 msgr2=0x7fcb140045f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fcb14000fb0 0x7fcb140045f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fcb14001cc0 msgr2=0x7fcb140029a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fcb14001cc0 0x7fcb140029a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fcb14003c30 msgr2=0x7fcb1400bca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fcb14003c30 0x7fcb1400bca0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcb1400c530 msgr2=0x7fcb1400c9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcb1400c530 0x7fcb1400c9b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fcb1400d820 msgr2=0x7fcb14012e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fcb1400d820 0x7fcb14012e00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fcb14013cb0 msgr2=0x7fcb140140d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6824/4151470176,v1:172.21.15.119:6825/4151470176] conn(0x7fcb14013cb0 0x7fcb140140d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fcb14018330 msgr2=0x7fcb140187b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fcb14018330 0x7fcb140187b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fcb14014b20 msgr2=0x7fcb14014f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fcb14014b20 0x7fcb14014f80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb3be00640 1 -- 172.21.15.63:0/1062251541 reap_dead start 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb3be00640 1 -- 172.21.15.63:0/1062251541 reap_dead start 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb3be00640 1 -- 172.21.15.63:0/1062251541 reap_dead start 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb3be00640 1 -- 172.21.15.63:0/1062251541 reap_dead start 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb3be00640 1 -- 172.21.15.63:0/1062251541 reap_dead start 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb18067990 msgr2=0x7fcb18069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb18067990 0x7fcb18069e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c00af30 tx=0x7fcb2c008040 comp rx=0 tx=0).stop 2024-09-12T02:58:33.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c158e40 msgr2=0x7fcb3c0cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c158e40 0x7fcb3c0cd330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400c3d0 tx=0x7fcb2400c890 comp rx=0 tx=0).stop 2024-09-12T02:58:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 shutdown_connections 2024-09-12T02:58:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcb18067990 0x7fcb18069e50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 --2- 172.21.15.63:0/1062251541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb3c158e40 0x7fcb3c0cd330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.600+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 >> 172.21.15.63:0/1062251541 conn(0x7fcb3c067a00 msgr2=0x7fcb3c156ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.604+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 shutdown_connections 2024-09-12T02:58:33.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.604+0000 7fcb42200640 1 -- 172.21.15.63:0/1062251541 wait complete. 2024-09-12T02:58:33.685 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:33.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:33.640+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7fa898005590 con 0x7fa8c006ccd0 2024-09-12T02:58:33.727 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:33.724+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:33.789 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:33.784+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:33.889 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:33.884+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:33.970 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:33.970 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:33.971 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:33.971 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:33.990 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:33.988+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:33.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:34.018 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T02:58:34.018 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T02:58:34.018 INFO:tasks.thrashosds.thrasher:Killing osd 5, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T02:58:34.018 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T02:58:34.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:58:34.077 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T02:58:34.077 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.5 2024-09-12T02:58:34.077 INFO:tasks.thrashosds.thrasher:remote for osd 5 is ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T02:58:34.077 DEBUG:teuthology.orchestra.run.smithi119:> type ceph-objectstore-tool 2024-09-12T02:58:34.082 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T02:58:34.083 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op list-pgs 2024-09-12T02:58:34.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.116+0000 7fa8b6a00640 1 -- 172.21.15.63:0/1732842283 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v52) ==== 101+0+0 (secure 0 0 0) 0x7fa8b00f0720 con 0x7fa8c006ccd0 2024-09-12T02:58:34.120 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-12T02:58:34.133 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:34.130+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a0067910 msgr2=0x7fa8a0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a0067910 0x7fa8a0069dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0156e00 tx=0x7fa8ac006bb0 comp rx=0 tx=0).stop 2024-09-12T02:58:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c006ccd0 msgr2=0x7fa8c0159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c006ccd0 0x7fa8c0159d00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa8b001a110 tx=0x7fa8b0019280 comp rx=0 tx=0).stop 2024-09-12T02:58:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 shutdown_connections 2024-09-12T02:58:34.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa8a0067910 0x7fa8a0069dd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:34.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8c00c38d0 0x7fa8c0150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:34.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8c0072ad0 0x7fa8c014acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:34.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 --2- 172.21.15.63:0/1732842283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8c006ccd0 0x7fa8c0159d00 secure :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa8b001a110 tx=0x7fa8b0019280 comp rx=0 tx=0).stop 2024-09-12T02:58:34.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.128+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 >> 172.21.15.63:0/1732842283 conn(0x7fa8c00c93e0 msgr2=0x7fa8c00cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:34.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.132+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 shutdown_connections 2024-09-12T02:58:34.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:34.132+0000 7fa8c5a00640 1 -- 172.21.15.63:0/1732842283 wait complete. 2024-09-12T02:58:34.192 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:34.188+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:34.292 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:34.292 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:34.293 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:34.293 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:34.293 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:34.293 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:34.288+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:34.314 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:34.394 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:34.390+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:34.495 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:34.490+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.653946207999994, 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011663767, 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.508 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.509 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853092+0000", 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853098+0000", 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7509999999999997e-06 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853119+0000", 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.075e-05 2024-09-12T02:58:34.510 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853130+0000", 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1396000000000001e-05 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853240+0000", 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109484 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853398+0000", 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158574 2024-09-12T02:58:34.511 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864754+0000", 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011355568999999999 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.653870569999995, 2024-09-12T02:58:34.512 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065283390000000002, 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.513 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853171+0000", 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1860000000000002e-06 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.514 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853181+0000", 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0239e-05 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853188+0000", 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0389999999999999e-06 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853287+0000", 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9116000000000004e-05 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.515 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853406+0000", 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011876500000000001 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859694+0000", 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006288348 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:34.516 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.651599376999997, 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031174459999999998, 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.517 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855439+0000", 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-06 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855447+0000", 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1899999999999995e-06 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855460+0000", 2024-09-12T02:58:34.518 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3521e-05 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855469+0000", 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2709999999999992e-06 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855540+0000", 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1112000000000006e-05 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855574+0000", 2024-09-12T02:58:34.519 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4823999999999997e-05 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858501+0000", 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002926695 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858554+0000", 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3270999999999999e-05 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.520 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.651539017000005, 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030877769999999999, 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.521 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855498+0000", 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6199999999999998e-07 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855504+0000", 2024-09-12T02:58:34.522 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7209999999999999e-06 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855512+0000", 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2500000000000006e-06 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855517+0000", 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4079999999999997e-06 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855770+0000", 2024-09-12T02:58:34.523 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025252599999999999 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855787+0000", 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7486000000000002e-05 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858557+0000", 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027699449999999998 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.524 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858585+0000", 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7979000000000001e-05 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.648791528999993, 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034578339999999999, 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.525 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.526 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858246+0000", 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7199999999999997e-07 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858287+0000", 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106000000000003e-05 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858304+0000", 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7221e-05 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858314+0000", 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3819999999999993e-06 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858531+0000", 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000217538 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858546+0000", 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4518000000000001e-05 2024-09-12T02:58:34.528 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861647+0000", 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031017060000000001 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861703+0000", 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5390999999999999e-05 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.529 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.648672774000005, 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006126589, 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.530 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858380+0000", 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5491000000000001e-05 2024-09-12T02:58:34.531 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858397+0000", 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7720999999999999e-05 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858404+0000", 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.669e-06 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858743+0000", 2024-09-12T02:58:34.532 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033907799999999998 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858760+0000", 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864447+0000", 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005686895 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.533 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864490+0000", 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3658000000000001e-05 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.648620926999996, 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061037929999999997, 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.534 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858416+0000", 2024-09-12T02:58:34.535 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2300000000000002e-07 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858421+0000", 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5319999999999997e-06 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858429+0000", 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8790000000000003e-06 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.536 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1599999999999997e-06 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858911+0000", 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047701999999999998 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858930+0000", 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8189000000000002e-05 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.537 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864493+0000", 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055629099999999999 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864519+0000", 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6679999999999999e-05 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.538 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.647718401000006, 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052338280000000003, 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.539 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859319+0000", 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3099999999999997e-07 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859326+0000", 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0520000000000004e-06 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.540 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859345+0000", 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9466e-05 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859353+0000", 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2009999999999999e-06 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859518+0000", 2024-09-12T02:58:34.541 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000164582 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859536+0000", 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8088999999999999e-05 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864521+0000", 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049850390000000001 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864552+0000", 2024-09-12T02:58:34.542 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0667999999999998e-05 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.647605338000005, 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026944499999999999, 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.543 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859432+0000", 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.068e-06 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859437+0000", 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3569999999999997e-06 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859457+0000", 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9462000000000001e-05 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859465+0000", 2024-09-12T02:58:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3990000000000004e-06 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859578+0000", 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112446 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859700+0000", 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012271299999999999 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.546 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.646431996000004, 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039558550000000003, 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.547 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860605+0000", 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3200000000000004e-07 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860613+0000", 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.644e-06 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.548 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860632+0000", 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9173000000000001e-05 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860661+0000", 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8589e-05 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860740+0000", 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9216999999999997e-05 2024-09-12T02:58:34.549 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864560+0000", 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038205000000000001 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.642423651000001, 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014506999999999999, 2024-09-12T02:58:34.550 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.551 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864614+0000", 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8599999999999997e-07 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864617+0000", 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864630+0000", 2024-09-12T02:58:34.552 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2659e-05 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864636+0000", 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7930000000000003e-06 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864684+0000", 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7926000000000002e-05 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.553 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864758+0000", 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4222999999999997e-05 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 84.640263168999994, 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075281000000000002, 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.555 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866774+0000", 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866779+0000", 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1499999999999998e-06 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866791+0000", 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.238e-05 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866799+0000", 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2559999999999996e-06 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866850+0000", 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1063999999999998e-05 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866862+0000", 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1891e-05 2024-09-12T02:58:34.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867492+0000", 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00062994899999999998 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867526+0000", 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4372999999999998e-05 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 73.892365865000002, 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001141305, 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614672+0000", 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4619999999999999e-06 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614684+0000", 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.204e-05 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614703+0000", 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9415e-05 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614713+0000", 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4720000000000001e-06 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614774+0000", 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1449000000000001e-05 2024-09-12T02:58:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614790+0000", 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6112000000000001e-05 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615776+0000", 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098508800000000007 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615812+0000", 2024-09-12T02:58:34.562 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6266999999999997e-05 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 72.136076793000001, 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001160754, 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370962+0000", 2024-09-12T02:58:34.564 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2529999999999999e-06 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371051+0000", 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9019999999999998e-05 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371086+0000", 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5153e-05 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.565 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371103+0000", 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7113999999999999e-05 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371265+0000", 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162063 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371314+0000", 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9110000000000002e-05 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.566 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372077+0000", 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000762566 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372120+0000", 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3475e-05 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-12T02:58:34.567 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 71.254262925999996, 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010780609999999999, 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.568 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252775+0000", 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252785+0000", 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9650000000000003e-06 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252802+0000", 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7550999999999998e-05 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252813+0000", 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0169e-05 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252883+0000", 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0660000000000004e-05 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252910+0000", 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6889999999999998e-05 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253800+0000", 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00088991299999999999 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253852+0000", 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1530000000000003e-05 2024-09-12T02:58:34.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 49.570099085999999, 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001011966, 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.572 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936939+0000", 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.573 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936949+0000", 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0395e-05 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936966+0000", 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7173e-05 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.574 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936977+0000", 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0557000000000001e-05 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937037+0000", 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9672000000000001e-05 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937056+0000", 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9338999999999999e-05 2024-09-12T02:58:34.575 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937870+0000", 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081393600000000002 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937949+0000", 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9418000000000004e-05 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.576 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 49.569126656000002, 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000793828, 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.577 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9100000000000003e-07 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937916+0000", 2024-09-12T02:58:34.578 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7309999999999998e-06 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937925+0000", 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4460000000000001e-06 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937934+0000", 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3039999999999994e-06 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.579 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937973+0000", 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9493999999999998e-05 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937984+0000", 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938672+0000", 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00068768500000000005 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.580 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938704+0000", 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1664e-05 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:45 2.14 e27/19 2:2e2fa760:::200.00000001:head v 27'12, mlcod=26'10)", 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 46.877269667999997, 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00181248, 2024-09-12T02:58:34.581 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.582 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.91e-07 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629819+0000", 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1918e-05 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629833+0000", 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3767999999999999e-05 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.583 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629844+0000", 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1326e-05 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629933+0000", 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9419999999999994e-05 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629962+0000", 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8314999999999999e-05 2024-09-12T02:58:34.584 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631512+0000", 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015498 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631579+0000", 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7642000000000001e-05 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.585 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:47 2.14 e47/19 2:2e2fa760:::200.00000001:head v 47'13, mlcod=26'11)", 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.197734562000001, 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001880287, 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.586 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309303+0000", 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.544e-06 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309325+0000", 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2031e-05 2024-09-12T02:58:34.587 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309346+0000", 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1049000000000001e-05 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309359+0000", 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2988e-05 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309439+0000", 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9721999999999993e-05 2024-09-12T02:58:34.588 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309465+0000", 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5884000000000002e-05 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311130+0000", 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001664837 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.589 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311182+0000", 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2231999999999997e-05 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:48 2.14 e47/19 2:292cf221:::200.00000000:head v 47'14, mlcod=26'11)", 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 14.196600759000001, 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001320122, 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:34.590 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:34.591 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5300000000000003e-07 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310443+0000", 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7739999999999999e-06 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310453+0000", 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8970000000000003e-06 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:34.592 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310460+0000", 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8460000000000002e-06 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310554+0000", 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4036999999999994e-05 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310577+0000", 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3462999999999999e-05 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.593 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311709+0000", 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011311400000000001 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311756+0000", 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7111999999999999e-05 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:34.594 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:34.596 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:34.596 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:34.592+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:34.697 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:34.694+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:34.722 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:34.722 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:34.722 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:34.736 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:34.798 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:34.792+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:34.898 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:34.896+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:34.906 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:34.907 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:34.907 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:34.907 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:34.907 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:34.927 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:34.999 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:34.996+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:35.047 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:35.047 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.193504852000004, 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.048 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:35.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.188744073999999, 2024-09-12T02:58:35.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:58:35.056 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.056 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.056 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.056 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:35.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.188606211999996, 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.060 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.064 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.188520095000001, 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:58:35.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.187796262999996, 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:58:35.068 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:58:35.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:58:35.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.187637396, 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.073 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:58:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:58:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:58:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:58:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:58:35.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.187183778000005, 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:58:35.078 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:58:35.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:58:35.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:58:35.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:58:35.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.183949784000006, 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:58:35.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:58:35.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPush(2.6 41/40 [PushOp(2:654134d2:::mds0_openfiles.0:head, version: 28'2, data_included: [], data_size: 0, omap_header_size: 42, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:654134d2:::mds0_openfiles.0:head@28'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 30.138566954000002, 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00050712800000000003, 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.087 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906694+0000", 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1620000000000001e-06 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906711+0000", 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6974e-05 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906734+0000", 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3862999999999998e-05 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906757+0000", 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2765e-05 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906918+0000", 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000160326 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906935+0000", 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7215e-05 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.907200+0000", 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026482300000000002 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.092 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.093 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:35.094 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:35.100 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:35.096+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:35.201 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:35.196+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:35.224 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:35.224 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:35.224 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:35.238 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:35.302 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:35.296+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:35.360 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:35.360 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:35.361 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:35.361 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:35.361 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:35.378 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:35.403 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:35.400+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:35.496 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:35.516 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.640395005000002, 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.517 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:35.522 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.640261796999994, 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:35.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:35.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:35.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:35.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:35.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:35.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:35.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.640157047000002, 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.530 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:35.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:35.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:35.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:35.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:35.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:35.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:35.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:35.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:35.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.537 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:35.537 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:35.537 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.640011228999995, 2024-09-12T02:58:35.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:35.537 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.537 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.537 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.537 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:35.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:35.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:35.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:35.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:35.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:35.544 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.545 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.545 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.545 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:35.545 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.639938047000001, 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:35.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.549 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:35.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:35.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:35.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:35.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:35.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:35.552 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.552 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.552 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.552 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:35.552 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:35.552 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.639878061000005, 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:35.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:35.558 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.639815714999997, 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.560 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:35.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.560 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.560 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:35.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:35.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:35.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:35.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:35.563 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.563 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.563 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.564 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.564 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:35.564 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:35.564 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.639758198999999, 2024-09-12T02:58:35.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:35.565 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.565 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.565 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:35.565 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:35.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:35.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.637590574000001, 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.569 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:35.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:35.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:35.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.634432059000005, 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:35.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.576 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:35.577 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.578 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 85.626723186000007, 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.579 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:35.580 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:35.581 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:35.582 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.583 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 76.607834234999999, 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.584 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:35.585 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.586 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.587 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:35.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:35.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.588 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.588 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:35.588 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:35.588 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.588 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.589 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 74.879432429000005, 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:35.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:35.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 73.123595847000004, 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.595 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.596 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:35.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:35.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:35.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:35.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 72.241506883, 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.601 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:35.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:35.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:35.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.607 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:35.608 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:35.608 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.557549270000003, 2024-09-12T02:58:35.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:35.608 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.608 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.608 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.608 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:35.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:35.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 50.557443978999999, 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:35.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:35.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:35.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 47.864880829000001, 2024-09-12T02:58:35.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:35.620 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.620 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.620 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.620 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:35.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:35.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:35.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:35.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:35.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:35.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:35.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:35.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:35.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:35.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:35.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:35.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:35.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:35.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:35.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:35.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5447~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 15.185522282999999, 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003274795, 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.632 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307146+0000", 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.123e-06 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307162+0000", 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5729000000000001e-05 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307197+0000", 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5179999999999999e-05 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307214+0000", 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7295999999999998e-05 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307371+0000", 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000156293 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307532+0000", 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016189399999999999 2024-09-12T02:58:35.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307741+0000", 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208493 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.309426+0000", 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016850299999999999 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310212+0000", 2024-09-12T02:58:35.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000786494 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310299+0000", 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6178000000000001e-05 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310418+0000", 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000119085 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.637 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 15.185409106, 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037307600000000001, 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307257+0000", 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2699999999999999e-06 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307266+0000", 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2160000000000006e-06 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307286+0000", 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0537e-05 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307299+0000", 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3297e-05 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308569+0000", 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001269121 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308706+0000", 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013719099999999999 2024-09-12T02:58:35.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308921+0000", 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021543199999999999 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310051+0000", 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001129901 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310836+0000", 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00078529800000000003 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310922+0000", 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5488000000000005e-05 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310987+0000", 2024-09-12T02:58:35.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5009e-05 2024-09-12T02:58:35.644 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.644 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.644 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.644 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:35.644 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:35.644 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:35.645 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:35.646 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:35.642+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:35.686 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:35.729 INFO:teuthology.orchestra.run.smithi119.stdout:4.es3 2024-09-12T02:58:35.729 INFO:teuthology.orchestra.run.smithi119.stdout:4.4s0 2024-09-12T02:58:35.729 INFO:teuthology.orchestra.run.smithi119.stdout:4.2s1 2024-09-12T02:58:35.729 INFO:teuthology.orchestra.run.smithi119.stdout:4.1s1 2024-09-12T02:58:35.729 INFO:teuthology.orchestra.run.smithi119.stdout:4.1as3 2024-09-12T02:58:35.729 INFO:teuthology.orchestra.run.smithi119.stdout:4.15s0 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:4.13s1 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:4.7s1 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:4.12s3 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:4.3s1 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:4.11s3 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:3.c 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:3.4 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:3.d 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:3.3c 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:3.5 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:3.3a 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:3.38 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:3.37 2024-09-12T02:58:35.730 INFO:teuthology.orchestra.run.smithi119.stdout:3.35 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.31 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.30 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.2f 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.2 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.28 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.22 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.21 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.1d 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:4.1fs1 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.1c 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.16 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:2.c 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:3.1f 2024-09-12T02:58:35.731 INFO:teuthology.orchestra.run.smithi119.stdout:2.3 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:4.1cs3 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:2.2 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:4.8s0 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:4.10s1 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:2.1c 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:3.2a 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:2.18 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:3.17 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:2.17 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:4.bs3 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:2.16 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:2.15 2024-09-12T02:58:35.732 INFO:teuthology.orchestra.run.smithi119.stdout:2.12 2024-09-12T02:58:35.746 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:35.740+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:35.812 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:35.812 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:35.812 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:35.812 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:35.828 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:35.847 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:35.844+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:35.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.912+0000 7f930ce00640 1 Processor -- start 2024-09-12T02:58:35.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.912+0000 7f930ce00640 1 -- start start 2024-09-12T02:58:35.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.912+0000 7f930ce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9308152850 0x7f9308158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:35.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.912+0000 7f930ce00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93080c8140 0x7f9308070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:35.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.912+0000 7f930ce00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9308070060 con 0x7f93080c8990 2024-09-12T02:58:35.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.912+0000 7f930ce00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f93080c5140 con 0x7f9308152850 2024-09-12T02:58:35.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.912+0000 7f930ce00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f93080c3190 con 0x7f93080c8140 2024-09-12T02:58:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.912+0000 7f9306a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93080c8140 0x7f9308070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.916+0000 7f9306a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93080c8140 0x7f9308070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:52738/0 (socket says 172.21.15.63:52738) 2024-09-12T02:58:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.916+0000 7f9306a00640 1 -- 172.21.15.63:0/3269653645 learned_addr learned my addr 172.21.15.63:0/3269653645 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.916+0000 7f9307400640 1 --2- 172.21.15.63:0/3269653645 >> v2:172.21.15.63:3300/0 conn(0x7f9308152850 0x7f9308158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.916+0000 7f9306a00640 1 -- 172.21.15.63:0/3269653645 >> v2:172.21.15.63:3300/0 conn(0x7f9308152850 msgr2=0x7f9308158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.916+0000 7f9306a00640 1 --2- 172.21.15.63:0/3269653645 >> v2:172.21.15.63:3300/0 conn(0x7f9308152850 0x7f9308158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.916+0000 7f9306a00640 1 -- 172.21.15.63:0/3269653645 >> v1:172.21.15.63:6789/0 conn(0x7f93080c8990 legacy=0x7f93080ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:35.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.916+0000 7f9306a00640 1 -- 172.21.15.63:0/3269653645 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93080c3470 con 0x7f93080c8140 2024-09-12T02:58:35.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f9306a00640 1 --2- 172.21.15.63:0/3269653645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93080c8140 0x7f9308070740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009870 tx=0x7f92f401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25314640f75d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:35.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f9306000640 1 -- 172.21.15.63:0/3269653645 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f40b5070 con 0x7f93080c8140 2024-09-12T02:58:35.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f9306000640 1 -- 172.21.15.63:0/3269653645 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f40a8a50 con 0x7f93080c8140 2024-09-12T02:58:35.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f9306000640 1 -- 172.21.15.63:0/3269653645 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f40a8e20 con 0x7f93080c8140 2024-09-12T02:58:35.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f930ce00640 1 -- 172.21.15.63:0/3269653645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93080c8140 msgr2=0x7f9308070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:35.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f930ce00640 1 --2- 172.21.15.63:0/3269653645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93080c8140 0x7f9308070740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009870 tx=0x7f92f401ed50 comp rx=0 tx=0).stop 2024-09-12T02:58:35.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f930ce00640 1 -- 172.21.15.63:0/3269653645 shutdown_connections 2024-09-12T02:58:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f930ce00640 1 --2- 172.21.15.63:0/3269653645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93080c8140 0x7f9308070740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f930ce00640 1 --2- 172.21.15.63:0/3269653645 >> v2:172.21.15.63:3300/0 conn(0x7f9308152850 0x7f9308158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f930ce00640 1 -- 172.21.15.63:0/3269653645 >> 172.21.15.63:0/3269653645 conn(0x7f9308067a00 msgr2=0x7f9308067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f930ce00640 1 -- 172.21.15.63:0/3269653645 shutdown_connections 2024-09-12T02:58:35.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.920+0000 7f930ce00640 1 -- 172.21.15.63:0/3269653645 wait complete. 2024-09-12T02:58:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.924+0000 7f930ce00640 1 Processor -- start 2024-09-12T02:58:35.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.924+0000 7f930ce00640 1 -- start start 2024-09-12T02:58:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.924+0000 7f930ce00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93080c8140 0x7f93081e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.924+0000 7f930ce00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93080c8990 0x7f930806e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.924+0000 7f930ce00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9308152850 0x7f93081e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.924+0000 7f930ce00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f93080ce750 con 0x7f93080c8140 2024-09-12T02:58:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.924+0000 7f930ce00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f93080c4b60 con 0x7f93080c8990 2024-09-12T02:58:35.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.924+0000 7f930ce00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f93080ce8d0 con 0x7f9308152850 2024-09-12T02:58:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9308152850 0x7f93081e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9308152850 0x7f93081e2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:52750/0 (socket says 172.21.15.63:52750) 2024-09-12T02:58:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307e00640 1 -- 172.21.15.63:0/1828683723 learned_addr learned my addr 172.21.15.63:0/1828683723 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307400640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93080c8140 0x7f93081e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:35.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9306a00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93080c8990 0x7f930806e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307400640 1 -- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9308152850 msgr2=0x7f93081e2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307400640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9308152850 0x7f93081e2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307400640 1 -- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93080c8990 msgr2=0x7f930806e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307400640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93080c8990 0x7f930806e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307400640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93081f8c60 con 0x7f93080c8140 2024-09-12T02:58:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307e00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9308152850 0x7f93081e2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:35.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f9307400640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93080c8140 0x7f93081e42d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f92f800d600 tx=0x7f92f800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f80125f0 con 0x7f93080c8140 2024-09-12T02:58:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f8019070 con 0x7f93080c8140 2024-09-12T02:58:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f80129b0 con 0x7f93080c8140 2024-09-12T02:58:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9308157d50 con 0x7f93080c8140 2024-09-12T02:58:35.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93081f88f0 con 0x7f93080c8140 2024-09-12T02:58:35.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.928+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f9308069870 con 0x7f93080c8140 2024-09-12T02:58:35.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.932+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92f8012b50 con 0x7f93080c8140 2024-09-12T02:58:35.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.932+0000 7f92ff400640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f92e8067940 0x7f92e8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:35.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.936+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6685+0+0 (secure 0 0 0) 0x7f92f8086c40 con 0x7f93080c8140 2024-09-12T02:58:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.936+0000 7f9306a00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f92e8067940 0x7f92e8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.936+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v53) ==== 54+0+16 (secure 0 0 0) 0x7f92f80870c0 con 0x7f93080c8140 2024-09-12T02:58:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.936+0000 7f930ce00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f930814b8a0 0x7f9308156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.936+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93081f8700 con 0x7f930814b8a0 2024-09-12T02:58:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.936+0000 7f9307e00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f930814b8a0 0x7f9308156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:35.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.936+0000 7f9306a00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f92e8067940 0x7f92e8069e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f92f40b2000 tx=0x7f92f40aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:35.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.936+0000 7f9307e00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f930814b8a0 0x7f9308156050 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:35.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.936+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93081f8700 con 0x7f930814b8a0 2024-09-12T02:58:35.947 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:35.944+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:35.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.968+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9308074da0 con 0x7f930814b8a0 2024-09-12T02:58:35.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.968+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9308074da0 con 0x7f930814b8a0 2024-09-12T02:58:35.973 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.968+0000 7f930ce00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f9308156aa0 0x7f930814a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.968+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f93080ce380 con 0x7f9308156aa0 2024-09-12T02:58:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.968+0000 7f9307400640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f9308156aa0 0x7f930814a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:35.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.972+0000 7f9307400640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f9308156aa0 0x7f930814a560 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:35.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:35.972+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93080ce380 con 0x7f9308156aa0 2024-09-12T02:58:35.997 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:35.997 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:35.997 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:35.997 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:35.998 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:36.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.000+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f93081e1840 con 0x7f9308156aa0 2024-09-12T02:58:36.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.000+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f93081e1840 con 0x7f9308156aa0 2024-09-12T02:58:36.006 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.004+0000 7f930ce00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f93080626e0 0x7f9308062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.004+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f930814b200 con 0x7f93080626e0 2024-09-12T02:58:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.004+0000 7f9306a00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f93080626e0 0x7f9308062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.004+0000 7f9306a00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f93080626e0 0x7f9308062b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:36.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.004+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f930814b200 con 0x7f93080626e0 2024-09-12T02:58:36.011 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:36.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.032+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f9308063310 con 0x7f93080626e0 2024-09-12T02:58:36.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.036+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9308063310 con 0x7f93080626e0 2024-09-12T02:58:36.038 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.036+0000 7f930ce00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f930802cb60 0x7f930802cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.036+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f93080ca580 con 0x7f930802cb60 2024-09-12T02:58:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.036+0000 7f9307e00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f930802cb60 0x7f930802cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.036+0000 7f9307e00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f930802cb60 0x7f930802cf60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:36.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.036+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93080ca580 con 0x7f930802cb60 2024-09-12T02:58:36.057 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:36.054+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:36.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.064+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f930802d770 con 0x7f930802cb60 2024-09-12T02:58:36.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.064+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f930802d770 con 0x7f930802cb60 2024-09-12T02:58:36.070 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:36.071 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:36.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.068+0000 7f930ce00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f93080c9380 0x7f93080c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.068+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f930802d6f0 con 0x7f93080c9380 2024-09-12T02:58:36.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.068+0000 7f9307400640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f93080c9380 0x7f93080c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.068+0000 7f9307400640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f93080c9380 0x7f93080c97c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:36.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.068+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f930802d6f0 con 0x7f93080c9380 2024-09-12T02:58:36.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.096+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f930802d6f0 con 0x7f93080c9380 2024-09-12T02:58:36.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.100+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f930802d6f0 con 0x7f93080c9380 2024-09-12T02:58:36.103 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.100+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=54}) -- 0x7f93080c9d00 con 0x7f93080c8140 2024-09-12T02:58:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.100+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f930802da20 con 0x7f93080c8140 2024-09-12T02:58:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.100+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f92f8012ec0 con 0x7f93080c8140 2024-09-12T02:58:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T02:58:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.100+0000 7f930ce00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f93082097e0 0x7f930820bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.100+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f93080ca4a0 con 0x7f93082097e0 2024-09-12T02:58:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.100+0000 7f9306a00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f93082097e0 0x7f930820bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.100+0000 7f9306a00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f93082097e0 0x7f930820bbd0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.104+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93080ca4a0 con 0x7f93082097e0 2024-09-12T02:58:36.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.128+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f93080ca4a0 con 0x7f93082097e0 2024-09-12T02:58:36.136 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:36.137 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:36.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:36.137 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:36.137 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.137 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.137 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:36.137 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.388543254, 2024-09-12T02:58:36.137 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.138 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:36.139 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:36.140 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.141 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:36.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:36.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:36.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.142 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.142 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:36.142 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:36.142 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.142 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.143 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:36.144 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.145 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.245347916, 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:36.146 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.147 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.148 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.149 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.150 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:36.151 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.152 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.24532739, 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.153 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.154 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.155 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:36.156 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.157 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.158 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:36.159 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.24521657699999, 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.160 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.161 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.162 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:36.163 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.164 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:36.165 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.166 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.245195051, 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.167 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.168 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.169 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.170 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:36.171 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.172 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:36.172 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:36.172 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.172 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.172 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.173 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.174 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.180208405, 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.175 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.176 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.177 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.178 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:36.179 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.180 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.181 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.958104882000001, 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.182 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.183 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.184 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:36.185 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.186 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.187 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:36.188 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.957967890999996, 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.189 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.190 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.191 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.192 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:36.193 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.194 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:36.195 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.956850689000007, 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.196 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.197 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.198 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:36.199 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.200 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.201 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:36.202 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.956778576000005, 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.203 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.204 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.205 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:36.206 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.208 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.209 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.956554592000003, 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:36.210 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:36.211 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.212 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.213 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:36.214 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.215 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.216 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:36.217 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:36.217 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.217 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.217 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.217 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.217 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.217 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.217 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:36.217 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.956484609, 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.218 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:36.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.219 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:36.219 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.219 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.219 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.219 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:36.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:36.220 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.220 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.220 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.220 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:36.220 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:36.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:36.221 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:36.221 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.221 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.221 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.221 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:36.222 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:36.223 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:36.224 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:36.224 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.224 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.224 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.224 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.225 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.956378971999996, 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.226 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:36.227 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.228 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.229 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.230 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.231 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.956188874999995, 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.232 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.233 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.234 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:36.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:36.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.236 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:36.236 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:36.236 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.236 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.236 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.237 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:36.238 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.956122088000001, 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.239 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:36.240 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.241 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:36.242 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.243 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.244 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.380772491000002, 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:36.245 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.246 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:36.247 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.248 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.249 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:36.250 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 86.282073057000005, 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:36.251 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.252 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.253 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.254 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.255 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:36.256 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 86.281987814999994, 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.257 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:36.258 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.259 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.260 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:36.261 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.262 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 86.281850700999996, 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.263 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:36.264 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.265 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.266 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:36.267 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 86.281680801999997, 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:36.268 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:36.269 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:36.270 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:36.271 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:36.272 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:36.273 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T02:58:36.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.136+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f93080ca4a0 con 0x7f93082097e0 2024-09-12T02:58:36.274 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:36.275 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:36.276 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:36.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.136+0000 7f930ce00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f930820c620 0x7f930820ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.136+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f93082117e0 con 0x7f930820c620 2024-09-12T02:58:36.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.136+0000 7f9307e00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f930820c620 0x7f930820ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.136+0000 7f9307e00640 1 --2- 172.21.15.63:0/1828683723 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f930820c620 0x7f930820ea10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:36.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.136+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93082117e0 con 0x7f930820c620 2024-09-12T02:58:36.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.164+0000 7f930ce00640 1 -- 172.21.15.63:0/1828683723 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f930820ef50 con 0x7f930820c620 2024-09-12T02:58:36.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.168+0000 7f92ff400640 1 -- 172.21.15.63:0/1828683723 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f930820ef50 con 0x7f930820c620 2024-09-12T02:58:36.277 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:36.277 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T02:58:36.277 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:36.278 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T02:58:36.278 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:36.268+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:36.292 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op export --pgid 3.4 --file /var/log/ceph/exp.3.4.5 2024-09-12T02:58:36.377 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:36.374+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:36.476 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:36.474+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:36.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdbe00640 1 Processor -- start 2024-09-12T02:58:36.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdbe00640 1 -- start start 2024-09-12T02:58:36.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbbdc154700 0x7fbbdc06c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdbe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 0x7fbbdc06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdbe00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbdc070d10 con 0x7fbbdc0b2180 2024-09-12T02:58:36.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdbe00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fbbdc15b610 con 0x7fbbdc154700 2024-09-12T02:58:36.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdbe00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbbdc070ff0 con 0x7fbbdc154ae0 2024-09-12T02:58:36.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdaa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbbdc154700 0x7fbbdc06c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdaa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbbdc154700 0x7fbbdc06c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43944/0 (socket says 172.21.15.63:43944) 2024-09-12T02:58:36.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.548+0000 7fbbdaa00640 1 -- 172.21.15.63:0/310160756 learned_addr learned my addr 172.21.15.63:0/310160756 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:36.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.552+0000 7fbbda000640 1 --2- 172.21.15.63:0/310160756 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 0x7fbbdc06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.552+0000 7fbbdaa00640 1 -- 172.21.15.63:0/310160756 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 msgr2=0x7fbbdc06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:36.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.552+0000 7fbbdaa00640 1 --2- 172.21.15.63:0/310160756 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 0x7fbbdc06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:36.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.552+0000 7fbbdaa00640 1 -- 172.21.15.63:0/310160756 >> v1:172.21.15.119:6789/0 conn(0x7fbbdc0b2180 legacy=0x7fbbdc0c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:36.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.552+0000 7fbbdaa00640 1 -- 172.21.15.63:0/310160756 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc15b330 con 0x7fbbdc154700 2024-09-12T02:58:36.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.552+0000 7fbbda000640 1 --2- 172.21.15.63:0/310160756 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 0x7fbbdc06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:36.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbdaa00640 1 --2- 172.21.15.63:0/310160756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 0x7fbbdc06c160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009870 tx=0x7fbbcc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4b2d3f43e45dac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:36.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbd9600640 1 -- 172.21.15.63:0/310160756 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0a9640 con 0x7fbbdc154700 2024-09-12T02:58:36.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbd9600640 1 -- 172.21.15.63:0/310160756 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbcc0a97e0 con 0x7fbbdc154700 2024-09-12T02:58:36.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbd9600640 1 -- 172.21.15.63:0/310160756 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc0a9bb0 con 0x7fbbdc154700 2024-09-12T02:58:36.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbdbe00640 1 -- 172.21.15.63:0/310160756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 msgr2=0x7fbbdc06c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:36.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbdbe00640 1 --2- 172.21.15.63:0/310160756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 0x7fbbdc06c160 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009870 tx=0x7fbbcc01c560 comp rx=0 tx=0).stop 2024-09-12T02:58:36.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbdbe00640 1 -- 172.21.15.63:0/310160756 shutdown_connections 2024-09-12T02:58:36.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbdbe00640 1 --2- 172.21.15.63:0/310160756 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 0x7fbbdc06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:36.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbdbe00640 1 --2- 172.21.15.63:0/310160756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 0x7fbbdc06c160 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:36.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbdbe00640 1 -- 172.21.15.63:0/310160756 >> 172.21.15.63:0/310160756 conn(0x7fbbdc070180 msgr2=0x7fbbdc070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:36.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbdbe00640 1 -- 172.21.15.63:0/310160756 shutdown_connections 2024-09-12T02:58:36.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.556+0000 7fbbdbe00640 1 -- 172.21.15.63:0/310160756 wait complete. 2024-09-12T02:58:36.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.560+0000 7fbbdbe00640 1 Processor -- start 2024-09-12T02:58:36.565 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:36.565 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:36.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.560+0000 7fbbdbe00640 1 -- start start 2024-09-12T02:58:36.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.560+0000 7fbbdbe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc0b2180 0x7fbbdc152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.560+0000 7fbbdbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 0x7fbbdc1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.560+0000 7fbbdbe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 0x7fbbdc0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.560+0000 7fbbdbe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc06e4e0 con 0x7fbbdc154700 2024-09-12T02:58:36.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.560+0000 7fbbdbe00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbbdc06e360 con 0x7fbbdc0b2180 2024-09-12T02:58:36.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.560+0000 7fbbdbe00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbbdc0c9400 con 0x7fbbdc154ae0 2024-09-12T02:58:36.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbdaa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc0b2180 0x7fbbdc152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbda000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 0x7fbbdc1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbda000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 0x7fbbdc1558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43958/0 (socket says 172.21.15.63:43958) 2024-09-12T02:58:36.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbdaa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc0b2180 0x7fbbdc152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:47884/0 (socket says 172.21.15.63:47884) 2024-09-12T02:58:36.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbda000640 1 -- 172.21.15.63:0/411476071 learned_addr learned my addr 172.21.15.63:0/411476071 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:36.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbda000640 1 -- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 msgr2=0x7fbbdc0c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:36.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbda000640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 0x7fbbdc0c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:36.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbda000640 1 -- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc0b2180 msgr2=0x7fbbdc152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:36.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbda000640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc0b2180 0x7fbbdc152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:36.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbda000640 1 -- 172.21.15.63:0/411476071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbdc0c41a0 con 0x7fbbdc154700 2024-09-12T02:58:36.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbda000640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 0x7fbbdc1558f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400d800 tx=0x7fbbc400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:36.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbd2a00640 1 -- 172.21.15.63:0/411476071 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4018020 con 0x7fbbdc154700 2024-09-12T02:58:36.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbd2a00640 1 -- 172.21.15.63:0/411476071 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc40096c0 con 0x7fbbdc154700 2024-09-12T02:58:36.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbdc150fd0 con 0x7fbbdc154700 2024-09-12T02:58:36.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbd2a00640 1 -- 172.21.15.63:0/411476071 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4009a90 con 0x7fbbdc154700 2024-09-12T02:58:36.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbdc153f80 con 0x7fbbdc154700 2024-09-12T02:58:36.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.564+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbdc0c1ec0 con 0x7fbbdc154700 2024-09-12T02:58:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.568+0000 7fbbd2a00640 1 -- 172.21.15.63:0/411476071 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbbc401b020 con 0x7fbbdc154700 2024-09-12T02:58:36.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.568+0000 7fbbd2a00640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbbb8067940 0x7fbbb8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:36.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.568+0000 7fbbd2a00640 1 -- 172.21.15.63:0/411476071 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6685+0+0 (secure 0 0 0) 0x7fbbc4086460 con 0x7fbbdc154700 2024-09-12T02:58:36.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.572+0000 7fbbdaa00640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbbb8067940 0x7fbbb8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:36.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.572+0000 7fbbdaa00640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbbb8067940 0x7fbbb8069e00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0ae000 tx=0x7fbbcc0b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:36.577 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:36.572+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:36.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.580+0000 7fbbd2a00640 1 -- 172.21.15.63:0/411476071 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbbc4022020 con 0x7fbbdc154700 2024-09-12T02:58:36.586 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:36.678 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:36.674+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:36.779 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:36.776+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:36.799 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:36.799 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:36.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:36.880 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:36.874+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:36.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:36.896+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7fbbdc15ae00 con 0x7fbbdc154700 2024-09-12T02:58:36.981 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:36.978+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:37.082 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:37.078+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:37.106 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:37.129 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:37.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.140+0000 7fbbd2a00640 1 -- 172.21.15.63:0/411476071 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v54) ==== 87+0+0 (secure 0 0 0) 0x7fbbc4056c40 con 0x7fbbdc154700 2024-09-12T02:58:37.144 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-12T02:58:37.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbbb8067940 msgr2=0x7fbbb8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:37.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbbb8067940 0x7fbbb8069e00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0ae000 tx=0x7fbbcc0b3040 comp rx=0 tx=0).stop 2024-09-12T02:58:37.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 msgr2=0x7fbbdc1558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:37.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 0x7fbbdc1558f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400d800 tx=0x7fbbc400dcc0 comp rx=0 tx=0).stop 2024-09-12T02:58:37.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 shutdown_connections 2024-09-12T02:58:37.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbbb8067940 0x7fbbb8069e00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:37.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbdc154ae0 0x7fbbdc0c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:37.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbbdc154700 0x7fbbdc1558f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:37.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 --2- 172.21.15.63:0/411476071 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbdc0b2180 0x7fbbdc152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:37.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 >> 172.21.15.63:0/411476071 conn(0x7fbbdc070180 msgr2=0x7fbbdc0cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:37.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 shutdown_connections 2024-09-12T02:58:37.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:37.144+0000 7fbbdbe00640 1 -- 172.21.15.63:0/411476071 wait complete. 2024-09-12T02:58:37.183 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:37.178+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:37.285 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:37.280+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:37.310 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:37.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:37.385 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:37.382+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:37.487 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:37.484+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:37.521 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:37.521 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:37.538 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:37.587 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:37.582+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:37.688 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:37.684+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:37.730 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:37.731 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:37.747 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:37.788 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:37.782+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:37.872 INFO:teuthology.orchestra.run.smithi119.stderr:Exporting 3.4 info 3.4( empty local-lis/les=40/41 n=0 ec=20/20 lis/c=40/40 les/c/f=41/41/0 sis=40) 2024-09-12T02:58:37.877 INFO:teuthology.orchestra.run.smithi119.stderr:Export successful 2024-09-12T02:58:37.889 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:37.884+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:37.940 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:37.940 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:37.957 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:37.998 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:37.996+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:38.091 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:38.086+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:38.152 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:38.153 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:38.168 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:38.192 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:38.186+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:38.279 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:38.327 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:38.324+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:38.335 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:38.335 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:38.362 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:38.393 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:38.390+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:38.410 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --force --op remove --pgid 3.4 2024-09-12T02:58:38.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb0de00640 1 Processor -- start 2024-09-12T02:58:38.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb0de00640 1 -- start start 2024-09-12T02:58:38.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb0de00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feb08159220 0x7feb080ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb0de00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 0x7feb080ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb0de00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb080c5310 con 0x7feb08158e40 2024-09-12T02:58:38.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb0de00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7feb08070560 con 0x7feb08159220 2024-09-12T02:58:38.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb0de00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7feb0806edf0 con 0x7feb080c3170 2024-09-12T02:58:38.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb06a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7feb08158e40 0x7feb0815f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:49364/0 (socket says 172.21.15.63:49364) 2024-09-12T02:58:38.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb06a00640 1 -- 172.21.15.63:0/929281322 learned_addr learned my addr 172.21.15.63:0/929281322 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:38.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb07400640 1 --2- 172.21.15.63:0/929281322 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 0x7feb080ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.432+0000 7feb06000640 1 --2- 172.21.15.63:0/929281322 >> v2:172.21.15.119:3300/0 conn(0x7feb08159220 0x7feb080ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.436+0000 7feb05600640 1 -- 172.21.15.63:0/929281322 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186091977 0 0) 0x7feb080c5310 con 0x7feb08158e40 2024-09-12T02:58:38.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.436+0000 7feb05600640 1 -- 172.21.15.63:0/929281322 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feaec003530 con 0x7feb08158e40 2024-09-12T02:58:38.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.436+0000 7feb07400640 1 -- 172.21.15.63:0/929281322 >> v2:172.21.15.119:3300/0 conn(0x7feb08159220 msgr2=0x7feb080ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:38.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.436+0000 7feb07400640 1 --2- 172.21.15.63:0/929281322 >> v2:172.21.15.119:3300/0 conn(0x7feb08159220 0x7feb080ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:38.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.436+0000 7feb07400640 1 -- 172.21.15.63:0/929281322 >> v1:172.21.15.63:6789/0 conn(0x7feb08158e40 legacy=0x7feb0815f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:38.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.436+0000 7feb07400640 1 -- 172.21.15.63:0/929281322 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0806ffa0 con 0x7feb080c3170 2024-09-12T02:58:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb07400640 1 --2- 172.21.15.63:0/929281322 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 0x7feb080ce5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb00009d90 tx=0x7feb0001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36000aef219c30c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb05600640 1 -- 172.21.15.63:0/929281322 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb000b4070 con 0x7feb080c3170 2024-09-12T02:58:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb05600640 1 -- 172.21.15.63:0/929281322 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb000af600 con 0x7feb080c3170 2024-09-12T02:58:38.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb05600640 1 -- 172.21.15.63:0/929281322 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb000af9b0 con 0x7feb080c3170 2024-09-12T02:58:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb0de00640 1 -- 172.21.15.63:0/929281322 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 msgr2=0x7feb080ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:38.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb0de00640 1 --2- 172.21.15.63:0/929281322 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 0x7feb080ce5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb00009d90 tx=0x7feb0001f150 comp rx=0 tx=0).stop 2024-09-12T02:58:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb0de00640 1 -- 172.21.15.63:0/929281322 shutdown_connections 2024-09-12T02:58:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb0de00640 1 --2- 172.21.15.63:0/929281322 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 0x7feb080ce5c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb0de00640 1 --2- 172.21.15.63:0/929281322 >> v2:172.21.15.119:3300/0 conn(0x7feb08159220 0x7feb080ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb0de00640 1 -- 172.21.15.63:0/929281322 >> 172.21.15.63:0/929281322 conn(0x7feb08067a00 msgr2=0x7feb08067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb0de00640 1 -- 172.21.15.63:0/929281322 shutdown_connections 2024-09-12T02:58:38.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.440+0000 7feb0de00640 1 -- 172.21.15.63:0/929281322 wait complete. 2024-09-12T02:58:38.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.444+0000 7feb0de00640 1 Processor -- start 2024-09-12T02:58:38.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.444+0000 7feb0de00640 1 -- start start 2024-09-12T02:58:38.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.444+0000 7feb0de00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 0x7feb0815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.444+0000 7feb0de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb08158e40 0x7feb080c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.444+0000 7feb0de00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb08159610 0x7feb081f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.444+0000 7feb0de00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7feb0815f190 con 0x7feb08158e40 2024-09-12T02:58:38.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.444+0000 7feb0de00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feb0815eeb0 con 0x7feb08159610 2024-09-12T02:58:38.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.444+0000 7feb0de00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7feb0806f110 con 0x7feb080c3170 2024-09-12T02:58:38.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 0x7feb0815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb08158e40 0x7feb080c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 0x7feb0815a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:52792/0 (socket says 172.21.15.63:52792) 2024-09-12T02:58:38.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06a00640 1 -- 172.21.15.63:0/4073276617 learned_addr learned my addr 172.21.15.63:0/4073276617 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:38.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb07400640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb08159610 0x7feb081f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06000640 1 -- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 msgr2=0x7feb0815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:38.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06000640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb080c3170 0x7feb0815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:38.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06000640 1 -- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb08159610 msgr2=0x7feb081f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06000640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb08159610 0x7feb081f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06000640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb080c53b0 con 0x7feb08158e40 2024-09-12T02:58:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb06000640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb08158e40 0x7feb080c3d70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feaf400e870 tx=0x7feaf400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4017070 con 0x7feb08158e40 2024-09-12T02:58:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf400ee60 con 0x7feb08158e40 2024-09-12T02:58:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb080c5f10 con 0x7feb08158e40 2024-09-12T02:58:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf400cb60 con 0x7feb08158e40 2024-09-12T02:58:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.448+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb080c5930 con 0x7feb08158e40 2024-09-12T02:58:38.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.452+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7feb081ea460 con 0x7feb08158e40 2024-09-12T02:58:38.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.452+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feaf401a070 con 0x7feb08158e40 2024-09-12T02:58:38.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.452+0000 7feaff400640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feae80678c0 0x7feae8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.452+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6685+0+0 (secure 0 0 0) 0x7feaf4086620 con 0x7feb08158e40 2024-09-12T02:58:38.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.452+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v54) ==== 54+0+16 (secure 0 0 0) 0x7feaf408c170 con 0x7feb08158e40 2024-09-12T02:58:38.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.452+0000 7feb06a00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feae80678c0 0x7feae8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.456+0000 7feb0de00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7feb08159220 0x7feb08151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.456+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb0806f900 con 0x7feb08159220 2024-09-12T02:58:38.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.456+0000 7feb06a00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feae80678c0 0x7feae8069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feaf8007fd0 tx=0x7feaf8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.456+0000 7feb07400640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7feb08159220 0x7feb08151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.456+0000 7feb07400640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7feb08159220 0x7feb08151590 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.460+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb0806f900 con 0x7feb08159220 2024-09-12T02:58:38.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.488+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7feb081eabe0 con 0x7feb08159220 2024-09-12T02:58:38.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.492+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7feb081eabe0 con 0x7feb08159220 2024-09-12T02:58:38.495 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:38.496 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:38.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.492+0000 7feb0de00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7feb081f83c0 0x7feb080ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.492+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7feb080755c0 con 0x7feb081f83c0 2024-09-12T02:58:38.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.492+0000 7feb06a00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7feb081f83c0 0x7feb080ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.492+0000 7feb06a00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7feb081f83c0 0x7feb080ccfa0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.497 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:38.494+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:38.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.492+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb080755c0 con 0x7feb081f83c0 2024-09-12T02:58:38.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.520+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7feb081f7a60 con 0x7feb081f83c0 2024-09-12T02:58:38.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.524+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7feb081f7a60 con 0x7feb081f83c0 2024-09-12T02:58:38.529 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.524+0000 7feb0de00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7feb080cd9f0 0x7feb080626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.524+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7feb080c42b0 con 0x7feb080cd9f0 2024-09-12T02:58:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.524+0000 7feb06000640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7feb080cd9f0 0x7feb080626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.528+0000 7feb06000640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7feb080cd9f0 0x7feb080626e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.528+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb080c42b0 con 0x7feb080cd9f0 2024-09-12T02:58:38.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.556+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7feb08062ef0 con 0x7feb080cd9f0 2024-09-12T02:58:38.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.560+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7feb08062ef0 con 0x7feb080cd9f0 2024-09-12T02:58:38.565 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:38.565 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:38.589 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:38.589 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:38.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.560+0000 7feb0de00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7feb081eaec0 0x7feb081eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.560+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7feb081eb840 con 0x7feb081eaec0 2024-09-12T02:58:38.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.560+0000 7feb07400640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7feb081eaec0 0x7feb081eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.564+0000 7feb07400640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7feb081eaec0 0x7feb081eb300 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.564+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb081eb840 con 0x7feb081eaec0 2024-09-12T02:58:38.594 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:38.590+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:38.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.592+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7feb081ebb10 con 0x7feb081eaec0 2024-09-12T02:58:38.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.592+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7feb081ebb10 con 0x7feb081eaec0 2024-09-12T02:58:38.598 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:38.598 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:38.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.592+0000 7feb0de00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feb0802cb60 0x7feb0802cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.592+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7feb081eba90 con 0x7feb0802cb60 2024-09-12T02:58:38.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.596+0000 7feb06a00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feb0802cb60 0x7feb0802cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.596+0000 7feb06a00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feb0802cb60 0x7feb0802cf80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.596+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb081eba90 con 0x7feb0802cb60 2024-09-12T02:58:38.609 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:38.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.612+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7feb081eba90 con 0x7feb0802cb60 2024-09-12T02:58:38.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.616+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7feb081eba90 con 0x7feb0802cb60 2024-09-12T02:58:38.622 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:38.623 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:38.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.620+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=55}) -- 0x7feb081ebd40 con 0x7feb08158e40 2024-09-12T02:58:38.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.620+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb0802d610 con 0x7feb08158e40 2024-09-12T02:58:38.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.620+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7feaf4021020 con 0x7feb08158e40 2024-09-12T02:58:38.623 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T02:58:38.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.620+0000 7feb0de00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7feb08208fa0 0x7feb0820b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.620+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7feb0820e1e0 con 0x7feb08208fa0 2024-09-12T02:58:38.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.620+0000 7feb06000640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7feb08208fa0 0x7feb0820b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.620+0000 7feb06000640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7feb08208fa0 0x7feb0820b390 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.624+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb0820e1e0 con 0x7feb08208fa0 2024-09-12T02:58:38.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.648+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7feb0820b950 con 0x7feb08208fa0 2024-09-12T02:58:38.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.652+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7feb0820b950 con 0x7feb08208fa0 2024-09-12T02:58:38.657 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:38.658 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:38.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.652+0000 7feb0de00640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7feb0820dbf0 0x7feb0820bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:38.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.652+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7feb0820e0d0 con 0x7feb0820dbf0 2024-09-12T02:58:38.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.656+0000 7feb07400640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7feb0820dbf0 0x7feb0820bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:38.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.656+0000 7feb07400640 1 --2- 172.21.15.63:0/4073276617 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7feb0820dbf0 0x7feb0820bb60 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:38.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.656+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb0820e0d0 con 0x7feb0820dbf0 2024-09-12T02:58:38.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.684+0000 7feb0de00640 1 -- 172.21.15.63:0/4073276617 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7feb0820e050 con 0x7feb0820dbf0 2024-09-12T02:58:38.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:38.688+0000 7feaff400640 1 -- 172.21.15.63:0/4073276617 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7feb0820e050 con 0x7feb0820dbf0 2024-09-12T02:58:38.693 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:38.693 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:38.695 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:38.690+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:38.705 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T02:58:38.706 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T02:58:38.768 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:38.768 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:38.768 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:38.784 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:38.796 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:38.790+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:38.897 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:38.894+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:38.935 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:38.935 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:38.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:38.935 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:38.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.935 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:38.935 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.080735368999996, 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011663767, 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853092+0000", 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853098+0000", 2024-09-12T02:58:38.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7509999999999997e-06 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853119+0000", 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.075e-05 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853130+0000", 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1396000000000001e-05 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853240+0000", 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109484 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853398+0000", 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158574 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864754+0000", 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011355568999999999 2024-09-12T02:58:38.939 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.080659730999997, 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065283390000000002, 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-09-12T02:58:38.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853171+0000", 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1860000000000002e-06 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853181+0000", 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0239e-05 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853188+0000", 2024-09-12T02:58:38.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0389999999999999e-06 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853287+0000", 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9116000000000004e-05 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853406+0000", 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011876500000000001 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859694+0000", 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006288348 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.078388537999999, 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031174459999999998, 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.944 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855439+0000", 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-06 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855447+0000", 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1899999999999995e-06 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855460+0000", 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3521e-05 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855469+0000", 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2709999999999992e-06 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855540+0000", 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1112000000000006e-05 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855574+0000", 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4823999999999997e-05 2024-09-12T02:58:38.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858501+0000", 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002926695 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858554+0000", 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3270999999999999e-05 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.948 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.078328178000007, 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030877769999999999, 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855498+0000", 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6199999999999998e-07 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855504+0000", 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7209999999999999e-06 2024-09-12T02:58:38.950 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855512+0000", 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2500000000000006e-06 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855517+0000", 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4079999999999997e-06 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855770+0000", 2024-09-12T02:58:38.951 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025252599999999999 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855787+0000", 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7486000000000002e-05 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858557+0000", 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027699449999999998 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.952 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858585+0000", 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7979000000000001e-05 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.075580689999995, 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034578339999999999, 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.953 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.954 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858246+0000", 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7199999999999997e-07 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858287+0000", 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106000000000003e-05 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858304+0000", 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7221e-05 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.955 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858314+0000", 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3819999999999993e-06 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858531+0000", 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000217538 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858546+0000", 2024-09-12T02:58:38.956 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4518000000000001e-05 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861647+0000", 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031017060000000001 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861703+0000", 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5390999999999999e-05 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.957 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.075461935000007, 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006126589, 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.958 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858380+0000", 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5491000000000001e-05 2024-09-12T02:58:38.959 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858397+0000", 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7720999999999999e-05 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858404+0000", 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.669e-06 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858743+0000", 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033907799999999998 2024-09-12T02:58:38.960 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858760+0000", 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864447+0000", 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005686895 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.961 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864490+0000", 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3658000000000001e-05 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.075410087999998, 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061037929999999997, 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.962 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.963 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858416+0000", 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2300000000000002e-07 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858421+0000", 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5319999999999997e-06 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858429+0000", 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8790000000000003e-06 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.964 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1599999999999997e-06 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858911+0000", 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047701999999999998 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858930+0000", 2024-09-12T02:58:38.965 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8189000000000002e-05 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864493+0000", 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055629099999999999 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864519+0000", 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6679999999999999e-05 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.966 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.074507561999994, 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052338280000000003, 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.967 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859319+0000", 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3099999999999997e-07 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859326+0000", 2024-09-12T02:58:38.968 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0520000000000004e-06 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859345+0000", 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9466e-05 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859353+0000", 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2009999999999999e-06 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.969 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859518+0000", 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000164582 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859536+0000", 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8088999999999999e-05 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864521+0000", 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049850390000000001 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864552+0000", 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0667999999999998e-05 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.074394498999993, 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026944499999999999, 2024-09-12T02:58:38.971 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.972 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859432+0000", 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.068e-06 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859437+0000", 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3569999999999997e-06 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859457+0000", 2024-09-12T02:58:38.973 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9462000000000001e-05 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859465+0000", 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3990000000000004e-06 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859578+0000", 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112446 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.974 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859700+0000", 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012271299999999999 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.073221157000006, 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039558550000000003, 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:38.975 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860605+0000", 2024-09-12T02:58:38.976 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3200000000000004e-07 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860613+0000", 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.644e-06 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860632+0000", 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9173000000000001e-05 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.977 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860661+0000", 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8589e-05 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860740+0000", 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9216999999999997e-05 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864560+0000", 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038205000000000001 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.978 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.069212812000004, 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014506999999999999, 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:38.979 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864614+0000", 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8599999999999997e-07 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.980 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864617+0000", 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864630+0000", 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2659e-05 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864636+0000", 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7930000000000003e-06 2024-09-12T02:58:38.981 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864684+0000", 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7926000000000002e-05 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864758+0000", 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4222999999999997e-05 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.982 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 89.067052329999996, 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075281000000000002, 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.983 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866774+0000", 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866779+0000", 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1499999999999998e-06 2024-09-12T02:58:38.984 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866791+0000", 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.238e-05 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866799+0000", 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2559999999999996e-06 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866850+0000", 2024-09-12T02:58:38.985 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1063999999999998e-05 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866862+0000", 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1891e-05 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867492+0000", 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00062994899999999998 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.986 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867526+0000", 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4372999999999998e-05 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 78.319155026000004, 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001141305, 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.987 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.988 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614672+0000", 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4619999999999999e-06 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614684+0000", 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.204e-05 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614703+0000", 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9415e-05 2024-09-12T02:58:38.989 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614713+0000", 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4720000000000001e-06 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614774+0000", 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1449000000000001e-05 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614790+0000", 2024-09-12T02:58:38.990 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6112000000000001e-05 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615776+0000", 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098508800000000007 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615812+0000", 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6266999999999997e-05 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.991 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 76.562865954000003, 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001160754, 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:38.992 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370962+0000", 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2529999999999999e-06 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.993 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371051+0000", 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9019999999999998e-05 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371086+0000", 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5153e-05 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371103+0000", 2024-09-12T02:58:38.994 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7113999999999999e-05 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371265+0000", 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162063 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371314+0000", 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9110000000000002e-05 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.995 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372077+0000", 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000762566 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372120+0000", 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3475e-05 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-12T02:58:38.996 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 75.681052086999998, 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010780609999999999, 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:38.997 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252775+0000", 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252785+0000", 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9650000000000003e-06 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.998 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252802+0000", 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7550999999999998e-05 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252813+0000", 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0169e-05 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252883+0000", 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0660000000000004e-05 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:38.999 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252910+0000", 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6889999999999998e-05 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253800+0000", 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00088991299999999999 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253852+0000", 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1530000000000003e-05 2024-09-12T02:58:39.000 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 53.996888247000001, 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001011966, 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.001 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936939+0000", 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.002 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936949+0000", 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0395e-05 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936966+0000", 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7173e-05 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936977+0000", 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0557000000000001e-05 2024-09-12T02:58:39.003 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937037+0000", 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9672000000000001e-05 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937056+0000", 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9338999999999999e-05 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937870+0000", 2024-09-12T02:58:39.004 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081393600000000002 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937949+0000", 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9418000000000004e-05 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 53.995915816999997, 2024-09-12T02:58:39.005 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000793828, 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.006 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9100000000000003e-07 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937916+0000", 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7309999999999998e-06 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937925+0000", 2024-09-12T02:58:39.007 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4460000000000001e-06 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937934+0000", 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3039999999999994e-06 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937973+0000", 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9493999999999998e-05 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:39.008 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937984+0000", 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938672+0000", 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00068768500000000005 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938704+0000", 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1664e-05 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:39.009 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:45 2.14 e27/19 2:2e2fa760:::200.00000001:head v 27'12, mlcod=26'10)", 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.304058828999999, 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00181248, 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:39.010 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.91e-07 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:39.011 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629819+0000", 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1918e-05 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629833+0000", 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3767999999999999e-05 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629844+0000", 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1326e-05 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.012 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629933+0000", 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9419999999999994e-05 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629962+0000", 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8314999999999999e-05 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631512+0000", 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015498 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.013 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631579+0000", 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7642000000000001e-05 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:47 2.14 e47/19 2:2e2fa760:::200.00000001:head v 47'13, mlcod=26'11)", 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.624523722999999, 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001880287, 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:39.014 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:39.015 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309303+0000", 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.544e-06 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309325+0000", 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2031e-05 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309346+0000", 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1049000000000001e-05 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.016 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309359+0000", 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2988e-05 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309439+0000", 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9721999999999993e-05 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309465+0000", 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5884000000000002e-05 2024-09-12T02:58:39.017 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311130+0000", 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001664837 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311182+0000", 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2231999999999997e-05 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:48 2.14 e47/19 2:292cf221:::200.00000000:head v 47'14, mlcod=26'11)", 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 18.623389920000001, 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001320122, 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.019 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5300000000000003e-07 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310443+0000", 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7739999999999999e-06 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.020 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310453+0000", 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8970000000000003e-06 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310460+0000", 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8460000000000002e-06 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310554+0000", 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4036999999999994e-05 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.021 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310577+0000", 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3462999999999999e-05 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311709+0000", 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011311400000000001 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311756+0000", 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7111999999999999e-05 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.022 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:39.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.023 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:39.023 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:39.023 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:39.024 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:39.025 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:39.020+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:39.125 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:39.118+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:39.167 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:39.167 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:39.167 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:39.186 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T02:58:39.192 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:39.233 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:39.230+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:39.327 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:39.324+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:39.357 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:39.357 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:39.357 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:39.357 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:39.358 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:39.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.352+0000 7f3bdf200640 1 Processor -- start 2024-09-12T02:58:39.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.352+0000 7f3bdf200640 1 -- start start 2024-09-12T02:58:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bdf200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3be00c8bf0 0x7f3be00c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bdf200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3be006fc30 0x7f3be00caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bdf200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3be006e980 con 0x7f3be00c8fd0 2024-09-12T02:58:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bdf200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f3be006ec40 con 0x7f3be006fc30 2024-09-12T02:58:39.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bdf200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f3be006ef20 con 0x7f3be00c8bf0 2024-09-12T02:58:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bde800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3be006fc30 0x7f3be00caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bde800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3be006fc30 0x7f3be00caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43972/0 (socket says 172.21.15.63:43972) 2024-09-12T02:58:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bde800640 1 -- 172.21.15.63:0/3590309969 learned_addr learned my addr 172.21.15.63:0/3590309969 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bdde00640 1 --2- 172.21.15.63:0/3590309969 >> v2:172.21.15.119:3300/0 conn(0x7f3be00c8bf0 0x7f3be00c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bde800640 1 -- 172.21.15.63:0/3590309969 >> v2:172.21.15.119:3300/0 conn(0x7f3be00c8bf0 msgr2=0x7f3be00c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:39.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bde800640 1 --2- 172.21.15.63:0/3590309969 >> v2:172.21.15.119:3300/0 conn(0x7f3be00c8bf0 0x7f3be00c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bde800640 1 -- 172.21.15.63:0/3590309969 >> v1:172.21.15.63:6789/0 conn(0x7f3be00c8fd0 legacy=0x7f3be006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:39.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.356+0000 7f3bde800640 1 -- 172.21.15.63:0/3590309969 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be015ab80 con 0x7f3be006fc30 2024-09-12T02:58:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bde800640 1 --2- 172.21.15.63:0/3590309969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be006fc30 0x7f3be00caf20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3be00cbb30 tx=0x7f3bd801f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe30381426ba07a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:39.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdca00640 1 -- 172.21.15.63:0/3590309969 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80b4070 con 0x7f3be006fc30 2024-09-12T02:58:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdca00640 1 -- 172.21.15.63:0/3590309969 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd80af400 con 0x7f3be006fc30 2024-09-12T02:58:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdca00640 1 -- 172.21.15.63:0/3590309969 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80af7d0 con 0x7f3be006fc30 2024-09-12T02:58:39.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdf200640 1 -- 172.21.15.63:0/3590309969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be006fc30 msgr2=0x7f3be00caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdf200640 1 --2- 172.21.15.63:0/3590309969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be006fc30 0x7f3be00caf20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3be00cbb30 tx=0x7f3bd801f200 comp rx=0 tx=0).stop 2024-09-12T02:58:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdf200640 1 -- 172.21.15.63:0/3590309969 shutdown_connections 2024-09-12T02:58:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdf200640 1 --2- 172.21.15.63:0/3590309969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be006fc30 0x7f3be00caf20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdf200640 1 --2- 172.21.15.63:0/3590309969 >> v2:172.21.15.119:3300/0 conn(0x7f3be00c8bf0 0x7f3be00c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdf200640 1 -- 172.21.15.63:0/3590309969 >> 172.21.15.63:0/3590309969 conn(0x7f3be0067a00 msgr2=0x7f3be0067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdf200640 1 -- 172.21.15.63:0/3590309969 shutdown_connections 2024-09-12T02:58:39.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.360+0000 7f3bdf200640 1 -- 172.21.15.63:0/3590309969 wait complete. 2024-09-12T02:58:39.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdf200640 1 Processor -- start 2024-09-12T02:58:39.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdf200640 1 -- start start 2024-09-12T02:58:39.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdf200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be006fc30 0x7f3be0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:39.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdf200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be00c8bf0 0x7f3be01f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:39.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdf200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be00c8fd0 0x7f3be014a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:39.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdf200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3be015a830 con 0x7f3be00c8bf0 2024-09-12T02:58:39.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdf200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3be015b140 con 0x7f3be006fc30 2024-09-12T02:58:39.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdf200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f3be015b660 con 0x7f3be00c8fd0 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be00c8bf0 0x7f3be01f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be00c8bf0 0x7f3be01f3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43976/0 (socket says 172.21.15.63:43976) 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdd400640 1 -- 172.21.15.63:0/4045565997 learned_addr learned my addr 172.21.15.63:0/4045565997 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bde800640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be00c8fd0 0x7f3be014a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdde00640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be006fc30 0x7f3be0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdd400640 1 -- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be00c8fd0 msgr2=0x7f3be014a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdd400640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be00c8fd0 0x7f3be014a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdd400640 1 -- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be006fc30 msgr2=0x7f3be0159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdd400640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be006fc30 0x7f3be0159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdd400640 1 -- 172.21.15.63:0/4045565997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3be01f0030 con 0x7f3be00c8bf0 2024-09-12T02:58:39.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.364+0000 7f3bdd400640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be00c8bf0 0x7f3be01f3a90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00c3a0 tx=0x7f3bcc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:39.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.368+0000 7f3bd6000640 1 -- 172.21.15.63:0/4045565997 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0052d0 con 0x7f3be00c8bf0 2024-09-12T02:58:39.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.368+0000 7f3bd6000640 1 -- 172.21.15.63:0/4045565997 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bcc005470 con 0x7f3be00c8bf0 2024-09-12T02:58:39.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.368+0000 7f3bd6000640 1 -- 172.21.15.63:0/4045565997 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc007260 con 0x7f3be00c8bf0 2024-09-12T02:58:39.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.368+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3be01f02f0 con 0x7f3be00c8bf0 2024-09-12T02:58:39.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.368+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3be01f08b0 con 0x7f3be00c8bf0 2024-09-12T02:58:39.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.368+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3be0069870 con 0x7f3be00c8bf0 2024-09-12T02:58:39.373 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:39.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.368+0000 7f3bd6000640 1 -- 172.21.15.63:0/4045565997 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3bcc007400 con 0x7f3be00c8bf0 2024-09-12T02:58:39.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.368+0000 7f3bd6000640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3bc00678c0 0x7f3bc0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:39.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.368+0000 7f3bd6000640 1 -- 172.21.15.63:0/4045565997 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6685+0+0 (secure 0 0 0) 0x7f3bcc085560 con 0x7f3be00c8bf0 2024-09-12T02:58:39.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.372+0000 7f3bdde00640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3bc00678c0 0x7f3bc0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:39.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.372+0000 7f3bdde00640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3bc00678c0 0x7f3bc0069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009b60 tx=0x7f3bd0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:39.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.380+0000 7f3bd6000640 1 -- 172.21.15.63:0/4045565997 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3bcc055550 con 0x7f3be00c8bf0 2024-09-12T02:58:39.428 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:39.424+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:39.496 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.643240172999995, 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.497 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:58:39.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:39.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:58:39.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:58:39.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:39.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:58:39.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:58:39.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:39.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:58:39.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:58:39.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:58:39.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.638479395000005, 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.504 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:39.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.508 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.509 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.510 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:39.510 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:39.510 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.638341533000002, 2024-09-12T02:58:39.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:58:39.510 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.510 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.511 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:58:39.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.515 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.638255416000007, 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:58:39.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.519 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.637531584000001, 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:58:39.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:39.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:39.524 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.637372717000005, 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:58:39.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:58:39.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.636919098999996, 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.529 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:58:39.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.633685104999998, 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:58:39.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPush(2.6 41/40 [PushOp(2:654134d2:::mds0_openfiles.0:head, version: 28'2, data_included: [], data_size: 0, omap_header_size: 42, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:654134d2:::mds0_openfiles.0:head@28'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 34.588302274999997, 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00050712800000000003, 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.537 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906694+0000", 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1620000000000001e-06 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906711+0000", 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6974e-05 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906734+0000", 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3862999999999998e-05 2024-09-12T02:58:39.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906757+0000", 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2765e-05 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906918+0000", 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000160326 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906935+0000", 2024-09-12T02:58:39.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7215e-05 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.907200+0000", 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026482300000000002 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.541 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:39.543 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:39.543 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:39.540+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:39.644 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:39.640+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:39.666 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:39.667 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:39.667 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:39.667 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:39.681 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:39.732+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7f3be0071b50 con 0x7f3be00c8bf0 2024-09-12T02:58:39.745 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:39.738+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:39.809 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:39.810 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:39.810 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:39.810 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:39.810 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:39.824 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:39.865 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:39.862+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:39.946 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:39.944+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:39.986 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:39.986 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:39.986 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:39.986 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:39.986 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.986 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:39.986 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.130032142999994, 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.987 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:39.988 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.989 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.990 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:39.991 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.129898935, 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:39.992 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.993 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:39.994 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:39.995 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:39.996 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:39.997 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.129794184999994, 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:39.998 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:39.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:40.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:40.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.129648367000001, 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:40.003 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:40.005 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:40.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:40.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.129575184999993, 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:40.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.011 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:40.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.129515198999997, 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.014 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:40.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:40.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.019 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.129452853000004, 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.020 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.129395337000005, 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:40.024 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.127227712000007, 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.028 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.032 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.124069196999997, 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.033 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:40.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.116360323999999, 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:40.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 81.097471373000005, 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.043 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:40.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 79.369069566999997, 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:40.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:40.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:40.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.053 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 77.613232984999996, 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.054 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:40.055 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:40.056 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.057 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:40.058 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 76.731144021000006, 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:40.059 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.060 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:40.061 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.062 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.063 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:40.064 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.047186408000002, 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.065 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.066 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:40.067 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:40.068 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:40.069 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 55.047081116999998, 2024-09-12T02:58:40.070 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.071 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.072 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.073 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.074 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:40.075 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 52.354517967, 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.076 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.077 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.078 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:40.079 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:40.080 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5447~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.675159421, 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003274795, 2024-09-12T02:58:40.081 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.082 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307146+0000", 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.123e-06 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307162+0000", 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5729000000000001e-05 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307197+0000", 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5179999999999999e-05 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.083 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307214+0000", 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7295999999999998e-05 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307371+0000", 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000156293 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.084 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307532+0000", 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016189399999999999 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307741+0000", 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208493 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.309426+0000", 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016850299999999999 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.085 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310212+0000", 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000786494 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310299+0000", 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6178000000000001e-05 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310418+0000", 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000119085 2024-09-12T02:58:40.086 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 19.675046244000001, 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037307600000000001, 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.087 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307257+0000", 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2699999999999999e-06 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.088 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307266+0000", 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2160000000000006e-06 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307286+0000", 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0537e-05 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307299+0000", 2024-09-12T02:58:40.089 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3297e-05 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308569+0000", 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001269121 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308706+0000", 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013719099999999999 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:40.090 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308921+0000", 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021543199999999999 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310051+0000", 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001129901 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310836+0000", 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00078529800000000003 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310922+0000", 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5488000000000005e-05 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310987+0000", 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5009e-05 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.092 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:40.094 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:40.095 INFO:teuthology.orchestra.run.smithi119.stdout: marking collection for removal 2024-09-12T02:58:40.095 INFO:teuthology.orchestra.run.smithi119.stdout:setting '_remove' omap key 2024-09-12T02:58:40.095 INFO:teuthology.orchestra.run.smithi119.stdout:finish_remove_pgs 3.4_head removing 3.4 2024-09-12T02:58:40.095 INFO:teuthology.orchestra.run.smithi119.stdout:Remove successful 2024-09-12T02:58:40.096 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:40.088+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:40.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.152+0000 7f3bd6000640 1 -- 172.21.15.63:0/4045565997 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v55) ==== 97+0+0 (secure 0 0 0) 0x7f3bcc059850 con 0x7f3be00c8bf0 2024-09-12T02:58:40.158 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-12T02:58:40.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3bc00678c0 msgr2=0x7f3bc0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:40.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3bc00678c0 0x7f3bc0069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009b60 tx=0x7f3bd0009190 comp rx=0 tx=0).stop 2024-09-12T02:58:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be00c8bf0 msgr2=0x7f3be01f3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be00c8bf0 0x7f3be01f3a90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00c3a0 tx=0x7f3bcc00c860 comp rx=0 tx=0).stop 2024-09-12T02:58:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 shutdown_connections 2024-09-12T02:58:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3bc00678c0 0x7f3bc0069d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be00c8fd0 0x7f3be014a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3be00c8bf0 0x7f3be01f3a90 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00c3a0 tx=0x7f3bcc00c860 comp rx=0 tx=0).stop 2024-09-12T02:58:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 --2- 172.21.15.63:0/4045565997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be006fc30 0x7f3be0159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 >> 172.21.15.63:0/4045565997 conn(0x7f3be0067a00 msgr2=0x7f3be00ce040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:40.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 shutdown_connections 2024-09-12T02:58:40.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.156+0000 7f3bdf200640 1 -- 172.21.15.63:0/4045565997 wait complete. 2024-09-12T02:58:40.195 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:40.190+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:40.225 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:40.225 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:40.225 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:40.225 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:40.239 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:40.329 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:40.326+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:40.396 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:40.392+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:40.407 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:40.407 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:40.407 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:40.407 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:40.407 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:40.421 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:40.497 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:40.492+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.838669201, 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:40.589 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.590 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.591 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:40.592 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.593 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.594 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.595 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.695473863, 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.597 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.598 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.599 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.600 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.601 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.695453337, 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:40.602 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.603 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.604 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:40.605 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.606 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.607 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.695342524, 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:40.608 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.609 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:40.610 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:40.611 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.612 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.695320998, 2024-09-12T02:58:40.613 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.614 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:40.615 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.616 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.617 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.618 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.63033435200001, 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.619 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.620 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:40.621 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.622 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:40.623 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:40.624 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.408230829, 2024-09-12T02:58:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.626 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.627 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.628 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:40.629 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:40.630 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.408093838, 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.631 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:40.633 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.634 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.635 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:40.636 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.406976636, 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.637 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:40.639 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.640 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.641 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.642 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.40690452299999, 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.643 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.644 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.645 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:40.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:40.647 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.648 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.40668053900001, 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.649 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:40.650 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:40.651 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.652 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.653 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.654 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.406610556, 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.655 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:40.656 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:40.657 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.658 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.659 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.406504919, 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:40.661 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.662 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.663 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.664 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:40.665 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.406314822, 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:40.666 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.667 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:40.668 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.669 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.670 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.671 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.406248035, 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:40.672 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.673 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:40.674 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.675 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.676 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.677 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:40.678 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.83089843800001, 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.679 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.680 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:40.681 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:40.682 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.683 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:40.684 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.732199003999995, 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:40.685 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.686 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.687 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:40.688 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.689 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.732113761999997, 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.690 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:40.691 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.692 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.694 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:40.695 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.731976648, 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.696 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.697 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.698 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:40.699 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:40.700 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.731806749, 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:40.701 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:40.702 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.703 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:40.704 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:40.705 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:40.707 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:40.708 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.4.5 2024-09-12T02:58:40.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:40.709 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:40.704+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:40.808 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:40.804+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:40.909 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:40.904+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:40.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.932+0000 7fe236400640 1 Processor -- start 2024-09-12T02:58:40.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.932+0000 7fe236400640 1 -- start start 2024-09-12T02:58:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe236400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe230152850 0x7fe230158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe236400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2300c8990 0x7fe230070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe236400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe230070060 con 0x7fe2300c8140 2024-09-12T02:58:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe236400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe2300c5140 con 0x7fe230152850 2024-09-12T02:58:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe236400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe2300c3190 con 0x7fe2300c8990 2024-09-12T02:58:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe235000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe230152850 0x7fe230158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe22fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe2300c8140 0x7fe2300ce040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:49372/0 (socket says 172.21.15.63:49372) 2024-09-12T02:58:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe22fe00640 1 -- 172.21.15.63:0/3135830019 learned_addr learned my addr 172.21.15.63:0/3135830019 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe235a00640 1 --2- 172.21.15.63:0/3135830019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2300c8990 0x7fe230070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe235000640 1 -- 172.21.15.63:0/3135830019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2300c8990 msgr2=0x7fe230070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:40.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe235000640 1 --2- 172.21.15.63:0/3135830019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2300c8990 0x7fe230070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe235000640 1 -- 172.21.15.63:0/3135830019 >> v1:172.21.15.63:6789/0 conn(0x7fe2300c8140 legacy=0x7fe2300ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:40.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.936+0000 7fe235000640 1 -- 172.21.15.63:0/3135830019 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2300c3470 con 0x7fe230152850 2024-09-12T02:58:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe235000640 1 --2- 172.21.15.63:0/3135830019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe230152850 0x7fe230158410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe2240097c0 tx=0x7fe22401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d59b516bb99338d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe22f400640 1 -- 172.21.15.63:0/3135830019 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240b5070 con 0x7fe230152850 2024-09-12T02:58:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe22f400640 1 -- 172.21.15.63:0/3135830019 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2240a8990 con 0x7fe230152850 2024-09-12T02:58:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe22f400640 1 -- 172.21.15.63:0/3135830019 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240a8d60 con 0x7fe230152850 2024-09-12T02:58:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe236400640 1 -- 172.21.15.63:0/3135830019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe230152850 msgr2=0x7fe230158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe236400640 1 --2- 172.21.15.63:0/3135830019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe230152850 0x7fe230158410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe2240097c0 tx=0x7fe22401ec90 comp rx=0 tx=0).stop 2024-09-12T02:58:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe236400640 1 -- 172.21.15.63:0/3135830019 shutdown_connections 2024-09-12T02:58:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe236400640 1 --2- 172.21.15.63:0/3135830019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2300c8990 0x7fe230070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe236400640 1 --2- 172.21.15.63:0/3135830019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe230152850 0x7fe230158410 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe236400640 1 -- 172.21.15.63:0/3135830019 >> 172.21.15.63:0/3135830019 conn(0x7fe230067a00 msgr2=0x7fe230067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.940+0000 7fe236400640 1 -- 172.21.15.63:0/3135830019 shutdown_connections 2024-09-12T02:58:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.944+0000 7fe236400640 1 -- 172.21.15.63:0/3135830019 wait complete. 2024-09-12T02:58:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.944+0000 7fe236400640 1 Processor -- start 2024-09-12T02:58:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.944+0000 7fe236400640 1 -- start start 2024-09-12T02:58:40.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe236400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2300c8140 0x7fe230152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe236400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2300c8990 0x7fe2301f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe236400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe230152850 0x7fe230141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe236400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe2300ce750 con 0x7fe2300c8140 2024-09-12T02:58:40.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe236400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe2300c4b60 con 0x7fe230152850 2024-09-12T02:58:40.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe236400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe2300ce8d0 con 0x7fe2300c8990 2024-09-12T02:58:40.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2300c8140 0x7fe230152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2300c8140 0x7fe230152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43992/0 (socket says 172.21.15.63:43992) 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235000640 1 -- 172.21.15.63:0/1788705446 learned_addr learned my addr 172.21.15.63:0/1788705446 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235a00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe230152850 0x7fe230141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe22fe00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2300c8990 0x7fe2301f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235000640 1 -- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2300c8990 msgr2=0x7fe2301f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235000640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2300c8990 0x7fe2301f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235000640 1 -- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe230152850 msgr2=0x7fe230141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235000640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe230152850 0x7fe230141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235000640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2300cdc10 con 0x7fe2300c8140 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:40.952 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:40.953 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:40.953 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:40.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe235000640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2300c8140 0x7fe230152d60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe2240b3040 tx=0x7fe22401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:40.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240bf070 con 0x7fe2300c8140 2024-09-12T02:58:40.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2240b0720 con 0x7fe2300c8140 2024-09-12T02:58:40.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240b5040 con 0x7fe2300c8140 2024-09-12T02:58:40.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2301f8550 con 0x7fe2300c8140 2024-09-12T02:58:40.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2300c6830 con 0x7fe2300c8140 2024-09-12T02:58:40.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.948+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fe230069870 con 0x7fe2300c8140 2024-09-12T02:58:40.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.952+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe2240b0b10 con 0x7fe2300c8140 2024-09-12T02:58:40.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.952+0000 7fe22cc00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2100678c0 0x7fe210069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.952+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6685+0+0 (secure 0 0 0) 0x7fe224122990 con 0x7fe2300c8140 2024-09-12T02:58:40.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.952+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v55) ==== 54+0+16 (secure 0 0 0) 0x7fe2240187f0 con 0x7fe2300c8140 2024-09-12T02:58:40.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.956+0000 7fe22fe00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2100678c0 0x7fe210069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.956+0000 7fe236400640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe2301f8030 0x7fe2300c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.956+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2300c6f70 con 0x7fe2301f8030 2024-09-12T02:58:40.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.956+0000 7fe235a00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe2301f8030 0x7fe2300c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.956+0000 7fe235a00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fe2301f8030 0x7fe2300c6a30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:40.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.956+0000 7fe22fe00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe2100678c0 0x7fe210069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe230145020 tx=0x7fe21c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:40.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.956+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2300c6f70 con 0x7fe2301f8030 2024-09-12T02:58:40.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.988+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fe2300c7310 con 0x7fe2301f8030 2024-09-12T02:58:40.994 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.988+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe2300c7310 con 0x7fe2301f8030 2024-09-12T02:58:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.988+0000 7fe236400640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe230141b40 0x7fe2301f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.988+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fe23006dc80 con 0x7fe230141b40 2024-09-12T02:58:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.988+0000 7fe235000640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe230141b40 0x7fe2301f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:40.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.992+0000 7fe235000640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe230141b40 0x7fe2301f4320 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:40.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:40.992+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe23006dc80 con 0x7fe230141b40 2024-09-12T02:58:41.010 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:41.004+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:41.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.020+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fe230141f70 con 0x7fe230141b40 2024-09-12T02:58:41.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.020+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe230141f70 con 0x7fe230141b40 2024-09-12T02:58:41.026 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.024+0000 7fe236400640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe2300626e0 0x7fe230062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.024+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fe230142180 con 0x7fe2300626e0 2024-09-12T02:58:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.024+0000 7fe22fe00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe2300626e0 0x7fe230062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.024+0000 7fe22fe00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fe2300626e0 0x7fe230062b00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.024+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe230142180 con 0x7fe2300626e0 2024-09-12T02:58:41.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.052+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fe230063040 con 0x7fe2300626e0 2024-09-12T02:58:41.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.056+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe230063040 con 0x7fe2300626e0 2024-09-12T02:58:41.058 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:41.059 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:41.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.056+0000 7fe236400640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe2300c9940 0x7fe2300c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.056+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fe2300635b0 con 0x7fe2300c9940 2024-09-12T02:58:41.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.056+0000 7fe235a00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe2300c9940 0x7fe2300c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.056+0000 7fe235a00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fe2300c9940 0x7fe2300c9d80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.056+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2300635b0 con 0x7fe2300c9940 2024-09-12T02:58:41.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.084+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fe23002c650 con 0x7fe2300c9940 2024-09-12T02:58:41.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.088+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe23002c650 con 0x7fe2300c9940 2024-09-12T02:58:41.090 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.088+0000 7fe236400640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe23002cee0 0x7fe23002d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.088+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fe23002d880 con 0x7fe23002cee0 2024-09-12T02:58:41.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.088+0000 7fe235000640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe23002cee0 0x7fe23002d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.088+0000 7fe235000640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fe23002cee0 0x7fe23002d340 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.092+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe23002d880 con 0x7fe23002cee0 2024-09-12T02:58:41.111 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:41.108+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:41.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.116+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fe23002d880 con 0x7fe23002cee0 2024-09-12T02:58:41.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.120+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe23002d880 con 0x7fe23002cee0 2024-09-12T02:58:41.123 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:41.124 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:41.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.120+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=56}) -- 0x7fe23002d880 con 0x7fe2300c8140 2024-09-12T02:58:41.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.120+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe23020b4a0 con 0x7fe2300c8140 2024-09-12T02:58:41.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.120+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe2240f28d0 con 0x7fe2300c8140 2024-09-12T02:58:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T02:58:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.120+0000 7fe236400640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe2302094e0 0x7fe230209930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.120+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7fe23020aff0 con 0x7fe2302094e0 2024-09-12T02:58:41.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.120+0000 7fe22fe00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe2302094e0 0x7fe230209930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.120+0000 7fe22fe00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fe2302094e0 0x7fe230209930 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.124+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe23020aff0 con 0x7fe2302094e0 2024-09-12T02:58:41.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.148+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fe23020b230 con 0x7fe2302094e0 2024-09-12T02:58:41.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.152+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe23020b230 con 0x7fe2302094e0 2024-09-12T02:58:41.157 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:41.157 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:41.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.152+0000 7fe236400640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe23020a380 0x7fe23020a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.152+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7fe23020ace0 con 0x7fe23020a380 2024-09-12T02:58:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.152+0000 7fe235a00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe23020a380 0x7fe23020a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:41.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.156+0000 7fe235a00640 1 --2- 172.21.15.63:0/1788705446 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fe23020a380 0x7fe23020a7a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:41.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.156+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe23020ace0 con 0x7fe23020a380 2024-09-12T02:58:41.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.184+0000 7fe236400640 1 -- 172.21.15.63:0/1788705446 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7fe23020ace0 con 0x7fe23020a380 2024-09-12T02:58:41.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:41.188+0000 7fe22cc00640 1 -- 172.21.15.63:0/1788705446 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fe23020ace0 con 0x7fe23020a380 2024-09-12T02:58:41.191 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:41.191 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:41.203 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T02:58:41.204 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T02:58:41.233 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:41.233 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:41.233 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:41.228+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:41.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:41.312 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:41.310+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:41.413 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:41.408+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:41.514 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:41.508+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:41.540 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:41.541 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:41.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:41.614 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:41.612+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:41.715 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:41.712+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:41.816 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:41.810+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:41.852 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:41.852 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:41.875 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:41.918 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:41.916+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:42.018 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:42.014+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:42.119 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:42.114+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:42.159 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:42.159 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:42.183 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:42.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T02:58:42.234 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:42.232+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:42.237 INFO:teuthology.orchestra.run.smithi119.stdout:get_pg_num_history pg_num_history pg_num_history(e51 pg_nums {1={16=1},2={19=32},3={20=64},4={24=32}} deleted_pools ) 2024-09-12T02:58:42.237 INFO:teuthology.orchestra.run.smithi119.stdout:Importing pgid 3.4 2024-09-12T02:58:42.237 INFO:teuthology.orchestra.run.smithi119.stdout:write_pg epoch 41 info 3.4( empty local-lis/les=40/41 n=0 ec=20/20 lis/c=40/40 les/c/f=41/41/0 sis=40) 2024-09-12T02:58:42.237 INFO:teuthology.orchestra.run.smithi119.stdout:Import successful 2024-09-12T02:58:42.321 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:42.316+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:42.422 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:42.420+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:42.426 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:42.426 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:42.454 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:42.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.468+0000 7fe587200640 1 Processor -- start 2024-09-12T02:58:42.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.468+0000 7fe587200640 1 -- start start 2024-09-12T02:58:42.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.468+0000 7fe587200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe588152850 0x7fe588158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.468+0000 7fe587200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe588070060 con 0x7fe5880c8990 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.468+0000 7fe587200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5880c5140 con 0x7fe5880c8140 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.468+0000 7fe587200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe5880c3190 con 0x7fe588152850 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.472+0000 7fe586800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe5880c8990 0x7fe588162d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:49384/0 (socket says 172.21.15.63:49384) 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.472+0000 7fe586800640 1 -- 172.21.15.63:0/1864991828 learned_addr learned my addr 172.21.15.63:0/1864991828 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.472+0000 7fe585e00640 1 --2- 172.21.15.63:0/1864991828 >> v2:172.21.15.119:3300/0 conn(0x7fe588152850 0x7fe588158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.472+0000 7fe584a00640 1 -- 172.21.15.63:0/1864991828 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94081761 0 0) 0x7fe588070060 con 0x7fe5880c8990 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.472+0000 7fe584a00640 1 -- 172.21.15.63:0/1864991828 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe56c003530 con 0x7fe5880c8990 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.472+0000 7fe585e00640 1 -- 172.21.15.63:0/1864991828 >> v1:172.21.15.119:6789/0 conn(0x7fe5880c8140 legacy=0x7fe5880ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.472+0000 7fe585e00640 1 -- 172.21.15.63:0/1864991828 >> v1:172.21.15.63:6789/0 conn(0x7fe5880c8990 legacy=0x7fe588162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:42.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.472+0000 7fe585e00640 1 -- 172.21.15.63:0/1864991828 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5880c3470 con 0x7fe588152850 2024-09-12T02:58:42.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe585e00640 1 --2- 172.21.15.63:0/1864991828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe588152850 0x7fe588158410 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe5780097c0 tx=0x7fe57801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed1fafe6c22f917e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:42.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe584a00640 1 -- 172.21.15.63:0/1864991828 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780b0070 con 0x7fe588152850 2024-09-12T02:58:42.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe584a00640 1 -- 172.21.15.63:0/1864991828 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5780ab600 con 0x7fe588152850 2024-09-12T02:58:42.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe584a00640 1 -- 172.21.15.63:0/1864991828 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780ab9b0 con 0x7fe588152850 2024-09-12T02:58:42.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe587200640 1 -- 172.21.15.63:0/1864991828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe588152850 msgr2=0x7fe588158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:42.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe587200640 1 --2- 172.21.15.63:0/1864991828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe588152850 0x7fe588158410 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe5780097c0 tx=0x7fe57801c4a0 comp rx=0 tx=0).stop 2024-09-12T02:58:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe587200640 1 -- 172.21.15.63:0/1864991828 shutdown_connections 2024-09-12T02:58:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe587200640 1 --2- 172.21.15.63:0/1864991828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe588152850 0x7fe588158410 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe587200640 1 -- 172.21.15.63:0/1864991828 >> 172.21.15.63:0/1864991828 conn(0x7fe588067a00 msgr2=0x7fe588067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe587200640 1 -- 172.21.15.63:0/1864991828 shutdown_connections 2024-09-12T02:58:42.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.476+0000 7fe587200640 1 -- 172.21.15.63:0/1864991828 wait complete. 2024-09-12T02:58:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.480+0000 7fe587200640 1 Processor -- start 2024-09-12T02:58:42.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.480+0000 7fe587200640 1 -- start start 2024-09-12T02:58:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.480+0000 7fe587200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5880c8140 0x7fe5881f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.480+0000 7fe587200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5880c8990 0x7fe588159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.480+0000 7fe587200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe588152850 0x7fe5880b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:42.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.480+0000 7fe587200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5880ce8d0 con 0x7fe5880c8140 2024-09-12T02:58:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.480+0000 7fe587200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe5880ce750 con 0x7fe5880c8990 2024-09-12T02:58:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.480+0000 7fe587200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe58806fc30 con 0x7fe588152850 2024-09-12T02:58:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5880c8140 0x7fe5881f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5880c8140 0x7fe5881f8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43994/0 (socket says 172.21.15.63:43994) 2024-09-12T02:58:42.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585e00640 1 -- 172.21.15.63:0/1188443358 learned_addr learned my addr 172.21.15.63:0/1188443358 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585400640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5880c8990 0x7fe588159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe586800640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe588152850 0x7fe5880b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585e00640 1 -- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe588152850 msgr2=0x7fe5880b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585e00640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe588152850 0x7fe5880b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585e00640 1 -- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5880c8990 msgr2=0x7fe588159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585e00640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5880c8990 0x7fe588159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585e00640 1 -- 172.21.15.63:0/1188443358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58815a300 con 0x7fe5880c8140 2024-09-12T02:58:42.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe585e00640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5880c8140 0x7fe5881f8160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe5780097c0 tx=0x7fe57801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:42.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe57e000640 1 -- 172.21.15.63:0/1188443358 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780bc070 con 0x7fe5880c8140 2024-09-12T02:58:42.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe57e000640 1 -- 172.21.15.63:0/1188443358 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5780b1040 con 0x7fe5880c8140 2024-09-12T02:58:42.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe57e000640 1 -- 172.21.15.63:0/1188443358 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5780b0050 con 0x7fe5880c8140 2024-09-12T02:58:42.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe588151d30 con 0x7fe5880c8140 2024-09-12T02:58:42.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5881522f0 con 0x7fe5880c8140 2024-09-12T02:58:42.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.484+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe588069870 con 0x7fe5880c8140 2024-09-12T02:58:42.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.488+0000 7fe57e000640 1 -- 172.21.15.63:0/1188443358 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5780bf070 con 0x7fe5880c8140 2024-09-12T02:58:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.488+0000 7fe57e000640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe568067940 0x7fe568069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:42.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.488+0000 7fe57e000640 1 -- 172.21.15.63:0/1188443358 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6685+0+0 (secure 0 0 0) 0x7fe57811fa70 con 0x7fe5880c8140 2024-09-12T02:58:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.488+0000 7fe585400640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe568067940 0x7fe568069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:42.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.492+0000 7fe585400640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe568067940 0x7fe568069e00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe5881643d0 tx=0x7fe574009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:42.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.496+0000 7fe57e000640 1 -- 172.21.15.63:0/1188443358 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe578016090 con 0x7fe5880c8140 2024-09-12T02:58:42.523 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:42.518+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:42.624 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:42.618+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:42.714 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:42.715 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:42.725 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:42.720+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:42.737 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:42.779 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /var/log/ceph/exp.3.4.5 2024-09-12T02:58:42.830 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:42.828+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:42.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:42.852+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7fe5880c56e0 con 0x7fe5880c8140 2024-09-12T02:58:42.927 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:42.922+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:43.020 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:43.020 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:43.027 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:43.022+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:43.043 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:43.129 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:43.122+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:43.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.168+0000 7fe57e000640 1 -- 172.21.15.63:0/1188443358 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v56) ==== 91+0+0 (secure 0 0 0) 0x7fe5780efb70 con 0x7fe5880c8140 2024-09-12T02:58:43.177 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-12T02:58:43.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.172+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe568067940 msgr2=0x7fe568069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:43.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.172+0000 7fe587200640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe568067940 0x7fe568069e00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe5881643d0 tx=0x7fe574009040 comp rx=0 tx=0).stop 2024-09-12T02:58:43.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.172+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5880c8140 msgr2=0x7fe5881f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.172+0000 7fe587200640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5880c8140 0x7fe5881f8160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe5780097c0 tx=0x7fe57801ace0 comp rx=0 tx=0).stop 2024-09-12T02:58:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.176+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 shutdown_connections 2024-09-12T02:58:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.176+0000 7fe587200640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe568067940 0x7fe568069e00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.176+0000 7fe587200640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe588152850 0x7fe5880b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.176+0000 7fe587200640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5880c8990 0x7fe588159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:43.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.176+0000 7fe587200640 1 --2- 172.21.15.63:0/1188443358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5880c8140 0x7fe5881f8160 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:43.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.176+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 >> 172.21.15.63:0/1188443358 conn(0x7fe588067a00 msgr2=0x7fe58806d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:43.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.176+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 shutdown_connections 2024-09-12T02:58:43.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.176+0000 7fe587200640 1 -- 172.21.15.63:0/1188443358 wait complete. 2024-09-12T02:58:43.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:43.262 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:43.260+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:43.331 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:43.328+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:43.333 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:43.333 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:43.357 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:43.432 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:43.430+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:43.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.432+0000 7f9565000640 1 Processor -- start 2024-09-12T02:58:43.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.432+0000 7f9565000640 1 -- start start 2024-09-12T02:58:43.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.432+0000 7f9565000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f95600c9470 0x7f95600ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.432+0000 7f9565000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9560070520 con 0x7f95601517d0 2024-09-12T02:58:43.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.432+0000 7f9565000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95600c9180 con 0x7f95600c9970 2024-09-12T02:58:43.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.432+0000 7f9565000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f956006f6f0 con 0x7f95600c9470 2024-09-12T02:58:43.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.432+0000 7f955de00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f95601517d0 0x7f956015de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56124/0 (socket says 172.21.15.63:56124) 2024-09-12T02:58:43.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.432+0000 7f955de00640 1 -- 172.21.15.63:0/610111509 learned_addr learned my addr 172.21.15.63:0/610111509 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:43.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.432+0000 7f955d400640 1 --2- 172.21.15.63:0/610111509 >> v2:172.21.15.119:3300/0 conn(0x7f95600c9470 0x7f95600ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.436+0000 7f955ca00640 1 -- 172.21.15.63:0/610111509 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4079759994 0 0) 0x7f9560070520 con 0x7f95601517d0 2024-09-12T02:58:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.436+0000 7f955ca00640 1 -- 172.21.15.63:0/610111509 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9544003530 con 0x7f95601517d0 2024-09-12T02:58:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.436+0000 7f955d400640 1 -- 172.21.15.63:0/610111509 >> v1:172.21.15.119:6789/0 conn(0x7f95600c9970 legacy=0x7f9560165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.436+0000 7f955d400640 1 -- 172.21.15.63:0/610111509 >> v1:172.21.15.63:6789/0 conn(0x7f95601517d0 legacy=0x7f956015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:43.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.436+0000 7f955d400640 1 -- 172.21.15.63:0/610111509 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956006ffa0 con 0x7f95600c9470 2024-09-12T02:58:43.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f955d400640 1 --2- 172.21.15.63:0/610111509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95600c9470 0x7f95600ce080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f954c009740 tx=0x7f954c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc63e04690a5f7f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f955ca00640 1 -- 172.21.15.63:0/610111509 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c0b2070 con 0x7f95600c9470 2024-09-12T02:58:43.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f955ca00640 1 -- 172.21.15.63:0/610111509 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954c0ad680 con 0x7f95600c9470 2024-09-12T02:58:43.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f955ca00640 1 -- 172.21.15.63:0/610111509 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c0ada30 con 0x7f95600c9470 2024-09-12T02:58:43.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f9565000640 1 -- 172.21.15.63:0/610111509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95600c9470 msgr2=0x7f95600ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f9565000640 1 --2- 172.21.15.63:0/610111509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95600c9470 0x7f95600ce080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f954c009740 tx=0x7f954c01c360 comp rx=0 tx=0).stop 2024-09-12T02:58:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f9565000640 1 -- 172.21.15.63:0/610111509 shutdown_connections 2024-09-12T02:58:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f9565000640 1 --2- 172.21.15.63:0/610111509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95600c9470 0x7f95600ce080 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f9565000640 1 -- 172.21.15.63:0/610111509 >> 172.21.15.63:0/610111509 conn(0x7f9560067a00 msgr2=0x7f9560067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f9565000640 1 -- 172.21.15.63:0/610111509 shutdown_connections 2024-09-12T02:58:43.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.440+0000 7f9565000640 1 -- 172.21.15.63:0/610111509 wait complete. 2024-09-12T02:58:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.444+0000 7f9565000640 1 Processor -- start 2024-09-12T02:58:43.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.444+0000 7f9565000640 1 -- start start 2024-09-12T02:58:43.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9565000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95600c9470 0x7f956015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9565000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95600c9970 0x7f956015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9565000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95601517d0 0x7f95601587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9565000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9560070240 con 0x7f95601517d0 2024-09-12T02:58:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9565000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f95600c8cf0 con 0x7f95600c9970 2024-09-12T02:58:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9565000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f956006fc00 con 0x7f95600c9470 2024-09-12T02:58:43.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955de00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95600c9470 0x7f956015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955de00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95600c9470 0x7f956015c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:44712/0 (socket says 172.21.15.63:44712) 2024-09-12T02:58:43.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955de00640 1 -- 172.21.15.63:0/3387091948 learned_addr learned my addr 172.21.15.63:0/3387091948 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:43.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955d400640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95600c9970 0x7f956015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955e800640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95601517d0 0x7f95601587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955de00640 1 -- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95600c9970 msgr2=0x7f956015dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955de00640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95600c9970 0x7f956015dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955de00640 1 -- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95601517d0 msgr2=0x7f95601587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955de00640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95601517d0 0x7f95601587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955de00640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95601f0df0 con 0x7f95600c9470 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955d400640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95600c9970 0x7f956015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f955de00640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95600c9470 0x7f956015c7e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f955000c500 tx=0x7f955000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550017070 con 0x7f95600c9470 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9550005cf0 con 0x7f95600c9470 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95500072f0 con 0x7f95600c9470 2024-09-12T02:58:43.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95601f10d0 con 0x7f95600c9470 2024-09-12T02:58:43.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95601567b0 con 0x7f95600c9470 2024-09-12T02:58:43.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.448+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f956006ec50 con 0x7f95600c9470 2024-09-12T02:58:43.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.452+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f955001a070 con 0x7f95600c9470 2024-09-12T02:58:43.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.452+0000 7f9556000640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f95400678c0 0x7f9540069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.452+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(56..56 src has 1..56) ==== 6685+0+0 (secure 0 0 0) 0x7f9550085590 con 0x7f95600c9470 2024-09-12T02:58:43.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.456+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v56) ==== 54+0+16 (secure 0 0 0) 0x7f9550085a20 con 0x7f95600c9470 2024-09-12T02:58:43.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.456+0000 7f955d400640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f95400678c0 0x7f9540069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.456+0000 7f9565000640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f956015e270 0x7f95600cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.456+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f956015d370 con 0x7f956015e270 2024-09-12T02:58:43.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.456+0000 7f955d400640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f95400678c0 0x7f9540069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f954c0af000 tx=0x7f954c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.456+0000 7f955e800640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f956015e270 0x7f95600cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.456+0000 7f955e800640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f956015e270 0x7f95600cd180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.456+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95580080b0 con 0x7f956015e270 2024-09-12T02:58:43.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.488+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f95600c4ed0 con 0x7f956015e270 2024-09-12T02:58:43.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.488+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f95600c4ed0 con 0x7f956015e270 2024-09-12T02:58:43.494 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:43.494 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:43.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.488+0000 7f9565000640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f9560151ca0 0x7f9560150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.488+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f9560151370 con 0x7f9560151ca0 2024-09-12T02:58:43.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.492+0000 7f955de00640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f9560151ca0 0x7f9560150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.492+0000 7f955de00640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f9560151ca0 0x7f9560150e30 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.492+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9560151370 con 0x7f9560151ca0 2024-09-12T02:58:43.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.520+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f956015d8a0 con 0x7f9560151ca0 2024-09-12T02:58:43.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.524+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f956015d8a0 con 0x7f9560151ca0 2024-09-12T02:58:43.527 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:43.528 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:43.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.524+0000 7f9565000640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f95601f4110 0x7f95600626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.524+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f95601f4510 con 0x7f95601f4110 2024-09-12T02:58:43.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.524+0000 7f955d400640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f95601f4110 0x7f95600626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.524+0000 7f955d400640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f95601f4110 0x7f95600626e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.528+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95601f4510 con 0x7f95601f4110 2024-09-12T02:58:43.532 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:43.526+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:43.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.552+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f9560062e70 con 0x7f95601f4110 2024-09-12T02:58:43.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.556+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f9560062e70 con 0x7f95601f4110 2024-09-12T02:58:43.560 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:43.561 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:43.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.556+0000 7f9565000640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f9560063440 0x7f95601e4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.556+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f95601e48c0 con 0x7f9560063440 2024-09-12T02:58:43.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.556+0000 7f955e800640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f9560063440 0x7f95601e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.556+0000 7f955e800640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f9560063440 0x7f95601e4380 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.560+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95601e48c0 con 0x7f9560063440 2024-09-12T02:58:43.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.584+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f95601e4b90 con 0x7f9560063440 2024-09-12T02:58:43.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.588+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f95601e4b90 con 0x7f9560063440 2024-09-12T02:58:43.592 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:43.593 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:43.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.588+0000 7f9565000640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f956002cb60 0x7f956002cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.588+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f95601e4b10 con 0x7f956002cb60 2024-09-12T02:58:43.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.588+0000 7f955de00640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f956002cb60 0x7f956002cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.592+0000 7f955de00640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f956002cb60 0x7f956002cfa0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.592+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95601e4b10 con 0x7f956002cb60 2024-09-12T02:58:43.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.620+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f95601e48c0 con 0x7f956002cb60 2024-09-12T02:58:43.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.624+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f95601e48c0 con 0x7f956002cb60 2024-09-12T02:58:43.627 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.624+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=57}) -- 0x7f95601e4c20 con 0x7f95600c9470 2024-09-12T02:58:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.624+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f956002d4e0 con 0x7f95600c9470 2024-09-12T02:58:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.624+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f9550053760 con 0x7f95600c9470 2024-09-12T02:58:43.629 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T02:58:43.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.624+0000 7f9565000640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f95602050d0 0x7f95602074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.624+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f956002da90 con 0x7f95602050d0 2024-09-12T02:58:43.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.624+0000 7f955d400640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f95602050d0 0x7f95602074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.624+0000 7f955d400640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f95602050d0 0x7f95602074c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.628+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f956002da90 con 0x7f95602050d0 2024-09-12T02:58:43.633 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:43.628+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:43.645 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:43.645 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:43.645 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:43.645 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:43.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.652+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f956002da90 con 0x7f95602050d0 2024-09-12T02:58:43.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.656+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f956002da90 con 0x7f95602050d0 2024-09-12T02:58:43.662 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:43.663 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:43.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.660+0000 7f9565000640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f9560207f10 0x7f956020a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:43.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.660+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f956020d1a0 con 0x7f9560207f10 2024-09-12T02:58:43.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.660+0000 7f955e800640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f9560207f10 0x7f956020a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:43.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.660+0000 7f955e800640 1 --2- 172.21.15.63:0/3387091948 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f9560207f10 0x7f956020a300 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:43.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.660+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f956020d1a0 con 0x7f9560207f10 2024-09-12T02:58:43.668 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:43.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.688+0000 7f9565000640 1 -- 172.21.15.63:0/3387091948 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7f956020d200 con 0x7f9560207f10 2024-09-12T02:58:43.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:43.692+0000 7f9556000640 1 -- 172.21.15.63:0/3387091948 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f956020d200 con 0x7f9560207f10 2024-09-12T02:58:43.697 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:43.697 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:43.708 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T02:58:43.708 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T02:58:43.734 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:43.730+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:43.835 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:43.832+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:43.935 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:43.935 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:43.935 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:43.936 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:43.932+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:43.958 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:44.054 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:44.052+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:44.137 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:44.134+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:44.234 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.379355899000004, 2024-09-12T02:58:44.234 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011663767, 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.235 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853092+0000", 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853098+0000", 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7509999999999997e-06 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853119+0000", 2024-09-12T02:58:44.236 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.075e-05 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853130+0000", 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1396000000000001e-05 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853240+0000", 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109484 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.237 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853398+0000", 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158574 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864754+0000", 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011355568999999999 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:44.238 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.379280261000005, 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065283390000000002, 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:44.239 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853171+0000", 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1860000000000002e-06 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853181+0000", 2024-09-12T02:58:44.240 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0239e-05 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853188+0000", 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0389999999999999e-06 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853287+0000", 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9116000000000004e-05 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.241 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853406+0000", 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011876500000000001 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859694+0000", 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006288348 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.377009068000007, 2024-09-12T02:58:44.242 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031174459999999998, 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.243 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855439+0000", 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-06 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855447+0000", 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1899999999999995e-06 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855460+0000", 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3521e-05 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855469+0000", 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2709999999999992e-06 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855540+0000", 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1112000000000006e-05 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855574+0000", 2024-09-12T02:58:44.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4823999999999997e-05 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858501+0000", 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002926695 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858554+0000", 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3270999999999999e-05 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.376948708, 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030877769999999999, 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855498+0000", 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6199999999999998e-07 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855504+0000", 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7209999999999999e-06 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855512+0000", 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2500000000000006e-06 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855517+0000", 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4079999999999997e-06 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855770+0000", 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025252599999999999 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855787+0000", 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7486000000000002e-05 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858557+0000", 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027699449999999998 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858585+0000", 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7979000000000001e-05 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.374201220000003, 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034578339999999999, 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.251 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858246+0000", 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7199999999999997e-07 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858287+0000", 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106000000000003e-05 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858304+0000", 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7221e-05 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858314+0000", 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3819999999999993e-06 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858531+0000", 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000217538 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858546+0000", 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4518000000000001e-05 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861647+0000", 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031017060000000001 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861703+0000", 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5390999999999999e-05 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:44.255 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.374082465000001, 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006126589, 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858380+0000", 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5491000000000001e-05 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858397+0000", 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7720999999999999e-05 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858404+0000", 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.669e-06 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858743+0000", 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033907799999999998 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858760+0000", 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864447+0000", 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005686895 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864490+0000", 2024-09-12T02:58:44.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3658000000000001e-05 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.374030618000006, 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061037929999999997, 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858416+0000", 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2300000000000002e-07 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858421+0000", 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5319999999999997e-06 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858429+0000", 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8790000000000003e-06 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1599999999999997e-06 2024-09-12T02:58:44.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858911+0000", 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047701999999999998 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858930+0000", 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8189000000000002e-05 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864493+0000", 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055629099999999999 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864519+0000", 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6679999999999999e-05 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:44.264 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.373128092000002, 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052338280000000003, 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859319+0000", 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3099999999999997e-07 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859326+0000", 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0520000000000004e-06 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859345+0000", 2024-09-12T02:58:44.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9466e-05 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859353+0000", 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2009999999999999e-06 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859518+0000", 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000164582 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859536+0000", 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8088999999999999e-05 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864521+0000", 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049850390000000001 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864552+0000", 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0667999999999998e-05 2024-09-12T02:58:44.268 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.373015029000001, 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026944499999999999, 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:44.269 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859432+0000", 2024-09-12T02:58:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.068e-06 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859437+0000", 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3569999999999997e-06 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859457+0000", 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9462000000000001e-05 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.271 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859465+0000", 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3990000000000004e-06 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859578+0000", 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112446 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859700+0000", 2024-09-12T02:58:44.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012271299999999999 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.371841687, 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039558550000000003, 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.273 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860605+0000", 2024-09-12T02:58:44.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3200000000000004e-07 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860613+0000", 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.644e-06 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860632+0000", 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9173000000000001e-05 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860661+0000", 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8589e-05 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860740+0000", 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9216999999999997e-05 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864560+0000", 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038205000000000001 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.276 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.367833341999997, 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014506999999999999, 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864614+0000", 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8599999999999997e-07 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.278 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864617+0000", 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864630+0000", 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2659e-05 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864636+0000", 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7930000000000003e-06 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.279 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864684+0000", 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7926000000000002e-05 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864758+0000", 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4222999999999997e-05 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.280 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.365672860000004, 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075281000000000002, 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866774+0000", 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866779+0000", 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1499999999999998e-06 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866791+0000", 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.238e-05 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866799+0000", 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2559999999999996e-06 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866850+0000", 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1063999999999998e-05 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866862+0000", 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1891e-05 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867492+0000", 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00062994899999999998 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867526+0000", 2024-09-12T02:58:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4372999999999998e-05 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 83.617775555999998, 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001141305, 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.285 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614672+0000", 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4619999999999999e-06 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614684+0000", 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.204e-05 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614703+0000", 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9415e-05 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614713+0000", 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4720000000000001e-06 2024-09-12T02:58:44.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614774+0000", 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1449000000000001e-05 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614790+0000", 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6112000000000001e-05 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615776+0000", 2024-09-12T02:58:44.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098508800000000007 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615812+0000", 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6266999999999997e-05 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 81.861486483999997, 2024-09-12T02:58:44.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001160754, 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370962+0000", 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2529999999999999e-06 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371051+0000", 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9019999999999998e-05 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371086+0000", 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5153e-05 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371103+0000", 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7113999999999999e-05 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371265+0000", 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162063 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371314+0000", 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9110000000000002e-05 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372077+0000", 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000762566 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372120+0000", 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3475e-05 2024-09-12T02:58:44.293 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 80.979672617000006, 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010780609999999999, 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252775+0000", 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:44.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252785+0000", 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9650000000000003e-06 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252802+0000", 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7550999999999998e-05 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252813+0000", 2024-09-12T02:58:44.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0169e-05 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252883+0000", 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0660000000000004e-05 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252910+0000", 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6889999999999998e-05 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253800+0000", 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00088991299999999999 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253852+0000", 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1530000000000003e-05 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.295508777000002, 2024-09-12T02:58:44.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001011966, 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936939+0000", 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936949+0000", 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0395e-05 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936966+0000", 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7173e-05 2024-09-12T02:58:44.300 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936977+0000", 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0557000000000001e-05 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937037+0000", 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9672000000000001e-05 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937056+0000", 2024-09-12T02:58:44.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9338999999999999e-05 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937870+0000", 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081393600000000002 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937949+0000", 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9418000000000004e-05 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 59.294536346999998, 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000793828, 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9100000000000003e-07 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937916+0000", 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7309999999999998e-06 2024-09-12T02:58:44.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937925+0000", 2024-09-12T02:58:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4460000000000001e-06 2024-09-12T02:58:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937934+0000", 2024-09-12T02:58:44.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3039999999999994e-06 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937973+0000", 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9493999999999998e-05 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937984+0000", 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938672+0000", 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00068768500000000005 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938704+0000", 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1664e-05 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:45 2.14 e27/19 2:2e2fa760:::200.00000001:head v 27'12, mlcod=26'10)", 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:44.307 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 56.602679359, 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00181248, 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:44.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.91e-07 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629819+0000", 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1918e-05 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629833+0000", 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3767999999999999e-05 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629844+0000", 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1326e-05 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629933+0000", 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9419999999999994e-05 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629962+0000", 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8314999999999999e-05 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631512+0000", 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015498 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631579+0000", 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7642000000000001e-05 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.311 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:47 2.14 e47/19 2:2e2fa760:::200.00000001:head v 47'13, mlcod=26'11)", 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.923144253, 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001880287, 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309303+0000", 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.544e-06 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309325+0000", 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2031e-05 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309346+0000", 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1049000000000001e-05 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309359+0000", 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2988e-05 2024-09-12T02:58:44.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309439+0000", 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9721999999999993e-05 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309465+0000", 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5884000000000002e-05 2024-09-12T02:58:44.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311130+0000", 2024-09-12T02:58:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001664837 2024-09-12T02:58:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311182+0000", 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2231999999999997e-05 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:48 2.14 e47/19 2:292cf221:::200.00000000:head v 47'14, mlcod=26'11)", 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 23.922010449999998, 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001320122, 2024-09-12T02:58:44.317 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:44.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5300000000000003e-07 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310443+0000", 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7739999999999999e-06 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:44.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310453+0000", 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8970000000000003e-06 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310460+0000", 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8460000000000002e-06 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310554+0000", 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4036999999999994e-05 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310577+0000", 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3462999999999999e-05 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311709+0000", 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011311400000000001 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311756+0000", 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7111999999999999e-05 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.321 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:44.322 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:44.323 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:44.324 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:44.322+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:44.425 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:44.418+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:44.455 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:44.456 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:44.456 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:44.456 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:44.470 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:44.561 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:44.558+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:44.626 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:44.622+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:44.638 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:44.638 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:44.638 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:44.638 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:44.638 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:44.653 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:44.727 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:44.724+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:44.823 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:44.823 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:44.823 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:44.823 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.969974538000002, 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:44.824 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:44.825 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:58:44.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:44.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.828 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.829 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.965213759999997, 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.830 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.831 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:58:44.832 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:44.833 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.965075897999995, 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:44.834 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:58:44.835 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.836 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.837 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:58:44.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.964989781, 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:58:44.839 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:44.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.841 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.842 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.964265948999994, 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:44.843 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.844 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:58:44.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:58:44.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.964107081999998, 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.848 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.849 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:58:44.850 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.852 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.963653464000004, 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:58:44.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:58:44.856 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.960419470000005, 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:44.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:58:44.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:58:44.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPush(2.6 41/40 [PushOp(2:654134d2:::mds0_openfiles.0:head, version: 28'2, data_included: [], data_size: 0, omap_header_size: 42, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:654134d2:::mds0_openfiles.0:head@28'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 39.915036639999997, 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00050712800000000003, 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:44.861 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906694+0000", 2024-09-12T02:58:44.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1620000000000001e-06 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906711+0000", 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6974e-05 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906734+0000", 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3862999999999998e-05 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906757+0000", 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2765e-05 2024-09-12T02:58:44.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906918+0000", 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000160326 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906935+0000", 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7215e-05 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.907200+0000", 2024-09-12T02:58:44.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026482300000000002 2024-09-12T02:58:44.865 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.865 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.865 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.865 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:44.865 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:44.865 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:44.866 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:44.867 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:44.862+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:44.967 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:44.964+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:45.040 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:45.040 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:45.040 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:45.040 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:45.052 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:45.068 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:45.064+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:45.169 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:45.166+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:45.176 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:45.176 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:45.176 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:45.176 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:45.176 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:45.190 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:45.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T02:58:45.270 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:45.268+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:45.356 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:45.356 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:45.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:45.356 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:45.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.501825514999993, 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:45.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:45.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.501692306999999, 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:45.362 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:45.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:45.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:45.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.501587556999993, 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:45.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:45.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.372 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:45.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:45.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.372 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:45.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:45.373 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.501441739000001, 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.377 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:45.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.379 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:45.380 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.501368557000006, 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.381 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:45.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:45.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:45.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.384 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:45.384 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:45.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.384 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:45.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.386 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:45.387 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.501308570999996, 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.388 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:45.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.501246225000003, 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:45.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.397 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.501188709000004, 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.398 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:45.401 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.499021084000006, 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.402 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:45.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.495862568999996, 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.410 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:45.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.488153695999998, 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.412 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:45.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:45.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:45.416 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.416 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:45.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:45.416 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:45.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:45.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:45.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 86.469264745000004, 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:45.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 84.740862938999996, 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.424 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:45.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:45.428 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.429 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 82.985026356999995, 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.430 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:45.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:45.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 82.102937393000005, 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.435 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.436 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:45.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:45.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:45.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:45.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:45.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:45.441 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.418979780000001, 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.442 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:45.445 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:45.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 60.418874488999997, 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.447 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:45.448 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:45.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.451 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.451 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:45.451 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:45.451 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.451 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.451 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.451 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:45.451 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:45.451 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:45.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:45.452 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:45.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:45.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:45.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:45.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:45.454 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 57.726311338999999, 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:45.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:45.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:45.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5447~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.046952792999999, 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003274795, 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.460 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307146+0000", 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.123e-06 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307162+0000", 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5729000000000001e-05 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307197+0000", 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5179999999999999e-05 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307214+0000", 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7295999999999998e-05 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307371+0000", 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000156293 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307532+0000", 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016189399999999999 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307741+0000", 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208493 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.309426+0000", 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016850299999999999 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310212+0000", 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000786494 2024-09-12T02:58:45.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310299+0000", 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6178000000000001e-05 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310418+0000", 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000119085 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 25.046839616, 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037307600000000001, 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307257+0000", 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2699999999999999e-06 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307266+0000", 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2160000000000006e-06 2024-09-12T02:58:45.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307286+0000", 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0537e-05 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307299+0000", 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3297e-05 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308569+0000", 2024-09-12T02:58:45.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001269121 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308706+0000", 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013719099999999999 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308921+0000", 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021543199999999999 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310051+0000", 2024-09-12T02:58:45.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001129901 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310836+0000", 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00078529800000000003 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310922+0000", 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5488000000000005e-05 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310987+0000", 2024-09-12T02:58:45.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5009e-05 2024-09-12T02:58:45.471 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.471 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.471 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.471 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.471 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.471 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:45.473 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:45.474 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:45.466+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:45.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a36a00640 1 Processor -- start 2024-09-12T02:58:45.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a36a00640 1 -- start start 2024-09-12T02:58:45.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a36a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a30152850 0x7f7a30158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:45.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a36a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a300c8140 0x7f7a30070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:45.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a36a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a30070060 con 0x7f7a300c8990 2024-09-12T02:58:45.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a36a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7a300c5140 con 0x7f7a300c8140 2024-09-12T02:58:45.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a36a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7a300c3190 con 0x7f7a30152850 2024-09-12T02:58:45.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a34c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a300c8140 0x7f7a30070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a35600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a30152850 0x7f7a30158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a34c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a300c8140 0x7f7a30070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39070/0 (socket says 172.21.15.63:39070) 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.444+0000 7f7a34c00640 1 -- 172.21.15.63:0/78422209 learned_addr learned my addr 172.21.15.63:0/78422209 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.448+0000 7f7a35600640 1 -- 172.21.15.63:0/78422209 >> v2:172.21.15.63:3300/0 conn(0x7f7a300c8140 msgr2=0x7f7a30070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.448+0000 7f7a35600640 1 --2- 172.21.15.63:0/78422209 >> v2:172.21.15.63:3300/0 conn(0x7f7a300c8140 0x7f7a30070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.448+0000 7f7a35600640 1 -- 172.21.15.63:0/78422209 >> v1:172.21.15.119:6789/0 conn(0x7f7a300c8990 legacy=0x7f7a300ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.448+0000 7f7a35600640 1 -- 172.21.15.63:0/78422209 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a300c3470 con 0x7f7a30152850 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a35600640 1 --2- 172.21.15.63:0/78422209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 0x7f7a30158410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a30070230 tx=0x7f7a2401c2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e67270612c9fc38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a2fe00640 1 -- 172.21.15.63:0/78422209 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240b0070 con 0x7f7a30152850 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a2fe00640 1 -- 172.21.15.63:0/78422209 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a240ab600 con 0x7f7a30152850 2024-09-12T02:58:45.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a2fe00640 1 -- 172.21.15.63:0/78422209 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240ab9d0 con 0x7f7a30152850 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a36a00640 1 -- 172.21.15.63:0/78422209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 msgr2=0x7f7a30158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a36a00640 1 --2- 172.21.15.63:0/78422209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 0x7f7a30158410 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7a30070230 tx=0x7f7a2401c2f0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a36a00640 1 -- 172.21.15.63:0/78422209 shutdown_connections 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a36a00640 1 --2- 172.21.15.63:0/78422209 >> v2:172.21.15.63:3300/0 conn(0x7f7a300c8140 0x7f7a30070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a36a00640 1 --2- 172.21.15.63:0/78422209 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 0x7f7a30158410 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a36a00640 1 -- 172.21.15.63:0/78422209 >> 172.21.15.63:0/78422209 conn(0x7f7a30067a00 msgr2=0x7f7a30067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a36a00640 1 -- 172.21.15.63:0/78422209 shutdown_connections 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.452+0000 7f7a36a00640 1 -- 172.21.15.63:0/78422209 wait complete. 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a36a00640 1 Processor -- start 2024-09-12T02:58:45.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a36a00640 1 -- start start 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a36a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a300c8140 0x7f7a3014ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a36a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a300c8990 0x7f7a30150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a36a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 0x7f7a3014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a36a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3006fdb0 con 0x7f7a300c8140 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a36a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3006fc30 con 0x7f7a30152850 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a36a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7a301655b0 con 0x7f7a300c8990 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a35600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a300c8140 0x7f7a3014ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a35600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a300c8140 0x7f7a3014ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39082/0 (socket says 172.21.15.63:39082) 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a35600640 1 -- 172.21.15.63:0/3695099151 learned_addr learned my addr 172.21.15.63:0/3695099151 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a34c00640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a300c8990 0x7f7a30150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.456+0000 7f7a36000640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 0x7f7a3014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a35600640 1 -- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a300c8990 msgr2=0x7f7a30150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:45.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a35600640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a300c8990 0x7f7a30150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a35600640 1 -- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 msgr2=0x7f7a3014fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a35600640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 0x7f7a3014fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a35600640 1 -- 172.21.15.63:0/3695099151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a300c53f0 con 0x7f7a300c8140 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a36000640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 0x7f7a3014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a35600640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a300c8140 0x7f7a3014ef50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7a24019f20 tx=0x7f7a2401ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a2d600640 1 -- 172.21.15.63:0/3695099151 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240b0050 con 0x7f7a300c8140 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a2d600640 1 -- 172.21.15.63:0/3695099151 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a240bc070 con 0x7f7a300c8140 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a2d600640 1 -- 172.21.15.63:0/3695099151 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240b5830 con 0x7f7a300c8140 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a36a00640 1 -- 172.21.15.63:0/3695099151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3014ce00 con 0x7f7a300c8140 2024-09-12T02:58:45.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a36a00640 1 -- 172.21.15.63:0/3695099151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3014d0a0 con 0x7f7a300c8140 2024-09-12T02:58:45.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.460+0000 7f7a22a00640 1 -- 172.21.15.63:0/3695099151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a30158410 con 0x7f7a300c8140 2024-09-12T02:58:45.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.464+0000 7f7a2d600640 1 -- 172.21.15.63:0/3695099151 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a240b59d0 con 0x7f7a300c8140 2024-09-12T02:58:45.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.464+0000 7f7a2d600640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a100678c0 0x7f7a10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:45.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.464+0000 7f7a2d600640 1 -- 172.21.15.63:0/3695099151 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6685+0+0 (secure 0 0 0) 0x7f7a24120770 con 0x7f7a300c8140 2024-09-12T02:58:45.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.464+0000 7f7a34c00640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a100678c0 0x7f7a10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:45.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.468+0000 7f7a34c00640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a100678c0 0x7f7a10069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a3014ccf0 tx=0x7f7a1c009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:45.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.472+0000 7f7a2d600640 1 -- 172.21.15.63:0/3695099151 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a24015f70 con 0x7f7a300c8140 2024-09-12T02:58:45.573 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:45.568+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:45.645 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:45.645 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:45.645 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:45.659 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:45.674 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:45.672+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:45.710 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:45.775 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:45.772+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:45.781 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:45.781 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:45.781 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:45.781 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:45.781 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:45.796 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:45.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.828+0000 7f7a22a00640 1 -- 172.21.15.63:0/3695099151 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7f7a3014d2e0 con 0x7f7a300c8140 2024-09-12T02:58:45.876 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:45.870+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:45.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.884+0000 7f7a2d600640 1 -- 172.21.15.63:0/3695099151 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v57) ==== 101+0+0 (secure 0 0 0) 0x7f7a240f0ed0 con 0x7f7a300c8140 2024-09-12T02:58:45.888 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-12T02:58:45.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 -- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a100678c0 msgr2=0x7f7a10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:45.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a100678c0 0x7f7a10069d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a3014ccf0 tx=0x7f7a1c009240 comp rx=0 tx=0).stop 2024-09-12T02:58:45.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 -- 172.21.15.63:0/3695099151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a300c8140 msgr2=0x7f7a3014ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:45.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a300c8140 0x7f7a3014ef50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7a24019f20 tx=0x7f7a2401ab30 comp rx=0 tx=0).stop 2024-09-12T02:58:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 -- 172.21.15.63:0/3695099151 shutdown_connections 2024-09-12T02:58:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a30152850 0x7f7a3014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a100678c0 0x7f7a10069d80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a300c8990 0x7f7a30150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 --2- 172.21.15.63:0/3695099151 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a300c8140 0x7f7a3014ef50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 -- 172.21.15.63:0/3695099151 >> 172.21.15.63:0/3695099151 conn(0x7f7a30067a00 msgr2=0x7f7a30157630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 -- 172.21.15.63:0/3695099151 shutdown_connections 2024-09-12T02:58:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.888+0000 7f7a22a00640 1 -- 172.21.15.63:0/3695099151 wait complete. 2024-09-12T02:58:45.927 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:45.927 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:45.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:45.927 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:45.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.927 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.927 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:45.927 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 110.17633583, 2024-09-12T02:58:45.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:45.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:45.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:45.934 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 110.033140492, 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 110.033119966, 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:45.946 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 110.03300915299999, 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.947 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:45.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:45.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:45.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 110.032987627, 2024-09-12T02:58:45.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:45.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:45.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:45.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.968000981, 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.960 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:45.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:45.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:45.966 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.745897458, 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:45.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.969 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.970 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:45.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.972 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.745760467, 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.973 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.974 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:45.975 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.976 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:45.977 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.978 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.979 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.74464326499999, 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.980 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:45.981 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.982 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.983 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:45.984 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.985 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.74457115200001, 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:45.986 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.987 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:45.988 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.989 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.990 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:45.991 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.744347168, 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.992 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:45.993 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.994 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:45.995 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:45.996 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.997 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.744277185, 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:45.998 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:45.999 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:46.000 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:46.001 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.002 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:46.003 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:46.004 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.744171548, 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:46.005 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.006 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:46.007 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:46.008 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:46.009 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.010 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.743981451, 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:46.011 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:46.012 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.013 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:46.014 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:46.015 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:46.016 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.743914664, 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:46.017 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.018 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.020 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:46.021 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:46.022 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.023 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.024 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 109.168565067, 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:46.025 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:46.026 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:46.027 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.028 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:46.029 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.030 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 96.069865633000006, 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:46.031 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:46.033 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:46.034 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.035 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.036 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 96.069780390999995, 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.037 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:46.038 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.039 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:46.040 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.041 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.042 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 96.069643276999997, 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.043 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:46.044 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:46.045 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.046 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:46.047 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 96.069473377999998, 2024-09-12T02:58:46.048 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:46.049 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.050 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.051 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:46.052 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:46.053 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:46.055 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.936+0000 7f2010e00640 1 Processor -- start 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.936+0000 7f2010e00640 1 -- start start 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f2010e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f200c06e0d0 0x7f200c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f2010e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200c1575e0 con 0x7f200c06d2f0 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f2010e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200c1578c0 con 0x7f200c151480 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f2010e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f200c06ce60 con 0x7f200c06e0d0 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f200c06d2f0 0x7f200c06d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56128/0 (socket says 172.21.15.63:56128) 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200be00640 1 -- 172.21.15.63:0/1054839518 learned_addr learned my addr 172.21.15.63:0/1054839518 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200aa00640 1 --2- 172.21.15.63:0/1054839518 >> v2:172.21.15.119:3300/0 conn(0x7f200c06e0d0 0x7f200c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200a000640 1 -- 172.21.15.63:0/1054839518 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142008180 0 0) 0x7f200c1575e0 con 0x7f200c06d2f0 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200a000640 1 -- 172.21.15.63:0/1054839518 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ff0003530 con 0x7f200c06d2f0 2024-09-12T02:58:46.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200a000640 1 -- 172.21.15.63:0/1054839518 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094518673 0 0) 0x7f200c1578c0 con 0x7f200c151480 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200a000640 1 -- 172.21.15.63:0/1054839518 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f200c1575e0 con 0x7f200c151480 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200aa00640 1 -- 172.21.15.63:0/1054839518 >> v1:172.21.15.119:6789/0 conn(0x7f200c151480 legacy=0x7f200c0c2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200aa00640 1 -- 172.21.15.63:0/1054839518 >> v1:172.21.15.63:6789/0 conn(0x7f200c06d2f0 legacy=0x7f200c06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.940+0000 7f200aa00640 1 -- 172.21.15.63:0/1054839518 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c157ba0 con 0x7f200c06e0d0 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f200aa00640 1 --2- 172.21.15.63:0/1054839518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200c06e0d0 0x7f200c070c70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80097c0 tx=0x7f1ff801c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e0d7457f26e0019 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f200a000640 1 -- 172.21.15.63:0/1054839518 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80b0070 con 0x7f200c06e0d0 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f200a000640 1 -- 172.21.15.63:0/1054839518 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff80ab600 con 0x7f200c06e0d0 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f200a000640 1 -- 172.21.15.63:0/1054839518 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80ab9d0 con 0x7f200c06e0d0 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f2010e00640 1 -- 172.21.15.63:0/1054839518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200c06e0d0 msgr2=0x7f200c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f2010e00640 1 --2- 172.21.15.63:0/1054839518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200c06e0d0 0x7f200c070c70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80097c0 tx=0x7f1ff801c4c0 comp rx=0 tx=0).stop 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f2010e00640 1 -- 172.21.15.63:0/1054839518 shutdown_connections 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f2010e00640 1 --2- 172.21.15.63:0/1054839518 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200c06e0d0 0x7f200c070c70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:46.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f2010e00640 1 -- 172.21.15.63:0/1054839518 >> 172.21.15.63:0/1054839518 conn(0x7f200c070180 msgr2=0x7f200c070560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f2010e00640 1 -- 172.21.15.63:0/1054839518 shutdown_connections 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.944+0000 7f2010e00640 1 -- 172.21.15.63:0/1054839518 wait complete. 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.948+0000 7f2010e00640 1 Processor -- start 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.948+0000 7f2010e00640 1 -- start start 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.948+0000 7f2010e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f200c06d2f0 0x7f200c150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.948+0000 7f2010e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200c06e0d0 0x7f200c14be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.948+0000 7f2010e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200c151480 0x7f200c14c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.948+0000 7f2010e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f200c1519e0 con 0x7f200c06d2f0 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.948+0000 7f2010e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f200c151860 con 0x7f200c06e0d0 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.948+0000 7f2010e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f200c0c3130 con 0x7f200c151480 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200c06e0d0 0x7f200c14be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200c06e0d0 0x7f200c14be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:60006/0 (socket says 172.21.15.63:60006) 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200c151480 0x7f200c14c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200aa00640 1 -- 172.21.15.63:0/2411922662 learned_addr learned my addr 172.21.15.63:0/2411922662 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f200c06d2f0 0x7f200c150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200aa00640 1 -- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200c151480 msgr2=0x7f200c14c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200aa00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200c151480 0x7f200c14c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200aa00640 1 -- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f200c06d2f0 msgr2=0x7f200c150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200aa00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f200c06d2f0 0x7f200c150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200aa00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c1f4520 con 0x7f200c06e0d0 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200b400640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f200c06d2f0 0x7f200c150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f200aa00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200c06e0d0 0x7f200c14be80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80190d0 tx=0x7f1ff8019260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80b8020 con 0x7f200c06e0d0 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff80b4410 con 0x7f200c06e0d0 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c1f4800 con 0x7f200c06e0d0 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80b0040 con 0x7f200c06e0d0 2024-09-12T02:58:46.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c073250 con 0x7f200c06e0d0 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.952+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f200c068e40 con 0x7f200c06e0d0 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.956+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ff80bb020 con 0x7f200c06e0d0 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.956+0000 7f2003400640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1fec0678c0 0x7f1fec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.956+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6685+0+0 (secure 0 0 0) 0x7f1ff811ffa0 con 0x7f200c06e0d0 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.956+0000 7f200b400640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1fec0678c0 0x7f1fec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.956+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v57) ==== 54+0+16 (secure 0 0 0) 0x7f1ff80c2030 con 0x7f200c06e0d0 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.960+0000 7f2010e00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f200c14cd20 0x7f200c143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.960+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f200c14d2f0 con 0x7f200c14cd20 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.960+0000 7f200b400640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1fec0678c0 0x7f1fec069d80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc001740 tx=0x7f1ffc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.960+0000 7f200be00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f200c14cd20 0x7f200c143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.960+0000 7f200be00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f200c14cd20 0x7f200c143740 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.964+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f200c14d2f0 con 0x7f200c14cd20 2024-09-12T02:58:46.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.996+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f200c0c74e0 con 0x7f200c14cd20 2024-09-12T02:58:46.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:45.996+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f200c0c74e0 con 0x7f200c14cd20 2024-09-12T02:58:46.064 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:46.065 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:46.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.000+0000 7f2010e00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f200c0cbcf0 0x7f200c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.000+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f200c144190 con 0x7f200c0cbcf0 2024-09-12T02:58:46.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.004+0000 7f200b400640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f200c0cbcf0 0x7f200c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.004+0000 7f200b400640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f200c0cbcf0 0x7f200c0cc0d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.004+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f200c144190 con 0x7f200c0cbcf0 2024-09-12T02:58:46.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.032+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f200c14d540 con 0x7f200c0cbcf0 2024-09-12T02:58:46.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.036+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f200c14d540 con 0x7f200c0cbcf0 2024-09-12T02:58:46.066 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:46.066 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:46.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.036+0000 7f2010e00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f200c0626e0 0x7f200c062ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.036+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f200c0ccb20 con 0x7f200c0626e0 2024-09-12T02:58:46.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.036+0000 7f200aa00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f200c0626e0 0x7f200c062ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.036+0000 7f200aa00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f200c0626e0 0x7f200c062ac0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.036+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f200c0ccb20 con 0x7f200c0626e0 2024-09-12T02:58:46.067 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:46.048+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.064+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f200c0ccb20 con 0x7f200c0626e0 2024-09-12T02:58:46.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.068+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f200c0ccb20 con 0x7f200c0626e0 2024-09-12T02:58:46.071 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.068+0000 7f2010e00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f200c0633c0 0x7f200c14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.068+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f200c0ccb20 con 0x7f200c0633c0 2024-09-12T02:58:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.068+0000 7f200be00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f200c0633c0 0x7f200c14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.068+0000 7f200be00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f200c0633c0 0x7f200c14f1c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.068+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f200c0ccb20 con 0x7f200c0633c0 2024-09-12T02:58:46.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.096+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f200c14f950 con 0x7f200c0633c0 2024-09-12T02:58:46.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.100+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f200c14f950 con 0x7f200c0633c0 2024-09-12T02:58:46.102 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:46.103 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:46.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.100+0000 7f2010e00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f200c02cb60 0x7f200c02cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.100+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f200c0ccb20 con 0x7f200c02cb60 2024-09-12T02:58:46.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.100+0000 7f200b400640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f200c02cb60 0x7f200c02cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.100+0000 7f200b400640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f200c02cb60 0x7f200c02cfc0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.100+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f200c0ccb20 con 0x7f200c02cb60 2024-09-12T02:58:46.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.128+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f200c0ccb20 con 0x7f200c02cb60 2024-09-12T02:58:46.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.132+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f200c0ccb20 con 0x7f200c02cb60 2024-09-12T02:58:46.136 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:46.138 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:46.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.132+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=58}) -- 0x7f200c0ccb20 con 0x7f200c06e0d0 2024-09-12T02:58:46.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.132+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f200c14fb00 con 0x7f200c06e0d0 2024-09-12T02:58:46.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.132+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f1ff80f0700 con 0x7f200c06e0d0 2024-09-12T02:58:46.138 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T02:58:46.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.132+0000 7f2010e00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f200c02d900 0x7f200c207310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.132+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f200c20a160 con 0x7f200c02d900 2024-09-12T02:58:46.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.136+0000 7f200aa00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f200c02d900 0x7f200c207310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.136+0000 7f200aa00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f200c02d900 0x7f200c207310 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.136+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f200c20a160 con 0x7f200c02d900 2024-09-12T02:58:46.155 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:46.152+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:46.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.164+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f200c207b20 con 0x7f200c02d900 2024-09-12T02:58:46.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.168+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f200c207b20 con 0x7f200c02d900 2024-09-12T02:58:46.172 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:46.172 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:46.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.168+0000 7f2010e00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f200c208240 0x7f200c208680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:46.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.168+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f200c20d5b0 con 0x7f200c208240 2024-09-12T02:58:46.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.168+0000 7f200be00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f200c208240 0x7f200c208680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:46.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.168+0000 7f200be00640 1 --2- 172.21.15.63:0/2411922662 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f200c208240 0x7f200c208680 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:46.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.172+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f200c20d5b0 con 0x7f200c208240 2024-09-12T02:58:46.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.196+0000 7f2010e00640 1 -- 172.21.15.63:0/2411922662 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f200c20c3b0 con 0x7f200c208240 2024-09-12T02:58:46.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:46.200+0000 7f2003400640 1 -- 172.21.15.63:0/2411922662 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f200c20c3b0 con 0x7f200c208240 2024-09-12T02:58:46.206 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:46.206 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:46.218 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T02:58:46.219 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T02:58:46.257 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:46.250+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:46.310 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:46.310 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:46.333 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:46.382 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:46.380+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:46.458 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:46.456+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:46.559 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:46.556+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:46.575 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:46.575 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:46.598 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:46.695 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:46.692+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:46.761 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:46.758+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:46.862 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:46.860+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:46.889 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:46.889 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:46.912 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:47.006 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:47.004+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:47.064 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:47.060+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:47.150 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:47.150 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:47.165 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:47.162+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:47.166 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:47.266 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:47.264+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:47.358 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:47.358 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:47.367 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:47.364+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:47.374 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:47.467 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:47.464+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:47.567 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:47.568 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:47.568 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:47.564+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:47.583 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:47.670 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:47.668+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:47.770 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:47.764+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:47.772 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:47.773 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:47.789 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:47.835 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-12T02:58:47.835 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T02:58:47.835 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:58:47.874 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:47.872+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:47.927 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T02:58:47.974 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:47.972+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:47.977 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:47.978 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:47.995 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:48.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.012+0000 7f2ae2800640 1 Processor -- start 2024-09-12T02:58:48.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.012+0000 7f2ae2800640 1 -- start start 2024-09-12T02:58:48.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ae2800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2adc152a70 0x7f2adc158820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ae2800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2adc0c9380 0x7f2adc0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ae2800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 0x7f2adc0c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ae2800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f2adc071590 con 0x7f2adc0c9380 2024-09-12T02:58:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ae2800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2adc158d60 con 0x7f2adc152a70 2024-09-12T02:58:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ae2800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2adc071830 con 0x7f2adc0ced50 2024-09-12T02:58:48.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ad2a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2adc0c9380 0x7f2adc0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ad2a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2adc0c9380 0x7f2adc0c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39102/0 (socket says 172.21.15.63:39102) 2024-09-12T02:58:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ad2a00640 1 -- 172.21.15.63:0/87805468 learned_addr learned my addr 172.21.15.63:0/87805468 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2adbe00640 1 --2- 172.21.15.63:0/87805468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 0x7f2adc0c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2adb400640 1 --2- 172.21.15.63:0/87805468 >> v2:172.21.15.119:3300/0 conn(0x7f2adc152a70 0x7f2adc158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ad2a00640 1 -- 172.21.15.63:0/87805468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 msgr2=0x7f2adc0c36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ad2a00640 1 --2- 172.21.15.63:0/87805468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 0x7f2adc0c36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ad2a00640 1 -- 172.21.15.63:0/87805468 >> v2:172.21.15.119:3300/0 conn(0x7f2adc152a70 msgr2=0x7f2adc158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ad2a00640 1 --2- 172.21.15.63:0/87805468 >> v2:172.21.15.119:3300/0 conn(0x7f2adc152a70 0x7f2adc158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.016+0000 7f2ad2a00640 1 -- 172.21.15.63:0/87805468 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc071b10 con 0x7f2adc0c9380 2024-09-12T02:58:48.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ad2a00640 1 --2- 172.21.15.63:0/87805468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc0c9380 0x7f2adc0c3170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0cbcf0 tx=0x7f2ac401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ea0ae8a13d731f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2adaa00640 1 -- 172.21.15.63:0/87805468 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40b5070 con 0x7f2adc0c9380 2024-09-12T02:58:48.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2adaa00640 1 -- 172.21.15.63:0/87805468 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac40a89d0 con 0x7f2adc0c9380 2024-09-12T02:58:48.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2adaa00640 1 -- 172.21.15.63:0/87805468 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40a8da0 con 0x7f2adc0c9380 2024-09-12T02:58:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 -- 172.21.15.63:0/87805468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc0c9380 msgr2=0x7f2adc0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 --2- 172.21.15.63:0/87805468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc0c9380 0x7f2adc0c3170 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0cbcf0 tx=0x7f2ac401ed10 comp rx=0 tx=0).stop 2024-09-12T02:58:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 -- 172.21.15.63:0/87805468 shutdown_connections 2024-09-12T02:58:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 --2- 172.21.15.63:0/87805468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc0c9380 0x7f2adc0c3170 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 --2- 172.21.15.63:0/87805468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 0x7f2adc0c36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 --2- 172.21.15.63:0/87805468 >> v2:172.21.15.119:3300/0 conn(0x7f2adc152a70 0x7f2adc158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 -- 172.21.15.63:0/87805468 >> 172.21.15.63:0/87805468 conn(0x7f2adc06bcc0 msgr2=0x7f2adc06fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:48.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 -- 172.21.15.63:0/87805468 shutdown_connections 2024-09-12T02:58:48.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 -- 172.21.15.63:0/87805468 wait complete. 2024-09-12T02:58:48.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 Processor -- start 2024-09-12T02:58:48.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.020+0000 7f2ae2800640 1 -- start start 2024-09-12T02:58:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ae2800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc0c9380 0x7f2adc155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ae2800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 0x7f2adc1eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ae2800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc152a70 0x7f2adc14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ae2800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc0ce550 con 0x7f2adc152a70 2024-09-12T02:58:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ae2800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc0ce270 con 0x7f2adc0c9380 2024-09-12T02:58:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ae2800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2adc0ce830 con 0x7f2adc0ced50 2024-09-12T02:58:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc152a70 0x7f2adc14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc152a70 0x7f2adc14e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39110/0 (socket says 172.21.15.63:39110) 2024-09-12T02:58:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adbe00640 1 -- 172.21.15.63:0/3910862986 learned_addr learned my addr 172.21.15.63:0/3910862986 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ad2a00640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 0x7f2adc1eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adb400640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc0c9380 0x7f2adc155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adbe00640 1 -- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 msgr2=0x7f2adc1eedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adbe00640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 0x7f2adc1eedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adbe00640 1 -- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc0c9380 msgr2=0x7f2adc155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adbe00640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc0c9380 0x7f2adc155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adbe00640 1 -- 172.21.15.63:0/3910862986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc14e940 con 0x7f2adc152a70 2024-09-12T02:58:48.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2adbe00640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc152a70 0x7f2adc14e070 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4007d50 tx=0x7f2ad400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ad3e00640 1 -- 172.21.15.63:0/3910862986 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4014420 con 0x7f2adc152a70 2024-09-12T02:58:48.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ad3e00640 1 -- 172.21.15.63:0/3910862986 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad4019070 con 0x7f2adc152a70 2024-09-12T02:58:48.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2adc14e5b0 con 0x7f2adc152a70 2024-09-12T02:58:48.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ad3e00640 1 -- 172.21.15.63:0/3910862986 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4014820 con 0x7f2adc152a70 2024-09-12T02:58:48.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2adc14a060 con 0x7f2adc152a70 2024-09-12T02:58:48.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.024+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2adc06c6d0 con 0x7f2adc152a70 2024-09-12T02:58:48.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.028+0000 7f2ad3e00640 1 -- 172.21.15.63:0/3910862986 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ad40149c0 con 0x7f2adc152a70 2024-09-12T02:58:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.028+0000 7f2ad3e00640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2ab80678c0 0x7f2ab8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.028+0000 7f2ad3e00640 1 -- 172.21.15.63:0/3910862986 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6685+0+0 (secure 0 0 0) 0x7f2ad4086810 con 0x7f2adc152a70 2024-09-12T02:58:48.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.028+0000 7f2adb400640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2ab80678c0 0x7f2ab8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.028+0000 7f2adb400640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2ab80678c0 0x7f2ab8069d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2acc007a60 tx=0x7f2acc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.032+0000 7f2ad3e00640 1 -- 172.21.15.63:0/3910862986 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2ad4056890 con 0x7f2adc152a70 2024-09-12T02:58:48.072 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:48.066+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.072+0000 7fc03a400640 1 Processor -- start 2024-09-12T02:58:48.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.072+0000 7fc03a400640 1 -- start start 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc03a400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc03406ed30 0x7fc0341523d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc03a400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc03406f110 0x7fc034152910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc03a400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03406c6d0 con 0x7fc0340ca820 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc03a400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fc03415cbf0 con 0x7fc03406ed30 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc03a400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc0340c7e50 con 0x7fc03406f110 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc033400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc03406ed30 0x7fc0341523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc033400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc03406ed30 0x7fc0341523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39112/0 (socket says 172.21.15.63:39112) 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc033400640 1 -- 172.21.15.63:0/1017665887 learned_addr learned my addr 172.21.15.63:0/1017665887 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc032a00640 1 --2- 172.21.15.63:0/1017665887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc03406f110 0x7fc034152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc033400640 1 -- 172.21.15.63:0/1017665887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc03406f110 msgr2=0x7fc034152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:48.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc033400640 1 --2- 172.21.15.63:0/1017665887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc03406f110 0x7fc034152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc033400640 1 -- 172.21.15.63:0/1017665887 >> v1:172.21.15.119:6789/0 conn(0x7fc0340ca820 legacy=0x7fc0341587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.076+0000 7fc033400640 1 -- 172.21.15.63:0/1017665887 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03415c630 con 0x7fc03406ed30 2024-09-12T02:58:48.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc033400640 1 --2- 172.21.15.63:0/1017665887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406ed30 0x7fc0341523d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc024009870 tx=0x7fc02401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f118be375a83bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc032000640 1 -- 172.21.15.63:0/1017665887 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0240b2070 con 0x7fc03406ed30 2024-09-12T02:58:48.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc032000640 1 -- 172.21.15.63:0/1017665887 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0240a9070 con 0x7fc03406ed30 2024-09-12T02:58:48.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc032000640 1 -- 172.21.15.63:0/1017665887 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0240ad880 con 0x7fc03406ed30 2024-09-12T02:58:48.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 -- 172.21.15.63:0/1017665887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406ed30 msgr2=0x7fc0341523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 --2- 172.21.15.63:0/1017665887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406ed30 0x7fc0341523d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc024009870 tx=0x7fc02401c560 comp rx=0 tx=0).stop 2024-09-12T02:58:48.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 -- 172.21.15.63:0/1017665887 shutdown_connections 2024-09-12T02:58:48.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 --2- 172.21.15.63:0/1017665887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc03406f110 0x7fc034152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 --2- 172.21.15.63:0/1017665887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406ed30 0x7fc0341523d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 -- 172.21.15.63:0/1017665887 >> 172.21.15.63:0/1017665887 conn(0x7fc034072960 msgr2=0x7fc034072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:48.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 -- 172.21.15.63:0/1017665887 shutdown_connections 2024-09-12T02:58:48.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 -- 172.21.15.63:0/1017665887 wait complete. 2024-09-12T02:58:48.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 Processor -- start 2024-09-12T02:58:48.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.080+0000 7fc03a400640 1 -- start start 2024-09-12T02:58:48.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc03a400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc03406ed30 0x7fc034141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc03a400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406f110 0x7fc0341597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc03a400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0340ca820 0x7fc0341472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc03a400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc0340c4280 con 0x7fc03406f110 2024-09-12T02:58:48.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc03a400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc0340c4100 con 0x7fc03406ed30 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc03a400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc0341657d0 con 0x7fc0340ca820 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc032a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406f110 0x7fc0341597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc032a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406f110 0x7fc0341597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39120/0 (socket says 172.21.15.63:39120) 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc032a00640 1 -- 172.21.15.63:0/1980664193 learned_addr learned my addr 172.21.15.63:0/1980664193 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc033e00640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0340ca820 0x7fc0341472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc033400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc03406ed30 0x7fc034141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc032a00640 1 -- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0340ca820 msgr2=0x7fc0341472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc032a00640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0340ca820 0x7fc0341472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc032a00640 1 -- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc03406ed30 msgr2=0x7fc034141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc032a00640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc03406ed30 0x7fc034141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc032a00640 1 -- 172.21.15.63:0/1980664193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc034158440 con 0x7fc03406f110 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc032a00640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406f110 0x7fc0341597f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc02000d5f0 tx=0x7fc02000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc02b400640 1 -- 172.21.15.63:0/1980664193 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0200125f0 con 0x7fc03406f110 2024-09-12T02:58:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc02b400640 1 -- 172.21.15.63:0/1980664193 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc020019070 con 0x7fc03406f110 2024-09-12T02:58:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03415bae0 con 0x7fc03406f110 2024-09-12T02:58:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc02b400640 1 -- 172.21.15.63:0/1980664193 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0200129d0 con 0x7fc03406f110 2024-09-12T02:58:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc034157860 con 0x7fc03406f110 2024-09-12T02:58:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0341587a0 con 0x7fc03406f110 2024-09-12T02:58:48.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.084+0000 7fc02b400640 1 -- 172.21.15.63:0/1980664193 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc020012b70 con 0x7fc03406f110 2024-09-12T02:58:48.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.088+0000 7fc02b400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0140678f0 0x7fc014069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.088+0000 7fc02b400640 1 -- 172.21.15.63:0/1980664193 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6685+0+0 (secure 0 0 0) 0x7fc020086370 con 0x7fc03406f110 2024-09-12T02:58:48.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.088+0000 7fc033400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0140678f0 0x7fc014069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.088+0000 7fc033400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0140678f0 0x7fc014069db0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc0240af000 tx=0x7fc024008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.092+0000 7fc02b400640 1 -- 172.21.15.63:0/1980664193 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc020056480 con 0x7fc03406f110 2024-09-12T02:58:48.173 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:48.168+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:48.191 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:48.191 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:48.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.200+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2adc152e50 con 0x7f2ab80678c0 2024-09-12T02:58:48.208 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:48.220 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.224+0000 7f2ad3e00640 1 -- 172.21.15.63:0/3910862986 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333509 (secure 0 0 0) 0x7f2adc152e50 con 0x7f2ab80678c0 2024-09-12T02:58:48.231 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:58:48.238 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:58:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.232+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2ab80678c0 msgr2=0x7f2ab8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.232+0000 7f2ae2800640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2ab80678c0 0x7f2ab8069d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2acc007a60 tx=0x7f2acc008040 comp rx=0 tx=0).stop 2024-09-12T02:58:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.232+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc152a70 msgr2=0x7f2adc14e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.232+0000 7f2ae2800640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc152a70 0x7f2adc14e070 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4007d50 tx=0x7f2ad400e4b0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.236+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 shutdown_connections 2024-09-12T02:58:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.236+0000 7f2ae2800640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2adc152a70 0x7f2adc14e070 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.236+0000 7f2ae2800640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2ab80678c0 0x7f2ab8069d80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.236+0000 7f2ae2800640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2adc0ced50 0x7f2adc1eedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.236+0000 7f2ae2800640 1 --2- 172.21.15.63:0/3910862986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2adc0c9380 0x7f2adc155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.236+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 >> 172.21.15.63:0/3910862986 conn(0x7f2adc06bcc0 msgr2=0x7f2adc06fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:48.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.236+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 shutdown_connections 2024-09-12T02:58:48.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.236+0000 7f2ae2800640 1 -- 172.21.15.63:0/3910862986 wait complete. 2024-09-12T02:58:48.272 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-09-12T02:58:47.784209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598954,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":219,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222352,"kb_used_data":6128,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752368,"statfs":{"total":773094113280,"available":772866424832,"internally_reserved":0,"allocated":6275072,"data_stored":3670927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.623275"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180989+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:58:43.180989+0000","last_peered":"2024-09-12T02:58:43.180989+0000","last_clean":"2024-09-12T02:58:43.180989+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:58:43.180989+0000","last_undegraded":"2024-09-12T02:58:43.180989+0000","last_fullsized":"2024-09-12T02:58:43.180989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.167102+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:58:40.167102+0000","last_peered":"2024-09-12T02:58:40.167102+0000","last_clean":"2024-09-12T02:58:40.167102+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:58:40.167102+0000","last_undegraded":"2024-09-12T02:58:40.167102+0000","last_fullsized":"2024-09-12T02:58:40.167102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165574+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:58:40.165574+0000","last_peered":"2024-09-12T02:58:40.165574+0000","last_clean":"2024-09-12T02:58:40.165574+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:58:40.165574+0000","last_undegraded":"2024-09-12T02:58:40.165574+0000","last_fullsized":"2024-09-12T02:58:40.165574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.167197+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:58:40.167197+0000","last_peered":"2024-09-12T02:58:40.167197+0000","last_clean":"2024-09-12T02:58:40.167197+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:58:40.167197+0000","last_undegraded":"2024-09-12T02:58:40.167197+0000","last_fullsized":"2024-09-12T02:58:40.167197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.180628+0000","last_change":"2024-09-12T02:58:35.158357+0000","last_active":"2024-09-12T02:58:43.180628+0000","last_peered":"2024-09-12T02:58:43.180628+0000","last_clean":"2024-09-12T02:58:31.553616+0000","last_became_active":"2024-09-12T02:58:35.158357+0000","last_became_peered":"2024-09-12T02:58:35.158357+0000","last_unstale":"2024-09-12T02:58:43.180628+0000","last_undegraded":"2024-09-12T02:58:43.180628+0000","last_fullsized":"2024-09-12T02:58:35.151301+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:24.962318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":86,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.162986+0000","last_change":"2024-09-12T02:58:04.912028+0000","last_active":"2024-09-12T02:58:40.162986+0000","last_peered":"2024-09-12T02:58:40.162986+0000","last_clean":"2024-09-12T02:58:40.162986+0000","last_became_active":"2024-09-12T02:58:04.910772+0000","last_became_peered":"2024-09-12T02:58:04.910772+0000","last_unstale":"2024-09-12T02:58:40.162986+0000","last_undegraded":"2024-09-12T02:58:40.162986+0000","last_fullsized":"2024-09-12T02:58:40.162986+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:12.643176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,0,3],"acting":[4,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":81,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164925+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:58:40.164925+0000","last_peered":"2024-09-12T02:58:40.164925+0000","last_clean":"2024-09-12T02:58:40.164925+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:58:40.164925+0000","last_undegraded":"2024-09-12T02:58:40.164925+0000","last_fullsized":"2024-09-12T02:58:40.164925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.164524+0000","last_change":"2024-09-12T02:58:35.137624+0000","last_active":"2024-09-12T02:58:40.164524+0000","last_peered":"2024-09-12T02:58:40.164524+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.137624+0000","last_became_peered":"2024-09-12T02:58:35.137624+0000","last_unstale":"2024-09-12T02:58:40.164524+0000","last_undegraded":"2024-09-12T02:58:40.164524+0000","last_fullsized":"2024-09-12T02:58:35.134619+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:32.320604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164390+0000","last_change":"2024-09-12T02:58:04.911785+0000","last_active":"2024-09-12T02:58:40.164390+0000","last_peered":"2024-09-12T02:58:40.164390+0000","last_clean":"2024-09-12T02:58:40.164390+0000","last_became_active":"2024-09-12T02:58:04.910102+0000","last_became_peered":"2024-09-12T02:58:04.910102+0000","last_unstale":"2024-09-12T02:58:40.164390+0000","last_undegraded":"2024-09-12T02:58:40.164390+0000","last_fullsized":"2024-09-12T02:58:40.164390+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:19.453937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":83,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-09-12T02:58:40.164830+0000","last_change":"2024-09-12T02:58:35.133806+0000","last_active":"2024-09-12T02:58:40.164830+0000","last_peered":"2024-09-12T02:58:40.164830+0000","last_clean":"2024-09-12T02:58:31.552590+0000","last_became_active":"2024-09-12T02:58:35.133806+0000","last_became_peered":"2024-09-12T02:58:35.133806+0000","last_unstale":"2024-09-12T02:58:40.164830+0000","last_undegraded":"2024-09-12T02:58:35.131393+0000","last_fullsized":"2024-09-12T02:58:35.131296+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:43.097158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":1}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.163904+0000","last_change":"2024-09-12T02:58:35.135816+0000","last_active":"2024-09-12T02:58:40.163904+0000","last_peered":"2024-09-12T02:58:40.163904+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.135816+0000","last_became_peered":"2024-09-12T02:58:35.135816+0000","last_unstale":"2024-09-12T02:58:40.163904+0000","last_undegraded":"2024-09-12T02:58:40.163904+0000","last_fullsized":"2024-09-12T02:58:35.134234+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:13:59.517274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.163234+0000","last_change":"2024-09-12T02:58:35.165037+0000","last_active":"2024-09-12T02:58:40.163234+0000","last_peered":"2024-09-12T02:58:40.163234+0000","last_clean":"2024-09-12T02:58:31.109116+0000","last_became_active":"2024-09-12T02:58:35.165037+0000","last_became_peered":"2024-09-12T02:58:35.165037+0000","last_unstale":"2024-09-12T02:58:40.163234+0000","last_undegraded":"2024-09-12T02:58:40.163234+0000","last_fullsized":"2024-09-12T02:58:35.132750+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:54.733237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,2147483647],"acting":[4,3,0,2147483647],"avail_no_missing":["4(0)","0(2)","3(1)"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.348464+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:58:40.348464+0000","last_peered":"2024-09-12T02:58:40.348464+0000","last_clean":"2024-09-12T02:58:40.348464+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:58:40.348464+0000","last_undegraded":"2024-09-12T02:58:40.348464+0000","last_fullsized":"2024-09-12T02:58:40.348464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":81,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.163905+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:58:40.163905+0000","last_peered":"2024-09-12T02:58:40.163905+0000","last_clean":"2024-09-12T02:58:40.163905+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:58:40.163905+0000","last_undegraded":"2024-09-12T02:58:40.163905+0000","last_fullsized":"2024-09-12T02:58:40.163905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.163810+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:58:40.163810+0000","last_peered":"2024-09-12T02:58:40.163810+0000","last_clean":"2024-09-12T02:58:40.163810+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:58:40.163810+0000","last_undegraded":"2024-09-12T02:58:40.163810+0000","last_fullsized":"2024-09-12T02:58:40.163810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.166275+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:58:40.166275+0000","last_peered":"2024-09-12T02:58:40.166275+0000","last_clean":"2024-09-12T02:58:40.166275+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:58:40.166275+0000","last_undegraded":"2024-09-12T02:58:40.166275+0000","last_fullsized":"2024-09-12T02:58:40.166275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.166031+0000","last_change":"2024-09-12T02:58:04.908275+0000","last_active":"2024-09-12T02:58:40.166031+0000","last_peered":"2024-09-12T02:58:40.166031+0000","last_clean":"2024-09-12T02:58:40.166031+0000","last_became_active":"2024-09-12T02:58:04.907988+0000","last_became_peered":"2024-09-12T02:58:04.907988+0000","last_unstale":"2024-09-12T02:58:40.166031+0000","last_undegraded":"2024-09-12T02:58:40.166031+0000","last_fullsized":"2024-09-12T02:58:40.166031+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:23.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164164+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:58:40.164164+0000","last_peered":"2024-09-12T02:58:40.164164+0000","last_clean":"2024-09-12T02:58:40.164164+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:58:40.164164+0000","last_undegraded":"2024-09-12T02:58:40.164164+0000","last_fullsized":"2024-09-12T02:58:40.164164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":82,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165304+0000","last_change":"2024-09-12T02:58:04.900619+0000","last_active":"2024-09-12T02:58:40.165304+0000","last_peered":"2024-09-12T02:58:40.165304+0000","last_clean":"2024-09-12T02:58:40.165304+0000","last_became_active":"2024-09-12T02:58:04.900300+0000","last_became_peered":"2024-09-12T02:58:04.900300+0000","last_unstale":"2024-09-12T02:58:40.165304+0000","last_undegraded":"2024-09-12T02:58:40.165304+0000","last_fullsized":"2024-09-12T02:58:40.165304+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:38.826721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":82,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T02:58:45.895492+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:58:45.895492+0000","last_peered":"2024-09-12T02:58:45.895492+0000","last_clean":"2024-09-12T02:58:45.895492+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:58:45.895492+0000","last_undegraded":"2024-09-12T02:58:45.895492+0000","last_fullsized":"2024-09-12T02:58:45.895492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":75,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T02:58:45.896085+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:58:45.896085+0000","last_peered":"2024-09-12T02:58:45.896085+0000","last_clean":"2024-09-12T02:58:45.896085+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:58:45.896085+0000","last_undegraded":"2024-09-12T02:58:45.896085+0000","last_fullsized":"2024-09-12T02:58:45.896085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.163946+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:58:40.163946+0000","last_peered":"2024-09-12T02:58:40.163946+0000","last_clean":"2024-09-12T02:58:40.163946+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:58:40.163946+0000","last_undegraded":"2024-09-12T02:58:40.163946+0000","last_fullsized":"2024-09-12T02:58:40.163946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165802+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:58:40.165802+0000","last_peered":"2024-09-12T02:58:40.165802+0000","last_clean":"2024-09-12T02:58:40.165802+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:58:40.165802+0000","last_undegraded":"2024-09-12T02:58:40.165802+0000","last_fullsized":"2024-09-12T02:58:40.165802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":83,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165448+0000","last_change":"2024-09-12T02:58:35.159883+0000","last_active":"2024-09-12T02:58:40.165448+0000","last_peered":"2024-09-12T02:58:40.165448+0000","last_clean":"2024-09-12T02:58:31.110250+0000","last_became_active":"2024-09-12T02:58:35.159883+0000","last_became_peered":"2024-09-12T02:58:35.159883+0000","last_unstale":"2024-09-12T02:58:40.165448+0000","last_undegraded":"2024-09-12T02:58:40.165448+0000","last_fullsized":"2024-09-12T02:58:35.134649+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:47.323688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2147483647],"acting":[4,3,6,2147483647],"avail_no_missing":["4(0)","3(1)","6(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":83,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180709+0000","last_change":"2024-09-12T02:58:04.910644+0000","last_active":"2024-09-12T02:58:43.180709+0000","last_peered":"2024-09-12T02:58:43.180709+0000","last_clean":"2024-09-12T02:58:43.180709+0000","last_became_active":"2024-09-12T02:58:04.910354+0000","last_became_peered":"2024-09-12T02:58:04.910354+0000","last_unstale":"2024-09-12T02:58:43.180709+0000","last_undegraded":"2024-09-12T02:58:43.180709+0000","last_fullsized":"2024-09-12T02:58:43.180709+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:33.761782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.349622+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:58:40.349622+0000","last_peered":"2024-09-12T02:58:40.349622+0000","last_clean":"2024-09-12T02:58:40.349622+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:58:40.349622+0000","last_undegraded":"2024-09-12T02:58:40.349622+0000","last_fullsized":"2024-09-12T02:58:40.349622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.163270+0000","last_change":"2024-09-12T02:58:35.148450+0000","last_active":"2024-09-12T02:58:40.163270+0000","last_peered":"2024-09-12T02:58:40.163270+0000","last_clean":"2024-09-12T02:58:31.108431+0000","last_became_active":"2024-09-12T02:58:35.148450+0000","last_became_peered":"2024-09-12T02:58:35.148450+0000","last_unstale":"2024-09-12T02:58:40.163270+0000","last_undegraded":"2024-09-12T02:58:40.163270+0000","last_fullsized":"2024-09-12T02:58:35.131493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:34.179585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2147483647,6,7],"acting":[4,2147483647,6,7],"avail_no_missing":["4(0)","6(2)","7(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.167532+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:58:40.167532+0000","last_peered":"2024-09-12T02:58:40.167532+0000","last_clean":"2024-09-12T02:58:40.167532+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:58:40.167532+0000","last_undegraded":"2024-09-12T02:58:40.167532+0000","last_fullsized":"2024-09-12T02:58:40.167532+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"49'4","reported_seq":70,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.349502+0000","last_change":"2024-09-12T02:58:04.914680+0000","last_active":"2024-09-12T02:58:40.349502+0000","last_peered":"2024-09-12T02:58:40.349502+0000","last_clean":"2024-09-12T02:58:40.349502+0000","last_became_active":"2024-09-12T02:58:04.904308+0000","last_became_peered":"2024-09-12T02:58:04.904308+0000","last_unstale":"2024-09-12T02:58:40.349502+0000","last_undegraded":"2024-09-12T02:58:40.349502+0000","last_fullsized":"2024-09-12T02:58:40.349502+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:02.835639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164566+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:58:40.164566+0000","last_peered":"2024-09-12T02:58:40.164566+0000","last_clean":"2024-09-12T02:58:40.164566+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:58:40.164566+0000","last_undegraded":"2024-09-12T02:58:40.164566+0000","last_fullsized":"2024-09-12T02:58:40.164566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.804509+0000","last_change":"2024-09-12T02:58:35.140154+0000","last_active":"2024-09-12T02:58:43.804509+0000","last_peered":"2024-09-12T02:58:43.804509+0000","last_clean":"2024-09-12T02:58:31.108667+0000","last_became_active":"2024-09-12T02:58:35.140154+0000","last_became_peered":"2024-09-12T02:58:35.140154+0000","last_unstale":"2024-09-12T02:58:43.804509+0000","last_undegraded":"2024-09-12T02:58:43.804509+0000","last_fullsized":"2024-09-12T02:58:35.137186+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:13.870330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165731+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:58:40.165731+0000","last_peered":"2024-09-12T02:58:40.165731+0000","last_clean":"2024-09-12T02:58:40.165731+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:58:40.165731+0000","last_undegraded":"2024-09-12T02:58:40.165731+0000","last_fullsized":"2024-09-12T02:58:40.165731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.180573+0000","last_change":"2024-09-12T02:58:35.147997+0000","last_active":"2024-09-12T02:58:43.180573+0000","last_peered":"2024-09-12T02:58:43.180573+0000","last_clean":"2024-09-12T02:58:31.551458+0000","last_became_active":"2024-09-12T02:58:35.147997+0000","last_became_peered":"2024-09-12T02:58:35.147997+0000","last_unstale":"2024-09-12T02:58:43.180573+0000","last_undegraded":"2024-09-12T02:58:43.180573+0000","last_fullsized":"2024-09-12T02:58:35.136012+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:18.168119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2147483647,7,2],"acting":[0,2147483647,7,2],"avail_no_missing":["0(0)","2(3)","7(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.166844+0000","last_change":"2024-09-12T02:58:35.165184+0000","last_active":"2024-09-12T02:58:40.166844+0000","last_peered":"2024-09-12T02:58:40.166844+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.165184+0000","last_became_peered":"2024-09-12T02:58:35.165184+0000","last_unstale":"2024-09-12T02:58:40.166844+0000","last_undegraded":"2024-09-12T02:58:40.166844+0000","last_fullsized":"2024-09-12T02:58:35.156148+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:18.007170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180202+0000","last_change":"2024-09-12T02:58:04.902570+0000","last_active":"2024-09-12T02:58:43.180202+0000","last_peered":"2024-09-12T02:58:43.180202+0000","last_clean":"2024-09-12T02:58:43.180202+0000","last_became_active":"2024-09-12T02:58:04.902287+0000","last_became_peered":"2024-09-12T02:58:04.902287+0000","last_unstale":"2024-09-12T02:58:43.180202+0000","last_undegraded":"2024-09-12T02:58:43.180202+0000","last_fullsized":"2024-09-12T02:58:43.180202+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:31.616979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":44,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165145+0000","last_change":"2024-09-12T02:58:35.150663+0000","last_active":"2024-09-12T02:58:40.165145+0000","last_peered":"2024-09-12T02:58:40.165145+0000","last_clean":"2024-09-12T02:58:31.551043+0000","last_became_active":"2024-09-12T02:58:35.150663+0000","last_became_peered":"2024-09-12T02:58:35.150663+0000","last_unstale":"2024-09-12T02:58:40.165145+0000","last_undegraded":"2024-09-12T02:58:40.165145+0000","last_fullsized":"2024-09-12T02:58:35.130020+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:24.377735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2147483647,4,0],"acting":[7,2147483647,4,0],"avail_no_missing":["7(0)","0(3)","4(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164774+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:58:40.164774+0000","last_peered":"2024-09-12T02:58:40.164774+0000","last_clean":"2024-09-12T02:58:40.164774+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:58:40.164774+0000","last_undegraded":"2024-09-12T02:58:40.164774+0000","last_fullsized":"2024-09-12T02:58:40.164774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T02:58:45.896005+0000","last_change":"2024-09-12T02:58:35.146366+0000","last_active":"2024-09-12T02:58:45.896005+0000","last_peered":"2024-09-12T02:58:45.896005+0000","last_clean":"2024-09-12T02:57:02.759027+0000","last_became_active":"2024-09-12T02:58:35.146366+0000","last_became_peered":"2024-09-12T02:58:35.146366+0000","last_unstale":"2024-09-12T02:58:45.896005+0000","last_undegraded":"2024-09-12T02:58:45.896005+0000","last_fullsized":"2024-09-12T02:58:35.135205+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:20.244256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.164346+0000","last_change":"2024-09-12T02:58:35.146146+0000","last_active":"2024-09-12T02:58:40.164346+0000","last_peered":"2024-09-12T02:58:40.164346+0000","last_clean":"2024-09-12T02:58:02.633483+0000","last_became_active":"2024-09-12T02:58:35.146146+0000","last_became_peered":"2024-09-12T02:58:35.146146+0000","last_unstale":"2024-09-12T02:58:40.164346+0000","last_undegraded":"2024-09-12T02:58:40.164346+0000","last_fullsized":"2024-09-12T02:58:35.131928+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:19.134373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,7,4,6],"acting":[2147483647,7,4,6],"avail_no_missing":["7(1)","4(2)","6(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":80,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T02:58:45.895076+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:58:45.895076+0000","last_peered":"2024-09-12T02:58:45.895076+0000","last_clean":"2024-09-12T02:58:45.895076+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:58:45.895076+0000","last_undegraded":"2024-09-12T02:58:45.895076+0000","last_fullsized":"2024-09-12T02:58:45.895076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.804578+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:58:43.804578+0000","last_peered":"2024-09-12T02:58:43.804578+0000","last_clean":"2024-09-12T02:58:43.804578+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:58:43.804578+0000","last_undegraded":"2024-09-12T02:58:43.804578+0000","last_fullsized":"2024-09-12T02:58:43.804578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":44,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165318+0000","last_change":"2024-09-12T02:58:35.161267+0000","last_active":"2024-09-12T02:58:40.165318+0000","last_peered":"2024-09-12T02:58:40.165318+0000","last_clean":"2024-09-12T02:58:31.553528+0000","last_became_active":"2024-09-12T02:58:35.161267+0000","last_became_peered":"2024-09-12T02:58:35.161267+0000","last_unstale":"2024-09-12T02:58:40.165318+0000","last_undegraded":"2024-09-12T02:58:40.165318+0000","last_fullsized":"2024-09-12T02:58:35.132081+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:41.538629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2147483647,0,3],"acting":[7,2147483647,0,3],"avail_no_missing":["7(0)","0(2)","3(3)"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180092+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:58:43.180092+0000","last_peered":"2024-09-12T02:58:43.180092+0000","last_clean":"2024-09-12T02:58:43.180092+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:58:43.180092+0000","last_undegraded":"2024-09-12T02:58:43.180092+0000","last_fullsized":"2024-09-12T02:58:43.180092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":84,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165879+0000","last_change":"2024-09-12T02:58:04.903530+0000","last_active":"2024-09-12T02:58:40.165879+0000","last_peered":"2024-09-12T02:58:40.165879+0000","last_clean":"2024-09-12T02:58:40.165879+0000","last_became_active":"2024-09-12T02:58:04.902890+0000","last_became_peered":"2024-09-12T02:58:04.902890+0000","last_unstale":"2024-09-12T02:58:40.165879+0000","last_undegraded":"2024-09-12T02:58:40.165879+0000","last_fullsized":"2024-09-12T02:58:40.165879+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:41:14.525948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180505+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:58:43.180505+0000","last_peered":"2024-09-12T02:58:43.180505+0000","last_clean":"2024-09-12T02:58:43.180505+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:58:43.180505+0000","last_undegraded":"2024-09-12T02:58:43.180505+0000","last_fullsized":"2024-09-12T02:58:43.180505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165869+0000","last_change":"2024-09-12T02:58:35.163528+0000","last_active":"2024-09-12T02:58:40.165869+0000","last_peered":"2024-09-12T02:58:40.165869+0000","last_clean":"2024-09-12T02:58:31.550256+0000","last_became_active":"2024-09-12T02:58:35.163528+0000","last_became_peered":"2024-09-12T02:58:35.163528+0000","last_unstale":"2024-09-12T02:58:40.165869+0000","last_undegraded":"2024-09-12T02:58:40.165869+0000","last_fullsized":"2024-09-12T02:58:35.149048+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:24.381032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.804262+0000","last_change":"2024-09-12T02:58:35.140074+0000","last_active":"2024-09-12T02:58:43.804262+0000","last_peered":"2024-09-12T02:58:43.804262+0000","last_clean":"2024-09-12T02:57:02.759027+0000","last_became_active":"2024-09-12T02:58:35.140074+0000","last_became_peered":"2024-09-12T02:58:35.140074+0000","last_unstale":"2024-09-12T02:58:43.804262+0000","last_undegraded":"2024-09-12T02:58:43.804262+0000","last_fullsized":"2024-09-12T02:58:35.136331+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:21.620194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":235,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165947+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:58:40.165947+0000","last_peered":"2024-09-12T02:58:40.165947+0000","last_clean":"2024-09-12T02:58:40.165947+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:58:40.165947+0000","last_undegraded":"2024-09-12T02:58:40.165947+0000","last_fullsized":"2024-09-12T02:58:40.165947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.349069+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:58:40.349069+0000","last_peered":"2024-09-12T02:58:40.349069+0000","last_clean":"2024-09-12T02:58:40.349069+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:58:40.349069+0000","last_undegraded":"2024-09-12T02:58:40.349069+0000","last_fullsized":"2024-09-12T02:58:40.349069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":69,"reported_epoch":57,"state":"active+undersized","last_fresh":"2024-09-12T02:58:45.896192+0000","last_change":"2024-09-12T02:58:35.152301+0000","last_active":"2024-09-12T02:58:45.896192+0000","last_peered":"2024-09-12T02:58:45.896192+0000","last_clean":"2024-09-12T02:58:31.377140+0000","last_became_active":"2024-09-12T02:58:35.152301+0000","last_became_peered":"2024-09-12T02:58:35.152301+0000","last_unstale":"2024-09-12T02:58:45.896192+0000","last_undegraded":"2024-09-12T02:58:45.896192+0000","last_fullsized":"2024-09-12T02:58:35.139274+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:39.085254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":84,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.804514+0000","last_change":"2024-09-12T02:58:35.140541+0000","last_active":"2024-09-12T02:58:43.804514+0000","last_peered":"2024-09-12T02:58:43.804514+0000","last_clean":"2024-09-12T02:58:31.108745+0000","last_became_active":"2024-09-12T02:58:35.140541+0000","last_became_peered":"2024-09-12T02:58:35.140541+0000","last_unstale":"2024-09-12T02:58:43.804514+0000","last_undegraded":"2024-09-12T02:58:43.804514+0000","last_fullsized":"2024-09-12T02:58:35.137412+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:58.619518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":71,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.348465+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:58:40.348465+0000","last_peered":"2024-09-12T02:58:40.348465+0000","last_clean":"2024-09-12T02:58:40.348465+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:58:40.348465+0000","last_undegraded":"2024-09-12T02:58:40.348465+0000","last_fullsized":"2024-09-12T02:58:40.348465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.166753+0000","last_change":"2024-09-12T02:58:35.161669+0000","last_active":"2024-09-12T02:58:40.166753+0000","last_peered":"2024-09-12T02:58:40.166753+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.161669+0000","last_became_peered":"2024-09-12T02:58:35.161669+0000","last_unstale":"2024-09-12T02:58:40.166753+0000","last_undegraded":"2024-09-12T02:58:40.166753+0000","last_fullsized":"2024-09-12T02:58:35.151434+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:46.877421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":83,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T02:58:45.896460+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:58:45.896460+0000","last_peered":"2024-09-12T02:58:45.896460+0000","last_clean":"2024-09-12T02:58:45.896460+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:58:45.896460+0000","last_undegraded":"2024-09-12T02:58:45.896460+0000","last_fullsized":"2024-09-12T02:58:45.896460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.180932+0000","last_change":"2024-09-12T02:58:35.154707+0000","last_active":"2024-09-12T02:58:43.180932+0000","last_peered":"2024-09-12T02:58:43.180932+0000","last_clean":"2024-09-12T02:58:31.551695+0000","last_became_active":"2024-09-12T02:58:35.154707+0000","last_became_peered":"2024-09-12T02:58:35.154707+0000","last_unstale":"2024-09-12T02:58:43.180932+0000","last_undegraded":"2024-09-12T02:58:43.180932+0000","last_fullsized":"2024-09-12T02:58:35.135981+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:00.045309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,2147483647],"acting":[0,1,4,2147483647],"avail_no_missing":["0(0)","1(1)","4(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165194+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:58:40.165194+0000","last_peered":"2024-09-12T02:58:40.165194+0000","last_clean":"2024-09-12T02:58:40.165194+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:58:40.165194+0000","last_undegraded":"2024-09-12T02:58:40.165194+0000","last_fullsized":"2024-09-12T02:58:40.165194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":84,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.804906+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:58:43.804906+0000","last_peered":"2024-09-12T02:58:43.804906+0000","last_clean":"2024-09-12T02:58:43.804906+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:58:43.804906+0000","last_undegraded":"2024-09-12T02:58:43.804906+0000","last_fullsized":"2024-09-12T02:58:43.804906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.162590+0000","last_change":"2024-09-12T02:58:35.145917+0000","last_active":"2024-09-12T02:58:40.162590+0000","last_peered":"2024-09-12T02:58:40.162590+0000","last_clean":"2024-09-12T02:57:07.839778+0000","last_became_active":"2024-09-12T02:58:35.145917+0000","last_became_peered":"2024-09-12T02:58:35.145917+0000","last_unstale":"2024-09-12T02:58:40.162590+0000","last_undegraded":"2024-09-12T02:58:40.162590+0000","last_fullsized":"2024-09-12T02:58:35.131026+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.177909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,4,7,6],"acting":[2147483647,4,7,6],"avail_no_missing":["4(1)","6(3)","7(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164511+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:58:40.164511+0000","last_peered":"2024-09-12T02:58:40.164511+0000","last_clean":"2024-09-12T02:58:40.164511+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:58:40.164511+0000","last_undegraded":"2024-09-12T02:58:40.164511+0000","last_fullsized":"2024-09-12T02:58:40.164511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164186+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:58:40.164186+0000","last_peered":"2024-09-12T02:58:40.164186+0000","last_clean":"2024-09-12T02:58:40.164186+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:58:40.164186+0000","last_undegraded":"2024-09-12T02:58:40.164186+0000","last_fullsized":"2024-09-12T02:58:40.164186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.162951+0000","last_change":"2024-09-12T02:58:04.910740+0000","last_active":"2024-09-12T02:58:40.162951+0000","last_peered":"2024-09-12T02:58:40.162951+0000","last_clean":"2024-09-12T02:58:40.162951+0000","last_became_active":"2024-09-12T02:58:04.910161+0000","last_became_peered":"2024-09-12T02:58:04.910161+0000","last_unstale":"2024-09-12T02:58:40.162951+0000","last_undegraded":"2024-09-12T02:58:40.162951+0000","last_fullsized":"2024-09-12T02:58:40.162951+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:31.485991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165839+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:58:40.165839+0000","last_peered":"2024-09-12T02:58:40.165839+0000","last_clean":"2024-09-12T02:58:40.165839+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:58:40.165839+0000","last_undegraded":"2024-09-12T02:58:40.165839+0000","last_fullsized":"2024-09-12T02:58:40.165839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":105,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.803939+0000","last_change":"2024-09-12T02:58:04.930543+0000","last_active":"2024-09-12T02:58:43.803939+0000","last_peered":"2024-09-12T02:58:43.803939+0000","last_clean":"2024-09-12T02:58:43.803939+0000","last_became_active":"2024-09-12T02:58:04.903386+0000","last_became_peered":"2024-09-12T02:58:04.903386+0000","last_unstale":"2024-09-12T02:58:43.803939+0000","last_undegraded":"2024-09-12T02:58:43.803939+0000","last_fullsized":"2024-09-12T02:58:43.803939+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:12.801139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180790+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:58:43.180790+0000","last_peered":"2024-09-12T02:58:43.180790+0000","last_clean":"2024-09-12T02:58:43.180790+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:58:43.180790+0000","last_undegraded":"2024-09-12T02:58:43.180790+0000","last_fullsized":"2024-09-12T02:58:43.180790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.348442+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:58:40.348442+0000","last_peered":"2024-09-12T02:58:40.348442+0000","last_clean":"2024-09-12T02:58:40.348442+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:58:40.348442+0000","last_undegraded":"2024-09-12T02:58:40.348442+0000","last_fullsized":"2024-09-12T02:58:40.348442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.348531+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:58:40.348531+0000","last_peered":"2024-09-12T02:58:40.348531+0000","last_clean":"2024-09-12T02:58:40.348531+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:58:40.348531+0000","last_undegraded":"2024-09-12T02:58:40.348531+0000","last_fullsized":"2024-09-12T02:58:40.348531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.167414+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:58:40.167414+0000","last_peered":"2024-09-12T02:58:40.167414+0000","last_clean":"2024-09-12T02:58:40.167414+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:58:40.167414+0000","last_undegraded":"2024-09-12T02:58:40.167414+0000","last_fullsized":"2024-09-12T02:58:40.167414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.163697+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:58:40.163697+0000","last_peered":"2024-09-12T02:58:40.163697+0000","last_clean":"2024-09-12T02:58:40.163697+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:58:40.163697+0000","last_undegraded":"2024-09-12T02:58:40.163697+0000","last_fullsized":"2024-09-12T02:58:40.163697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165709+0000","last_change":"2024-09-12T02:58:35.162568+0000","last_active":"2024-09-12T02:58:40.165709+0000","last_peered":"2024-09-12T02:58:40.165709+0000","last_clean":"2024-09-12T02:57:02.759027+0000","last_became_active":"2024-09-12T02:58:35.162568+0000","last_became_peered":"2024-09-12T02:58:35.162568+0000","last_unstale":"2024-09-12T02:58:40.165709+0000","last_undegraded":"2024-09-12T02:58:40.165709+0000","last_fullsized":"2024-09-12T02:58:35.148821+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:55.971737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.166587+0000","last_change":"2024-09-12T02:58:04.909623+0000","last_active":"2024-09-12T02:58:40.166587+0000","last_peered":"2024-09-12T02:58:40.166587+0000","last_clean":"2024-09-12T02:58:40.166587+0000","last_became_active":"2024-09-12T02:58:04.904318+0000","last_became_peered":"2024-09-12T02:58:04.904318+0000","last_unstale":"2024-09-12T02:58:40.166587+0000","last_undegraded":"2024-09-12T02:58:40.166587+0000","last_fullsized":"2024-09-12T02:58:40.166587+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:58.275293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180466+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:58:43.180466+0000","last_peered":"2024-09-12T02:58:43.180466+0000","last_clean":"2024-09-12T02:58:43.180466+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:58:43.180466+0000","last_undegraded":"2024-09-12T02:58:43.180466+0000","last_fullsized":"2024-09-12T02:58:43.180466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.181144+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:58:43.181144+0000","last_peered":"2024-09-12T02:58:43.181144+0000","last_clean":"2024-09-12T02:58:43.181144+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:58:43.181144+0000","last_undegraded":"2024-09-12T02:58:43.181144+0000","last_fullsized":"2024-09-12T02:58:43.181144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.164594+0000","last_change":"2024-09-12T02:58:35.163060+0000","last_active":"2024-09-12T02:58:40.164594+0000","last_peered":"2024-09-12T02:58:40.164594+0000","last_clean":"2024-09-12T02:57:07.839778+0000","last_became_active":"2024-09-12T02:58:35.163060+0000","last_became_peered":"2024-09-12T02:58:35.163060+0000","last_unstale":"2024-09-12T02:58:40.164594+0000","last_undegraded":"2024-09-12T02:58:40.164594+0000","last_fullsized":"2024-09-12T02:58:35.129921+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:23.009020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,7,3,2],"acting":[2147483647,7,3,2],"avail_no_missing":["7(1)","2(3)","3(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164455+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:58:40.164455+0000","last_peered":"2024-09-12T02:58:40.164455+0000","last_clean":"2024-09-12T02:58:40.164455+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:58:40.164455+0000","last_undegraded":"2024-09-12T02:58:40.164455+0000","last_fullsized":"2024-09-12T02:58:40.164455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"47'14","reported_seq":92,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.349127+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:58:40.349127+0000","last_peered":"2024-09-12T02:58:40.349127+0000","last_clean":"2024-09-12T02:58:40.349127+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:58:40.349127+0000","last_undegraded":"2024-09-12T02:58:40.349127+0000","last_fullsized":"2024-09-12T02:58:40.349127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7788,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.180065+0000","last_change":"2024-09-12T02:58:35.150069+0000","last_active":"2024-09-12T02:58:43.180065+0000","last_peered":"2024-09-12T02:58:43.180065+0000","last_clean":"2024-09-12T02:58:31.550955+0000","last_became_active":"2024-09-12T02:58:35.150069+0000","last_became_peered":"2024-09-12T02:58:35.150069+0000","last_unstale":"2024-09-12T02:58:43.180065+0000","last_undegraded":"2024-09-12T02:58:43.180065+0000","last_fullsized":"2024-09-12T02:58:35.137187+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:16.344592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2,2147483647],"acting":[0,6,2,2147483647],"avail_no_missing":["0(0)","2(2)","6(1)"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164430+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:58:40.164430+0000","last_peered":"2024-09-12T02:58:40.164430+0000","last_clean":"2024-09-12T02:58:40.164430+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:58:40.164430+0000","last_undegraded":"2024-09-12T02:58:40.164430+0000","last_fullsized":"2024-09-12T02:58:40.164430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":34,"reported_epoch":56,"state":"active+undersized+degraded","last_fresh":"2024-09-12T02:58:43.180708+0000","last_change":"2024-09-12T02:58:35.158282+0000","last_active":"2024-09-12T02:58:43.180708+0000","last_peered":"2024-09-12T02:58:43.180708+0000","last_clean":"2024-09-12T02:57:08.857905+0000","last_became_active":"2024-09-12T02:58:35.158282+0000","last_became_peered":"2024-09-12T02:58:35.158282+0000","last_unstale":"2024-09-12T02:58:43.180708+0000","last_undegraded":"2024-09-12T02:58:35.150011+0000","last_fullsized":"2024-09-12T02:58:35.149930+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:05.547193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":90,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.164048+0000","last_change":"2024-09-12T02:58:35.161395+0000","last_active":"2024-09-12T02:58:40.164048+0000","last_peered":"2024-09-12T02:58:40.164048+0000","last_clean":"2024-09-12T02:58:31.110514+0000","last_became_active":"2024-09-12T02:58:35.161395+0000","last_became_peered":"2024-09-12T02:58:35.161395+0000","last_unstale":"2024-09-12T02:58:40.164048+0000","last_undegraded":"2024-09-12T02:58:40.164048+0000","last_fullsized":"2024-09-12T02:58:35.132749+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:19.531467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2147483647,6,3],"acting":[4,2147483647,6,3],"avail_no_missing":["4(0)","3(3)","6(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.180867+0000","last_change":"2024-09-12T02:58:35.158583+0000","last_active":"2024-09-12T02:58:43.180867+0000","last_peered":"2024-09-12T02:58:43.180867+0000","last_clean":"2024-09-12T02:58:31.554414+0000","last_became_active":"2024-09-12T02:58:35.158583+0000","last_became_peered":"2024-09-12T02:58:35.158583+0000","last_unstale":"2024-09-12T02:58:43.180867+0000","last_undegraded":"2024-09-12T02:58:43.180867+0000","last_fullsized":"2024-09-12T02:58:35.151644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:22.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.349564+0000","last_change":"2024-09-12T02:58:35.146888+0000","last_active":"2024-09-12T02:58:40.349564+0000","last_peered":"2024-09-12T02:58:40.349564+0000","last_clean":"2024-09-12T02:57:02.759027+0000","last_became_active":"2024-09-12T02:58:35.146888+0000","last_became_peered":"2024-09-12T02:58:35.146888+0000","last_unstale":"2024-09-12T02:58:40.349564+0000","last_undegraded":"2024-09-12T02:58:40.349564+0000","last_fullsized":"2024-09-12T02:58:35.141455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.065824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":83,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165004+0000","last_change":"2024-09-12T02:58:35.155152+0000","last_active":"2024-09-12T02:58:40.165004+0000","last_peered":"2024-09-12T02:58:40.165004+0000","last_clean":"2024-09-12T02:58:31.549857+0000","last_became_active":"2024-09-12T02:58:35.155152+0000","last_became_peered":"2024-09-12T02:58:35.155152+0000","last_unstale":"2024-09-12T02:58:40.165004+0000","last_undegraded":"2024-09-12T02:58:40.165004+0000","last_fullsized":"2024-09-12T02:58:35.141311+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:00.045309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2147483647,6,4],"acting":[3,2147483647,6,4],"avail_no_missing":["3(0)","4(3)","6(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.164291+0000","last_change":"2024-09-12T02:58:35.135818+0000","last_active":"2024-09-12T02:58:40.164291+0000","last_peered":"2024-09-12T02:58:40.164291+0000","last_clean":"2024-09-12T02:57:48.057131+0000","last_became_active":"2024-09-12T02:58:35.135818+0000","last_became_peered":"2024-09-12T02:58:35.135818+0000","last_unstale":"2024-09-12T02:58:40.164291+0000","last_undegraded":"2024-09-12T02:58:40.164291+0000","last_fullsized":"2024-09-12T02:58:35.130143+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:43.251441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":80,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.349384+0000","last_change":"2024-09-12T02:58:35.147529+0000","last_active":"2024-09-12T02:58:40.349384+0000","last_peered":"2024-09-12T02:58:40.349384+0000","last_clean":"2024-09-12T02:58:31.550943+0000","last_became_active":"2024-09-12T02:58:35.147529+0000","last_became_peered":"2024-09-12T02:58:35.147529+0000","last_unstale":"2024-09-12T02:58:40.349384+0000","last_undegraded":"2024-09-12T02:58:40.349384+0000","last_fullsized":"2024-09-12T02:58:35.141720+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:37.818217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165817+0000","last_change":"2024-09-12T02:58:35.159653+0000","last_active":"2024-09-12T02:58:40.165817+0000","last_peered":"2024-09-12T02:58:40.165817+0000","last_clean":"2024-09-12T02:58:31.550703+0000","last_became_active":"2024-09-12T02:58:35.159653+0000","last_became_peered":"2024-09-12T02:58:35.159653+0000","last_unstale":"2024-09-12T02:58:40.165817+0000","last_undegraded":"2024-09-12T02:58:40.165817+0000","last_fullsized":"2024-09-12T02:58:35.144443+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:10.627943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,2147483647],"acting":[3,7,6,2147483647],"avail_no_missing":["3(0)","6(2)","7(1)"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":73,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180393+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:58:43.180393+0000","last_peered":"2024-09-12T02:58:43.180393+0000","last_clean":"2024-09-12T02:58:43.180393+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:58:43.180393+0000","last_undegraded":"2024-09-12T02:58:43.180393+0000","last_fullsized":"2024-09-12T02:58:43.180393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.804201+0000","last_change":"2024-09-12T02:58:04.906224+0000","last_active":"2024-09-12T02:58:43.804201+0000","last_peered":"2024-09-12T02:58:43.804201+0000","last_clean":"2024-09-12T02:58:43.804201+0000","last_became_active":"2024-09-12T02:58:04.905949+0000","last_became_peered":"2024-09-12T02:58:04.905949+0000","last_unstale":"2024-09-12T02:58:43.804201+0000","last_undegraded":"2024-09-12T02:58:43.804201+0000","last_fullsized":"2024-09-12T02:58:43.804201+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:09.079113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":13,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.163103+0000","last_change":"2024-09-12T02:58:35.135680+0000","last_active":"2024-09-12T02:58:40.163103+0000","last_peered":"2024-09-12T02:58:40.163103+0000","last_clean":"2024-09-12T02:57:02.759027+0000","last_became_active":"2024-09-12T02:58:35.135680+0000","last_became_peered":"2024-09-12T02:58:35.135680+0000","last_unstale":"2024-09-12T02:58:40.163103+0000","last_undegraded":"2024-09-12T02:58:40.163103+0000","last_fullsized":"2024-09-12T02:58:35.132497+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:38.076751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":75,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.349299+0000","last_change":"2024-09-12T02:58:35.150499+0000","last_active":"2024-09-12T02:58:40.349299+0000","last_peered":"2024-09-12T02:58:40.349299+0000","last_clean":"2024-09-12T02:58:31.550478+0000","last_became_active":"2024-09-12T02:58:35.150499+0000","last_became_peered":"2024-09-12T02:58:35.150499+0000","last_unstale":"2024-09-12T02:58:40.349299+0000","last_undegraded":"2024-09-12T02:58:40.349299+0000","last_fullsized":"2024-09-12T02:58:35.141309+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.513391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2147483647,1,0],"acting":[6,2147483647,1,0],"avail_no_missing":["6(0)","0(3)","1(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165215+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:58:40.165215+0000","last_peered":"2024-09-12T02:58:40.165215+0000","last_clean":"2024-09-12T02:58:40.165215+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:58:40.165215+0000","last_undegraded":"2024-09-12T02:58:40.165215+0000","last_fullsized":"2024-09-12T02:58:40.165215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.166031+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:58:40.166031+0000","last_peered":"2024-09-12T02:58:40.166031+0000","last_clean":"2024-09-12T02:58:40.166031+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:58:40.166031+0000","last_undegraded":"2024-09-12T02:58:40.166031+0000","last_fullsized":"2024-09-12T02:58:40.166031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":79,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.348816+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:58:40.348816+0000","last_peered":"2024-09-12T02:58:40.348816+0000","last_clean":"2024-09-12T02:58:40.348816+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:58:40.348816+0000","last_undegraded":"2024-09-12T02:58:40.348816+0000","last_fullsized":"2024-09-12T02:58:40.348816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.181055+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:58:43.181055+0000","last_peered":"2024-09-12T02:58:43.181055+0000","last_clean":"2024-09-12T02:58:43.181055+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:58:43.181055+0000","last_undegraded":"2024-09-12T02:58:43.181055+0000","last_fullsized":"2024-09-12T02:58:43.181055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.804280+0000","last_change":"2024-09-12T02:58:35.157224+0000","last_active":"2024-09-12T02:58:43.804280+0000","last_peered":"2024-09-12T02:58:43.804280+0000","last_clean":"2024-09-12T02:58:31.108586+0000","last_became_active":"2024-09-12T02:58:35.157224+0000","last_became_peered":"2024-09-12T02:58:35.157224+0000","last_unstale":"2024-09-12T02:58:43.804280+0000","last_undegraded":"2024-09-12T02:58:43.804280+0000","last_fullsized":"2024-09-12T02:58:35.136745+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:27.108661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,2147483647],"acting":[2,1,3,2147483647],"avail_no_missing":["2(0)","1(1)","3(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":80,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.166396+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:58:40.166396+0000","last_peered":"2024-09-12T02:58:40.166396+0000","last_clean":"2024-09-12T02:58:40.166396+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:58:40.166396+0000","last_undegraded":"2024-09-12T02:58:40.166396+0000","last_fullsized":"2024-09-12T02:58:40.166396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.163643+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:58:40.163643+0000","last_peered":"2024-09-12T02:58:40.163643+0000","last_clean":"2024-09-12T02:58:40.163643+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:58:40.163643+0000","last_undegraded":"2024-09-12T02:58:40.163643+0000","last_fullsized":"2024-09-12T02:58:40.163643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":72,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.166680+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:58:40.166680+0000","last_peered":"2024-09-12T02:58:40.166680+0000","last_clean":"2024-09-12T02:58:40.166680+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:58:40.166680+0000","last_undegraded":"2024-09-12T02:58:40.166680+0000","last_fullsized":"2024-09-12T02:58:40.166680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.348337+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:58:40.348337+0000","last_peered":"2024-09-12T02:58:40.348337+0000","last_clean":"2024-09-12T02:58:40.348337+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:58:40.348337+0000","last_undegraded":"2024-09-12T02:58:40.348337+0000","last_fullsized":"2024-09-12T02:58:40.348337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.804414+0000","last_change":"2024-09-12T02:58:35.138116+0000","last_active":"2024-09-12T02:58:43.804414+0000","last_peered":"2024-09-12T02:58:43.804414+0000","last_clean":"2024-09-12T02:58:31.107937+0000","last_became_active":"2024-09-12T02:58:35.138116+0000","last_became_peered":"2024-09-12T02:58:35.138116+0000","last_unstale":"2024-09-12T02:58:43.804414+0000","last_undegraded":"2024-09-12T02:58:43.804414+0000","last_fullsized":"2024-09-12T02:58:35.135635+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:03.844143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165496+0000","last_change":"2024-09-12T02:58:35.162325+0000","last_active":"2024-09-12T02:58:40.165496+0000","last_peered":"2024-09-12T02:58:40.165496+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.162325+0000","last_became_peered":"2024-09-12T02:58:35.162325+0000","last_unstale":"2024-09-12T02:58:40.165496+0000","last_undegraded":"2024-09-12T02:58:40.165496+0000","last_fullsized":"2024-09-12T02:58:35.147897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:22.146699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180961+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:58:43.180961+0000","last_peered":"2024-09-12T02:58:43.180961+0000","last_clean":"2024-09-12T02:58:43.180961+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:58:43.180961+0000","last_undegraded":"2024-09-12T02:58:43.180961+0000","last_fullsized":"2024-09-12T02:58:43.180961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.166784+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:58:40.166784+0000","last_peered":"2024-09-12T02:58:40.166784+0000","last_clean":"2024-09-12T02:58:40.166784+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:58:40.166784+0000","last_undegraded":"2024-09-12T02:58:40.166784+0000","last_fullsized":"2024-09-12T02:58:40.166784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.166993+0000","last_change":"2024-09-12T02:58:04.899523+0000","last_active":"2024-09-12T02:58:40.166993+0000","last_peered":"2024-09-12T02:58:40.166993+0000","last_clean":"2024-09-12T02:58:40.166993+0000","last_became_active":"2024-09-12T02:58:04.899174+0000","last_became_peered":"2024-09-12T02:58:04.899174+0000","last_unstale":"2024-09-12T02:58:40.166993+0000","last_undegraded":"2024-09-12T02:58:40.166993+0000","last_fullsized":"2024-09-12T02:58:40.166993+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:26.441144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.349383+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:58:40.349383+0000","last_peered":"2024-09-12T02:58:40.349383+0000","last_clean":"2024-09-12T02:58:40.349383+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:58:40.349383+0000","last_undegraded":"2024-09-12T02:58:40.349383+0000","last_fullsized":"2024-09-12T02:58:40.349383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.167463+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:58:40.167463+0000","last_peered":"2024-09-12T02:58:40.167463+0000","last_clean":"2024-09-12T02:58:40.167463+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:58:40.167463+0000","last_undegraded":"2024-09-12T02:58:40.167463+0000","last_fullsized":"2024-09-12T02:58:40.167463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.164675+0000","last_change":"2024-09-12T02:58:35.160496+0000","last_active":"2024-09-12T02:58:40.164675+0000","last_peered":"2024-09-12T02:58:40.164675+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.160496+0000","last_became_peered":"2024-09-12T02:58:35.160496+0000","last_unstale":"2024-09-12T02:58:40.164675+0000","last_undegraded":"2024-09-12T02:58:40.164675+0000","last_fullsized":"2024-09-12T02:58:35.147067+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:24.962318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165666+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:58:40.165666+0000","last_peered":"2024-09-12T02:58:40.165666+0000","last_clean":"2024-09-12T02:58:40.165666+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:58:40.165666+0000","last_undegraded":"2024-09-12T02:58:40.165666+0000","last_fullsized":"2024-09-12T02:58:40.165666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165218+0000","last_change":"2024-09-12T02:58:35.137012+0000","last_active":"2024-09-12T02:58:40.165218+0000","last_peered":"2024-09-12T02:58:40.165218+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.137012+0000","last_became_peered":"2024-09-12T02:58:35.137012+0000","last_unstale":"2024-09-12T02:58:40.165218+0000","last_undegraded":"2024-09-12T02:58:40.165218+0000","last_fullsized":"2024-09-12T02:58:35.130981+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:50.660990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180830+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:58:43.180830+0000","last_peered":"2024-09-12T02:58:43.180830+0000","last_clean":"2024-09-12T02:58:43.180830+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:58:43.180830+0000","last_undegraded":"2024-09-12T02:58:43.180830+0000","last_fullsized":"2024-09-12T02:58:43.180830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":76,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.348999+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:58:40.348999+0000","last_peered":"2024-09-12T02:58:40.348999+0000","last_clean":"2024-09-12T02:58:40.348999+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:58:40.348999+0000","last_undegraded":"2024-09-12T02:58:40.348999+0000","last_fullsized":"2024-09-12T02:58:40.348999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165070+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:58:40.165070+0000","last_peered":"2024-09-12T02:58:40.165070+0000","last_clean":"2024-09-12T02:58:40.165070+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:58:40.165070+0000","last_undegraded":"2024-09-12T02:58:40.165070+0000","last_fullsized":"2024-09-12T02:58:40.165070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":80,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.804929+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:58:43.804929+0000","last_peered":"2024-09-12T02:58:43.804929+0000","last_clean":"2024-09-12T02:58:43.804929+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:58:43.804929+0000","last_undegraded":"2024-09-12T02:58:43.804929+0000","last_fullsized":"2024-09-12T02:58:43.804929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165343+0000","last_change":"2024-09-12T02:58:35.136657+0000","last_active":"2024-09-12T02:58:40.165343+0000","last_peered":"2024-09-12T02:58:40.165343+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.136657+0000","last_became_peered":"2024-09-12T02:58:35.136657+0000","last_unstale":"2024-09-12T02:58:40.165343+0000","last_undegraded":"2024-09-12T02:58:40.165343+0000","last_fullsized":"2024-09-12T02:58:35.132526+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:15.459220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.180493+0000","last_change":"2024-09-12T02:58:35.148650+0000","last_active":"2024-09-12T02:58:43.180493+0000","last_peered":"2024-09-12T02:58:43.180493+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.148650+0000","last_became_peered":"2024-09-12T02:58:35.148650+0000","last_unstale":"2024-09-12T02:58:43.180493+0000","last_undegraded":"2024-09-12T02:58:43.180493+0000","last_fullsized":"2024-09-12T02:58:35.137231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:48.142599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.163643+0000","last_change":"2024-09-12T02:58:35.135501+0000","last_active":"2024-09-12T02:58:40.163643+0000","last_peered":"2024-09-12T02:58:40.163643+0000","last_clean":"2024-09-12T02:58:31.108639+0000","last_became_active":"2024-09-12T02:58:35.135501+0000","last_became_peered":"2024-09-12T02:58:35.135501+0000","last_unstale":"2024-09-12T02:58:40.163643+0000","last_undegraded":"2024-09-12T02:58:40.163643+0000","last_fullsized":"2024-09-12T02:58:35.133667+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:21.252760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180373+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:58:43.180373+0000","last_peered":"2024-09-12T02:58:43.180373+0000","last_clean":"2024-09-12T02:58:43.180373+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:58:43.180373+0000","last_undegraded":"2024-09-12T02:58:43.180373+0000","last_fullsized":"2024-09-12T02:58:43.180373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.166254+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:58:40.166254+0000","last_peered":"2024-09-12T02:58:40.166254+0000","last_clean":"2024-09-12T02:58:40.166254+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:58:40.166254+0000","last_undegraded":"2024-09-12T02:58:40.166254+0000","last_fullsized":"2024-09-12T02:58:40.166254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164327+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:58:40.164327+0000","last_peered":"2024-09-12T02:58:40.164327+0000","last_clean":"2024-09-12T02:58:40.164327+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:58:40.164327+0000","last_undegraded":"2024-09-12T02:58:40.164327+0000","last_fullsized":"2024-09-12T02:58:40.164327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":78,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.349197+0000","last_change":"2024-09-12T02:58:35.146440+0000","last_active":"2024-09-12T02:58:40.349197+0000","last_peered":"2024-09-12T02:58:40.349197+0000","last_clean":"2024-09-12T02:58:31.550324+0000","last_became_active":"2024-09-12T02:58:35.146440+0000","last_became_peered":"2024-09-12T02:58:35.146440+0000","last_unstale":"2024-09-12T02:58:40.349197+0000","last_undegraded":"2024-09-12T02:58:40.349197+0000","last_fullsized":"2024-09-12T02:58:35.140940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:50.422348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":81,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.349320+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:58:40.349320+0000","last_peered":"2024-09-12T02:58:40.349320+0000","last_clean":"2024-09-12T02:58:40.349320+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:58:40.349320+0000","last_undegraded":"2024-09-12T02:58:40.349320+0000","last_fullsized":"2024-09-12T02:58:40.349320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.165114+0000","last_change":"2024-09-12T02:58:35.136003+0000","last_active":"2024-09-12T02:58:40.165114+0000","last_peered":"2024-09-12T02:58:40.165114+0000","last_clean":"2024-09-12T02:58:31.553257+0000","last_became_active":"2024-09-12T02:58:35.136003+0000","last_became_peered":"2024-09-12T02:58:35.136003+0000","last_unstale":"2024-09-12T02:58:40.165114+0000","last_undegraded":"2024-09-12T02:58:40.165114+0000","last_fullsized":"2024-09-12T02:58:35.131657+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:30.107338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":79,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.164846+0000","last_change":"2024-09-12T02:58:35.160709+0000","last_active":"2024-09-12T02:58:40.164846+0000","last_peered":"2024-09-12T02:58:40.164846+0000","last_clean":"2024-09-12T02:58:31.549773+0000","last_became_active":"2024-09-12T02:58:35.160709+0000","last_became_peered":"2024-09-12T02:58:35.160709+0000","last_unstale":"2024-09-12T02:58:40.164846+0000","last_undegraded":"2024-09-12T02:58:40.164846+0000","last_fullsized":"2024-09-12T02:58:35.147320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:22.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.165702+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:58:40.165702+0000","last_peered":"2024-09-12T02:58:40.165702+0000","last_clean":"2024-09-12T02:58:40.165702+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:58:40.165702+0000","last_undegraded":"2024-09-12T02:58:40.165702+0000","last_fullsized":"2024-09-12T02:58:40.165702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":56,"state":"active+undersized","last_fresh":"2024-09-12T02:58:43.180334+0000","last_change":"2024-09-12T02:58:35.150593+0000","last_active":"2024-09-12T02:58:43.180334+0000","last_peered":"2024-09-12T02:58:43.180334+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.150593+0000","last_became_peered":"2024-09-12T02:58:35.150593+0000","last_unstale":"2024-09-12T02:58:43.180334+0000","last_undegraded":"2024-09-12T02:58:43.180334+0000","last_fullsized":"2024-09-12T02:58:35.137732+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:10.464827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.163484+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:58:40.163484+0000","last_peered":"2024-09-12T02:58:40.163484+0000","last_clean":"2024-09-12T02:58:40.163484+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:58:40.163484+0000","last_undegraded":"2024-09-12T02:58:40.163484+0000","last_fullsized":"2024-09-12T02:58:40.163484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-12T02:58:40.166612+0000","last_change":"2024-09-12T02:58:35.161458+0000","last_active":"2024-09-12T02:58:40.166612+0000","last_peered":"2024-09-12T02:58:40.166612+0000","last_clean":"2024-09-12T02:57:03.767531+0000","last_became_active":"2024-09-12T02:58:35.161458+0000","last_became_peered":"2024-09-12T02:58:35.161458+0000","last_unstale":"2024-09-12T02:58:40.166612+0000","last_undegraded":"2024-09-12T02:58:40.166612+0000","last_fullsized":"2024-09-12T02:58:35.151020+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:05.519866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":78,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180925+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:58:43.180925+0000","last_peered":"2024-09-12T02:58:43.180925+0000","last_clean":"2024-09-12T02:58:43.180925+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:58:43.180925+0000","last_undegraded":"2024-09-12T02:58:43.180925+0000","last_fullsized":"2024-09-12T02:58:43.180925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T02:58:43.180621+0000","last_change":"2024-09-12T02:58:04.912670+0000","last_active":"2024-09-12T02:58:43.180621+0000","last_peered":"2024-09-12T02:58:43.180621+0000","last_clean":"2024-09-12T02:58:43.180621+0000","last_became_active":"2024-09-12T02:58:04.912393+0000","last_became_peered":"2024-09-12T02:58:04.912393+0000","last_unstale":"2024-09-12T02:58:43.180621+0000","last_undegraded":"2024-09-12T02:58:43.180621+0000","last_fullsized":"2024-09-12T02:58:43.180621+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:36.583669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":77,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-12T02:58:40.164991+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:58:40.164991+0000","last_peered":"2024-09-12T02:58:40.164991+0000","last_clean":"2024-09-12T02:58:40.164991+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:58:40.164991+0000","last_undegraded":"2024-09-12T02:58:40.164991+0000","last_fullsized":"2024-09-12T02:58:40.164991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":106,"acting":106,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8586,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":17172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":55,"acting":55,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":317053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":316150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1249280,"data_stored":907246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1224704,"data_stored":900215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27656,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":643072,"data_stored":317053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":581632,"data_stored":280714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":309391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":655360,"data_stored":323105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":7788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:58:48.278 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-backfill 2.1c 2024-09-12T02:58:48.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.276+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "noscrub"} v 0) -- 0x7fc0340c3cd0 con 0x7fc03406f110 2024-09-12T02:58:48.280 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:48.276+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:48.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835e00640 1 Processor -- start 2024-09-12T02:58:48.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835e00640 1 -- start start 2024-09-12T02:58:48.380 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:48.376+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:48.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8300cc770 0x7fc8300c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc8300ccb50 0x7fc830158750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8300c3810 0x7fc830152550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fc83015bcc0 con 0x7fc8300c3810 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc8300c62f0 con 0x7fc8300ccb50 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc8300c65d0 con 0x7fc8300cc770 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8300c3810 0x7fc830152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc834a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8300cc770 0x7fc8300c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc8300c3810 0x7fc830152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39126/0 (socket says 172.21.15.63:39126) 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835400640 1 -- 172.21.15.63:0/1753464775 learned_addr learned my addr 172.21.15.63:0/1753464775 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc82fe00640 1 --2- 172.21.15.63:0/1753464775 >> v2:172.21.15.119:3300/0 conn(0x7fc8300ccb50 0x7fc830158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835400640 1 -- 172.21.15.63:0/1753464775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8300cc770 msgr2=0x7fc8300c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835400640 1 --2- 172.21.15.63:0/1753464775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8300cc770 0x7fc8300c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835400640 1 -- 172.21.15.63:0/1753464775 >> v2:172.21.15.119:3300/0 conn(0x7fc8300ccb50 msgr2=0x7fc830158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:48.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835400640 1 --2- 172.21.15.63:0/1753464775 >> v2:172.21.15.119:3300/0 conn(0x7fc8300ccb50 0x7fc830158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc835400640 1 -- 172.21.15.63:0/1753464775 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83015bf10 con 0x7fc8300c3810 2024-09-12T02:58:48.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.376+0000 7fc82fe00640 1 --2- 172.21.15.63:0/1753464775 >> v2:172.21.15.119:3300/0 conn(0x7fc8300ccb50 0x7fc830158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:48.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835400640 1 --2- 172.21.15.63:0/1753464775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8300c3810 0x7fc830152550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc830068e90 tx=0x7fc82801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb4dfbaf0c7b7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc82f400640 1 -- 172.21.15.63:0/1753464775 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a5760 con 0x7fc8300c3810 2024-09-12T02:58:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc82f400640 1 -- 172.21.15.63:0/1753464775 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8280a5900 con 0x7fc8300c3810 2024-09-12T02:58:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc82f400640 1 -- 172.21.15.63:0/1753464775 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8280a5cd0 con 0x7fc8300c3810 2024-09-12T02:58:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 -- 172.21.15.63:0/1753464775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8300c3810 msgr2=0x7fc830152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 --2- 172.21.15.63:0/1753464775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8300c3810 0x7fc830152550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc830068e90 tx=0x7fc82801c9f0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 -- 172.21.15.63:0/1753464775 shutdown_connections 2024-09-12T02:58:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 --2- 172.21.15.63:0/1753464775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8300c3810 0x7fc830152550 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 --2- 172.21.15.63:0/1753464775 >> v2:172.21.15.119:3300/0 conn(0x7fc8300ccb50 0x7fc830158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 --2- 172.21.15.63:0/1753464775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8300cc770 0x7fc8300c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 -- 172.21.15.63:0/1753464775 >> 172.21.15.63:0/1753464775 conn(0x7fc83006be90 msgr2=0x7fc83006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:48.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 -- 172.21.15.63:0/1753464775 shutdown_connections 2024-09-12T02:58:48.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 -- 172.21.15.63:0/1753464775 wait complete. 2024-09-12T02:58:48.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 Processor -- start 2024-09-12T02:58:48.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.384+0000 7fc835e00640 1 -- start start 2024-09-12T02:58:48.390 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:48.390 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8300c3810 0x7fc8300cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8300cc770 0x7fc830157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8300ccb50 0x7fc8300c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc83015c9f0 con 0x7fc8300c3810 2024-09-12T02:58:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc830158c90 con 0x7fc8300ccb50 2024-09-12T02:58:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc8300cb960 con 0x7fc8300cc770 2024-09-12T02:58:48.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc834a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8300c3810 0x7fc8300cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc834a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8300c3810 0x7fc8300cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39140/0 (socket says 172.21.15.63:39140) 2024-09-12T02:58:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc834a00640 1 -- 172.21.15.63:0/1536445575 learned_addr learned my addr 172.21.15.63:0/1536445575 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc82fe00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8300cc770 0x7fc830157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835400640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8300ccb50 0x7fc8300c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc834a00640 1 -- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8300cc770 msgr2=0x7fc830157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc834a00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc8300cc770 0x7fc830157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc834a00640 1 -- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8300ccb50 msgr2=0x7fc8300c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc834a00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc8300ccb50 0x7fc8300c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc834a00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8300c1c20 con 0x7fc8300c3810 2024-09-12T02:58:48.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc834a00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8300c3810 0x7fc8300cb420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc82400e900 tx=0x7fc82400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824017070 con 0x7fc8300c3810 2024-09-12T02:58:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82400ca00 con 0x7fc8300c3810 2024-09-12T02:58:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8300c1920 con 0x7fc8300c3810 2024-09-12T02:58:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82400cdd0 con 0x7fc8300c3810 2024-09-12T02:58:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8300cc070 con 0x7fc8300c3810 2024-09-12T02:58:48.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.388+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fc8300c71c0 con 0x7fc8300c3810 2024-09-12T02:58:48.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.392+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc82401a070 con 0x7fc8300c3810 2024-09-12T02:58:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.392+0000 7fc82cc00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc8100678c0 0x7fc810069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.392+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6685+0+0 (secure 0 0 0) 0x7fc824086120 con 0x7fc8300c3810 2024-09-12T02:58:48.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.392+0000 7fc82fe00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc8100678c0 0x7fc810069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.392+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v57) ==== 54+0+16 (secure 0 0 0) 0x7fc8300c1920 con 0x7fc8300c3810 2024-09-12T02:58:48.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.392+0000 7fc835e00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fc8300c0170 0x7fc8300c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.396+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc83015cb70 con 0x7fc8300c0170 2024-09-12T02:58:48.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.396+0000 7fc835400640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fc8300c0170 0x7fc8300c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.396+0000 7fc82fe00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc8100678c0 0x7fc810069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc8300c4920 tx=0x7fc81c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.396+0000 7fc835400640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fc8300c0170 0x7fc8300c28f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.396+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc83015cb70 con 0x7fc8300c0170 2024-09-12T02:58:48.410 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:48.417 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.412+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fc830150080 con 0x7fc8300c0170 2024-09-12T02:58:48.421 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:48.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.416+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc830150080 con 0x7fc8300c0170 2024-09-12T02:58:48.421 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:48.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.416+0000 7fc835e00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fc830146b90 0x7fc830146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.416+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fc83006c480 con 0x7fc830146b90 2024-09-12T02:58:48.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.416+0000 7fc834a00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fc830146b90 0x7fc830146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.416+0000 7fc834a00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fc830146b90 0x7fc830146fb0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.416+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc83006c480 con 0x7fc830146b90 2024-09-12T02:58:48.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f2411600640 1 Processor -- start 2024-09-12T02:58:48.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f2411600640 1 -- start start 2024-09-12T02:58:48.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f2411600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c154a40 0x7f240c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f2411600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240c0cbdc0 con 0x7f240c0c8660 2024-09-12T02:58:48.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f2411600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f240c067aa0 con 0x7f240c06eb30 2024-09-12T02:58:48.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f2411600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f240c0cc200 con 0x7f240c154a40 2024-09-12T02:58:48.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f240a000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f240c0c8660 0x7f240c06ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56138/0 (socket says 172.21.15.63:56138) 2024-09-12T02:58:48.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f240a000640 1 -- 172.21.15.63:0/2326031647 learned_addr learned my addr 172.21.15.63:0/2326031647 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:48.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f240aa00640 1 --2- 172.21.15.63:0/2326031647 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c154a40 0x7f240c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f2409600640 1 -- 172.21.15.63:0/2326031647 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470507615 0 0) 0x7f240c0cbdc0 con 0x7f240c0c8660 2024-09-12T02:58:48.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f2409600640 1 -- 172.21.15.63:0/2326031647 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23f0003530 con 0x7f240c0c8660 2024-09-12T02:58:48.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.432+0000 7f240aa00640 1 -- 172.21.15.63:0/2326031647 >> v1:172.21.15.119:6789/0 conn(0x7f240c06eb30 legacy=0x7f240c165290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.436+0000 7f2409600640 1 -- 172.21.15.63:0/2326031647 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656546128 0 0) 0x7f240c067aa0 con 0x7f240c06eb30 2024-09-12T02:58:48.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.436+0000 7f240aa00640 1 -- 172.21.15.63:0/2326031647 >> v1:172.21.15.63:6789/0 conn(0x7f240c0c8660 legacy=0x7f240c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.436+0000 7f240aa00640 1 -- 172.21.15.63:0/2326031647 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c067d80 con 0x7f240c154a40 2024-09-12T02:58:48.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fc830157c70 con 0x7fc830146b90 2024-09-12T02:58:48.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f240aa00640 1 --2- 172.21.15.63:0/2326031647 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c154a40 0x7f240c15a910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0097f0 tx=0x7f23fc01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b0f284653fe77c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2409600640 1 -- 172.21.15.63:0/2326031647 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0ab5f0 con 0x7f240c154a40 2024-09-12T02:58:48.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2409600640 1 -- 172.21.15.63:0/2326031647 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc0b0070 con 0x7f240c154a40 2024-09-12T02:58:48.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2409600640 1 -- 172.21.15.63:0/2326031647 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0ab990 con 0x7f240c154a40 2024-09-12T02:58:48.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2411600640 1 -- 172.21.15.63:0/2326031647 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c154a40 msgr2=0x7f240c15a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2411600640 1 --2- 172.21.15.63:0/2326031647 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c154a40 0x7f240c15a910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0097f0 tx=0x7f23fc01c4e0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2411600640 1 -- 172.21.15.63:0/2326031647 shutdown_connections 2024-09-12T02:58:48.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2411600640 1 --2- 172.21.15.63:0/2326031647 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c154a40 0x7f240c15a910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2411600640 1 -- 172.21.15.63:0/2326031647 >> 172.21.15.63:0/2326031647 conn(0x7f240c06dcb0 msgr2=0x7f240c06e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:48.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2411600640 1 -- 172.21.15.63:0/2326031647 shutdown_connections 2024-09-12T02:58:48.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7f2411600640 1 -- 172.21.15.63:0/2326031647 wait complete. 2024-09-12T02:58:48.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc830157c70 con 0x7fc830146b90 2024-09-12T02:58:48.445 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:48.446 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:48.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7fc835e00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fc8300ca820 0x7fc8300cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fc83014ad80 con 0x7fc8300ca820 2024-09-12T02:58:48.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.440+0000 7fc82fe00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fc8300ca820 0x7fc8300cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 Processor -- start 2024-09-12T02:58:48.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 -- start start 2024-09-12T02:58:48.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7fc82fe00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fc8300ca820 0x7fc8300cac40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c06eb30 0x7f240c0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f240c154a40 0x7f240c1f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f240c0c61d0 0x7f240c14a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f240c0c3a20 con 0x7f240c154a40 2024-09-12T02:58:48.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f240c0c38a0 con 0x7f240c0c61d0 2024-09-12T02:58:48.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f240c06d3e0 con 0x7f240c06eb30 2024-09-12T02:58:48.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f240c154a40 0x7f240c1f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f240c154a40 0x7f240c1f6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39144/0 (socket says 172.21.15.63:39144) 2024-09-12T02:58:48.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240a000640 1 -- 172.21.15.63:0/1097848559 learned_addr learned my addr 172.21.15.63:0/1097848559 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:48.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240aa00640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c06eb30 0x7f240c0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc83014ad80 con 0x7fc8300ca820 2024-09-12T02:58:48.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240b400640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f240c0c61d0 0x7f240c14a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240a000640 1 -- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c06eb30 msgr2=0x7f240c0ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240a000640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c06eb30 0x7f240c0ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240a000640 1 -- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f240c0c61d0 msgr2=0x7f240c14a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240a000640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f240c0c61d0 0x7f240c14a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240a000640 1 -- 172.21.15.63:0/1097848559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c1f4310 con 0x7f240c154a40 2024-09-12T02:58:48.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f240a000640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f240c154a40 0x7f240c1f6b40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c410 tx=0x7f23f800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2402a00640 1 -- 172.21.15.63:0/1097848559 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8017070 con 0x7f240c154a40 2024-09-12T02:58:48.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2402a00640 1 -- 172.21.15.63:0/1097848559 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f8005cf0 con 0x7f240c154a40 2024-09-12T02:58:48.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2402a00640 1 -- 172.21.15.63:0/1097848559 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f80072d0 con 0x7f240c154a40 2024-09-12T02:58:48.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c14bee0 con 0x7f240c154a40 2024-09-12T02:58:48.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.444+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c158170 con 0x7f240c154a40 2024-09-12T02:58:48.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.448+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240c067aa0 con 0x7f240c154a40 2024-09-12T02:58:48.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.448+0000 7f2402a00640 1 -- 172.21.15.63:0/1097848559 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23f801a070 con 0x7f240c154a40 2024-09-12T02:58:48.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.448+0000 7f2402a00640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f23ec0678c0 0x7f23ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.448+0000 7f2402a00640 1 -- 172.21.15.63:0/1097848559 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6685+0+0 (secure 0 0 0) 0x7f23f8085390 con 0x7f240c154a40 2024-09-12T02:58:48.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.448+0000 7f240aa00640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f23ec0678c0 0x7f23ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.452+0000 7f240aa00640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f23ec0678c0 0x7f23ec069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0af000 tx=0x7f23fc0a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.460+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fc83014b290 con 0x7fc8300ca820 2024-09-12T02:58:48.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.460+0000 7f2402a00640 1 -- 172.21.15.63:0/1097848559 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f23f8055420 con 0x7f240c154a40 2024-09-12T02:58:48.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.460+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc83014b290 con 0x7fc8300ca820 2024-09-12T02:58:48.465 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:48.466 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:48.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.460+0000 7fc835e00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fc8300626e0 0x7fc830062b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.460+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fc830063060 con 0x7fc8300626e0 2024-09-12T02:58:48.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.460+0000 7fc835400640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fc8300626e0 0x7fc830062b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.464+0000 7fc835400640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fc8300626e0 0x7fc830062b20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.464+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc830063060 con 0x7fc8300626e0 2024-09-12T02:58:48.481 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:48.474+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:48.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.476+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fc830063530 con 0x7fc8300626e0 2024-09-12T02:58:48.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.480+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc830063530 con 0x7fc8300626e0 2024-09-12T02:58:48.483 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:48.483 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:48.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.480+0000 7fc835e00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fc83002cb60 0x7fc83002cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.480+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fc830063530 con 0x7fc83002cb60 2024-09-12T02:58:48.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.480+0000 7fc834a00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fc83002cb60 0x7fc83002cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.480+0000 7fc834a00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fc83002cb60 0x7fc83002cf80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.480+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc830063530 con 0x7fc83002cb60 2024-09-12T02:58:48.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.508+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fc830063530 con 0x7fc83002cb60 2024-09-12T02:58:48.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.512+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc830063530 con 0x7fc83002cb60 2024-09-12T02:58:48.518 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:48.518 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:48.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.512+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=58}) -- 0x7fc830063060 con 0x7fc8300c3810 2024-09-12T02:58:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.512+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc830063530 con 0x7fc8300c3810 2024-09-12T02:58:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.516+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fc824021040 con 0x7fc8300c3810 2024-09-12T02:58:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T02:58:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.516+0000 7fc835e00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fc83002d8c0 0x7fc83020a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.516+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7fc83020d260 con 0x7fc83002d8c0 2024-09-12T02:58:48.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.516+0000 7fc82fe00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fc83002d8c0 0x7fc83020a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.516+0000 7fc82fe00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fc83002d8c0 0x7fc83020a490 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.516+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc83020d260 con 0x7fc83002d8c0 2024-09-12T02:58:48.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.544+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fc83020aa50 con 0x7fc83002d8c0 2024-09-12T02:58:48.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.548+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc83020aa50 con 0x7fc83002d8c0 2024-09-12T02:58:48.553 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:48.554 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:48.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.548+0000 7fc835e00640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fc83020b170 0x7fc83020b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:48.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.548+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7fc830210600 con 0x7fc83020b170 2024-09-12T02:58:48.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.548+0000 7fc835400640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fc83020b170 0x7fc83020b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:48.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.552+0000 7fc835400640 1 --2- 172.21.15.63:0/1536445575 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fc83020b170 0x7fc83020b5f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:48.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.552+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc830210600 con 0x7fc83020b170 2024-09-12T02:58:48.574 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:48.574 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:48.574 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:48.574 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:48.575 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:48.581 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:48.578+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:48.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.580+0000 7fc835e00640 1 -- 172.21.15.63:0/1536445575 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fc83020bcc0 con 0x7fc83020b170 2024-09-12T02:58:48.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.584+0000 7fc82cc00640 1 -- 172.21.15.63:0/1536445575 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fc83020bcc0 con 0x7fc83020b170 2024-09-12T02:58:48.588 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:48.588 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:48.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:48.594 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T02:58:48.595 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T02:58:48.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.668+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg force-backfill", "pgid": ["2.1c"], "target": ["mon-mgr", ""]}) -- 0x7f240c06e910 con 0x7f23ec0678c0 2024-09-12T02:58:48.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.668+0000 7f2402a00640 1 -- 172.21.15.63:0/1097848559 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructing pg(s) [2.1c] on osd.7 to force-backfill; 2024-09-12T02:58:48.673 INFO:teuthology.orchestra.run.smithi063.stderr:) ==== 62+0+0 (secure 0 0 0) 0x7f240c06e910 con 0x7f23ec0678c0 2024-09-12T02:58:48.673 INFO:teuthology.orchestra.run.smithi063.stderr:instructing pg(s) [2.1c] on osd.7 to force-backfill; 2024-09-12T02:58:48.673 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T02:58:48.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f23ec0678c0 msgr2=0x7f23ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f23ec0678c0 0x7f23ec069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0af000 tx=0x7f23fc0a7000 comp rx=0 tx=0).stop 2024-09-12T02:58:48.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f240c154a40 msgr2=0x7f240c1f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f240c154a40 0x7f240c1f6b40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f23f800c410 tx=0x7f23f800c8d0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 shutdown_connections 2024-09-12T02:58:48.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f240c0c61d0 0x7f240c14a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f240c154a40 0x7f240c1f6b40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f23ec0678c0 0x7f23ec069d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 --2- 172.21.15.63:0/1097848559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f240c06eb30 0x7f240c0ca8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 >> 172.21.15.63:0/1097848559 conn(0x7f240c06dcb0 msgr2=0x7f240c14f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:48.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 shutdown_connections 2024-09-12T02:58:48.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.672+0000 7f2411600640 1 -- 172.21.15.63:0/1097848559 wait complete. 2024-09-12T02:58:48.681 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:48.678+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:48.783 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:48.780+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:48.786 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:48.786 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:48.786 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.932287122999995, 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011663767, 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.787 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853092+0000", 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.788 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853098+0000", 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7509999999999997e-06 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853119+0000", 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.075e-05 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853130+0000", 2024-09-12T02:58:48.789 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1396000000000001e-05 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853240+0000", 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109484 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853398+0000", 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158574 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.790 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864754+0000", 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011355568999999999 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.932211484999996, 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065283390000000002, 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:48.791 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.792 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853171+0000", 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1860000000000002e-06 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853181+0000", 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0239e-05 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.793 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853188+0000", 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0389999999999999e-06 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853287+0000", 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9116000000000004e-05 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853406+0000", 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011876500000000001 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.794 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859694+0000", 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006288348 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.929940291999998, 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031174459999999998, 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.796 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855439+0000", 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-06 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855447+0000", 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1899999999999995e-06 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855460+0000", 2024-09-12T02:58:48.797 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3521e-05 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855469+0000", 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2709999999999992e-06 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855540+0000", 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1112000000000006e-05 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.798 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855574+0000", 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4823999999999997e-05 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858501+0000", 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002926695 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858554+0000", 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3270999999999999e-05 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.799 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.929879932000006, 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030877769999999999, 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.800 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855498+0000", 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6199999999999998e-07 2024-09-12T02:58:48.801 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855504+0000", 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7209999999999999e-06 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855512+0000", 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2500000000000006e-06 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855517+0000", 2024-09-12T02:58:48.802 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4079999999999997e-06 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855770+0000", 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025252599999999999 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855787+0000", 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7486000000000002e-05 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.803 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858557+0000", 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027699449999999998 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858585+0000", 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7979000000000001e-05 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.804 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.927132443999994, 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034578339999999999, 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.805 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858246+0000", 2024-09-12T02:58:48.806 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7199999999999997e-07 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858287+0000", 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106000000000003e-05 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858304+0000", 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7221e-05 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.807 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858314+0000", 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3819999999999993e-06 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858531+0000", 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000217538 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858546+0000", 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4518000000000001e-05 2024-09-12T02:58:48.808 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861647+0000", 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031017060000000001 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861703+0000", 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5390999999999999e-05 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.809 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.927013689000006, 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006126589, 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:48.810 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858380+0000", 2024-09-12T02:58:48.811 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5491000000000001e-05 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858397+0000", 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7720999999999999e-05 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858404+0000", 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.669e-06 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.812 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858743+0000", 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033907799999999998 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858760+0000", 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864447+0000", 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005686895 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.813 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864490+0000", 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3658000000000001e-05 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.926961841999997, 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061037929999999997, 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.814 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.815 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858416+0000", 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2300000000000002e-07 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858421+0000", 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5319999999999997e-06 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858429+0000", 2024-09-12T02:58:48.816 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8790000000000003e-06 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1599999999999997e-06 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858911+0000", 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047701999999999998 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.817 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858930+0000", 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8189000000000002e-05 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864493+0000", 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055629099999999999 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864519+0000", 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6679999999999999e-05 2024-09-12T02:58:48.818 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.926059316000007, 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052338280000000003, 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.819 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859319+0000", 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3099999999999997e-07 2024-09-12T02:58:48.820 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859326+0000", 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0520000000000004e-06 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859345+0000", 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9466e-05 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.821 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859353+0000", 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2009999999999999e-06 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859518+0000", 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000164582 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859536+0000", 2024-09-12T02:58:48.822 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8088999999999999e-05 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864521+0000", 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049850390000000001 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864552+0000", 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0667999999999998e-05 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1e epoch 25/19 rep_tid 0 lcod 25'1)", 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.925946253000006, 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026944499999999999, 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.824 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859431+0000", 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859432+0000", 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.068e-06 2024-09-12T02:58:48.825 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859437+0000", 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3569999999999997e-06 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859457+0000", 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9462000000000001e-05 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.826 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859465+0000", 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3990000000000004e-06 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859578+0000", 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112446 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859700+0000", 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012271299999999999 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.827 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.924772911000005, 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039558550000000003, 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.828 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860605+0000", 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3200000000000004e-07 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.829 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860613+0000", 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.644e-06 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860632+0000", 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9173000000000001e-05 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860661+0000", 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8589e-05 2024-09-12T02:58:48.830 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860740+0000", 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9216999999999997e-05 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864560+0000", 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038205000000000001 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.831 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing_reply(2.1b epoch 25/19 rep_tid 1 lcod 25'1)", 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.920764566000003, 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014506999999999999, 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.832 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864613+0000", 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864614+0000", 2024-09-12T02:58:48.833 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8599999999999997e-07 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864617+0000", 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6830000000000001e-06 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864630+0000", 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2659e-05 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.834 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864636+0000", 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7930000000000003e-06 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864684+0000", 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7926000000000002e-05 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864758+0000", 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4222999999999997e-05 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.835 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:38 2.14 e25/19 2:2e2fa760:::200.00000001:head v 25'6, mlcod=25'4)", 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 98.918604083999995, 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00075281000000000002, 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.836 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866773+0000", 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866774+0000", 2024-09-12T02:58:48.837 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866779+0000", 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1499999999999998e-06 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866791+0000", 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.238e-05 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.838 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866799+0000", 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2559999999999996e-06 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866850+0000", 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1063999999999998e-05 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.866862+0000", 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1891e-05 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.839 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867492+0000", 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00062994899999999998 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.867526+0000", 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4372999999999998e-05 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.840 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 88.170706780000003, 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001141305, 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.841 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614672+0000", 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4619999999999999e-06 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614684+0000", 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.204e-05 2024-09-12T02:58:48.842 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614703+0000", 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9415e-05 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614713+0000", 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4720000000000001e-06 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.843 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614774+0000", 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1449000000000001e-05 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614790+0000", 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6112000000000001e-05 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615776+0000", 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098508800000000007 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.844 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615812+0000", 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6266999999999997e-05 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 86.414417708000002, 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001160754, 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.845 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.846 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370962+0000", 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2529999999999999e-06 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371051+0000", 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9019999999999998e-05 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371086+0000", 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5153e-05 2024-09-12T02:58:48.847 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371103+0000", 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7113999999999999e-05 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371265+0000", 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162063 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.848 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371314+0000", 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9110000000000002e-05 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372077+0000", 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000762566 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372120+0000", 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3475e-05 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.849 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 85.532603840999997, 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010780609999999999, 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.850 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252775+0000", 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.851 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252785+0000", 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9650000000000003e-06 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252802+0000", 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7550999999999998e-05 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252813+0000", 2024-09-12T02:58:48.852 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0169e-05 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252883+0000", 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0660000000000004e-05 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252910+0000", 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6889999999999998e-05 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.853 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253800+0000", 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00088991299999999999 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253852+0000", 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1530000000000003e-05 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.848440001, 2024-09-12T02:58:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001011966, 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:48.855 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936939+0000", 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936949+0000", 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0395e-05 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936966+0000", 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7173e-05 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936977+0000", 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0557000000000001e-05 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937037+0000", 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9672000000000001e-05 2024-09-12T02:58:48.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937056+0000", 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9338999999999999e-05 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937870+0000", 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081393600000000002 2024-09-12T02:58:48.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937949+0000", 2024-09-12T02:58:48.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9418000000000004e-05 2024-09-12T02:58:48.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.859 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.859 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.860 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:44 2.14 e26/19 2:292cf221:::200.00000000:head v 26'11, mlcod=26'8)", 2024-09-12T02:58:48.860 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:48.860 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 63.847467571000003, 2024-09-12T02:58:48.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000793828, 2024-09-12T02:58:48.860 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937910+0000", 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9100000000000003e-07 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937916+0000", 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7309999999999998e-06 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937925+0000", 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4460000000000001e-06 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937934+0000", 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3039999999999994e-06 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937973+0000", 2024-09-12T02:58:48.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9493999999999998e-05 2024-09-12T02:58:48.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937984+0000", 2024-09-12T02:58:48.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0813e-05 2024-09-12T02:58:48.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938672+0000", 2024-09-12T02:58:48.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00068768500000000005 2024-09-12T02:58:48.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.865 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.938704+0000", 2024-09-12T02:58:48.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1664e-05 2024-09-12T02:58:48.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.866 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.866 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.866 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:45 2.14 e27/19 2:2e2fa760:::200.00000001:head v 27'12, mlcod=26'10)", 2024-09-12T02:58:48.867 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:48.867 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 61.155610582999998, 2024-09-12T02:58:48.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00181248, 2024-09-12T02:58:48.867 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.867 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.867 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.867 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:48.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:48.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:48.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.91e-07 2024-09-12T02:58:48.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629819+0000", 2024-09-12T02:58:48.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1918e-05 2024-09-12T02:58:48.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629833+0000", 2024-09-12T02:58:48.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3767999999999999e-05 2024-09-12T02:58:48.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629844+0000", 2024-09-12T02:58:48.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1326e-05 2024-09-12T02:58:48.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629933+0000", 2024-09-12T02:58:48.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9419999999999994e-05 2024-09-12T02:58:48.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629962+0000", 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8314999999999999e-05 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631512+0000", 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015498 2024-09-12T02:58:48.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631579+0000", 2024-09-12T02:58:48.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7642000000000001e-05 2024-09-12T02:58:48.874 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.874 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.874 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:47 2.14 e47/19 2:2e2fa760:::200.00000001:head v 47'13, mlcod=26'11)", 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.476075476999998, 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001880287, 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309303+0000", 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.544e-06 2024-09-12T02:58:48.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309325+0000", 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2031e-05 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309346+0000", 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1049000000000001e-05 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309359+0000", 2024-09-12T02:58:48.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2988e-05 2024-09-12T02:58:48.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309439+0000", 2024-09-12T02:58:48.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9721999999999993e-05 2024-09-12T02:58:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309465+0000", 2024-09-12T02:58:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5884000000000002e-05 2024-09-12T02:58:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.879 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311130+0000", 2024-09-12T02:58:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001664837 2024-09-12T02:58:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311182+0000", 2024-09-12T02:58:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2231999999999997e-05 2024-09-12T02:58:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.880 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.881 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.881 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:48 2.14 e47/19 2:292cf221:::200.00000000:head v 47'14, mlcod=26'11)", 2024-09-12T02:58:48.881 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:48.881 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 28.474941674, 2024-09-12T02:58:48.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001320122, 2024-09-12T02:58:48.882 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:48.882 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:48.882 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:48.882 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:48.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:48.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:48.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:48.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:48.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:48.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:48.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:48.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5300000000000003e-07 2024-09-12T02:58:48.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:48.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310443+0000", 2024-09-12T02:58:48.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7739999999999999e-06 2024-09-12T02:58:48.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:48.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310453+0000", 2024-09-12T02:58:48.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8970000000000003e-06 2024-09-12T02:58:48.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:48.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310460+0000", 2024-09-12T02:58:48.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8460000000000002e-06 2024-09-12T02:58:48.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:48.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310554+0000", 2024-09-12T02:58:48.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4036999999999994e-05 2024-09-12T02:58:48.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:48.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310577+0000", 2024-09-12T02:58:48.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3462999999999999e-05 2024-09-12T02:58:48.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:48.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311709+0000", 2024-09-12T02:58:48.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011311400000000001 2024-09-12T02:58:48.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:48.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:48.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:48.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311756+0000", 2024-09-12T02:58:48.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7111999999999999e-05 2024-09-12T02:58:48.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.889 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.889 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:48.889 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:48.889 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:48.891 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:48.891 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:48.886+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:48.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.900+0000 7fc02b400640 1 -- 172.21.15.63:0/1980664193 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "noscrub"}]=0 noscrub is set v58) ==== 87+0+0 (secure 0 0 0) 0x7fc02005a780 con 0x7fc03406f110 2024-09-12T02:58:48.905 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is set 2024-09-12T02:58:48.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0140678f0 msgr2=0x7fc014069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0140678f0 0x7fc014069db0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc0240af000 tx=0x7fc024008040 comp rx=0 tx=0).stop 2024-09-12T02:58:48.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406f110 msgr2=0x7fc0341597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:48.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406f110 0x7fc0341597f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc02000d5f0 tx=0x7fc02000dab0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 shutdown_connections 2024-09-12T02:58:48.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0140678f0 0x7fc014069db0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0340ca820 0x7fc0341472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc03406f110 0x7fc0341597f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 --2- 172.21.15.63:0/1980664193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc03406ed30 0x7fc034141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:48.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 >> 172.21.15.63:0/1980664193 conn(0x7fc034072960 msgr2=0x7fc0341521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:48.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 shutdown_connections 2024-09-12T02:58:48.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:48.904+0000 7fc03a400640 1 -- 172.21.15.63:0/1980664193 wait complete. 2024-09-12T02:58:48.992 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:48.988+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:49.020 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:49.020 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:49.020 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:49.021 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:49.035 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:49.092 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:49.086+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:49.151 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:49.151 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:49.151 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:49.152 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:49.152 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:49.165 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:49.193 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:49.188+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:49.293 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:49.290+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:49.334 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:49.334 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:49.334 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:49.334 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:49.334 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.482043379999993, 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.335 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:58:49.336 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.337 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.338 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.339 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.477282602000002, 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.340 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:58:49.341 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.342 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:58:49.343 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:58:49.343 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.343 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.343 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.343 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:58:49.344 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:58:49.344 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.344 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.344 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:58:49.345 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.47714474, 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.346 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.347 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:58:49.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:58:49.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:49.350 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.477058623000005, 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.351 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.352 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:58:49.353 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.476334790999999, 2024-09-12T02:58:49.354 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:49.355 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.358 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.476175924000003, 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:58:49.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:49.363 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.475722305999994, 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:58:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.472488311999996, 2024-09-12T02:58:49.367 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:49.368 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.371 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPush(2.6 41/40 [PushOp(2:654134d2:::mds0_openfiles.0:head, version: 28'2, data_included: [], data_size: 0, omap_header_size: 42, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:654134d2:::mds0_openfiles.0:head@28'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 44.427105482000002, 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00050712800000000003, 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906694+0000", 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1620000000000001e-06 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906711+0000", 2024-09-12T02:58:49.373 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6974e-05 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906734+0000", 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3862999999999998e-05 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906757+0000", 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2765e-05 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.374 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906918+0000", 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000160326 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906935+0000", 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7215e-05 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.907200+0000", 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026482300000000002 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.375 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.376 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:49.377 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:49.421 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:49.418+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:49.495 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:49.492+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:49.544 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:49.544 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:49.545 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:49.545 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:49.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:49.609 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:49.606+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:49.681 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:49.681 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:49.681 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:49.681 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:49.681 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:49.695 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:49.737 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:49.734+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:49.797 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:49.792+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:49.854 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.000500785, 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.855 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:49.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.00036757700001, 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:49.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:49.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:49.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.000262827, 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:49.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:49.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:49.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.00011700899999, 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:49.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.000043827, 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.877 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:49.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:49.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:49.882 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.999983841000002, 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:49.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.999921494999995, 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.892 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.999863978999997, 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:49.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.997696353999999, 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.897 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:49.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.994537839000003, 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:49.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:49.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 99.986828966000004, 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.906 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:49.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:49.911 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.967940014999996, 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.912 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.915 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 89.239538209000003, 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:49.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.918 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.921 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 87.483701627000002, 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:49.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 86.601612662999997, 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.927 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:49.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:49.932 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.917655049999993, 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:49.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:49.938 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 64.917549758999996, 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:49.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:49.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 62.224986608999998, 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:49.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:49.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.949 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5447~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.545628062999999, 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003274795, 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307146+0000", 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.123e-06 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307162+0000", 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5729000000000001e-05 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307197+0000", 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5179999999999999e-05 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307214+0000", 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7295999999999998e-05 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307371+0000", 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000156293 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307532+0000", 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016189399999999999 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307741+0000", 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208493 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.309426+0000", 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016850299999999999 2024-09-12T02:58:49.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310212+0000", 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000786494 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310299+0000", 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6178000000000001e-05 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310418+0000", 2024-09-12T02:58:49.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000119085 2024-09-12T02:58:49.955 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.955 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.955 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.956 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:49.956 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:49.956 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 29.545514885999999, 2024-09-12T02:58:49.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037307600000000001, 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:49.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307257+0000", 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2699999999999999e-06 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307266+0000", 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2160000000000006e-06 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307286+0000", 2024-09-12T02:58:49.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0537e-05 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307299+0000", 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3297e-05 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308569+0000", 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001269121 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308706+0000", 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013719099999999999 2024-09-12T02:58:49.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308921+0000", 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021543199999999999 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310051+0000", 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001129901 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310836+0000", 2024-09-12T02:58:49.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00078529800000000003 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310922+0000", 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5488000000000005e-05 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310987+0000", 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5009e-05 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.961 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:49.962 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:49.962 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:49.964 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:49.964 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:49.960+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:50.064 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:50.058+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:50.070 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 65% (8388/12903) Updating files: 66% (8516/12903) Updating files: 67% (8646/12903) Updating files: 68% (8775/12903) Updating files: 69% (8904/12903) Updating files: 70% (9033/12903) Updating files: 71% (9162/12903) Updating files: 72% (9291/12903) Updating files: 73% (9420/12903) Updating files: 74% (9549/12903) Updating files: 75% (9678/12903) Updating files: 76% (9807/12903) Updating files: 77% (9936/12903) Updating files: 78% (10065/12903) Updating files: 79% (10194/12903) Updating files: 80% (10323/12903) Updating files: 81% (10452/12903) Updating files: 82% (10581/12903) Updating files: 83% (10710/12903) Updating files: 84% (10839/12903) Updating files: 85% (10968/12903) Updating files: 86% (11097/12903) Updating files: 87% (11226/12903) Updating files: 88% (11355/12903) Updating files: 89% (11484/12903) Updating files: 90% (11613/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T02:58:50.092 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:50.092 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:50.092 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:50.092 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:50.106 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:50.193 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:50.190+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:50.266 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:50.260+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:50.271 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:50.271 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:50.271 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:50.272 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:50.272 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:50.285 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:50.377 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:50.374+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:50.454 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.70473975100001, 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.455 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:50.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:50.461 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.56154441300001, 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.462 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:50.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:50.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.467 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.56152388700001, 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.468 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:50.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:50.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:50.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.561413074, 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.474 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:50.479 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.561391548, 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.480 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:50.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.485 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.49640490199999, 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.486 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:50.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.27430137899999, 2024-09-12T02:58:50.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:50.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:50.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.498 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.274164388, 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:50.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:50.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.504 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.273047186, 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.505 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:50.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.510 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.272975073, 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.511 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.512 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.512 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.512 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.512 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:50.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.512 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:50.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.272751089, 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:50.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:50.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:50.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:50.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.523 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.27268110599999, 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:50.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:50.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.529 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.272575469, 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.530 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:50.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.535 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.272385372, 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.536 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:50.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:50.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 114.27231858499999, 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.542 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:50.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.545 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:50.546 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.547 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:50.548 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 113.69696898799999, 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.549 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.550 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.551 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:50.552 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.553 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:50.554 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.598269554, 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.555 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.556 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:50.557 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.558 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.559 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.598184312, 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:50.560 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.561 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:50.562 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.563 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.564 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:50.565 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.598047198, 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.566 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.567 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.568 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.569 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.570 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.571 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 100.597877299, 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.572 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:50.573 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:50.574 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:50.575 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:50.576 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:50.577 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:50.577 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:50.572+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:50.595 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T02:58:50.678 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:50.674+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:50.702 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T02:58:50.702 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T02:58:50.702 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T02:58:50.702 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T02:58:50.702 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T02:58:50.702 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T02:58:50.702 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-09-12T02:58:50.703 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T02:58:50.717 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T02:58:50.725 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T02:58:50.727 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:50.727 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:50.727 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:50.727 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:50.729 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:58:50.729 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T02:58:50.744 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:50.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f531e400640 1 Processor -- start 2024-09-12T02:58:50.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f531e400640 1 -- start start 2024-09-12T02:58:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f531e400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53180c9700 0x7f53181576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f531e400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f531806fef0 0x7f5318157be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f531e400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53180c6a10 con 0x7f5318151ad0 2024-09-12T02:58:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f531e400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f53180c7a10 con 0x7f53180c9700 2024-09-12T02:58:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f531e400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f53180c6cf0 con 0x7f531806fef0 2024-09-12T02:58:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f530ea00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53180c9700 0x7f53181576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f530ea00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53180c9700 0x7f53181576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39156/0 (socket says 172.21.15.63:39156) 2024-09-12T02:58:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f530ea00640 1 -- 172.21.15.63:0/733659082 learned_addr learned my addr 172.21.15.63:0/733659082 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:50.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f5317e00640 1 --2- 172.21.15.63:0/733659082 >> v2:172.21.15.119:3300/0 conn(0x7f531806fef0 0x7f5318157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f530ea00640 1 -- 172.21.15.63:0/733659082 >> v2:172.21.15.119:3300/0 conn(0x7f531806fef0 msgr2=0x7f5318157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:50.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f530ea00640 1 --2- 172.21.15.63:0/733659082 >> v2:172.21.15.119:3300/0 conn(0x7f531806fef0 0x7f5318157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:50.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f530ea00640 1 -- 172.21.15.63:0/733659082 >> v1:172.21.15.119:6789/0 conn(0x7f5318151ad0 legacy=0x7f5318072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:50.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.760+0000 7f530ea00640 1 -- 172.21.15.63:0/733659082 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53180c6fd0 con 0x7f53180c9700 2024-09-12T02:58:50.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f530ea00640 1 --2- 172.21.15.63:0/733659082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53180c9700 0x7f53181576a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f531806cf50 tx=0x7f530001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a7bb20a33e60c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f5316a00640 1 -- 172.21.15.63:0/733659082 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53000b2070 con 0x7f53180c9700 2024-09-12T02:58:50.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f5316a00640 1 -- 172.21.15.63:0/733659082 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53000ad640 con 0x7f53180c9700 2024-09-12T02:58:50.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f5316a00640 1 -- 172.21.15.63:0/733659082 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53000ada10 con 0x7f53180c9700 2024-09-12T02:58:50.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f531e400640 1 -- 172.21.15.63:0/733659082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53180c9700 msgr2=0x7f53181576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f531e400640 1 --2- 172.21.15.63:0/733659082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53180c9700 0x7f53181576a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f531806cf50 tx=0x7f530001c4e0 comp rx=0 tx=0).stop 2024-09-12T02:58:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f531e400640 1 -- 172.21.15.63:0/733659082 shutdown_connections 2024-09-12T02:58:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f531e400640 1 --2- 172.21.15.63:0/733659082 >> v2:172.21.15.119:3300/0 conn(0x7f531806fef0 0x7f5318157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f531e400640 1 --2- 172.21.15.63:0/733659082 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53180c9700 0x7f53181576a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f531e400640 1 -- 172.21.15.63:0/733659082 >> 172.21.15.63:0/733659082 conn(0x7f531806f3d0 msgr2=0x7f531806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f531e400640 1 -- 172.21.15.63:0/733659082 shutdown_connections 2024-09-12T02:58:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.764+0000 7f531e400640 1 -- 172.21.15.63:0/733659082 wait complete. 2024-09-12T02:58:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 Processor -- start 2024-09-12T02:58:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 -- start start 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f531806fef0 0x7f531813f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180c9700 0x7f5318140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318151ad0 0x7f5318140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f53180742b0 con 0x7f531806fef0 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5318074130 con 0x7f5318151ad0 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5318073620 con 0x7f53180c9700 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f531806fef0 0x7f531813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f531806fef0 0x7f531813f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39172/0 (socket says 172.21.15.63:39172) 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317400640 1 -- 172.21.15.63:0/3654678885 learned_addr learned my addr 172.21.15.63:0/3654678885 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f530ea00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180c9700 0x7f5318140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317e00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318151ad0 0x7f5318140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317400640 1 -- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180c9700 msgr2=0x7f5318140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53180c9700 0x7f5318140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317400640 1 -- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318151ad0 msgr2=0x7f5318140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318151ad0 0x7f5318140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53181f3bf0 con 0x7f531806fef0 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317e00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5318151ad0 0x7f5318140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f5317400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f531806fef0 0x7f531813f320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f530800c7c0 tx=0x7f530800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308016020 con 0x7f531806fef0 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f530800aa50 con 0x7f531806fef0 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53181f3ed0 con 0x7f531806fef0 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308012420 con 0x7f531806fef0 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.768+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53181f4490 con 0x7f531806fef0 2024-09-12T02:58:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7f5318072f10 con 0x7f531806fef0 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5308019020 con 0x7f531806fef0 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f530fe00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52f40678c0 0x7f52f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6685+0+0 (secure 0 0 0) 0x7f5308086180 con 0x7f531806fef0 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v58) ==== 54+0+16 (secure 0 0 0) 0x7f5308020030 con 0x7f531806fef0 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f530ea00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52f40678c0 0x7f52f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f531e400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f53181f3760 0x7f5318138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53181402c0 con 0x7f53181f3760 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f5317e00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f53181f3760 0x7f5318138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f530ea00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52f40678c0 0x7f52f4069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f53000af000 tx=0x7f5300008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.772+0000 7f5317e00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f53181f3760 0x7f5318138690 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.776+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53181402c0 con 0x7f53181f3760 2024-09-12T02:58:50.780 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:50.776+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:50.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.788+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f53180c85d0 con 0x7f53181f3760 2024-09-12T02:58:50.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.792+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f53180c85d0 con 0x7f53181f3760 2024-09-12T02:58:50.797 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:50.797 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:50.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.792+0000 7f531e400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5318145c40 0x7f53181f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.792+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7f531806f8c0 con 0x7f5318145c40 2024-09-12T02:58:50.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.792+0000 7f5317400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5318145c40 0x7f53181f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.792+0000 7f5317400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f5318145c40 0x7f53181f6cd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.796+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f531806f8c0 con 0x7f5318145c40 2024-09-12T02:58:50.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.808+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f5318143270 con 0x7f5318145c40 2024-09-12T02:58:50.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.812+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f5318143270 con 0x7f5318145c40 2024-09-12T02:58:50.815 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.812+0000 7f531e400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5318161950 0x7f53181f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.812+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7f531814f810 con 0x7f5318161950 2024-09-12T02:58:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.812+0000 7f530ea00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5318161950 0x7f53181f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.812+0000 7f530ea00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f5318161950 0x7f53181f7720 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.812+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f531814f810 con 0x7f5318161950 2024-09-12T02:58:50.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.828+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f53180626e0 con 0x7f5318161950 2024-09-12T02:58:50.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.828+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f53180626e0 con 0x7f5318161950 2024-09-12T02:58:50.832 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.828+0000 7f531e400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f53180631c0 0x7f5318146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.828+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7f53180635a0 con 0x7f53180631c0 2024-09-12T02:58:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.828+0000 7f5317e00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f53180631c0 0x7f5318146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.828+0000 7f5317e00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f53180631c0 0x7f5318146cc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.828+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53180635a0 con 0x7f53180631c0 2024-09-12T02:58:50.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.844+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f53180635a0 con 0x7f53180631c0 2024-09-12T02:58:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.844+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f53180635a0 con 0x7f53180631c0 2024-09-12T02:58:50.849 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:50.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.844+0000 7f531e400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5318147a40 0x7f531802c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.844+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7f53180635a0 con 0x7f5318147a40 2024-09-12T02:58:50.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.844+0000 7f5317400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5318147a40 0x7f531802c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.848+0000 7f5317400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7f5318147a40 0x7f531802c650 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.848+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53180635a0 con 0x7f5318147a40 2024-09-12T02:58:50.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.860+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f53180635a0 con 0x7f5318147a40 2024-09-12T02:58:50.869 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.864+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f53180635a0 con 0x7f5318147a40 2024-09-12T02:58:50.870 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:50.870 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.864+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=59}) -- 0x7f5318209760 con 0x7f531806fef0 2024-09-12T02:58:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.864+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5318209930 con 0x7f531806fef0 2024-09-12T02:58:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.864+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f530808d070 con 0x7f531806fef0 2024-09-12T02:58:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T02:58:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.868+0000 7f531e400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f531802d460 0x7f5318208050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.868+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7f531802d970 con 0x7f531802d460 2024-09-12T02:58:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.868+0000 7f530ea00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f531802d460 0x7f5318208050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.868+0000 7f530ea00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f531802d460 0x7f5318208050 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.873 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.868+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f531802d970 con 0x7f531802d460 2024-09-12T02:58:50.880 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:50.876+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:50.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.884+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f531802d8c0 con 0x7f531802d460 2024-09-12T02:58:50.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.888+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f531802d8c0 con 0x7f531802d460 2024-09-12T02:58:50.891 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:50.891 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:50.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.888+0000 7f531e400640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5318208aa0 0x7f5318208ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:50.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.888+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7f53182094f0 con 0x7f5318208aa0 2024-09-12T02:58:50.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.888+0000 7f5317e00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5318208aa0 0x7f5318208ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:50.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.888+0000 7f5317e00640 1 --2- 172.21.15.63:0/3654678885 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f5318208aa0 0x7f5318208ee0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:50.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.888+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53182094f0 con 0x7f5318208aa0 2024-09-12T02:58:50.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.904+0000 7f531e400640 1 -- 172.21.15.63:0/3654678885 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=false"]}) -- 0x7f53182094f0 con 0x7f5318208aa0 2024-09-12T02:58:50.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:50.908+0000 7f530fe00640 1 -- 172.21.15.63:0/3654678885 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7f53182094f0 con 0x7f5318208aa0 2024-09-12T02:58:50.912 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:50.912 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:50.917 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:50.917 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:50.920 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T02:58:50.921 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T02:58:50.929 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T02:58:50.935 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:50.981 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:50.974+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:51.081 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:51.078+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:51.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa65ec00640 1 Processor -- start 2024-09-12T02:58:51.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa65ec00640 1 -- start start 2024-09-12T02:58:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa65ec00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6581517d0 0x7fa65815de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa65ec00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa65815e340 0x7fa6580ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa65ec00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa658070520 con 0x7fa6580c9470 2024-09-12T02:58:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa65ec00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fa65806f6f0 con 0x7fa65815e340 2024-09-12T02:58:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa65ec00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa6580c8cf0 con 0x7fa6581517d0 2024-09-12T02:58:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa657e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6581517d0 0x7fa65815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa64f400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa65815e340 0x7fa6580ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:51.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa65cc00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa6580c9470 0x7fa65815a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:60648/0 (socket says 172.21.15.63:60648) 2024-09-12T02:58:51.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.116+0000 7fa65cc00640 1 -- 172.21.15.63:0/622407560 learned_addr learned my addr 172.21.15.63:0/622407560 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:51.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.120+0000 7fa657e00640 1 -- 172.21.15.63:0/622407560 >> v2:172.21.15.119:3300/0 conn(0x7fa65815e340 msgr2=0x7fa6580ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:51.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.120+0000 7fa657e00640 1 --2- 172.21.15.63:0/622407560 >> v2:172.21.15.119:3300/0 conn(0x7fa65815e340 0x7fa6580ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.120+0000 7fa657e00640 1 -- 172.21.15.63:0/622407560 >> v1:172.21.15.119:6789/0 conn(0x7fa6580c9470 legacy=0x7fa65815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:51.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.120+0000 7fa657e00640 1 -- 172.21.15.63:0/622407560 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6580c9180 con 0x7fa6581517d0 2024-09-12T02:58:51.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.120+0000 7fa64f400640 1 --2- 172.21.15.63:0/622407560 >> v2:172.21.15.119:3300/0 conn(0x7fa65815e340 0x7fa6580ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:51.124 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:51.124 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:51.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.120+0000 7fa657e00640 1 --2- 172.21.15.63:0/622407560 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6581517d0 0x7fa65815de00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa648009d90 tx=0x7fa64801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2461d2a81313852e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:51.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.120+0000 7fa657400640 1 -- 172.21.15.63:0/622407560 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480b4070 con 0x7fa6581517d0 2024-09-12T02:58:51.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.120+0000 7fa657400640 1 -- 172.21.15.63:0/622407560 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6480af600 con 0x7fa6581517d0 2024-09-12T02:58:51.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.120+0000 7fa657400640 1 -- 172.21.15.63:0/622407560 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480af9d0 con 0x7fa6581517d0 2024-09-12T02:58:51.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 -- 172.21.15.63:0/622407560 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6581517d0 msgr2=0x7fa65815de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:51.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 --2- 172.21.15.63:0/622407560 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6581517d0 0x7fa65815de00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa648009d90 tx=0x7fa64801f150 comp rx=0 tx=0).stop 2024-09-12T02:58:51.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 -- 172.21.15.63:0/622407560 shutdown_connections 2024-09-12T02:58:51.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 --2- 172.21.15.63:0/622407560 >> v2:172.21.15.119:3300/0 conn(0x7fa65815e340 0x7fa6580ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 --2- 172.21.15.63:0/622407560 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6581517d0 0x7fa65815de00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 -- 172.21.15.63:0/622407560 >> 172.21.15.63:0/622407560 conn(0x7fa658067a00 msgr2=0x7fa658067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:51.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 -- 172.21.15.63:0/622407560 shutdown_connections 2024-09-12T02:58:51.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 -- 172.21.15.63:0/622407560 wait complete. 2024-09-12T02:58:51.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 Processor -- start 2024-09-12T02:58:51.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 -- start start 2024-09-12T02:58:51.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6580c9470 0x7fa65814f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:51.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6581517d0 0x7fa658149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:51.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65815e340 0x7fa65814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa658070240 con 0x7fa6580c9470 2024-09-12T02:58:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa65806ffa0 con 0x7fa6581517d0 2024-09-12T02:58:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.124+0000 7fa65ec00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa65806fc00 con 0x7fa65815e340 2024-09-12T02:58:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa657e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6580c9470 0x7fa65814f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa657e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6580c9470 0x7fa65814f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39188/0 (socket says 172.21.15.63:39188) 2024-09-12T02:58:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa657e00640 1 -- 172.21.15.63:0/2479955257 learned_addr learned my addr 172.21.15.63:0/2479955257 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa64f400640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6581517d0 0x7fa658149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:51.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa65cc00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65815e340 0x7fa65814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:51.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa657e00640 1 -- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65815e340 msgr2=0x7fa65814a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:51.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa657e00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65815e340 0x7fa65814a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa657e00640 1 -- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6581517d0 msgr2=0x7fa658149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:51.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa657e00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6581517d0 0x7fa658149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa657e00640 1 -- 172.21.15.63:0/2479955257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa658154c80 con 0x7fa6580c9470 2024-09-12T02:58:51.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa657e00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6580c9470 0x7fa65814f550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa6480b2040 tx=0x7fa64801bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:51.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa654c00640 1 -- 172.21.15.63:0/2479955257 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6480b4040 con 0x7fa6580c9470 2024-09-12T02:58:51.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa654c00640 1 -- 172.21.15.63:0/2479955257 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6480c1070 con 0x7fa6580c9470 2024-09-12T02:58:51.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa654c00640 1 -- 172.21.15.63:0/2479955257 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648009450 con 0x7fa6580c9470 2024-09-12T02:58:51.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa658153830 con 0x7fa6580c9470 2024-09-12T02:58:51.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa658154920 con 0x7fa6580c9470 2024-09-12T02:58:51.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa658153fe0 con 0x7fa6580c9470 2024-09-12T02:58:51.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.128+0000 7fa654c00640 1 -- 172.21.15.63:0/2479955257 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa6480ba6b0 con 0x7fa6580c9470 2024-09-12T02:58:51.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.132+0000 7fa654c00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa6340678c0 0x7fa634069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:51.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.132+0000 7fa654c00640 1 -- 172.21.15.63:0/2479955257 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6685+0+0 (secure 0 0 0) 0x7fa648124960 con 0x7fa6580c9470 2024-09-12T02:58:51.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.132+0000 7fa64f400640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa6340678c0 0x7fa634069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:51.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.132+0000 7fa64f400640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa6340678c0 0x7fa634069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa640009580 tx=0x7fa640009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:51.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.136+0000 7fa654c00640 1 -- 172.21.15.63:0/2479955257 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa6580c9180 con 0x7fa6580c9470 2024-09-12T02:58:51.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:51.195 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:51.192+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:51.283 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:51.280+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:51.291 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:51.291 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:51.307 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:51.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.340+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd set", "key": "nodeep-scrub"} v 0) -- 0x7fa65806ec50 con 0x7fa6580c9470 2024-09-12T02:58:51.385 INFO:tasks.ceph.osd.4.smithi119.stderr:2024-09-12T02:58:51.382+0000 7f6459931640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 29570) UID: 0 2024-09-12T02:58:51.486 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:51.480+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:51.491 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:51.491 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:51.495 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T02:58:51.507 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:51.576 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T02:58:51.586 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:51.582+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:51.633 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T02:58:51.635 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:58:51.635 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T02:58:51.687 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:51.684+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:51.690 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T02:58:51.697 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:58:51.697 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T02:58:51.697 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:51.697 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:51.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:51.762 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-09-12T02:58:51.763 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-09-12T02:58:51.763 DEBUG:teuthology.orchestra.run.smithi063:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-09-12T02:58:51.788 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:51.782+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:51.888 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:51.884+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:51.910 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:51.910 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:51.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:51.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa654c00640 1 -- 172.21.15.63:0/2479955257 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "nodeep-scrub"}]=0 nodeep-scrub is set v59) ==== 97+0+0 (secure 0 0 0) 0x7fa648018cb0 con 0x7fa6580c9470 2024-09-12T02:58:51.931 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is set 2024-09-12T02:58:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa6340678c0 msgr2=0x7fa634069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa6340678c0 0x7fa634069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa640009580 tx=0x7fa640009190 comp rx=0 tx=0).stop 2024-09-12T02:58:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6580c9470 msgr2=0x7fa65814f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6580c9470 0x7fa65814f550 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa6480b2040 tx=0x7fa64801bef0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 shutdown_connections 2024-09-12T02:58:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa6340678c0 0x7fa634069d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa65815e340 0x7fa65814a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6581517d0 0x7fa658149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 --2- 172.21.15.63:0/2479955257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6580c9470 0x7fa65814f550 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:51.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 >> 172.21.15.63:0/2479955257 conn(0x7fa658067a00 msgr2=0x7fa65815d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:51.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 shutdown_connections 2024-09-12T02:58:51.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:51.928+0000 7fa65ec00640 1 -- 172.21.15.63:0/2479955257 wait complete. 2024-09-12T02:58:52.002 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:52.000+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:52.080 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:52.080 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:52.090 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:52.086+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:52.096 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:52.190 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:52.186+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:52.289 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:52.289 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:52.292 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:52.288+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:52.305 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:52.398 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:52.396+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:52.493 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:52.490+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:52.494 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:52.494 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:52.510 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:52.609 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:52.604+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:52.695 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:52.692+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:52.708 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:52.708 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:52.725 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:52.818 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:52.816+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:52.896 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:52.892+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:52.918 INFO:teuthology.orchestra.run.smithi063.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:52.918 INFO:teuthology.orchestra.run.smithi063.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:52.922 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T02:58:52.935 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:52.997 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:52.994+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:53.068 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:53.069 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:53.083 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:53.097 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:53.092+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:53.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa05a800640 1 Processor -- start 2024-09-12T02:58:53.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa05a800640 1 -- start start 2024-09-12T02:58:53.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa05a800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa054173230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa05a800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa05408c6c0 con 0x7fa0540c1810 2024-09-12T02:58:53.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa05a800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa054168130 con 0x7fa054168a10 2024-09-12T02:58:53.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa05a800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa05406cec0 con 0x7fa054170e40 2024-09-12T02:58:53.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa053400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa0540c1810 0x7fa05406d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56150/0 (socket says 172.21.15.63:56150) 2024-09-12T02:58:53.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa053400640 1 -- 172.21.15.63:0/920088529 learned_addr learned my addr 172.21.15.63:0/920088529 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:53.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa053e00640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa054173230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.060+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357592620 0 0) 0x7fa05408c6c0 con 0x7fa0540c1810 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa038003510 con 0x7fa0540c1810 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 999835297 0 0) 0x7fa03c001120 con 0x7fa054168a10 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa05408c6c0 con 0x7fa054168a10 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1337344931 0 0) 0x7fa038003510 con 0x7fa0540c1810 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 msgr2=0x7fa054173230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa054173230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 >> v1:172.21.15.119:6789/0 conn(0x7fa054168a10 legacy=0x7fa0540c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0540c98d0 con 0x7fa0540c1810 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7fa044001a00 con 0x7fa0540c1810 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 >> v1:172.21.15.63:6789/0 conn(0x7fa0540c1810 legacy=0x7fa05406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:53.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa038003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa038004220 0x7fa038004680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03800d420 0x7fa03800f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa05406cec0 con 0x7fa038004220 2024-09-12T02:58:53.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa03800ff10 con 0x7fa03800d420 2024-09-12T02:58:53.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa038010110 con 0x7fa054170e40 2024-09-12T02:58:53.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa04aa00640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa038004220 0x7fa038004680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa053400640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa038003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa053e00640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03800d420 0x7fa03800f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa053400640 1 -- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03800d420 msgr2=0x7fa03800f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:53.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa053400640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03800d420 0x7fa03800f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:53.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa053400640 1 -- 172.21.15.63:0/920088529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa038004220 msgr2=0x7fa038004680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:53.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa053400640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa038004220 0x7fa038004680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:53.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa053400640 1 -- 172.21.15.63:0/920088529 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa038003510 con 0x7fa054170e40 2024-09-12T02:58:53.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa04aa00640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa038004220 0x7fa038004680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:53.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa053400640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa038003ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa04400a720 tx=0x7fa04401f9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b86344ea191f6e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04400a370 con 0x7fa054170e40 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0440b1070 con 0x7fa054170e40 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa052a00640 1 -- 172.21.15.63:0/920088529 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0440ac910 con 0x7fa054170e40 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa05a800640 1 -- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 msgr2=0x7fa038003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa05a800640 1 --2- 172.21.15.63:0/920088529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa038003ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa04400a720 tx=0x7fa04401f9c0 comp rx=0 tx=0).stop 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa053e00640 1 -- 172.21.15.63:0/920088529 reap_dead start 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa05a800640 1 -- 172.21.15.63:0/920088529 shutdown_connections 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa05a800640 1 -- 172.21.15.63:0/920088529 >> 172.21.15.63:0/920088529 conn(0x7fa05406f3d0 msgr2=0x7fa05406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa05a800640 1 -- 172.21.15.63:0/920088529 shutdown_connections 2024-09-12T02:58:53.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.164+0000 7fa05a800640 1 -- 172.21.15.63:0/920088529 wait complete. 2024-09-12T02:58:53.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 Processor -- start 2024-09-12T02:58:53.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 -- start start 2024-09-12T02:58:53.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa0540c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0540c5ff0 0x7fa054166c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa054165c40 0x7fa05415c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa05406d110 con 0x7fa054165c40 2024-09-12T02:58:53.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa05406d480 con 0x7fa0540c5ff0 2024-09-12T02:58:53.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa0540c0f90 con 0x7fa054170e40 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa054165c40 0x7fa05415c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa04aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0540c5ff0 0x7fa054166c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa0540c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa054165c40 0x7fa05415c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39208/0 (socket says 172.21.15.63:39208) 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053e00640 1 -- 172.21.15.63:0/1770653236 learned_addr learned my addr 172.21.15.63:0/1770653236 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053e00640 1 -- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 msgr2=0x7fa0540c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053e00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa0540c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053e00640 1 -- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0540c5ff0 msgr2=0x7fa054166c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053e00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0540c5ff0 0x7fa054166c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:53.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053e00640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa054165480 con 0x7fa054165c40 2024-09-12T02:58:53.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053400640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa054170e40 0x7fa0540c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:53.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa053e00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa054165c40 0x7fa05415c6c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa04c011860 tx=0x7fa04c011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c019020 con 0x7fa054165c40 2024-09-12T02:58:53.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c004240 con 0x7fa054165c40 2024-09-12T02:58:53.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0016f0 con 0x7fa054165c40 2024-09-12T02:58:53.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0540ca220 con 0x7fa054165c40 2024-09-12T02:58:53.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.168+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0540ca7e0 con 0x7fa054165c40 2024-09-12T02:58:53.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd ls"} v 0) -- 0x7fa05408c380 con 0x7fa054165c40 2024-09-12T02:58:53.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa04c01c020 con 0x7fa054165c40 2024-09-12T02:58:53.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa04be00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa0300678c0 0x7fa030069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6685+0+0 (secure 0 0 0) 0x7fa04c086120 con 0x7fa054165c40 2024-09-12T02:58:53.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa053400640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa0300678c0 0x7fa030069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "osd ls"}]=0 v59) ==== 54+0+16 (secure 0 0 0) 0x7fa04c023020 con 0x7fa054165c40 2024-09-12T02:58:53.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa05a800640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa0541660c0 0x7fa054163980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0540c3a40 con 0x7fa0541660c0 2024-09-12T02:58:53.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa04aa00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa0541660c0 0x7fa054163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa053400640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa0300678c0 0x7fa030069d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa0440b0000 tx=0x7fa0440b8040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.172+0000 7fa04aa00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fa0541660c0 0x7fa054163980 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.176+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0540c3a40 con 0x7fa0541660c0 2024-09-12T02:58:53.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.188+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa05415d110 con 0x7fa0541660c0 2024-09-12T02:58:53.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.192+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa05415d110 con 0x7fa0541660c0 2024-09-12T02:58:53.195 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0: {} 2024-09-12T02:58:53.196 INFO:teuthology.orchestra.run.smithi063.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T02:58:53.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.192+0000 7fa05a800640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa054200ff0 0x7fa054201430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.192+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 3: {"prefix": "get_command_descriptions"}) -- 0x7fa054073cb0 con 0x7fa054200ff0 2024-09-12T02:58:53.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.192+0000 7fa053400640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa054200ff0 0x7fa054201430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.192+0000 7fa053400640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fa054200ff0 0x7fa054201430 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.192+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 3: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa054073cb0 con 0x7fa054200ff0 2024-09-12T02:58:53.197 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:53.192+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:53.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.208+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 4: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa0540c9690 con 0x7fa054200ff0 2024-09-12T02:58:53.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.208+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 4: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa0540c9690 con 0x7fa054200ff0 2024-09-12T02:58:53.213 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1: {} 2024-09-12T02:58:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T02:58:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.208+0000 7fa05a800640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa054062bf0 0x7fa054062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.208+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 5: {"prefix": "get_command_descriptions"}) -- 0x7fa0540c7030 con 0x7fa054062bf0 2024-09-12T02:58:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.208+0000 7fa04aa00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa054062bf0 0x7fa054062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.208+0000 7fa04aa00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7fa054062bf0 0x7fa054062ff0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.212+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 5: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0540c7030 con 0x7fa054062bf0 2024-09-12T02:58:53.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.224+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 6: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa0540742b0 con 0x7fa054062bf0 2024-09-12T02:58:53.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.224+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 6: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa0540742b0 con 0x7fa054062bf0 2024-09-12T02:58:53.229 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2: {} 2024-09-12T02:58:53.230 INFO:teuthology.orchestra.run.smithi063.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T02:58:53.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.224+0000 7fa05a800640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa054169330 0x7fa054169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.224+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 7: {"prefix": "get_command_descriptions"}) -- 0x7fa05415ef90 con 0x7fa054169330 2024-09-12T02:58:53.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.224+0000 7fa053e00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa054169330 0x7fa054169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.228+0000 7fa053e00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fa054169330 0x7fa054169750 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.228+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 7: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa05415ef90 con 0x7fa054169330 2024-09-12T02:58:53.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.240+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 8: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa05402c650 con 0x7fa054169330 2024-09-12T02:58:53.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.240+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 8: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa05402c650 con 0x7fa054169330 2024-09-12T02:58:53.246 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3: {} 2024-09-12T02:58:53.246 INFO:teuthology.orchestra.run.smithi063.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T02:58:53.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.240+0000 7fa05a800640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa05402cd70 0x7fa05402d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.240+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 9: {"prefix": "get_command_descriptions"}) -- 0x7fa05402d6d0 con 0x7fa05402cd70 2024-09-12T02:58:53.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.244+0000 7fa053400640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa05402cd70 0x7fa05402d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.244+0000 7fa053400640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fa05402cd70 0x7fa05402d190 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.244+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 9: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa05402d6d0 con 0x7fa05402cd70 2024-09-12T02:58:53.248 INFO:teuthology.orchestra.run.smithi119.stdout:ERROR: (22) Invalid argument 2024-09-12T02:58:53.249 INFO:teuthology.orchestra.run.smithi119.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T02:58:53.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.256+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 10: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa05402d6d0 con 0x7fa05402cd70 2024-09-12T02:58:53.263 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:53.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.260+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 10: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa05402d6d0 con 0x7fa05402cd70 2024-09-12T02:58:53.264 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4: {} 2024-09-12T02:58:53.265 INFO:teuthology.orchestra.run.smithi063.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T02:58:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.260+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=60}) -- 0x7fa05402d6d0 con 0x7fa054165c40 2024-09-12T02:58:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.260+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa05402da10 con 0x7fa054165c40 2024-09-12T02:58:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.260+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fa04c08d070 con 0x7fa054165c40 2024-09-12T02:58:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-12T02:58:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.260+0000 7fa05a800640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa0542125c0 0x7fa0542149b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.260+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 12: {"prefix": "get_command_descriptions"}) -- 0x7fa054217780 con 0x7fa0542125c0 2024-09-12T02:58:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.260+0000 7fa04aa00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa0542125c0 0x7fa0542149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.260+0000 7fa04aa00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7fa0542125c0 0x7fa0542149b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.264+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 12: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa054217780 con 0x7fa0542125c0 2024-09-12T02:58:53.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.276+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 13: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa054214ef0 con 0x7fa0542125c0 2024-09-12T02:58:53.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.276+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 13: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa054214ef0 con 0x7fa0542125c0 2024-09-12T02:58:53.282 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6: {} 2024-09-12T02:58:53.283 INFO:teuthology.orchestra.run.smithi063.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T02:58:53.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.280+0000 7fa05a800640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa054215610 0x7fa054217a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:53.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.280+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 14: {"prefix": "get_command_descriptions"}) -- 0x7fa05421a8a0 con 0x7fa054215610 2024-09-12T02:58:53.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.280+0000 7fa053e00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa054215610 0x7fa054217a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:53.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.280+0000 7fa053e00640 1 --2- 172.21.15.63:0/1770653236 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7fa054215610 0x7fa054217a00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:53.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.280+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 14: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa05421a8a0 con 0x7fa054215610 2024-09-12T02:58:53.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.292+0000 7fa05a800640 1 -- 172.21.15.63:0/1770653236 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 15: {"prefix": "injectargs", "injected_args": ["--osd_enable_op_tracker=true"]}) -- 0x7fa054000960 con 0x7fa054215610 2024-09-12T02:58:53.298 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:53.296+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:53.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:53.296+0000 7fa04be00640 1 -- 172.21.15.63:0/1770653236 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 15: 0 osd_enable_op_tracker = '' ) ==== 35+0+3 (crc 0 0 0) 0x7fa054000960 con 0x7fa054215610 2024-09-12T02:58:53.301 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7: {} 2024-09-12T02:58:53.301 INFO:teuthology.orchestra.run.smithi063.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T02:58:53.307 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-12T02:58:53.308 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-12T02:58:53.385 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:53.385 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:53.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:53.385 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:53.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.532700648, 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:58:53.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.391 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:58:53.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:58:53.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.391 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.52793987, 2024-09-12T02:58:53.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:53.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:58:53.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.52780200799999, 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:53.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.527715891, 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:58:53.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.405 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.52699205899999, 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:58:53.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:58:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.526833192, 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:58:53.410 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.411 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:58:53.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.526379574, 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:53.415 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:58:53.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:58:53.418 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.52314558, 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.419 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:58:53.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:58:53.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPush(2.6 41/40 [PushOp(2:654134d2:::mds0_openfiles.0:head, version: 28'2, data_included: [], data_size: 0, omap_header_size: 42, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:654134d2:::mds0_openfiles.0:head@28'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:53.423 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 48.477762749999997, 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00050712800000000003, 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:53.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906694+0000", 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1620000000000001e-06 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906711+0000", 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6974e-05 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906734+0000", 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3862999999999998e-05 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906757+0000", 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2765e-05 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906918+0000", 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000160326 2024-09-12T02:58:53.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906935+0000", 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7215e-05 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.907200+0000", 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026482300000000002 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.427 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:53.429 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:53.429 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:53.426+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:53.529 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-12T02:58:53.524+0000 7fd530800640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 28943) UID: 0 2024-09-12T02:58:53.598 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:53.598 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:53.598 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:53.598 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:53.612 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:53.629 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:53.628+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:53.696 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-12T02:58:53.696 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T02:58:53.696 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-12T02:58:53.696 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-12T02:58:53.696 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-12T02:58:53.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-12T02:58:53.727 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:53.727 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:53.727 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:53.727 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:53.727 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:53.742 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:53.743 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:53.740+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:53.833 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:53.830+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:53.844 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:53.844 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-12T02:58:53.844 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.013001812, 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.869 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:53.871 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:53.874 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.012868604, 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:53.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:53.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:53.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.012763854, 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.881 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:53.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:53.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:53.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.886 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.01261803600001, 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:53.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.889 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.012544854, 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:53.897 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.012484868, 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:53.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:53.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.01242252199999, 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:53.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.906 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.012365006, 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:53.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:53.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.010197381, 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.912 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:53.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:53.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:53.916 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.007038866, 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:53.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.918 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.920 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:38 2.14 2:2e2fa760:::200.00000001:head [write 0~940] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e25)", 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 103.999329993, 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017900710000000001, 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.921 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865942+0000", 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865944+0000", 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0600000000000002e-06 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865956+0000", 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1959e-05 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865982+0000", 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6322e-05 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865997+0000", 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4469e-05 2024-09-12T02:58:53.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866096+0000", 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.9487000000000005e-05 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866206+0000", 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010986 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.866395+0000", 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00018928799999999999 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867509+0000", 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001113564 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867585+0000", 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6085000000000001e-05 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867669+0000", 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4301000000000005e-05 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.867732+0000", 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2675999999999994e-05 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:39 2.6 e26/19 2:654134d2:::mds0_openfiles.0:head v 26'1, mlcod=0'0)", 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 94.980441041999995, 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001615287, 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:53.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884831+0000", 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884833+0000", 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9690000000000001e-06 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884873+0000", 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9564999999999998e-05 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884903+0000", 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0108e-05 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.884918+0000", 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5773e-05 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885063+0000", 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014501 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.885100+0000", 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6807999999999997e-05 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886309+0000", 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001209138 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:18.886446+0000", 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000136916 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:40 2.14 2:2e2fa760:::200.00000001:head [write 940~451 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 93.252039236000002, 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024364500000000002, 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.931 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613233+0000", 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613236+0000", 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8569999999999999e-06 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613251+0000", 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5095e-05 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613285+0000", 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4329000000000003e-05 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613305+0000", 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9792999999999998e-05 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613462+0000", 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000157322 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613621+0000", 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000158369 2024-09-12T02:58:53.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.613838+0000", 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021719400000000001 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615454+0000", 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001616721 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615525+0000", 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0060000000000003e-05 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615602+0000", 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7616999999999999e-05 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:20.615669+0000", 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7093000000000003e-05 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.936 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 91.496202654000001, 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:53.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:53.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:42 2.14 2:2e2fa760:::200.00000001:head [write 3031~141 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 90.614113689999996, 2024-09-12T02:58:53.942 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002499093, 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.943 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251158+0000", 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251161+0000", 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9529999999999999e-06 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.944 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251175+0000", 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3376e-05 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251209+0000", 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4625000000000001e-05 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251226+0000", 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.666e-05 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.945 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251426+0000", 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019966100000000001 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251583+0000", 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015779999999999999 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.251793+0000", 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020998100000000001 2024-09-12T02:58:53.946 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253253+0000", 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014591980000000001 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253491+0000", 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023833 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253584+0000", 2024-09-12T02:58:53.947 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2621999999999995e-05 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:23.253657+0000", 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3887000000000006e-05 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:43 2.14 2:2e2fa760:::200.00000001:head [write 3172~259 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:53.948 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 68.930156077000007, 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023106310000000001, 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.949 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935116+0000", 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935119+0000", 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9660000000000001e-06 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935134+0000", 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5007e-05 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.950 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935167+0000", 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2595999999999998e-05 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935185+0000", 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8236e-05 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935313+0000", 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012778299999999999 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.951 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935464+0000", 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000151743 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935681+0000", 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000216345 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937171+0000", 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001490824 2024-09-12T02:58:53.952 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937260+0000", 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8797999999999999e-05 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937358+0000", 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7878e-05 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.953 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937427+0000", 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8454999999999994e-05 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 68.930050785999995, 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.954 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:53.955 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.956 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.957 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:53.958 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.959 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 66.237487635999997, 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.961 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.962 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.963 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:53.964 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5447~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.558129090000001, 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003274795, 2024-09-12T02:58:53.965 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.966 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307146+0000", 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.123e-06 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307162+0000", 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5729000000000001e-05 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307197+0000", 2024-09-12T02:58:53.967 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5179999999999999e-05 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307214+0000", 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7295999999999998e-05 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307371+0000", 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000156293 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.968 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307532+0000", 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016189399999999999 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307741+0000", 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208493 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.309426+0000", 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016850299999999999 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.969 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310212+0000", 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000786494 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310299+0000", 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6178000000000001e-05 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310418+0000", 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000119085 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.970 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 33.558015912999998, 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037307600000000001, 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:53.971 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307257+0000", 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2699999999999999e-06 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:53.972 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307266+0000", 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2160000000000006e-06 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307286+0000", 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0537e-05 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307299+0000", 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3297e-05 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.973 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308569+0000", 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001269121 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308706+0000", 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013719099999999999 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308921+0000", 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021543199999999999 2024-09-12T02:58:53.974 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310051+0000", 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001129901 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310836+0000", 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00078529800000000003 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310922+0000", 2024-09-12T02:58:53.975 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5488000000000005e-05 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310987+0000", 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5009e-05 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:53.976 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:53.977 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T02:58:53.978 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:53.972+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:53.979 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:53.983 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T02:58:53.983 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T02:58:54.057 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-09-12T02:58:54.057 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T02:58:54.098 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:54.096+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:54.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea8c00640 1 Processor -- start 2024-09-12T02:58:54.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea8c00640 1 -- start start 2024-09-12T02:58:54.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea8c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea40c9110 0x7f1ea4163fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea8c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea40c6970 con 0x7f1ea4152640 2024-09-12T02:58:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea8c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea4159500 con 0x7f1ea41590b0 2024-09-12T02:58:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea8c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea4071f60 con 0x7f1ea40c9110 2024-09-12T02:58:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea1e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1ea4152640 0x7f1ea4071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:41992/0 (socket says 172.21.15.63:41992) 2024-09-12T02:58:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea1e00640 1 -- 172.21.15.63:0/3366585264 learned_addr learned my addr 172.21.15.63:0/3366585264 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:58:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea2800640 1 --2- 172.21.15.63:0/3366585264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea40c9110 0x7f1ea4163fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea1400640 1 -- 172.21.15.63:0/3366585264 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2546611393 0 0) 0x7f1ea40c6970 con 0x7f1ea4152640 2024-09-12T02:58:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.116+0000 7f1ea1400640 1 -- 172.21.15.63:0/3366585264 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e88003530 con 0x7f1ea4152640 2024-09-12T02:58:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea1400640 1 -- 172.21.15.63:0/3366585264 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467370920 0 0) 0x7f1ea4159500 con 0x7f1ea41590b0 2024-09-12T02:58:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea1400640 1 -- 172.21.15.63:0/3366585264 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ea40c6970 con 0x7f1ea41590b0 2024-09-12T02:58:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea1400640 1 -- 172.21.15.63:0/3366585264 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 8683065 0 0) 0x7f1e88003530 con 0x7f1ea4152640 2024-09-12T02:58:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea2800640 1 -- 172.21.15.63:0/3366585264 >> v1:172.21.15.119:6789/0 conn(0x7f1ea41590b0 legacy=0x7f1ea40c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea2800640 1 -- 172.21.15.63:0/3366585264 >> v1:172.21.15.63:6789/0 conn(0x7f1ea4152640 legacy=0x7f1ea4071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea2800640 1 -- 172.21.15.63:0/3366585264 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea40c6c30 con 0x7f1ea40c9110 2024-09-12T02:58:54.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea2800640 1 --2- 172.21.15.63:0/3366585264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea40c9110 0x7f1ea4163fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0097f0 tx=0x7f1e9c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8491e33af9b27d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:54.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea1400640 1 -- 172.21.15.63:0/3366585264 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c0b0070 con 0x7f1ea40c9110 2024-09-12T02:58:54.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea1400640 1 -- 172.21.15.63:0/3366585264 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9c0ab400 con 0x7f1ea40c9110 2024-09-12T02:58:54.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.120+0000 7f1ea1400640 1 -- 172.21.15.63:0/3366585264 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94001a00 con 0x7f1ea40c9110 2024-09-12T02:58:54.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 -- 172.21.15.63:0/3366585264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea40c9110 msgr2=0x7f1ea4163fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 --2- 172.21.15.63:0/3366585264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea40c9110 0x7f1ea4163fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0097f0 tx=0x7f1e9c01c400 comp rx=0 tx=0).stop 2024-09-12T02:58:54.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 -- 172.21.15.63:0/3366585264 shutdown_connections 2024-09-12T02:58:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 --2- 172.21.15.63:0/3366585264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea40c9110 0x7f1ea4163fc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 -- 172.21.15.63:0/3366585264 >> 172.21.15.63:0/3366585264 conn(0x7f1ea406f3d0 msgr2=0x7f1ea406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 -- 172.21.15.63:0/3366585264 shutdown_connections 2024-09-12T02:58:54.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 -- 172.21.15.63:0/3366585264 wait complete. 2024-09-12T02:58:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 Processor -- start 2024-09-12T02:58:54.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 -- start start 2024-09-12T02:58:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ea40c9110 0x7f1ea40ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea4152640 0x7f1ea40c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea41590b0 0x7f1ea40c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4152a20 con 0x7f1ea4152640 2024-09-12T02:58:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4074290 con 0x7f1ea40c9110 2024-09-12T02:58:54.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea8c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea40c85f0 con 0x7f1ea41590b0 2024-09-12T02:58:54.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1e99400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea4152640 0x7f1ea40c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ea40c9110 0x7f1ea40ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1e99400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea4152640 0x7f1ea40c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39632/0 (socket says 172.21.15.63:39632) 2024-09-12T02:58:54.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1e99400640 1 -- 172.21.15.63:0/1648604235 learned_addr learned my addr 172.21.15.63:0/1648604235 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:54.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1ea2800640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea41590b0 0x7f1ea40c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1e99400640 1 -- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea41590b0 msgr2=0x7f1ea40c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1e99400640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea41590b0 0x7f1ea40c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1e99400640 1 -- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ea40c9110 msgr2=0x7f1ea40ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1e99400640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ea40c9110 0x7f1ea40ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1e99400640 1 -- 172.21.15.63:0/1648604235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea41539c0 con 0x7f1ea4152640 2024-09-12T02:58:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.124+0000 7f1e99400640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea4152640 0x7f1ea40c23a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00c490 tx=0x7f1e8c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1e9aa00640 1 -- 172.21.15.63:0/1648604235 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0052d0 con 0x7f1ea4152640 2024-09-12T02:58:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1e9aa00640 1 -- 172.21.15.63:0/1648604235 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c005470 con 0x7f1ea4152640 2024-09-12T02:58:54.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1e9aa00640 1 -- 172.21.15.63:0/1648604235 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c012870 con 0x7f1ea4152640 2024-09-12T02:58:54.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea40c2a30 con 0x7f1ea4152640 2024-09-12T02:58:54.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea40b0330 con 0x7f1ea4152640 2024-09-12T02:58:54.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea4071850 con 0x7f1ea4152640 2024-09-12T02:58:54.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1e9aa00640 1 -- 172.21.15.63:0/1648604235 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e8c012a10 con 0x7f1ea4152640 2024-09-12T02:58:54.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1e9aa00640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1e800678c0 0x7f1e80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:54.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1e9aa00640 1 -- 172.21.15.63:0/1648604235 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6685+0+0 (secure 0 0 0) 0x7f1e8c085bf0 con 0x7f1ea4152640 2024-09-12T02:58:54.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.128+0000 7f1ea1e00640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1e800678c0 0x7f1e80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:54.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.132+0000 7f1ea1e00640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1e800678c0 0x7f1e80069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e94001570 tx=0x7f1e94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:54.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.132+0000 7f1e9aa00640 1 -- 172.21.15.63:0/1648604235 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1ea41539c0 con 0x7f1ea4152640 2024-09-12T02:58:54.149 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:54.149 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:54.149 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:54.149 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:54.163 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:54.179 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:54.176+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:54.280 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:54.276+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:54.286 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:54.286 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:54.286 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:54.286 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:54.286 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:54.300 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:54.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.308+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7f1ea406d240 con 0x7f1ea4152640 2024-09-12T02:58:54.381 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:54.378+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:54.420 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:54.420 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.67065410799999, 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.421 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:54.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.423 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:54.424 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:54.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.52745877, 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.428 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.429 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:54.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:54.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.432 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:54.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.527438244, 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:54.434 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.435 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.436 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:54.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.440 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.527327431, 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.441 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.442 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:54.442 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.442 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.442 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.442 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:54.442 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.442 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:54.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.445 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:54.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:54.447 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.52730590500001, 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.448 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:54.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.451 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:54.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:54.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:54.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:54.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.462319259, 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.454 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:54.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:54.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.240215736, 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:54.460 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:54.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:54.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:54.466 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.24007874500001, 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.468 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.469 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:54.470 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.471 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:54.472 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.238961543, 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.473 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.474 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.475 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:54.476 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.477 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:54.478 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.23888943, 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.479 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.480 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:54.481 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.482 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.483 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.484 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.238665446, 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:54.485 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.486 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.487 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.488 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.489 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:54.490 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.238595463, 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.491 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.492 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.493 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:54.494 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:54.495 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:54.496 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:54.497 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.23848982600001, 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.498 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.499 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:54.500 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.501 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:54.502 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.503 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.238299729, 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:54.504 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.505 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.506 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:54.507 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.508 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.509 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 118.238232942, 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.510 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.511 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.512 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:54.513 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.514 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.515 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 117.662883345, 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.516 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.517 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.518 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:54.519 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.520 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.521 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.564183911, 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:54.522 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:54.523 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.524 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:54.525 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.526 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:54.527 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.564098669, 2024-09-12T02:58:54.528 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.529 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.530 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:54.531 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.532 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.533 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.56396155500001, 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.534 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.535 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:54.536 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.537 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.538 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:54.539 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 104.56379165600001, 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:54.540 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:54.541 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:54.542 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:54.543 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:54.544 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:54.544 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:54.544 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.544 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.544 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.544 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:54.544 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:54.544 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:54.546 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:54.542+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:54.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T02:58:54.649 INFO:tasks.ceph.osd.7.smithi119.stderr:2024-09-12T02:58:54.642+0000 7f952e9a8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 29577) UID: 0 2024-09-12T02:58:54.693 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:54.693 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:54.693 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:54.693 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:54.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T02:58:54.755 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:54.752+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:54.848 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-12T02:58:54.844+0000 7f29e1400640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 28946) UID: 0 2024-09-12T02:58:54.854 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:54.854 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:54.854 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:54.854 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:54.854 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:54.870 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T02:58:54.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.944+0000 7f1e9aa00640 1 -- 172.21.15.63:0/1648604235 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v60) ==== 91+0+0 (secure 0 0 0) 0x7f1e8c055d00 con 0x7f1ea4152640 2024-09-12T02:58:54.950 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-12T02:58:54.951 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f8573000640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 28950) UID: 0 2024-09-12T02:58:54.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1e800678c0 msgr2=0x7f1e80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1e800678c0 0x7f1e80069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1e94001570 tx=0x7f1e94009040 comp rx=0 tx=0).stop 2024-09-12T02:58:54.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea4152640 msgr2=0x7f1ea40c23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:54.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea4152640 0x7f1ea40c23a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00c490 tx=0x7f1e8c00c950 comp rx=0 tx=0).stop 2024-09-12T02:58:54.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 shutdown_connections 2024-09-12T02:58:54.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1e800678c0 0x7f1e80069d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ea41590b0 0x7f1ea40c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ea4152640 0x7f1ea40c23a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 --2- 172.21.15.63:0/1648604235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ea40c9110 0x7f1ea40ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:54.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 >> 172.21.15.63:0/1648604235 conn(0x7f1ea406f3d0 msgr2=0x7f1ea414d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:54.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 shutdown_connections 2024-09-12T02:58:54.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:54.948+0000 7f1ea8c00640 1 -- 172.21.15.63:0/1648604235 wait complete. 2024-09-12T02:58:55.050 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-12T02:58:55.044+0000 7eff3aa00640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 28945) UID: 0 2024-09-12T02:58:55.068 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:55.068 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:55.068 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:55.068 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:55.068 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'39)", 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 119.111603147, 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047813200000000004, 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955737+0000", 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955738+0000", 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3099999999999998e-07 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955742+0000", 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3730000000000003e-06 2024-09-12T02:58:55.070 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955753+0000", 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1321000000000001e-05 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955759+0000", 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1070000000000001e-06 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.071 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955810+0000", 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0711000000000003e-05 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.955823+0000", 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2605999999999999e-05 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960475+0000", 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004652354 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.072 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960518+0000", 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3316999999999999e-05 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'39)", 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 119.110080352, 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039674089999999999, 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.073 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957260+0000", 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.074 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957261+0000", 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8400000000000004e-07 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957334+0000", 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3613000000000001e-05 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.075 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957347+0000", 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3349e-05 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957353+0000", 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1089999999999997e-06 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957405+0000", 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2206000000000001e-05 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.076 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.957427+0000", 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2155999999999999e-05 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961190+0000", 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0037629849999999999 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.961227+0000", 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7307e-05 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.077 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 119.107835314, 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004389858, 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:55.078 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959505+0000", 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959506+0000", 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8599999999999998e-07 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.079 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959510+0000", 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7339999999999999e-06 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959523+0000", 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2773e-05 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.959528+0000", 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9740000000000001e-06 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.080 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960547+0000", 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010187359999999999 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.960560+0000", 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3223e-05 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963855+0000", 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032949910000000002 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.081 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.963895+0000", 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9740999999999998e-05 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:72 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'46, mlcod=17'43)", 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 119.100282562, 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021753509999999998, 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.082 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.083 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967058+0000", 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6599999999999996e-07 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967141+0000", 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2319999999999998e-05 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967152+0000", 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1432e-05 2024-09-12T02:58:55.084 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967158+0000", 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8019999999999997e-06 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967207+0000", 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9075e-05 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.967224+0000", 2024-09-12T02:58:55.085 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7427000000000001e-05 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969194+0000", 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019695590000000001 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.969233+0000", 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9169999999999999e-05 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.086 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:73 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'47, mlcod=17'43)", 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 119.09888437799999, 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003562614, 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.087 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968456+0000", 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7899999999999998e-07 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.088 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968495+0000", 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8025000000000003e-05 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968507+0000", 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2758999999999999e-05 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968513+0000", 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3009999999999997e-06 2024-09-12T02:58:55.089 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968585+0000", 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2139999999999997e-05 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.968599+0000", 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4752999999999999e-05 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.971980+0000", 2024-09-12T02:58:55.090 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033801059999999999 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972018+0000", 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8850999999999998e-05 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:74 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'48, mlcod=17'44)", 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 119.097214424, 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022444370000000002, 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:55.092 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970126+0000", 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7100000000000001e-07 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970131+0000", 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4850000000000003e-06 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.093 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970144+0000", 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2595999999999999e-05 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970149+0000", 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.395e-06 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970209+0000", 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9905999999999999e-05 2024-09-12T02:58:55.094 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.970225+0000", 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6177000000000001e-05 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972340+0000", 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002114917 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.972370+0000", 2024-09-12T02:58:55.095 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.029e-05 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:83 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'50)", 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 119.08123344800001, 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002809059, 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.096 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986107+0000", 2024-09-12T02:58:55.097 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6000000000000004e-07 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986112+0000", 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8019999999999999e-06 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986123+0000", 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0953e-05 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986128+0000", 2024-09-12T02:58:55.098 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7849999999999999e-06 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986166+0000", 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7923000000000003e-05 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.986180+0000", 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4211e-05 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.099 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988884+0000", 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027039640000000001 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.988916+0000", 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.1860999999999999e-05 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:84 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'50)", 2024-09-12T02:58:55.100 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 119.080236636, 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002347909, 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.101 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987104+0000", 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8899999999999999e-07 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987155+0000", 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0776000000000003e-05 2024-09-12T02:58:55.102 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987167+0000", 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2215000000000001e-05 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987172+0000", 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.04e-06 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987232+0000", 2024-09-12T02:58:55.103 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9595000000000001e-05 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.987246+0000", 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3757000000000001e-05 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989417+0000", 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021715329999999998 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.104 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.989451+0000", 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4304000000000002e-05 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:90 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'60, mlcod=17'57)", 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 119.071700733, 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027093489999999998, 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.105 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995639+0000", 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.106 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995640+0000", 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9699999999999995e-07 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995794+0000", 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015367199999999999 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995805+0000", 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1061e-05 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.107 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995810+0000", 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4589999999999997e-06 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995856+0000", 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6127000000000001e-05 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.995870+0000", 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3854e-05 2024-09-12T02:58:55.108 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998315+0000", 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024450930000000002 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:55.998349+0000", 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3386000000000002e-05 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.109 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:105 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'67, mlcod=17'64)", 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 118.88942561499999, 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026337050000000001, 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.110 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177915+0000", 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4300000000000003e-07 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.111 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177930+0000", 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4735999999999999e-05 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177942+0000", 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2349e-05 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.177949+0000", 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6599999999999998e-06 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.112 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178003+0000", 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3535999999999997e-05 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.178018+0000", 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5227e-05 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180517+0000", 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024996419999999998 2024-09-12T02:58:55.113 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:56.180548+0000", 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0911999999999998e-05 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:158 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'112, mlcod=18'109)", 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 117.61218662900001, 2024-09-12T02:58:55.114 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026267230000000001, 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.115 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455154+0000", 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.58e-07 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455235+0000", 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1242000000000006e-05 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455245+0000", 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.995e-06 2024-09-12T02:58:55.116 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455250+0000", 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7079999999999996e-06 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455297+0000", 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6885000000000003e-05 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455311+0000", 2024-09-12T02:58:55.117 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4354e-05 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457734+0000", 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024232540000000001 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.457780+0000", 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5827e-05 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.118 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(client.4172.0:159 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'113, mlcod=18'109)", 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 117.611465641, 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046885809999999998, 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:55.119 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455875+0000", 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5300000000000004e-07 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.120 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455879+0000", 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8650000000000003e-06 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455889+0000", 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0139999999999999e-05 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455894+0000", 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2959999999999998e-06 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.121 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455944+0000", 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9774999999999997e-05 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.455962+0000", 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8009999999999999e-05 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460534+0000", 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045721299999999998 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.122 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:56:57.460563+0000", 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8812000000000001e-05 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:4 2.1f 2:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.215317286, 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0073449359999999998, 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.123 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852023+0000", 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852025+0000", 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2280000000000001e-06 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.124 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852034+0000", 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1619999999999997e-06 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852060+0000", 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5714000000000001e-05 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852073+0000", 2024-09-12T02:58:55.125 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3199e-05 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852384+0000", 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00031071499999999998 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852627+0000", 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00024345000000000001 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.126 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852778+0000", 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015093999999999999 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857277+0000", 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044991120000000004 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859269+0000", 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0019915879999999999 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.127 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:55.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3817999999999999e-05 2024-09-12T02:58:55.128 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.128 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.128 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.128 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859368+0000", 2024-09-12T02:58:55.128 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5009999999999998e-05 2024-09-12T02:58:55.128 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:5 2.1f 2:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.21522587699999, 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012795443, 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.129 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852115+0000", 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.54e-07 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852120+0000", 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2299999999999999e-06 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852132+0000", 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1746000000000001e-05 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852140+0000", 2024-09-12T02:58:55.131 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2300000000000008e-06 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854507+0000", 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023667369999999998 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854587+0000", 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0024000000000005e-05 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:55.132 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854730+0000", 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014253599999999999 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859376+0000", 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046468200000000003 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864800+0000", 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054233670000000001 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.133 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864864+0000", 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4397e-05 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864910+0000", 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.5602000000000001e-05 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:28 2.13 2:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:55.134 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.21516762900001, 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011320167000000001, 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852173+0000", 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1600000000000001e-07 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852188+0000", 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.506e-05 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852199+0000", 2024-09-12T02:58:55.136 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0677e-05 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852206+0000", 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8279999999999997e-06 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852418+0000", 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021227799999999999 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.137 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852545+0000", 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012638499999999999 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852774+0000", 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0002299 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856085+0000", 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033103569999999999 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.138 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863371+0000", 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0072860260000000001 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863444+0000", 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.305e-05 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863493+0000", 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8890000000000001e-05 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.139 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:26 2.1f 2:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.215105568, 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012832368, 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.140 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852235+0000", 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.5700000000000002e-07 2024-09-12T02:58:55.141 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852262+0000", 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7135e-05 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852366+0000", 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103606 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852378+0000", 2024-09-12T02:58:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2204999999999999e-05 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854980+0000", 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026019860000000001 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855096+0000", 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000115887 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:55.143 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855213+0000", 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116916 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859383+0000", 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041700089999999997 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864993+0000", 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056103209999999997 2024-09-12T02:58:55.144 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865043+0000", 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9481999999999998e-05 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865067+0000", 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4164000000000001e-05 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:27 2.13 2:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.214893166, 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012817586000000001, 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.146 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852447+0000", 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852448+0000", 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5600000000000005e-07 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.147 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852453+0000", 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9019999999999998e-06 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852462+0000", 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9069999999999996e-06 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852469+0000", 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.374e-06 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.148 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853604+0000", 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011349299999999999 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853717+0000", 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000112797 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853836+0000", 2024-09-12T02:58:55.149 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011936500000000001 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859663+0000", 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0058266209999999997 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865167+0000", 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055044849999999999 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.150 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865226+0000", 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8718000000000003e-05 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865265+0000", 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8730999999999999e-05 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.151 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:35 2.1f 2:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.214861567, 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.012748110999999999, 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.152 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852479+0000", 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6699999999999999e-07 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852492+0000", 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.291e-05 2024-09-12T02:58:55.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852500+0000", 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1580000000000005e-06 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852506+0000", 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5330000000000002e-06 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.154 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856830+0000", 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004324194 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856959+0000", 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012862099999999999 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.865227+0000", 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0082682280000000007 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.155 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.1e epoch 25/19 rep_tid 0 entries 25'1 (0'0) error 2:7bf7e7b5:::200.00000006:head by mds.0.4:37 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.212539476, 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045219450000000003, 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:55.156 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854801+0000", 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854802+0000", 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.157 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854814+0000", 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1759999999999999e-05 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854836+0000", 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2039999999999999e-05 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.158 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854855+0000", 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.929e-05 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854975+0000", 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000119561 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859323+0000", 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0043479110000000003 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:2 2.f e25/19 2:f1f69726:::400.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.209223279, 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0032847000000000002, 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.160 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858117+0000", 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858118+0000", 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1540000000000001e-06 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858126+0000", 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7759999999999997e-06 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858138+0000", 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2184999999999999e-05 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858145+0000", 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3350000000000001e-06 2024-09-12T02:58:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858282+0000", 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013642799999999999 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858297+0000", 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5328e-05 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.163 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861346+0000", 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030492729999999999 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861402+0000", 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5220999999999999e-05 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.164 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:55.166 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T02:58:55.167 DEBUG:teuthology.parallel:result is None 2024-09-12T02:58:55.167 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:58:55.168 INFO:tasks.ceph.osd.6.smithi119.stderr:2024-09-12T02:58:55.162+0000 7fefc2a29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 29574) UID: 0 2024-09-12T02:58:55.238 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T02:58:55.238 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T02:58:55.247 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T02:58:55.356 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:55.357 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:55.357 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:55.357 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:55.371 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T02:58:55.516 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:55.517 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:55.517 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:55.517 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:55.517 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:55.532 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T02:58:55.678 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:14 2.15 2:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852074+0000", 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.82584887900001, 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0078481039999999998, 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.679 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852074+0000", 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852074+0000", 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.680 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852076+0000", 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1560000000000002e-06 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852084+0000", 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6120000000000001e-06 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852104+0000", 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0211e-05 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.681 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852114+0000", 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0370000000000001e-05 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852279+0000", 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016455699999999999 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852509+0000", 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00023028999999999999 2024-09-12T02:58:55.682 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:55.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:55.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00019626999999999999 2024-09-12T02:58:55.683 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.683 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.683 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.683 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855351+0000", 2024-09-12T02:58:55.683 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0026456140000000001 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859812+0000", 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044611879999999996 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859873+0000", 2024-09-12T02:58:55.684 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0844999999999998e-05 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859922+0000", 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8990999999999999e-05 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:15 2.15 2:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852155+0000", 2024-09-12T02:58:55.685 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.825767826, 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011168487, 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852155+0000", 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852155+0000", 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.686 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852156+0000", 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2200000000000003e-07 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852161+0000", 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9629999999999997e-06 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.687 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852182+0000", 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0797000000000001e-05 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852190+0000", 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.7350000000000002e-06 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853176+0000", 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000985931 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.688 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853259+0000", 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2324000000000007e-05 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853524+0000", 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026560499999999998 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.689 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029936820000000001 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863248+0000", 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006729985 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863288+0000", 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.9777000000000002e-05 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.690 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863324+0000", 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5966000000000001e-05 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:30 2.15 2:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852204+0000", 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.825719089, 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011319594000000001, 2024-09-12T02:58:55.691 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852204+0000", 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852204+0000", 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.692 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852204+0000", 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3799999999999997e-07 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852209+0000", 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7010000000000004e-06 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.693 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852218+0000", 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5259999999999993e-06 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852224+0000", 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3550000000000001e-06 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.694 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854500+0000", 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002276078 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854607+0000", 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000106523 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854715+0000", 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000108072 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.695 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859260+0000", 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045450960000000002 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863432+0000", 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.004172406 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863485+0000", 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2765e-05 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.696 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863524+0000", 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8534000000000001e-05 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:31 2.d 2:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.852282+0000", 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.825640694, 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011262444999999999, 2024-09-12T02:58:55.697 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852282+0000", 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852282+0000", 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852283+0000", 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8100000000000002e-07 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852312+0000", 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8787999999999999e-05 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852334+0000", 2024-09-12T02:58:55.699 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2425e-05 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.852343+0000", 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9670000000000007e-06 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853796+0000", 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001452549 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.700 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853912+0000", 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000116172 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854041+0000", 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000129414 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856522+0000", 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024809879999999999 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.701 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863465+0000", 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006942391 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863509+0000", 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4461e-05 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863545+0000", 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5509000000000002e-05 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.702 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.703 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.703 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.703 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.703 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:6 2.10 e25/19 2:0d82a743:::600.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:55.703 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855315+0000", 2024-09-12T02:58:55.703 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.822608108, 2024-09-12T02:58:55.703 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036891609999999998, 2024-09-12T02:58:55.703 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855315+0000", 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.704 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855315+0000", 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855316+0000", 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4300000000000001e-06 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855325+0000", 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.6319999999999997e-06 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.705 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855338+0000", 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2996999999999999e-05 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855346+0000", 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0479999999999999e-06 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.706 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855411+0000", 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4503000000000002e-05 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855453+0000", 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2110999999999997e-05 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858953+0000", 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0035002000000000002 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.707 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859004+0000", 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1239999999999997e-05 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:7 2.10 e25/19 2:0d82a743:::600.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855378+0000", 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.82254549699999, 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0036560809999999998, 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.708 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855378+0000", 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855378+0000", 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.709 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855378+0000", 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3200000000000005e-07 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855383+0000", 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0440000000000003e-06 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855392+0000", 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9609999999999994e-06 2024-09-12T02:58:55.710 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855398+0000", 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2330000000000003e-06 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855685+0000", 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000286326 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855695+0000", 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0582e-05 2024-09-12T02:58:55.711 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859007+0000", 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033114479999999998 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859034+0000", 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6954999999999999e-05 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.712 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:8 2.10 e25/19 2:09401a81:::601.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855435+0000", 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.82248764800001, 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003623687, 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855435+0000", 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855435+0000", 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855436+0000", 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7100000000000001e-07 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855441+0000", 2024-09-12T02:58:55.714 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.451e-06 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855450+0000", 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.4290000000000001e-06 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855456+0000", 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8320000000000002e-06 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.715 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855817+0000", 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00036077100000000002 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855833+0000", 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6365e-05 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859035+0000", 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003202323 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.716 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859059+0000", 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3845e-05 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:9 2.10 e25/19 2:09401a81:::601.00000000:head v 25'4, mlcod=0'0)", 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.856437+0000", 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.82148588699999, 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0051876750000000001, 2024-09-12T02:58:55.717 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856437+0000", 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856437+0000", 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.718 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856438+0000", 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.031e-06 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856446+0000", 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4760000000000001e-06 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856459+0000", 2024-09-12T02:58:55.719 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.289e-05 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856466+0000", 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3860000000000001e-06 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856603+0000", 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013690100000000001 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.720 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856614+0000", 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1636e-05 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861573+0000", 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049580960000000004 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861625+0000", 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2259000000000002e-05 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.721 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:10 2.10 e25/19 2:0bd6d154:::602.00000000:head v 25'5, mlcod=0'0)", 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.856887+0000", 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.82103639899999, 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0047695890000000003, 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.722 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856887+0000", 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856887+0000", 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856887+0000", 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5899999999999995e-07 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856894+0000", 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8059999999999997e-06 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856912+0000", 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7554000000000002e-05 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.724 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856931+0000", 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9120999999999999e-05 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857028+0000", 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6626000000000006e-05 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857046+0000", 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8478000000000002e-05 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.725 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861627+0000", 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0045811239999999998 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861656+0000", 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9020999999999999e-05 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.726 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:11 2.10 e25/19 2:0bd6d154:::602.00000000:head v 25'6, mlcod=0'0)", 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.857372+0000", 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.820551253, 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00432016, 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857372+0000", 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.727 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857372+0000", 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857372+0000", 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9800000000000003e-07 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857401+0000", 2024-09-12T02:58:55.728 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8679000000000001e-05 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857413+0000", 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2352e-05 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857419+0000", 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.729 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857462+0000", 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3157e-05 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857474+0000", 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1783999999999999e-05 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861659+0000", 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041855080000000001 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.730 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861692+0000", 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2814000000000001e-05 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:12 2.10 e25/19 2:0d89b25e:::603.00000000:head v 25'7, mlcod=0'0)", 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.857734+0000", 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.820189429, 2024-09-12T02:58:55.731 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039852569999999999, 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857734+0000", 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857734+0000", 2024-09-12T02:58:55.732 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857734+0000", 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4300000000000002e-07 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857740+0000", 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2970000000000003e-06 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.733 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857752+0000", 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2673e-05 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857760+0000", 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857806+0000", 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6402000000000001e-05 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.734 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857818+0000", 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1216000000000001e-05 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861694+0000", 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038761249999999998 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861719+0000", 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5201000000000001e-05 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.735 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:13 2.10 e25/19 2:0d89b25e:::603.00000000:head v 25'8, mlcod=0'0)", 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858274+0000", 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.819649157, 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034689600000000001, 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858274+0000", 2024-09-12T02:58:55.736 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858274+0000", 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858275+0000", 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5499999999999997e-07 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.737 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858281+0000", 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3249999999999996e-06 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858293+0000", 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1841999999999999e-05 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858300+0000", 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0219999999999999e-06 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.738 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858358+0000", 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7969e-05 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858377+0000", 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9127000000000002e-05 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861720+0000", 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033434580000000001 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.739 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861743+0000", 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2461999999999999e-05 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:14 2.15 e25/19 ondisk, result = 0)", 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859703+0000", 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.818219693, 2024-09-12T02:58:55.740 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022974099999999999, 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859703+0000", 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859703+0000", 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.741 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859704+0000", 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0020000000000001e-06 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859710+0000", 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9789999999999998e-06 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.742 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859729+0000", 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8700000000000001e-05 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859735+0000", 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0499999999999997e-06 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859796+0000", 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0891999999999999e-05 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.743 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859806+0000", 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.039e-05 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859933+0000", 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000126728 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:15 2.15 e25/19 ondisk, result = 0)", 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.863131+0000", 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.81479197900001, 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00020692400000000001, 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863131+0000", 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.745 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863131+0000", 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863132+0000", 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863136+0000", 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0269999999999997e-06 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.746 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863150+0000", 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3983e-05 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863155+0000", 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6180000000000003e-06 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863236+0000", 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0922999999999998e-05 2024-09-12T02:58:55.747 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863242+0000", 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0569999999999998e-06 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863338+0000", 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5465999999999997e-05 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.748 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:30 2.15 e25/19 ondisk, result = 0)", 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.863234+0000", 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.81468946699999, 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00030001799999999999, 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.749 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863234+0000", 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863234+0000", 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.750 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863234+0000", 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.7199999999999998e-07 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863238+0000", 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.433e-06 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863247+0000", 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5359999999999998e-06 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.751 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863253+0000", 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6210000000000001e-06 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015325000000000001 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863414+0000", 2024-09-12T02:58:55.752 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3950000000000003e-06 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863534+0000", 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120011 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:31 2.d e25/19 ondisk, result = 0)", 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.863335+0000", 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 105.81458775, 2024-09-12T02:58:55.753 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00021601300000000001, 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863335+0000", 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863335+0000", 2024-09-12T02:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863336+0000", 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9500000000000002e-07 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863340+0000", 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.749e-06 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.755 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863367+0000", 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7430999999999999e-05 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863373+0000", 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1970000000000001e-06 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863452+0000", 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9084000000000004e-05 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.756 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863459+0000", 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9179999999999997e-06 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863551+0000", 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.1939000000000002e-05 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.757 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:39 2.6 2:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:18.884790+0000", 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 96.793132505000003, 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002678293, 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.884790+0000", 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.758 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.884790+0000", 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.884792+0000", 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.99e-06 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.884801+0000", 2024-09-12T02:58:55.759 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5019999999999992e-06 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.884820+0000", 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9513000000000001e-05 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.884832+0000", 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1221e-05 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.760 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.884904+0000", 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2545000000000004e-05 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.885026+0000", 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121721 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.885116+0000", 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.0344000000000001e-05 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.761 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.886032+0000", 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00091535100000000001 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887349+0000", 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001316946 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887407+0000", 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8112000000000002e-05 2024-09-12T02:58:55.762 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887469+0000", 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2048e-05 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:39 2.6 e26/19 ondisk, result = 0)", 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:18.887148+0000", 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 96.790775112000006, 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00032739899999999997, 2024-09-12T02:58:55.763 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887148+0000", 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887148+0000", 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.764 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887149+0000", 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.001e-06 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887154+0000", 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0189999999999997e-06 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887173+0000", 2024-09-12T02:58:55.765 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8961999999999999e-05 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887182+0000", 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.5680000000000005e-06 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887332+0000", 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014982099999999999 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887343+0000", 2024-09-12T02:58:55.766 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0302999999999999e-05 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:18.887475+0000", 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00013272499999999999 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:55.767 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:55.768 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T02:58:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:55.914 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:55.931 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T02:58:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:56.080 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:56.080 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:56.080 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:56.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T02:58:56.243 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:56.243 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:56.243 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:56.243 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:56.243 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.243 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:6 2.10 2:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.243 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853008+0000", 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.38870782399999, 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063063160000000002, 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853008+0000", 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.244 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853008+0000", 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853010+0000", 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.956e-06 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853018+0000", 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9750000000000007e-06 2024-09-12T02:58:56.245 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853037+0000", 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9100999999999999e-05 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853047+0000", 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0009e-05 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853197+0000", 2024-09-12T02:58:56.246 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000150056 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853337+0000", 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000140259 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853503+0000", 2024-09-12T02:58:56.247 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000165422 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857417+0000", 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003914084 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859215+0000", 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001798673 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.248 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859274+0000", 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8284e-05 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859314+0000", 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0497000000000002e-05 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.249 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:7 2.10 2:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853093+0000", 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.388622738, 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0063596670000000003, 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853093+0000", 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.250 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853093+0000", 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853094+0000", 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3e-07 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853120+0000", 2024-09-12T02:58:56.251 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6641000000000001e-05 2024-09-12T02:58:56.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.252 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.252 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.252 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853134+0000", 2024-09-12T02:58:56.252 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3839000000000001e-05 2024-09-12T02:58:56.252 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853142+0000", 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.841e-06 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853844+0000", 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00070157499999999996 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853923+0000", 2024-09-12T02:58:56.253 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9788000000000002e-05 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854068+0000", 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014444800000000001 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857421+0000", 2024-09-12T02:58:56.254 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003353609 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859354+0000", 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001933066 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859401+0000", 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6320999999999999e-05 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.255 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859453+0000", 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1808999999999998e-05 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:8 2.10 2:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853156+0000", 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.388559438, 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0080683319999999992, 2024-09-12T02:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.257 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.257 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.257 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.257 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.257 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853156+0000", 2024-09-12T02:58:56.257 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.257 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.257 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853156+0000", 2024-09-12T02:58:56.258 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.258 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.258 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.258 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.258 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853157+0000", 2024-09-12T02:58:56.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4000000000000001e-07 2024-09-12T02:58:56.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.259 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.259 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.259 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853162+0000", 2024-09-12T02:58:56.259 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0309999999999998e-06 2024-09-12T02:58:56.259 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.260 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853170+0000", 2024-09-12T02:58:56.260 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1629999999999996e-06 2024-09-12T02:58:56.260 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.260 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.260 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853177+0000", 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9779999999999999e-06 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854290+0000", 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011129930000000001 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.261 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854411+0000", 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000120549 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854563+0000", 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00015264900000000001 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859494+0000", 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049306869999999996 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861133+0000", 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001639431 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861196+0000", 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.2359000000000004e-05 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861225+0000", 2024-09-12T02:58:56.263 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8751999999999998e-05 2024-09-12T02:58:56.264 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.264 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.264 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.264 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.264 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.264 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:9 2.10 2:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.264 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853189+0000", 2024-09-12T02:58:56.264 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.388526344, 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010822211, 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853189+0000", 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853189+0000", 2024-09-12T02:58:56.265 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853190+0000", 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6599999999999996e-07 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853193+0000", 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4199999999999999e-06 2024-09-12T02:58:56.266 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853201+0000", 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3409999999999997e-06 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853206+0000", 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7100000000000004e-06 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854912+0000", 2024-09-12T02:58:56.267 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001705334 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856238+0000", 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001326558 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856314+0000", 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5444000000000005e-05 2024-09-12T02:58:56.268 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861799+0000", 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0054855290000000003 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863906+0000", 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021071010000000001 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.269 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.863965+0000", 2024-09-12T02:58:56.270 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8349e-05 2024-09-12T02:58:56.270 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.270 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.270 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.270 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864012+0000", 2024-09-12T02:58:56.271 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6859e-05 2024-09-12T02:58:56.271 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.271 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.271 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.271 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.271 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.271 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:10 2.10 2:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.271 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853215+0000", 2024-09-12T02:58:56.272 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.388500904, 2024-09-12T02:58:56.272 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010898964000000001, 2024-09-12T02:58:56.272 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.272 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.273 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.273 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.273 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.273 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.273 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853215+0000", 2024-09-12T02:58:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853215+0000", 2024-09-12T02:58:56.274 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.275 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.275 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853215+0000", 2024-09-12T02:58:56.275 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3099999999999998e-07 2024-09-12T02:58:56.275 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.275 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.276 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.276 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853218+0000", 2024-09-12T02:58:56.276 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.836e-06 2024-09-12T02:58:56.276 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.277 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.277 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.277 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853225+0000", 2024-09-12T02:58:56.277 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3849999999999996e-06 2024-09-12T02:58:56.277 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853231+0000", 2024-09-12T02:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.6350000000000003e-06 2024-09-12T02:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856576+0000", 2024-09-12T02:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0033451330000000001 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856698+0000", 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000121867 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.856787+0000", 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.8918000000000005e-05 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.282 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861840+0000", 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0050528229999999997 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864024+0000", 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021840919999999999 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.283 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864072+0000", 2024-09-12T02:58:56.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.8204999999999997e-05 2024-09-12T02:58:56.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.284 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.284 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.284 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864114+0000", 2024-09-12T02:58:56.284 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1638999999999999e-05 2024-09-12T02:58:56.284 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.284 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.284 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.285 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.285 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.285 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:11 2.10 2:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.285 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853238+0000", 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.38847754699999, 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.010981797999999999, 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853238+0000", 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.286 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853238+0000", 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853239+0000", 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1399999999999997e-07 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853242+0000", 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0410000000000002e-06 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.287 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853303+0000", 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1274999999999999e-05 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853311+0000", 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6899999999999992e-06 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.288 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857055+0000", 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003744079 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.5790000000000005e-05 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857258+0000", 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012758999999999999 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.289 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861872+0000", 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0046140269999999997 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864125+0000", 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0022524289999999998 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.290 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864176+0000", 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1171000000000002e-05 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864220+0000", 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4091999999999997e-05 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.291 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:12 2.10 2:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853324+0000", 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.388391982, 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011005320000000001, 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.292 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.293 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853324+0000", 2024-09-12T02:58:56.293 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.293 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.293 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.294 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853324+0000", 2024-09-12T02:58:56.294 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.294 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.294 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.294 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853324+0000", 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6000000000000003e-07 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853329+0000", 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1159999999999998e-06 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853338+0000", 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5920000000000001e-06 2024-09-12T02:58:56.295 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853345+0000", 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7070000000000003e-06 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857485+0000", 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0041405849999999996 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.296 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857555+0000", 2024-09-12T02:58:56.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9400000000000006e-05 2024-09-12T02:58:56.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.297 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.297 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:56.297 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857638+0000", 2024-09-12T02:58:56.297 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.3676000000000003e-05 2024-09-12T02:58:56.297 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861898+0000", 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0042591419999999996 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864232+0000", 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0023346899999999999 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.298 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864285+0000", 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2994000000000001e-05 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864329+0000", 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3757999999999997e-05 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.299 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:13 2.10 2:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853354+0000", 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.38836127099999, 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011074278, 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.300 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853354+0000", 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853354+0000", 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853355+0000", 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1799999999999995e-07 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.301 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.302 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853370+0000", 2024-09-12T02:58:56.302 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5542000000000001e-05 2024-09-12T02:58:56.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.302 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.302 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.303 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853379+0000", 2024-09-12T02:58:56.303 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.405e-06 2024-09-12T02:58:56.303 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.303 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.303 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.304 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853385+0000", 2024-09-12T02:58:56.304 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.8749999999999997e-06 2024-09-12T02:58:56.304 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.304 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.305 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.305 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857859+0000", 2024-09-12T02:58:56.305 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0044746480000000003 2024-09-12T02:58:56.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.306 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.306 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.306 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857903+0000", 2024-09-12T02:58:56.306 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3655000000000001e-05 2024-09-12T02:58:56.306 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 1", 2024-09-12T02:58:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.857999+0000", 2024-09-12T02:58:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.6358000000000001e-05 2024-09-12T02:58:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861915+0000", 2024-09-12T02:58:56.307 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039161250000000003 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864337+0000", 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0024215880000000001 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864388+0000", 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0624999999999997e-05 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.308 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864429+0000", 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0939000000000002e-05 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:22 2.e 2:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853394+0000", 2024-09-12T02:58:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.38832128599999, 2024-09-12T02:58:56.310 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0056117909999999997, 2024-09-12T02:58:56.310 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.310 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.310 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.310 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.310 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.310 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.310 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853394+0000", 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853394+0000", 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853395+0000", 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5899999999999996e-07 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.311 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853398+0000", 2024-09-12T02:58:56.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4020000000000002e-06 2024-09-12T02:58:56.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.312 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.312 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853405+0000", 2024-09-12T02:58:56.312 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.9600000000000003e-06 2024-09-12T02:58:56.312 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.312 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853411+0000", 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5809999999999996e-06 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853577+0000", 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016634000000000001 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853740+0000", 2024-09-12T02:58:56.313 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016266300000000001 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853844+0000", 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000103726 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855953+0000", 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0021098810000000001 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.314 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858879+0000", 2024-09-12T02:58:56.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0029252570000000001 2024-09-12T02:58:56.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.315 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.315 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.315 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858951+0000", 2024-09-12T02:58:56.315 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1948999999999998e-05 2024-09-12T02:58:56.315 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859006+0000", 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5473000000000002e-05 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:23 2.e 2:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853435+0000", 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.388280391, 2024-09-12T02:58:56.316 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0057211149999999997, 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853435+0000", 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.317 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853435+0000", 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853436+0000", 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9500000000000002e-07 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853440+0000", 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.7780000000000001e-06 2024-09-12T02:58:56.318 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853448+0000", 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2330000000000006e-06 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853454+0000", 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3679999999999998e-06 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854198+0000", 2024-09-12T02:58:56.319 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00074401299999999997 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854270+0000", 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.203e-05 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.854434+0000", 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016403000000000001 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.320 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855961+0000", 2024-09-12T02:58:56.321 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001526419 2024-09-12T02:58:56.321 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.321 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.321 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.321 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859063+0000", 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.003102058 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859118+0000", 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5000999999999997e-05 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859156+0000", 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.8590000000000002e-05 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.322 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:22 2.e e25/19 ondisk, result = 0)", 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858671+0000", 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.38304449499999, 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00035054999999999998, 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.323 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858671+0000", 2024-09-12T02:58:56.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.324 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.324 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858671+0000", 2024-09-12T02:58:56.324 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.324 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.324 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858672+0000", 2024-09-12T02:58:56.325 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1680000000000001e-06 2024-09-12T02:58:56.325 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.325 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.325 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.325 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858678+0000", 2024-09-12T02:58:56.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5690000000000004e-06 2024-09-12T02:58:56.326 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.326 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.326 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.326 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858759+0000", 2024-09-12T02:58:56.326 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.0660000000000004e-05 2024-09-12T02:58:56.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858769+0000", 2024-09-12T02:58:56.327 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0052e-05 2024-09-12T02:58:56.327 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.327 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.327 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.327 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858866+0000", 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7079999999999999e-05 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858873+0000", 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4569999999999999e-06 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859022+0000", 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014856400000000001 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.328 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:23 2.e e25/19 ondisk, result = 0)", 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858823+0000", 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.38289215899999, 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000343789, 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.329 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:56.330 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.330 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858823+0000", 2024-09-12T02:58:56.330 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.330 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.330 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.330 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858823+0000", 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858835+0000", 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1319e-05 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858839+0000", 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2919999999999997e-06 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.331 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858872+0000", 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2499000000000002e-05 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858888+0000", 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6888000000000002e-05 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.332 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.333 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.333 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859051+0000", 2024-09-12T02:58:56.333 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016227200000000001 2024-09-12T02:58:56.333 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859058+0000", 2024-09-12T02:58:56.334 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8379999999999996e-06 2024-09-12T02:58:56.334 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.334 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.334 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.334 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859167+0000", 2024-09-12T02:58:56.335 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109681 2024-09-12T02:58:56.335 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.335 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.335 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.335 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.335 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.335 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:7 2.10 e25/19 ondisk, result = 0)", 2024-09-12T02:58:56.335 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859177+0000", 2024-09-12T02:58:56.335 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.38253887800001, 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00028307000000000001, 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859177+0000", 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.336 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859177+0000", 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859177+0000", 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.4900000000000001e-07 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.337 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859204+0000", 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6341000000000001e-05 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859213+0000", 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4339999999999998e-06 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859219+0000", 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3400000000000003e-06 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.338 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859344+0000", 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000124315 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859350+0000", 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9649999999999996e-06 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859460+0000", 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000110226 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.339 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop_reply(mds.0.4:8 2.10 e25/19 ondisk, result = 0)", 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859239+0000", 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.382477134, 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00026201499999999999, 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.340 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859239+0000", 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859239+0000", 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859239+0000", 2024-09-12T02:58:56.341 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.2300000000000002e-07 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859242+0000", 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.022e-06 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859250+0000", 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.6939999999999995e-06 2024-09-12T02:58:56.342 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.343 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.343 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859255+0000", 2024-09-12T02:58:56.343 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1769999999999997e-06 2024-09-12T02:58:56.343 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.343 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859482+0000", 2024-09-12T02:58:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022756400000000001 2024-09-12T02:58:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859489+0000", 2024-09-12T02:58:56.345 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0129999999999996e-06 2024-09-12T02:58:56.345 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.345 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.345 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.345 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859501+0000", 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1222e-05 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDPGPushReply(2.10 41/40 [PushReplyOp(2:0bd6d154:::602.00000000:head)])", 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:04.927475+0000", 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 51.314240656999999, 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00022701199999999999, 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.346 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.347 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:56.347 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.347 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.347 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.347 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927475+0000", 2024-09-12T02:58:56.347 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.347 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927475+0000", 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927476+0000", 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0299999999999998e-07 2024-09-12T02:58:56.348 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927479+0000", 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.518e-06 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927491+0000", 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2271e-05 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.349 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927502+0000", 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0488e-05 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927558+0000", 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5699000000000003e-05 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:04.927702+0000", 2024-09-12T02:58:56.350 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00014433299999999999 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:58 2.1 2:86ee9bce:::500.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:55.970571+0000", 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.27114465500000001, 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001498943, 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.351 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.352 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.970571+0000", 2024-09-12T02:58:56.352 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.352 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.352 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.352 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.970571+0000", 2024-09-12T02:58:56.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.353 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.353 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.353 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.353 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.970574+0000", 2024-09-12T02:58:56.353 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6029999999999999e-06 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.970585+0000", 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1827e-05 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.970616+0000", 2024-09-12T02:58:56.354 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0175000000000002e-05 2024-09-12T02:58:56.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.970630+0000", 2024-09-12T02:58:56.355 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4096e-05 2024-09-12T02:58:56.355 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.355 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.355 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.355 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.970719+0000", 2024-09-12T02:58:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9456999999999994e-05 2024-09-12T02:58:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.970841+0000", 2024-09-12T02:58:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00012232899999999999 2024-09-12T02:58:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.356 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.972070+0000", 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012284559999999999 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:65 2.1 2:86ee9bce:::500.00000001:head [write 0~311] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:55.973619+0000", 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.26809703400000001, 2024-09-12T02:58:56.357 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001846961, 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973619+0000", 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973619+0000", 2024-09-12T02:58:56.358 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.359 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.359 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973620+0000", 2024-09-12T02:58:56.359 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3900000000000003e-07 2024-09-12T02:58:56.359 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.359 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973624+0000", 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3059999999999999e-06 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973635+0000", 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.164e-05 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.360 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973644+0000", 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9600000000000006e-06 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973705+0000", 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.0223000000000003e-05 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.361 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973745+0000", 2024-09-12T02:58:56.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0800000000000002e-05 2024-09-12T02:58:56.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.362 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:56.362 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973817+0000", 2024-09-12T02:58:56.362 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1200999999999998e-05 2024-09-12T02:58:56.362 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.362 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "op_commit", 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.974647+0000", 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00083004900000000002 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975384+0000", 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000737088 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975437+0000", 2024-09-12T02:58:56.363 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2768e-05 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975466+0000", 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8986999999999999e-05 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.364 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:66 2.1 2:86ee9bce:::500.00000001:head [read 0~311 [fadvise_dontneed]] snapc 0=[] ondisk+read+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:55.975619+0000", 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.26609652900000003, 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001201557, 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.365 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975619+0000", 2024-09-12T02:58:56.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.366 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975619+0000", 2024-09-12T02:58:56.366 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.366 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.366 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.366 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975620+0000", 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.6499999999999999e-07 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975623+0000", 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.3230000000000002e-06 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.367 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975634+0000", 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0742e-05 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975655+0000", 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.0886e-05 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975706+0000", 2024-09-12T02:58:56.368 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1523000000000001e-05 2024-09-12T02:58:56.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.369 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.369 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975757+0000", 2024-09-12T02:58:56.369 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0538999999999998e-05 2024-09-12T02:58:56.369 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.369 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.370 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.370 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.976821+0000", 2024-09-12T02:58:56.370 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001063879 2024-09-12T02:58:56.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.370 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.370 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.370 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.370 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.371 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(4.12s2 60/52 ECSubWrite(tid=11, reqid=mds.0.4:68, at_version=60'3, trim_to=0'0, roll_forward_to=58'2))", 2024-09-12T02:58:56.371 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:55.977837+0000", 2024-09-12T02:58:56.371 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.26387864799999999, 2024-09-12T02:58:56.371 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010933189999999999, 2024-09-12T02:58:56.371 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.371 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.371 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977837+0000", 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977837+0000", 2024-09-12T02:58:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977837+0000", 2024-09-12T02:58:56.373 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0899999999999997e-07 2024-09-12T02:58:56.373 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.373 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.373 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.373 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977855+0000", 2024-09-12T02:58:56.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8048999999999999e-05 2024-09-12T02:58:56.374 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.374 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.374 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.374 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977871+0000", 2024-09-12T02:58:56.374 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5721000000000001e-05 2024-09-12T02:58:56.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977881+0000", 2024-09-12T02:58:56.375 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7529999999999996e-06 2024-09-12T02:58:56.375 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.375 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.375 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.375 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.978045+0000", 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00016381300000000001 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.978050+0000", 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5520000000000004e-06 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.978901+0000", 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00085084199999999998 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.376 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.978930+0000", 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9280000000000001e-05 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "MOSDECSubOpWrite(4.12s2 60/52 ECSubWrite(tid=13, reqid=mds.0.4:68, at_version=0'0, trim_to=0'0, roll_forward_to=60'3))", 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:55.981743+0000", 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.25997239999999999, 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00061073900000000001, 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.377 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.981743+0000", 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.378 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.981743+0000", 2024-09-12T02:58:56.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.379 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.379 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.379 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.379 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.981744+0000", 2024-09-12T02:58:56.379 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.3900000000000004e-07 2024-09-12T02:58:56.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.380 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.380 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.380 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.981752+0000", 2024-09-12T02:58:56.380 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2300000000000008e-06 2024-09-12T02:58:56.380 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.981763+0000", 2024-09-12T02:58:56.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.128e-05 2024-09-12T02:58:56.381 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.381 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.381 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.381 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.981771+0000", 2024-09-12T02:58:56.381 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8720000000000002e-06 2024-09-12T02:58:56.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.382 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.981827+0000", 2024-09-12T02:58:56.382 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5862999999999997e-05 2024-09-12T02:58:56.382 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.382 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.382 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_started", 2024-09-12T02:58:56.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.981835+0000", 2024-09-12T02:58:56.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1999999999999994e-06 2024-09-12T02:58:56.383 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.383 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.383 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "sub_op_committed", 2024-09-12T02:58:56.383 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.982324+0000", 2024-09-12T02:58:56.383 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00048862000000000005 2024-09-12T02:58:56.384 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.384 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.384 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.384 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.982354+0000", 2024-09-12T02:58:56.384 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0035e-05 2024-09-12T02:58:56.384 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.384 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.385 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.385 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.385 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.385 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:56.387 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T02:58:56.533 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:56.533 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:56.533 INFO:teuthology.orchestra.run.smithi063.stdout: "num_ops": 0 2024-09-12T02:58:56.533 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:56.548 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T02:58:56.692 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:56.693 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [], 2024-09-12T02:58:56.693 INFO:teuthology.orchestra.run.smithi063.stdout: "complaint_time": 180, 2024-09-12T02:58:56.693 INFO:teuthology.orchestra.run.smithi063.stdout: "num_blocked_ops": 0 2024-09-12T02:58:56.693 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:56.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T02:58:56.855 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:58:56.855 INFO:teuthology.orchestra.run.smithi063.stdout: "size": 20, 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 600, 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "ops": [ 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:33 2.1b 2:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 107.001526927, 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011663767, 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.856 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:56.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.857 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.857 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.857 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.857 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853090+0000", 2024-09-12T02:58:56.857 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853092+0000", 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.243e-06 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853098+0000", 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7509999999999997e-06 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.858 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853119+0000", 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.075e-05 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853130+0000", 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1396000000000001e-05 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853240+0000", 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000109484 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853398+0000", 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000158574 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864754+0000", 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.011355568999999999 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.860 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:37 2.1e 2:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 107.001451289, 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0065283390000000002, 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:56.861 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853166+0000", 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.4600000000000004e-07 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.862 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853171+0000", 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1860000000000002e-06 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853181+0000", 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0239e-05 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853188+0000", 2024-09-12T02:58:56.863 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0389999999999999e-06 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853287+0000", 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9116000000000004e-05 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.853406+0000", 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00011876500000000001 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.864 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859694+0000", 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006288348 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:22 2.e e25/19 2:717a0223:::608.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.999180096, 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031174459999999998, 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.865 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855437+0000", 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.866 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855439+0000", 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.562e-06 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855447+0000", 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.1899999999999995e-06 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855460+0000", 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3521e-05 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.867 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855469+0000", 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2709999999999992e-06 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855540+0000", 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.1112000000000006e-05 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855574+0000", 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.4823999999999997e-05 2024-09-12T02:58:56.868 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858501+0000", 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.002926695 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858554+0000", 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.3270999999999999e-05 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.869 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:23 2.e e25/19 2:717a0223:::608.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.999119736, 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0030877769999999999, 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.870 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855497+0000", 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855498+0000", 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6199999999999998e-07 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855504+0000", 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.7209999999999999e-06 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855512+0000", 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2500000000000006e-06 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855517+0000", 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.4079999999999997e-06 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.872 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855770+0000", 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00025252599999999999 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.855787+0000", 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7486000000000002e-05 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858557+0000", 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0027699449999999998 2024-09-12T02:58:56.873 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858585+0000", 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.7979000000000001e-05 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:18 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.996372248, 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0034578339999999999, 2024-09-12T02:58:56.874 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858245+0000", 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.875 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858246+0000", 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.7199999999999997e-07 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858287+0000", 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1106000000000003e-05 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858304+0000", 2024-09-12T02:58:56.876 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7221e-05 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858314+0000", 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.3819999999999993e-06 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858531+0000", 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000217538 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.877 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858546+0000", 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4518000000000001e-05 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861647+0000", 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0031017060000000001 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.861703+0000", 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5390999999999999e-05 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.878 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:19 2.14 e25/19 2:2f55791f:::606.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.996253493, 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.006126589, 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.879 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858364+0000", 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.0399999999999996e-07 2024-09-12T02:58:56.880 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858380+0000", 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5491000000000001e-05 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858397+0000", 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7720999999999999e-05 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.881 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858404+0000", 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.669e-06 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858743+0000", 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00033907799999999998 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858760+0000", 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6572999999999999e-05 2024-09-12T02:58:56.882 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864447+0000", 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.005686895 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864490+0000", 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3658000000000001e-05 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.883 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:1 2.14 e25/19 2:292cf221:::200.00000000:head v 25'3, mlcod=0'0)", 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.996201646, 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0061037929999999997, 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.884 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858415+0000", 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858416+0000", 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.2300000000000002e-07 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.885 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858421+0000", 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.5319999999999997e-06 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858429+0000", 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.8790000000000003e-06 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1599999999999997e-06 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.886 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858911+0000", 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00047701999999999998 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.858930+0000", 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8189000000000002e-05 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864493+0000", 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0055629099999999999 2024-09-12T02:58:56.887 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864519+0000", 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6679999999999999e-05 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:3 2.14 e25/19 2:287034c4:::1.00000000.inode:head v 25'4, mlcod=0'0)", 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.99529912, 2024-09-12T02:58:56.888 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0052338280000000003, 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.889 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859318+0000", 2024-09-12T02:58:56.892 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.892 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.892 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.892 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.892 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859319+0000", 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3099999999999997e-07 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859326+0000", 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0520000000000004e-06 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859345+0000", 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9466e-05 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.893 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859353+0000", 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.2009999999999999e-06 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859518+0000", 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000164582 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.859536+0000", 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.8088999999999999e-05 2024-09-12T02:58:56.894 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864521+0000", 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0049850390000000001 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864552+0000", 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.0667999999999998e-05 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.895 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "pg_update_log_missing(2.14 epoch 25/19 rep_tid 7 entries 25'5 (0'0) error 2:2e2fa760:::200.00000001:head by mds.0.4:32 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 106.994012715, 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0039558550000000003, 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "reached pg", 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:56.896 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860604+0000", 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860605+0000", 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.3200000000000004e-07 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.897 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860613+0000", 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.644e-06 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860632+0000", 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9173000000000001e-05 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860661+0000", 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8589e-05 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.898 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.860740+0000", 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9216999999999997e-05 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:09.864560+0000", 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0038205000000000001 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:40 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'7, mlcod=25'5)", 2024-09-12T02:58:56.899 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 96.239946583999995, 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001141305, 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.900 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614671+0000", 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614672+0000", 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4619999999999999e-06 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614684+0000", 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.204e-05 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.901 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614703+0000", 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9415e-05 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614713+0000", 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4720000000000001e-06 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614774+0000", 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.1449000000000001e-05 2024-09-12T02:58:56.902 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.614790+0000", 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.6112000000000001e-05 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615776+0000", 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00098508800000000007 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.903 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:20.615812+0000", 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.6266999999999997e-05 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:41 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'8, mlcod=25'6)", 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 94.483657511999994, 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001160754, 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.904 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370960+0000", 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.905 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.370962+0000", 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2529999999999999e-06 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371051+0000", 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9019999999999998e-05 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371086+0000", 2024-09-12T02:58:56.906 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 3.5153e-05 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371103+0000", 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7113999999999999e-05 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371265+0000", 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000162063 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.907 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.371314+0000", 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.9110000000000002e-05 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372077+0000", 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.000762566 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:22.372120+0000", 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.3475e-05 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.908 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:42 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'9, mlcod=26'7)", 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 93.601843645000002, 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010780609999999999, 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.909 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252773+0000", 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252775+0000", 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3829999999999999e-06 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.910 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252785+0000", 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.9650000000000003e-06 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252802+0000", 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7550999999999998e-05 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252813+0000", 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0169e-05 2024-09-12T02:58:56.911 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252883+0000", 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0660000000000004e-05 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.252910+0000", 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6889999999999998e-05 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253800+0000", 2024-09-12T02:58:56.912 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00088991299999999999 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:23.253852+0000", 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1530000000000003e-05 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:43 2.14 e26/19 2:2e2fa760:::200.00000001:head v 26'10, mlcod=26'8)", 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 71.917679805000006, 2024-09-12T02:58:56.913 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001011966, 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936937+0000", 2024-09-12T02:58:56.914 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936939+0000", 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936949+0000", 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0395e-05 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.915 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936966+0000", 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7173e-05 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.936977+0000", 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0557000000000001e-05 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937037+0000", 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.9672000000000001e-05 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.916 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937056+0000", 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9338999999999999e-05 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937870+0000", 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00081393600000000002 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:44.937949+0000", 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9418000000000004e-05 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.917 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:45 2.14 e27/19 2:2e2fa760:::200.00000001:head v 27'12, mlcod=26'10)", 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 69.224850387000004, 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00181248, 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.918 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629767+0000", 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.91e-07 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.919 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629819+0000", 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.1918e-05 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629833+0000", 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3767999999999999e-05 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629844+0000", 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1326e-05 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629933+0000", 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9419999999999994e-05 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.629962+0000", 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.8314999999999999e-05 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.921 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631512+0000", 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0015498 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:57:47.631579+0000", 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7642000000000001e-05 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.922 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:47 2.14 e47/19 2:2e2fa760:::200.00000001:head v 47'13, mlcod=26'11)", 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.545315281000001, 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001880287, 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.923 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309302+0000", 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309303+0000", 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.544e-06 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309325+0000", 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.2031e-05 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.924 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309346+0000", 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.1049000000000001e-05 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309359+0000", 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.2988e-05 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309439+0000", 2024-09-12T02:58:56.925 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9721999999999993e-05 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.309465+0000", 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.5884000000000002e-05 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311130+0000", 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001664837 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311182+0000", 2024-09-12T02:58:56.926 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 5.2231999999999997e-05 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:48 2.14 e47/19 2:292cf221:::200.00000000:head v 47'14, mlcod=26'11)", 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 36.544181477999999, 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001320122, 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.927 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.928 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310436+0000", 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.5300000000000003e-07 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310443+0000", 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.7739999999999999e-06 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310453+0000", 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.8970000000000003e-06 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.929 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310460+0000", 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 6.8460000000000002e-06 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310554+0000", 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4036999999999994e-05 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.310577+0000", 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.3462999999999999e-05 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.930 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311709+0000", 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011311400000000001 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:20.311756+0000", 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.7111999999999999e-05 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.931 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:54 2.14 e59/19 2:2e2fa760:::200.00000001:head v 59'17, mlcod=58'15)", 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:54.051628+0000", 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 2.8029892379999999, 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001439475, 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.051628+0000", 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.932 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.051628+0000", 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.051630+0000", 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.4839999999999998e-06 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.933 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.051660+0000", 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9904999999999999e-05 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.051687+0000", 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.6718999999999999e-05 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.051700+0000", 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3358e-05 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.934 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.051795+0000", 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 9.4412000000000003e-05 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.051814+0000", 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9624999999999999e-05 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.053027+0000", 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001212723 2024-09-12T02:58:56.935 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:54.053067+0000", 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.0249e-05 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:56 2.14 e60/19 2:2e2fa760:::200.00000001:head v 60'18, mlcod=58'16)", 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:55.231357+0000", 2024-09-12T02:58:56.936 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 1.623260154, 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001116765, 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.231357+0000", 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.937 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.231357+0000", 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.231357+0000", 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.73e-07 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.231369+0000", 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.1727e-05 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.938 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.231385+0000", 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.5682e-05 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.231395+0000", 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.0550999999999999e-05 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.231484+0000", 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 8.9006999999999997e-05 2024-09-12T02:58:56.939 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.231503+0000", 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.9012e-05 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.232432+0000", 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00092875300000000004 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.940 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.232474+0000", 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.1860000000000002e-05 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_repop(mds.0.4:65 2.1 e60/19 2:86ee9bce:::500.00000001:head v 60'2, mlcod=0'0)", 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:55.973933+0000", 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.88068428600000004, 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.001317253, 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:56.941 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973933+0000", 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973933+0000", 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.942 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973934+0000", 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4700000000000001e-07 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973941+0000", 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.4630000000000004e-06 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973955+0000", 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.3757000000000001e-05 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.943 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.973962+0000", 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0029999999999997e-06 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.974034+0000", 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.2445000000000002e-05 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.974054+0000", 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.995e-05 2024-09-12T02:58:56.944 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "commit_sent", 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975221+0000", 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0011664889999999999 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.975250+0000", 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 2.9399000000000001e-05 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.945 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "description": "osd_op(mds.0.4:67 2.12 2:4bec3886:::10000000002.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "initiated_at": "2024-09-12T02:58:55.977050+0000", 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.87756712999999997, 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0012636839999999999, 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "continuous": false, 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "type_data": { 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "flag_point": "started", 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "events": [ 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "initiated", 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977050+0000", 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.946 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "header_read", 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977050+0000", 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "throttled", 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977052+0000", 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.849e-06 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "all_read", 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977057+0000", 2024-09-12T02:58:56.947 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 4.6870000000000002e-06 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "dispatched", 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977074+0000", 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 1.7490999999999999e-05 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "queued_for_pg", 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977082+0000", 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.9580000000000007e-06 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.948 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "reached_pg", 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977152+0000", 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 7.0091000000000004e-05 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "started", 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.977259+0000", 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.00010649000000000001 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "event": "done", 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "time": "2024-09-12T02:58:55.978314+0000", 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: "duration": 0.0010551180000000001 2024-09-12T02:58:56.949 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-12T02:58:56.950 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-12T02:58:56.950 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:58:56.951 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T02:58:56.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T02:58:57.083 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:57.083 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:57.083 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:57.083 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:57.099 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T02:58:57.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9d800640 1 Processor -- start 2024-09-12T02:58:57.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9d800640 1 -- start start 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9d800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efe98154850 0x7efe980b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9d800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 0x7efe980c5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9d800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe980cb5b0 0x7efe980c5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9d800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7efe9806c350 con 0x7efe980cb5b0 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9d800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7efe9815b520 con 0x7efe98154850 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9d800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7efe9806c610 con 0x7efe980cb190 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9ce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe980cb5b0 0x7efe980c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe97e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efe98154850 0x7efe980b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe8f400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 0x7efe980c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:57.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe97e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efe98154850 0x7efe980b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:57188/0 (socket says 172.21.15.63:57188) 2024-09-12T02:58:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9ce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe980cb5b0 0x7efe980c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39648/0 (socket says 172.21.15.63:39648) 2024-09-12T02:58:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe97e00640 1 -- 172.21.15.63:0/2232065435 learned_addr learned my addr 172.21.15.63:0/2232065435 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9ce00640 1 -- 172.21.15.63:0/2232065435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 msgr2=0x7efe980c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9ce00640 1 --2- 172.21.15.63:0/2232065435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 0x7efe980c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9ce00640 1 -- 172.21.15.63:0/2232065435 >> v2:172.21.15.119:3300/0 conn(0x7efe98154850 msgr2=0x7efe980b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9ce00640 1 --2- 172.21.15.63:0/2232065435 >> v2:172.21.15.119:3300/0 conn(0x7efe98154850 0x7efe980b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.116+0000 7efe9ce00640 1 -- 172.21.15.63:0/2232065435 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9806c8f0 con 0x7efe980cb5b0 2024-09-12T02:58:57.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9ce00640 1 --2- 172.21.15.63:0/2232065435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 0x7efe980c5540 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe980d1260 tx=0x7efe9001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c22ff976b14d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe97400640 1 -- 172.21.15.63:0/2232065435 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe900b2070 con 0x7efe980cb5b0 2024-09-12T02:58:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe97400640 1 -- 172.21.15.63:0/2232065435 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe900a5980 con 0x7efe980cb5b0 2024-09-12T02:58:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe97400640 1 -- 172.21.15.63:0/2232065435 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe900a5d50 con 0x7efe980cb5b0 2024-09-12T02:58:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9d800640 1 -- 172.21.15.63:0/2232065435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 msgr2=0x7efe980c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9d800640 1 --2- 172.21.15.63:0/2232065435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 0x7efe980c5540 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe980d1260 tx=0x7efe9001c900 comp rx=0 tx=0).stop 2024-09-12T02:58:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9d800640 1 -- 172.21.15.63:0/2232065435 shutdown_connections 2024-09-12T02:58:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9d800640 1 --2- 172.21.15.63:0/2232065435 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 0x7efe980c5540 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9d800640 1 --2- 172.21.15.63:0/2232065435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 0x7efe980c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9d800640 1 --2- 172.21.15.63:0/2232065435 >> v2:172.21.15.119:3300/0 conn(0x7efe98154850 0x7efe980b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9d800640 1 -- 172.21.15.63:0/2232065435 >> 172.21.15.63:0/2232065435 conn(0x7efe98067a00 msgr2=0x7efe98067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:57.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9d800640 1 -- 172.21.15.63:0/2232065435 shutdown_connections 2024-09-12T02:58:57.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.120+0000 7efe9d800640 1 -- 172.21.15.63:0/2232065435 wait complete. 2024-09-12T02:58:57.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 Processor -- start 2024-09-12T02:58:57.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 -- start start 2024-09-12T02:58:57.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 0x7efe980b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:57.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 0x7efe98157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:57.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe98154850 0x7efe98157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:57.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efe9815dd30 con 0x7efe980cb5b0 2024-09-12T02:58:57.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7efe9815dbb0 con 0x7efe98154850 2024-09-12T02:58:57.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7efe9815deb0 con 0x7efe980cb190 2024-09-12T02:58:57.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe8f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 0x7efe98157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe97e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 0x7efe980b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe8f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 0x7efe98157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39658/0 (socket says 172.21.15.63:39658) 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe8f400640 1 -- 172.21.15.63:0/1850945052 learned_addr learned my addr 172.21.15.63:0/1850945052 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9ce00640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe98154850 0x7efe98157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe8f400640 1 -- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 msgr2=0x7efe980b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe8f400640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 0x7efe980b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe8f400640 1 -- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe98154850 msgr2=0x7efe98157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe8f400640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe98154850 0x7efe98157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe8f400640 1 -- 172.21.15.63:0/1850945052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe981560a0 con 0x7efe980cb5b0 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe8f400640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 0x7efe98157140 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efe8000e930 tx=0x7efe8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe94c00640 1 -- 172.21.15.63:0/1850945052 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80017070 con 0x7efe980cb5b0 2024-09-12T02:58:57.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe94c00640 1 -- 172.21.15.63:0/1850945052 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe8000ca00 con 0x7efe980cb5b0 2024-09-12T02:58:57.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe94c00640 1 -- 172.21.15.63:0/1850945052 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8000cdd0 con 0x7efe980cb5b0 2024-09-12T02:58:57.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe98156380 con 0x7efe980cb5b0 2024-09-12T02:58:57.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe98156940 con 0x7efe980cb5b0 2024-09-12T02:58:57.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.124+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe980b2de0 con 0x7efe980cb5b0 2024-09-12T02:58:57.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.128+0000 7efe94c00640 1 -- 172.21.15.63:0/1850945052 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe8001a070 con 0x7efe980cb5b0 2024-09-12T02:58:57.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.128+0000 7efe94c00640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efe740678c0 0x7efe74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:57.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.128+0000 7efe94c00640 1 -- 172.21.15.63:0/1850945052 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6685+0+0 (secure 0 0 0) 0x7efe800862a0 con 0x7efe980cb5b0 2024-09-12T02:58:57.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.128+0000 7efe97e00640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efe740678c0 0x7efe74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:57.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.128+0000 7efe97e00640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efe740678c0 0x7efe74069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efe88009ab0 tx=0x7efe88009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:57.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.132+0000 7efe94c00640 1 -- 172.21.15.63:0/1850945052 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe80056510 con 0x7efe980cb5b0 2024-09-12T02:58:57.221 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:57.221 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:57.221 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:57.221 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:57.221 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:57.235 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T02:58:57.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.308+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd unset", "key": "noscrub"} v 0) -- 0x7efe980cb9f0 con 0x7efe980cb5b0 2024-09-12T02:58:57.360 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:57.360 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:57.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:2 2.f 2:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.506130744, 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010113216, 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.361 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851755+0000", 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851757+0000", 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6570000000000001e-06 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851768+0000", 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1229e-05 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851791+0000", 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2272e-05 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.851815+0000", 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4088e-05 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852067+0000", 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025200100000000002 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852395+0000", 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000328516 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:57.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852816+0000", 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00042120999999999999 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856792+0000", 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003975391 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861612+0000", 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048197120000000003 2024-09-12T02:58:57.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861765+0000", 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015328999999999999 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861868+0000", 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010285000000000001 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.367 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.368 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:31 2.d e25/19 2:b50e409b:::mds_snaptable:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:57.368 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:57.368 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.501369966, 2024-09-12T02:58:57.368 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064933129999999997, 2024-09-12T02:58:57.368 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.368 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.368 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.368 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856515+0000", 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856518+0000", 2024-09-12T02:58:57.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2869999999999999e-06 2024-09-12T02:58:57.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856533+0000", 2024-09-12T02:58:57.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5519000000000002e-05 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856564+0000", 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0803999999999998e-05 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856585+0000", 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0883e-05 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857084+0000", 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00049961500000000002 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857131+0000", 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6270000000000003e-05 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862906+0000", 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057754679999999997 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863009+0000", 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00010246700000000001 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:29 2.b e25/19 2:d0630e4c:::mds0_sessionmap:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.501232104, 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029032509999999999, 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.373 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856653+0000", 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.374 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1230000000000001e-06 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856665+0000", 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1093e-05 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856687+0000", 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1968e-05 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856701+0000", 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4012999999999999e-05 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856849+0000", 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000147217 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856911+0000", 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2015999999999997e-05 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859446+0000", 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025352650000000001 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859556+0000", 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110556 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.377 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 25/19 rep_tid 120 entries 25'2 (0'0) error 2:d5c7a900:::200.00000003:head by mds.0.4:34 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.501145987, 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060738329999999998, 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:57.378 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856739+0000", 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856740+0000", 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8400000000000003e-07 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.379 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856756+0000", 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5522000000000001e-05 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856793+0000", 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7375e-05 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856826+0000", 2024-09-12T02:58:57.380 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2554e-05 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857624+0000", 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000798524 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862813+0000", 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0051890740000000001 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:28 2.13 e25/19 2:cd5a64a3:::100.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.500422155, 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0054539109999999997, 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.382 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857463+0000", 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857465+0000", 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9130000000000001e-06 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857489+0000", 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4108e-05 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857517+0000", 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7801999999999999e-05 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857536+0000", 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9468999999999999e-05 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.384 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857930+0000", 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000394039 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857974+0000", 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3294000000000003e-05 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862819+0000", 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048455820000000002 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.385 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862917+0000", 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.7703999999999998e-05 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:27 2.13 e25/19 2:c91d4a1d:::mds0_inotable:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.500263288, 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0070811249999999997, 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.386 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857622+0000", 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857623+0000", 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4759999999999999e-06 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857652+0000", 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8418000000000001e-05 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857685+0000", 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2838e-05 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857702+0000", 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7762999999999999e-05 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858469+0000", 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00076699500000000002 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858515+0000", 2024-09-12T02:58:57.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.57e-05 2024-09-12T02:58:57.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864594+0000", 2024-09-12T02:58:57.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0060784919999999996 2024-09-12T02:58:57.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864703+0000", 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109443 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.1a epoch 25/19 rep_tid 5 entries 25'1 (0'0) error 2:5e41ab69:::200.00000005:head by mds.0.4:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.49980967, 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0048697209999999996, 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.392 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858076+0000", 2024-09-12T02:58:57.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858077+0000", 2024-09-12T02:58:57.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5629999999999999e-06 2024-09-12T02:58:57.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858098+0000", 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0574999999999999e-05 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858141+0000", 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.3587000000000001e-05 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858179+0000", 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7635000000000001e-05 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858389+0000", 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021037000000000001 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862945+0000", 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0045559909999999997 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop_reply(mds.0.4:2 2.f e25/19 ondisk, result = 0)", 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.49657567600001, 2024-09-12T02:58:57.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00057191100000000003, 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.397 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861310+0000", 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861312+0000", 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1399999999999998e-06 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.398 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861323+0000", 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1732e-05 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861362+0000", 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8838000000000003e-05 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861381+0000", 2024-09-12T02:58:57.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9088000000000001e-05 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861574+0000", 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192182 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861593+0000", 2024-09-12T02:58:57.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9894999999999998e-05 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861881+0000", 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00028803599999999998 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.401 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDPGPush(2.6 41/40 [PushOp(2:654134d2:::mds0_openfiles.0:head, version: 28'2, data_included: [], data_size: 0, omap_header_size: 42, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(2:654134d2:::mds0_openfiles.0:head@28'2, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 0, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 52.451192845999998, 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00050712800000000003, 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.402 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906692+0000", 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906694+0000", 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1620000000000001e-06 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906711+0000", 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6974e-05 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906734+0000", 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3862999999999998e-05 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906757+0000", 2024-09-12T02:58:57.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2765e-05 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906918+0000", 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000160326 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.906935+0000", 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7215e-05 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:04.907200+0000", 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026482300000000002 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:55 2.6 e59/40 2:654134d2:::mds0_openfiles.0:head v 59'6, mlcod=49'4)", 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:54.896746+0000", 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 2.4611394679999998, 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016516180000000001, 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896746+0000", 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896746+0000", 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896748+0000", 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3e-06 2024-09-12T02:58:57.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896765+0000", 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7044000000000001e-05 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896804+0000", 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8630000000000001e-05 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896828+0000", 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3839e-05 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896979+0000", 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015176600000000001 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.897044+0000", 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.4906000000000005e-05 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.898303+0000", 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012591410000000001 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.898397+0000", 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3992000000000004e-05 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:57 2.6 e60/40 2:654134d2:::mds0_openfiles.0:head v 60'7, mlcod=58'5)", 2024-09-12T02:58:57.410 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:55.896906+0000", 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.460979238, 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016969039999999999, 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896906+0000", 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896906+0000", 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896908+0000", 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8500000000000001e-06 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896921+0000", 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3200000000000001e-05 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896945+0000", 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4340000000000001e-05 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896976+0000", 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0658999999999999e-05 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.897111+0000", 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013459299999999999 2024-09-12T02:58:57.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.897168+0000", 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7318999999999998e-05 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.898528+0000", 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013598939999999999 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.898603+0000", 2024-09-12T02:58:57.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.5049000000000006e-05 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.b epoch 60/19 rep_tid 123 entries 60'3 (0'0) error 2:d5442d2d:::500.00000006:head by mds.0.4:63 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 25'1)", 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:55.971165+0000", 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.3867203539999999, 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001456475, 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971165+0000", 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971165+0000", 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971168+0000", 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7130000000000001e-06 2024-09-12T02:58:57.416 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971192+0000", 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4635999999999999e-05 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971263+0000", 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.0423e-05 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971303+0000", 2024-09-12T02:58:57.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.0760000000000003e-05 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971525+0000", 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000221561 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.972621+0000", 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010963819999999999 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.419 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "pg_update_log_missing(2.6 epoch 60/40 rep_tid 28 entries 60'8 (0'0) error 2:66eb7180:::500.00000004:head by mds.0.4:61 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 59'6)", 2024-09-12T02:58:57.419 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:55.971223+0000", 2024-09-12T02:58:57.419 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.3866620350000001, 2024-09-12T02:58:57.419 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019885760000000001, 2024-09-12T02:58:57.419 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.419 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.419 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:57.419 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971223+0000", 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971223+0000", 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971225+0000", 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.996e-06 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971252+0000", 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6373999999999999e-05 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971305+0000", 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.3426e-05 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971345+0000", 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9780000000000002e-05 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.971604+0000", 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025942499999999998 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.973212+0000", 2024-09-12T02:58:57.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001607575 2024-09-12T02:58:57.423 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.423 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.423 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.423 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.423 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.423 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:57.425 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T02:58:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:57.550 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:57.550 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:57.550 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:57.564 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T02:58:57.686 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:57.686 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:57.686 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:57.686 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:57.686 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:57.700 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T02:58:57.824 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:57.824 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:57.824 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:18 2.14 2:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.970114446, 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010425156999999999, 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.825 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852270+0000", 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852273+0000", 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.8830000000000002e-06 2024-09-12T02:58:57.826 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852287+0000", 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3942e-05 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852314+0000", 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6729000000000001e-05 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.827 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.828 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.828 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852337+0000", 2024-09-12T02:58:57.828 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3295e-05 2024-09-12T02:58:57.828 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.828 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.828 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.828 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852591+0000", 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025376400000000002 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852915+0000", 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032403999999999999 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853305+0000", 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000390045 2024-09-12T02:58:57.829 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861043+0000", 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077385259999999999 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862421+0000", 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013773730000000001 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862569+0000", 2024-09-12T02:58:57.830 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000148684 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862695+0000", 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125876 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:19 2.14 2:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:57.831 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.969981238, 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012535321, 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852403+0000", 2024-09-12T02:58:57.832 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852405+0000", 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1069999999999999e-06 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852412+0000", 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9189999999999999e-06 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.833 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852428+0000", 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5366000000000002e-05 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852445+0000", 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7385e-05 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854020+0000", 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001574649 2024-09-12T02:58:57.834 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854228+0000", 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020809299999999999 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854564+0000", 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033596199999999998 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861097+0000", 2024-09-12T02:58:57.835 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0065335380000000002 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864726+0000", 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003628338 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864877+0000", 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015152399999999999 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.836 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864939+0000", 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1439999999999995e-05 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:24 2.7 2:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.969876488, 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010076079, 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.837 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852508+0000", 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852510+0000", 2024-09-12T02:58:57.838 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4729999999999999e-06 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852548+0000", 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8138e-05 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852587+0000", 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8781e-05 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.839 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852606+0000", 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9508999999999999e-05 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852769+0000", 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000163043 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853050+0000", 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000280759 2024-09-12T02:58:57.840 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.853369+0000", 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031891999999999999 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861085+0000", 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0077166869999999999 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.841 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862334+0000", 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012488110000000001 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862472+0000", 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013820799999999999 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862584+0000", 2024-09-12T02:58:57.842 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011175000000000001 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:25 2.7 2:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.96973067, 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012439499999999999, 2024-09-12T02:58:57.843 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852654+0000", 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.844 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852656+0000", 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6029999999999999e-06 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852664+0000", 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5499999999999995e-06 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.845 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852689+0000", 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.4924999999999999e-05 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852704+0000", 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5228999999999999e-05 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854375+0000", 2024-09-12T02:58:57.846 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016708949999999999 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854583+0000", 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020824299999999999 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 7", 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854960+0000", 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037623700000000002 2024-09-12T02:58:57.847 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861100+0000", 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061406550000000001 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864785+0000", 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0036846819999999999 2024-09-12T02:58:57.848 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.849 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.849 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.849 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864983+0000", 2024-09-12T02:58:57.849 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019814400000000001 2024-09-12T02:58:57.849 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.849 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.849 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.849 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865093+0000", 2024-09-12T02:58:57.849 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000110337 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:1 2.14 2:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.969657488, 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012550232999999999, 2024-09-12T02:58:57.850 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.851 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.851 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.851 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.851 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.851 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.851 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:57.851 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.851 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852727+0000", 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852728+0000", 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1429999999999999e-06 2024-09-12T02:58:57.852 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852735+0000", 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3029999999999996e-06 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852753+0000", 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8811999999999999e-05 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.853 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852768+0000", 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5029e-05 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855163+0000", 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0023949869999999999 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855458+0000", 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00029505500000000001 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.854 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855782+0000", 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032358300000000001 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861161+0000", 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0053788289999999999 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865076+0000", 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039151680000000001 2024-09-12T02:58:57.855 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865161+0000", 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4938000000000006e-05 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865277+0000", 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011638599999999999 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.856 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:3 2.14 2:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.969597502, 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012725302000000001, 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:57.857 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852787+0000", 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852788+0000", 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.274e-06 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.858 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852796+0000", 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7819999999999994e-06 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852818+0000", 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1532e-05 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852832+0000", 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4209000000000001e-05 2024-09-12T02:58:57.859 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858111+0000", 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0052792059999999998 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858434+0000", 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032332699999999999 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.860 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858772+0000", 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00033724900000000002 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861338+0000", 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025660750000000001 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865377+0000", 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.004039356 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.861 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865456+0000", 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.9202000000000005e-05 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865512+0000", 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.609e-05 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.862 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:32 2.14 2:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.96953515600001, 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012881246000000001, 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.863 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852850+0000", 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852851+0000", 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3370000000000001e-06 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852856+0000", 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.4759999999999997e-06 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.864 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8875000000000001e-05 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852889+0000", 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3793e-05 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859743+0000", 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.006853657 2024-09-12T02:58:57.865 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.859968+0000", 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000225806 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.865731+0000", 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057623020000000004 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.866 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:36 2.1a 2:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.96947763999999, 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01052846, 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.867 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852907+0000", 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852908+0000", 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.187e-06 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852933+0000", 2024-09-12T02:58:57.868 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5075999999999998e-05 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852953+0000", 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9440999999999999e-05 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852966+0000", 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3509999999999999e-05 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856338+0000", 2024-09-12T02:58:57.869 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0033714349999999999 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.856654+0000", 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031617 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863435+0000", 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0067816409999999997 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.870 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:16 2.1d e25/19 2:b871830b:::605.00000000:head v 25'1, mlcod=0'0)", 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.967310015, 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0061671570000000004, 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:57.871 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855075+0000", 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855078+0000", 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.2490000000000001e-06 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.872 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855094+0000", 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5879000000000002e-05 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855124+0000", 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0244999999999999e-05 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.873 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855148+0000", 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3509000000000001e-05 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855385+0000", 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023773199999999999 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855428+0000", 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2707000000000003e-05 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.874 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861123+0000", 2024-09-12T02:58:57.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0056950630000000002 2024-09-12T02:58:57.875 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.875 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.875 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.875 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861242+0000", 2024-09-12T02:58:57.875 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000118773 2024-09-12T02:58:57.875 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_repop(mds.0.4:17 2.1d e25/19 2:b871830b:::605.00000000:head v 25'2, mlcod=0'0)", 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 107.9641515, 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030979530000000001, 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.876 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858233+0000", 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.877 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858235+0000", 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8670000000000001e-06 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858249+0000", 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3696000000000001e-05 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.878 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858298+0000", 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9116999999999997e-05 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858317+0000", 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8740999999999999e-05 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.879 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858734+0000", 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000417241 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.858790+0000", 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6113999999999998e-05 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861250+0000", 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002459625 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.880 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861331+0000", 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1551999999999994e-05 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:41 2.14 2:2e2fa760:::200.00000001:head [write 1391~1640 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:57.881 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 95.453315287999999, 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029762500000000002, 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:57.882 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.883 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369069+0000", 2024-09-12T02:58:57.883 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.883 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.883 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.883 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369072+0000", 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.976e-06 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369087+0000", 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4156e-05 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369120+0000", 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3801999999999999e-05 2024-09-12T02:58:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369137+0000", 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6809000000000001e-05 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369346+0000", 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208631 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369608+0000", 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026195199999999997 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.369969+0000", 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000360897 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371520+0000", 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00155141 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.886 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371774+0000", 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000253756 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.371930+0000", 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015599599999999999 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:22.372046+0000", 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115865 2024-09-12T02:58:57.887 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:44 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e26)", 2024-09-12T02:58:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:57.888 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 72.887163419999993, 2024-09-12T02:58:57.889 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0029260979999999998, 2024-09-12T02:58:57.889 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.889 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.889 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.889 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.889 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.889 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935221+0000", 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.890 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935223+0000", 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.333e-06 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935230+0000", 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6000000000000001e-06 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935256+0000", 2024-09-12T02:58:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.5959e-05 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.935267+0000", 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.059e-05 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936388+0000", 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011213180000000001 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.892 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936525+0000", 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013725599999999999 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.936713+0000", 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000187918 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937899+0000", 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0011857899999999999 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.893 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.937938+0000", 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8773000000000003e-05 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938031+0000", 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3187000000000001e-05 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:44.938147+0000", 2024-09-12T02:58:57.894 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00011637399999999999 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:45 2.14 2:2e2fa760:::200.00000001:head [write 3431~2016 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e27)", 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 70.194600269999995, 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003239483, 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.895 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627784+0000", 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627788+0000", 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.6160000000000002e-06 2024-09-12T02:58:57.896 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627805+0000", 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7370000000000001e-05 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627844+0000", 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8282999999999999e-05 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.897 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.627874+0000", 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.0704999999999998e-05 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628026+0000", 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015198100000000001 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628188+0000", 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016181600000000001 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.898 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.628415+0000", 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00022728099999999999 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630481+0000", 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020658109999999999 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630866+0000", 2024-09-12T02:58:57.899 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00038433400000000001 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.630956+0000", 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.0630999999999993e-05 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:47.631024+0000", 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.7655000000000002e-05 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.900 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:47 2.14 2:2e2fa760:::200.00000001:head [write 5447~1669 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 37.515241723999999, 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.003274795, 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:57.901 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307143+0000", 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307146+0000", 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.123e-06 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.902 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307162+0000", 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5729000000000001e-05 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307197+0000", 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.5179999999999999e-05 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307214+0000", 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7295999999999998e-05 2024-09-12T02:58:57.903 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307371+0000", 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000156293 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307532+0000", 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00016189399999999999 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307741+0000", 2024-09-12T02:58:57.904 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000208493 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.309426+0000", 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0016850299999999999 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310212+0000", 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000786494 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.905 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310299+0000", 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.6178000000000001e-05 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310418+0000", 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000119085 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:48 2.14 2:292cf221:::200.00000000:head [writefull 0~90 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e47)", 2024-09-12T02:58:57.906 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 37.515128547000003, 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037307600000000001, 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.907 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307256+0000", 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307257+0000", 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2699999999999999e-06 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307266+0000", 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2160000000000006e-06 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.908 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307286+0000", 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0537e-05 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.307299+0000", 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3297e-05 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.909 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308569+0000", 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001269121 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308706+0000", 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013719099999999999 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.308921+0000", 2024-09-12T02:58:57.910 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021543199999999999 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310051+0000", 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001129901 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310836+0000", 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00078529800000000003 2024-09-12T02:58:57.911 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310922+0000", 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5488000000000005e-05 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:20.310987+0000", 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.5009e-05 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.912 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:55 2.6 2:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e59)", 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:54.895894+0000", 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 2.9264907409999998, 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002964922, 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.913 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.895894+0000", 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.895894+0000", 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.914 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.895897+0000", 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9969999999999999e-06 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.895911+0000", 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4333e-05 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.915 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.895945+0000", 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3905999999999997e-05 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.895962+0000", 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6824e-05 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.916 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896115+0000", 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000153349 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896273+0000", 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015771200000000001 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:57.917 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.896523+0000", 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025023100000000001 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.897862+0000", 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013385739999999999 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.918 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.898699+0000", 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00083687400000000004 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.898787+0000", 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7808999999999999e-05 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.919 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:54.898859+0000", 2024-09-12T02:58:57.920 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2312999999999997e-05 2024-09-12T02:58:57.920 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.920 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.920 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.920 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.920 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.920 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:56 2.14 2:2e2fa760:::200.00000001:head [write 23991~3176 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-12T02:58:57.920 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:55.229418+0000", 2024-09-12T02:58:57.921 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 2.5929663199999999, 2024-09-12T02:58:57.921 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0026328150000000002, 2024-09-12T02:58:57.921 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.921 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.921 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.921 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.229418+0000", 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.229418+0000", 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.922 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.229421+0000", 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.7870000000000002e-06 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.229437+0000", 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.229472+0000", 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4839999999999998e-05 2024-09-12T02:58:57.923 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.229489+0000", 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7884e-05 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.229625+0000", 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013538499999999999 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.924 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.229774+0000", 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000149512 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 3", 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.230001+0000", 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000226469 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.231806+0000", 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001805617 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.925 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.231856+0000", 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.977e-05 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.231947+0000", 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1001999999999994e-05 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.232051+0000", 2024-09-12T02:58:57.926 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000103966 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:57 2.6 2:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:55.896097+0000", 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.9262881350000001, 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002964735, 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.927 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896097+0000", 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896097+0000", 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896099+0000", 2024-09-12T02:58:57.928 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.813e-06 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896113+0000", 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.396e-05 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896147+0000", 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.4100000000000002e-05 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.929 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896166+0000", 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.825e-05 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896275+0000", 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000109236 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896429+0000", 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015402800000000001 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.930 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 4", 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.896672+0000", 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00024335599999999999 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.897966+0000", 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0012940930000000001 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.898900+0000", 2024-09-12T02:58:57.931 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00093356299999999999 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.898989+0000", 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.8826000000000006e-05 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.899061+0000", 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2509999999999995e-05 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:61 2.6 2:66eb7180:::500.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:55.970064+0000", 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.8523202859999999, 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0035840400000000001, 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.970064+0000", 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.933 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.970064+0000", 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.970066+0000", 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.61e-06 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.934 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.970075+0000", 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4700000000000008e-06 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.970105+0000", 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.9122999999999999e-05 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.970121+0000", 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6753e-05 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.935 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.970281+0000", 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015980500000000001 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.970597+0000", 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031579200000000001 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.973648+0000", 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030514869999999999 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.936 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "MOSDECSubOpWrite(4.12s1 60/52 ECSubWrite(tid=11, reqid=mds.0.4:68, at_version=60'3, trim_to=0'0, roll_forward_to=58'2))", 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:58:55.976900+0000", 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 1.8454849499999999, 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034449160000000001, 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "reached pg", 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:57.937 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.976900+0000", 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.976900+0000", 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.976900+0000", 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2699999999999999e-07 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.938 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.976950+0000", 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.9456000000000002e-05 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.976973+0000", 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3323e-05 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.976993+0000", 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0080000000000001e-05 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.939 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.977136+0000", 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000143089 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_started", 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.977163+0000", 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.6979999999999999e-05 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_committed", 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.980277+0000", 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0031133440000000001 2024-09-12T02:58:57.940 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:58:55.980345+0000", 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8116999999999999e-05 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:57.941 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:57.943 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T02:58:57.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.948+0000 7efe94c00640 1 -- 172.21.15.63:0/1850945052 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "noscrub"}]=0 noscrub is unset v61) ==== 91+0+0 (secure 0 0 0) 0x7efe8005a810 con 0x7efe980cb5b0 2024-09-12T02:58:57.954 INFO:teuthology.orchestra.run.smithi063.stderr:noscrub is unset 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efe740678c0 msgr2=0x7efe74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efe740678c0 0x7efe74069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efe88009ab0 tx=0x7efe88009240 comp rx=0 tx=0).stop 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 msgr2=0x7efe98157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 0x7efe98157140 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efe8000e930 tx=0x7efe8000edf0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 shutdown_connections 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe98154850 0x7efe98157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe980cb5b0 0x7efe98157140 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7efe740678c0 0x7efe74069d80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 --2- 172.21.15.63:0/1850945052 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe980cb190 0x7efe980b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 >> 172.21.15.63:0/1850945052 conn(0x7efe98067a00 msgr2=0x7efe98159390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 shutdown_connections 2024-09-12T02:58:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:57.952+0000 7efe9d800640 1 -- 172.21.15.63:0/1850945052 wait complete. 2024-09-12T02:58:57.983 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T02:58:58.067 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:58.067 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:58.067 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:58:58.067 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:58.081 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T02:58:58.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.124+0000 7f821ee00640 1 Processor -- start 2024-09-12T02:58:58.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.124+0000 7f821ee00640 1 -- start start 2024-09-12T02:58:58.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ee00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f821806cf30 0x7f82180c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:58.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ee00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806d310 0x7f8218154910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:58.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ee00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82180c8a90 0x7f8218154e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:58.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ee00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f821815ba30 con 0x7f82180c8a90 2024-09-12T02:58:58.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ee00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f821815b4d0 con 0x7f821806cf30 2024-09-12T02:58:58.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ee00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f8218067ba0 con 0x7f821806d310 2024-09-12T02:58:58.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82180c8a90 0x7f8218154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:58.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f8217e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f821806cf30 0x7f82180c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:58.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ce00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f82180c8a90 0x7f8218154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39670/0 (socket says 172.21.15.63:39670) 2024-09-12T02:58:58.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f820f400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806d310 0x7f8218154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:58.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ce00640 1 -- 172.21.15.63:0/1643496081 learned_addr learned my addr 172.21.15.63:0/1643496081 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:58.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ce00640 1 -- 172.21.15.63:0/1643496081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806d310 msgr2=0x7f8218154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:58.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ce00640 1 --2- 172.21.15.63:0/1643496081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806d310 0x7f8218154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ce00640 1 -- 172.21.15.63:0/1643496081 >> v2:172.21.15.119:3300/0 conn(0x7f821806cf30 msgr2=0x7f82180c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:58:58.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ce00640 1 --2- 172.21.15.63:0/1643496081 >> v2:172.21.15.119:3300/0 conn(0x7f821806cf30 0x7f82180c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f821ce00640 1 -- 172.21.15.63:0/1643496081 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821815b770 con 0x7f82180c8a90 2024-09-12T02:58:58.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.128+0000 7f8217e00640 1 --2- 172.21.15.63:0/1643496081 >> v2:172.21.15.119:3300/0 conn(0x7f821806cf30 0x7f82180c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:58.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ce00640 1 --2- 172.21.15.63:0/1643496081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 0x7f8218154e50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8218071770 tx=0x7f821001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da2b91695c1082c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:58.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f8217400640 1 -- 172.21.15.63:0/1643496081 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100a5760 con 0x7f82180c8a90 2024-09-12T02:58:58.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f8217400640 1 -- 172.21.15.63:0/1643496081 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82100a5900 con 0x7f82180c8a90 2024-09-12T02:58:58.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f8217400640 1 -- 172.21.15.63:0/1643496081 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82100a5cd0 con 0x7f82180c8a90 2024-09-12T02:58:58.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 -- 172.21.15.63:0/1643496081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 msgr2=0x7f8218154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:58.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 --2- 172.21.15.63:0/1643496081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 0x7f8218154e50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8218071770 tx=0x7f821001c9f0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 -- 172.21.15.63:0/1643496081 shutdown_connections 2024-09-12T02:58:58.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 --2- 172.21.15.63:0/1643496081 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 0x7f8218154e50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 --2- 172.21.15.63:0/1643496081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806d310 0x7f8218154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 --2- 172.21.15.63:0/1643496081 >> v2:172.21.15.119:3300/0 conn(0x7f821806cf30 0x7f82180c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 -- 172.21.15.63:0/1643496081 >> 172.21.15.63:0/1643496081 conn(0x7f82180c93e0 msgr2=0x7f82180c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:58.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 -- 172.21.15.63:0/1643496081 shutdown_connections 2024-09-12T02:58:58.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 -- 172.21.15.63:0/1643496081 wait complete. 2024-09-12T02:58:58.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 Processor -- start 2024-09-12T02:58:58.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 -- start start 2024-09-12T02:58:58.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806cf30 0x7f8218159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:58.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821806d310 0x7f8218158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:58.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 0x7f82180c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:58.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f821815e140 con 0x7f82180c8a90 2024-09-12T02:58:58.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f821815dfc0 con 0x7f821806d310 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.132+0000 7f821ee00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f821815e2c0 con 0x7f821806cf30 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f8217e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806cf30 0x7f8218159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f8217e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806cf30 0x7f8218159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:39666/0 (socket says 172.21.15.63:39666) 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f820f400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821806d310 0x7f8218158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f8217e00640 1 -- 172.21.15.63:0/91753460 learned_addr learned my addr 172.21.15.63:0/91753460 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f821ce00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 0x7f82180c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f820f400640 1 -- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806cf30 msgr2=0x7f8218159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f820f400640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806cf30 0x7f8218159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f820f400640 1 -- 172.21.15.63:0/91753460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 msgr2=0x7f82180c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f820f400640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 0x7f82180c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f820f400640 1 -- 172.21.15.63:0/91753460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821815ccf0 con 0x7f821806d310 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f821ce00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 0x7f82180c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f820f400640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821806d310 0x7f8218158b20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f820000e820 tx=0x7f820000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:58.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f8214c00640 1 -- 172.21.15.63:0/91753460 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200017070 con 0x7f821806d310 2024-09-12T02:58:58.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f8214c00640 1 -- 172.21.15.63:0/91753460 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f820000c940 con 0x7f821806d310 2024-09-12T02:58:58.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f8214c00640 1 -- 172.21.15.63:0/91753460 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820000cd30 con 0x7f821806d310 2024-09-12T02:58:58.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821815cfd0 con 0x7f821806d310 2024-09-12T02:58:58.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82180c5320 con 0x7f821806d310 2024-09-12T02:58:58.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82180c9f00 con 0x7f821806d310 2024-09-12T02:58:58.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f8214c00640 1 -- 172.21.15.63:0/91753460 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f820001a070 con 0x7f821806d310 2024-09-12T02:58:58.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.136+0000 7f8214c00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f81f40678f0 0x7f81f4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:58:58.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.140+0000 7f8214c00640 1 -- 172.21.15.63:0/91753460 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6685+0+0 (secure 0 0 0) 0x7f8200086060 con 0x7f821806d310 2024-09-12T02:58:58.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.140+0000 7f8217e00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f81f40678f0 0x7f81f4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:58:58.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.140+0000 7f8217e00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f81f40678f0 0x7f81f4069db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8208009580 tx=0x7f8208009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:58:58.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.144+0000 7f8214c00640 1 -- 172.21.15.63:0/91753460 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8200056050 con 0x7f821806d310 2024-09-12T02:58:58.205 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:58.205 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:58:58.205 INFO:teuthology.orchestra.run.smithi119.stdout: "complaint_time": 180, 2024-09-12T02:58:58.205 INFO:teuthology.orchestra.run.smithi119.stdout: "num_blocked_ops": 0 2024-09-12T02:58:58.206 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:58.220 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T02:58:58.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.316+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd unset", "key": "nodeep-scrub"} v 0) -- 0x7f821806ddf0 con 0x7f821806d310 2024-09-12T02:58:58.346 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:58:58.346 INFO:teuthology.orchestra.run.smithi119.stdout: "size": 20, 2024-09-12T02:58:58.346 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 600, 2024-09-12T02:58:58.346 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [ 2024-09-12T02:58:58.346 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.596220672, 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.100763201, 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 1 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.347 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746012+0000", 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.348 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746015+0000", 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.993e-06 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746029+0000", 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4052e-05 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746053+0000", 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.3878000000000001e-05 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.349 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746071+0000", 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7418000000000002e-05 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746196+0000", 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000125351 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for peered", 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.746212+0000", 2024-09-12T02:58:58.350 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5583e-05 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844486+0000", 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.098274080999999999 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.844799+0000", 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031307399999999999 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.351 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.845153+0000", 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00035450599999999998 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846199+0000", 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001045399 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846577+0000", 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037882200000000001 2024-09-12T02:58:58.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846671+0000", 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3681e-05 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.846776+0000", 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000104363 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.353 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:34 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.453025334, 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010442105, 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 34 2024-09-12T02:58:58.354 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.355 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.355 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.355 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:58.355 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.355 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.355 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.355 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889208+0000", 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.32e-07 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.356 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889212+0000", 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.279e-06 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889218+0000", 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.2680000000000002e-06 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889222+0000", 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.425e-06 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.357 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.894978+0000", 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057560579999999997 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895114+0000", 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000135418 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.895337+0000", 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000223372 2024-09-12T02:58:58.358 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899279+0000", 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0039417870000000004 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899381+0000", 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000102147 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.359 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899532+0000", 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015133 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899650+0000", 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000117589 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.360 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.453004808, 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010737932, 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 35 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.361 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889228+0000", 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.362 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889229+0000", 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3500000000000002e-07 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889313+0000", 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.4040000000000002e-05 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889322+0000", 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.6940000000000007e-06 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.363 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889329+0000", 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.64e-06 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896607+0000", 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0072783250000000004 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.896845+0000", 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000238187 2024-09-12T02:58:58.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.897238+0000", 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039292400000000001 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899797+0000", 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025588630000000002 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899820+0000", 2024-09-12T02:58:58.365 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2648000000000001e-05 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899894+0000", 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3953000000000002e-05 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.899966+0000", 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2323000000000005e-05 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.366 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.452893995, 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012172551, 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 36 2024-09-12T02:58:58.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889339+0000", 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.368 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889340+0000", 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.6499999999999999e-07 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889343+0000", 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.7299999999999999e-06 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889348+0000", 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0479999999999998e-06 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.369 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889352+0000", 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.8929999999999998e-06 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898478+0000", 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091254089999999993 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898604+0000", 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000126002 2024-09-12T02:58:58.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.898807+0000", 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000202864 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901301+0000", 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024945560000000002 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.371 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901352+0000", 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.0844999999999999e-05 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901443+0000", 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.1428999999999995e-05 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901512+0000", 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8209999999999999e-05 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.372 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.452872469, 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012786980999999999, 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.373 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 37 2024-09-12T02:58:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.374 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889361+0000", 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.3000000000000002e-07 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889364+0000", 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.304e-06 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.375 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889369+0000", 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8760000000000004e-06 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.889374+0000", 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.8829999999999997e-06 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900038+0000", 2024-09-12T02:58:58.376 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010664412999999999 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900275+0000", 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00023685500000000001 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.900651+0000", 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00037591499999999999 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.377 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.901969+0000", 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001318126 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902012+0000", 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.2886999999999998e-05 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902090+0000", 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8319999999999996e-05 2024-09-12T02:58:58.378 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.902148+0000", 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7071999999999998e-05 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.387885823, 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010584461, 2024-09-12T02:58:58.379 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 70 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:58.380 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954347+0000", 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954348+0000", 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.7899999999999997e-07 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.381 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954354+0000", 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.1829999999999999e-06 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954364+0000", 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0026e-05 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.954372+0000", 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.8460000000000008e-06 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.382 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959427+0000", 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0050550430000000004 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959644+0000", 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217123 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.959979+0000", 2024-09-12T02:58:58.383 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000334765 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.961696+0000", 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00171693 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964783+0000", 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0030874240000000001 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.384 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964860+0000", 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6223000000000005e-05 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:55.964932+0000", 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2019000000000003e-05 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.385 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.1657823, 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010057257999999999, 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 106 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.386 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176451+0000", 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176452+0000", 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6559999999999999e-06 2024-09-12T02:58:58.387 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176538+0000", 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5389999999999994e-05 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176552+0000", 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4504999999999999e-05 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176562+0000", 2024-09-12T02:58:58.388 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0192e-05 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179038+0000", 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024757630000000002 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179209+0000", 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017045100000000001 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.389 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.179410+0000", 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020153099999999999 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.182865+0000", 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034552710000000002 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186357+0000", 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034919759999999999 2024-09-12T02:58:58.390 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186441+0000", 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.3922000000000001e-05 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186508+0000", 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.6600999999999995e-05 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.391 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.165645309, 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010127551, 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 107 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.392 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176588+0000", 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176589+0000", 2024-09-12T02:58:58.393 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0499999999999999e-06 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176595+0000", 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.2859999999999996e-06 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176607+0000", 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1849e-05 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.394 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.176615+0000", 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2290000000000003e-06 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180316+0000", 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0037005850000000002 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180441+0000", 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012504200000000001 2024-09-12T02:58:58.395 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.180637+0000", 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00019627199999999999 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.183086+0000", 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024485309999999999 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186525+0000", 2024-09-12T02:58:58.396 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0034397009999999999 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186641+0000", 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000115686 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.186715+0000", 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4320000000000007e-05 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.397 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.164528107, 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012041651, 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.398 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 111 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177705+0000", 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.399 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177707+0000", 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.767e-06 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177720+0000", 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3258000000000001e-05 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177739+0000", 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8638999999999999e-05 2024-09-12T02:58:58.400 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177755+0000", 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6175e-05 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185413+0000", 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0076586579999999996 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.401 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185546+0000", 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013261800000000001 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.185760+0000", 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00021368099999999999 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187153+0000", 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013937660000000001 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.402 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189601+0000", 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0024473979999999999 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189678+0000", 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7520000000000003e-05 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189747+0000", 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8170999999999995e-05 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.403 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.16445599399999, 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013231297, 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.404 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 112 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177777+0000", 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.405 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177778+0000", 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1939999999999999e-06 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177931+0000", 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000152836 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177953+0000", 2024-09-12T02:58:58.406 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1730999999999999e-05 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.177973+0000", 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9758e-05 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187653+0000", 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0096801890000000005 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.407 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187781+0000", 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012784800000000001 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.187982+0000", 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020120500000000001 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190709+0000", 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0027270459999999999 2024-09-12T02:58:58.408 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190857+0000", 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014834599999999999 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190935+0000", 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7942999999999996e-05 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191008+0000", 2024-09-12T02:58:58.409 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.3201000000000006e-05 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.16423201000001, 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.015396596, 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.410 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 113 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178001+0000", 2024-09-12T02:58:58.411 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178002+0000", 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4130000000000001e-06 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178013+0000", 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.0532e-05 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.412 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178031+0000", 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8232000000000001e-05 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178049+0000", 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7731999999999999e-05 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188777+0000", 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010727833000000001 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.413 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.188907+0000", 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000130068 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189108+0000", 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000200998 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190832+0000", 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0017240070000000001 2024-09-12T02:58:58.414 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193248+0000", 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002416358 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193329+0000", 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.0976000000000005e-05 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193398+0000", 2024-09-12T02:58:58.415 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.8447000000000004e-05 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.164162027, 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016217691999999999, 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.416 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 114 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.417 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178071+0000", 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178072+0000", 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.37e-06 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178083+0000", 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1002000000000001e-05 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.418 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178101+0000", 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8162e-05 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178119+0000", 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7308000000000001e-05 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189840+0000", 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.01172083 2024-09-12T02:58:58.419 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.189990+0000", 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00015064700000000001 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.190194+0000", 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00020405099999999999 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.420 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193082+0000", 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.002887265 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194153+0000", 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010717330000000001 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194230+0000", 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.6798999999999994e-05 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.421 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194289+0000", 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.8525e-05 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.16405639, 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016328742, 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.422 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 115 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.423 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178177+0000", 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178178+0000", 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.35e-06 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178302+0000", 2024-09-12T02:58:58.424 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000124349 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178324+0000", 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.1370999999999999e-05 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178340+0000", 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6138999999999999e-05 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.425 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191101+0000", 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012760752 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191236+0000", 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00013524399999999999 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.191428+0000", 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000192346 2024-09-12T02:58:58.426 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193226+0000", 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001797634 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194307+0000", 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001080805 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194431+0000", 2024-09-12T02:58:58.427 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012462500000000001 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194505+0000", 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.4127000000000004e-05 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:58.428 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.163866293, 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016430452000000002, 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 116 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.429 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178367+0000", 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178368+0000", 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.2359999999999999e-06 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.430 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178380+0000", 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1586000000000001e-05 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178398+0000", 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8491e-05 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178412+0000", 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4456e-05 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.431 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192163+0000", 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013750642 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192291+0000", 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012804799999999999 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.192509+0000", 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000217961 2024-09-12T02:58:58.432 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194531+0000", 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020217759999999999 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194609+0000", 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.7643000000000002e-05 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.433 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194698+0000", 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.9864999999999994e-05 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194797+0000", 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.8747999999999997e-05 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.434 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 122.163799506, 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.016641046999999999, 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 117 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.435 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178433+0000", 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178435+0000", 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.1459999999999999e-06 2024-09-12T02:58:58.436 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178444+0000", 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.5030000000000003e-06 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178462+0000", 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8060999999999999e-05 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.178477+0000", 2024-09-12T02:58:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4433000000000001e-05 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193454+0000", 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.014976981 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193598+0000", 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00014415700000000001 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.438 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.193793+0000", 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000194785 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194879+0000", 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0010866319999999999 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.194919+0000", 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.9533000000000002e-05 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.439 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195011+0000", 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.2487999999999999e-05 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.195075+0000", 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3328000000000001e-05 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.440 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(client.4172.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 121.588449909, 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.013917521, 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "client_info": { 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "client": "client.4172", 2024-09-12T02:58:58.441 INFO:teuthology.orchestra.run.smithi119.stdout: "client_addr": "172.21.15.119:0/4048895224", 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: "tid": 141 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753783+0000", 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.442 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753784+0000", 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.5000000000000001e-07 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753790+0000", 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 5.7080000000000002e-06 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753799+0000", 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.3619999999999995e-06 2024-09-12T02:58:58.443 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.753806+0000", 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.1960000000000002e-06 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759508+0000", 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0057020339999999999 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.444 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759555+0000", 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.6857000000000002e-05 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 0", 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.759638+0000", 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.2552000000000005e-05 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.761161+0000", 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001523242 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.445 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767627+0000", 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0064665649999999996 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767669+0000", 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.1687999999999998e-05 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:56:56.767701+0000", 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 3.1467000000000002e-05 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.446 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:17 2.1d 2:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 108.48975047499999, 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.012039485000000001, 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.447 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852483+0000", 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852484+0000", 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.7099999999999999e-06 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.448 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852498+0000", 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.3949e-05 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852521+0000", 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2816e-05 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852538+0000", 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.6538999999999999e-05 2024-09-12T02:58:58.449 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857337+0000", 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0047990960000000001 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857591+0000", 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00025405399999999998 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 6", 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.857984+0000", 2024-09-12T02:58:58.450 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00039304100000000001 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.862185+0000", 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0042012309999999997 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864282+0000", 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0020972040000000001 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.451 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864427+0000", 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000145208 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864522+0000", 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 9.4636999999999995e-05 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:20 2.1c 2:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:58.452 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 108.489665233, 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011040024000000001, 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.453 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852568+0000", 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852569+0000", 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.33e-06 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852614+0000", 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 4.4873999999999998e-05 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.454 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852637+0000", 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.2738000000000002e-05 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852657+0000", 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 2.0534999999999999e-05 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854077+0000", 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0014196479999999999 2024-09-12T02:58:58.455 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854404+0000", 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00032680600000000001 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854666+0000", 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00026267 2024-09-12T02:58:58.456 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861793+0000", 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0071268440000000002 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863406+0000", 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.001613268 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863544+0000", 2024-09-12T02:58:58.457 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000137801 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863608+0000", 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 6.3509999999999993e-05 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:21 2.1c 2:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 108.489528119, 2024-09-12T02:58:58.458 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.011333339, 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852705+0000", 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.459 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852706+0000", 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.564e-06 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852714+0000", 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 7.2960000000000001e-06 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.460 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852732+0000", 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.8725000000000001e-05 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852747+0000", 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.4802e-05 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855340+0000", 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0025923280000000001 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.461 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855547+0000", 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.000207591 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "waiting for subops from 5", 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.855891+0000", 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00034386099999999999 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "op_commit", 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.861808+0000", 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0059167289999999999 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.462 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "sub_op_commit_rec", 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863740+0000", 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0019324419999999999 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "commit_sent", 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863911+0000", 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00017091900000000001 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.864038+0000", 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00012708199999999999 2024-09-12T02:58:58.463 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: "description": "osd_op(mds.0.4:34 2.b 2:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: "initiated_at": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: "age": 108.48935822, 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.010836808, 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: "continuous": false, 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: "type_data": { 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: "flag_point": "started", 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: "events": [ 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.464 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "initiated", 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "header_read", 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852875+0000", 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "throttled", 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852876+0000", 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5400000000000001e-06 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.465 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "all_read", 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852884+0000", 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 8.1340000000000004e-06 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "dispatched", 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852904+0000", 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.9800999999999999e-05 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "queued_for_pg", 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.852920+0000", 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 1.5899000000000001e-05 2024-09-12T02:58:58.466 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "reached_pg", 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854221+0000", 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0013013090000000001 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "started", 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.854538+0000", 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.00031634000000000002 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: { 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: "event": "done", 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: "time": "2024-09-12T02:57:09.863712+0000", 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: "duration": 0.0091737850000000003 2024-09-12T02:58:58.467 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.468 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.468 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.468 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-12T02:58:58.468 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-12T02:58:58.468 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:58:58.860 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-12T02:58:58.861 INFO:tasks.thrashosds.thrasher:Reviving osd 5 2024-09-12T02:58:58.861 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T02:58:58.861 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T02:58:58.864 INFO:tasks.ceph.osd.5:Started 2024-09-12T02:58:58.864 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:58:58.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f8214c00640 1 -- 172.21.15.63:0/91753460 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "nodeep-scrub"}]=0 nodeep-scrub is unset v62) ==== 101+0+0 (secure 0 0 0) 0x7f820005a350 con 0x7f821806d310 2024-09-12T02:58:58.960 INFO:teuthology.orchestra.run.smithi063.stderr:nodeep-scrub is unset 2024-09-12T02:58:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f81f40678f0 msgr2=0x7f81f4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f81f40678f0 0x7f81f4069db0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8208009580 tx=0x7f8208009190 comp rx=0 tx=0).stop 2024-09-12T02:58:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821806d310 msgr2=0x7f8218158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:58:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821806d310 0x7f8218158b20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f820000e820 tx=0x7f820000ece0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 shutdown_connections 2024-09-12T02:58:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f82180c8a90 0x7f82180c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f821806d310 0x7f8218158b20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f81f40678f0 0x7f81f4069db0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 --2- 172.21.15.63:0/91753460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f821806cf30 0x7f8218159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:58:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.956+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 >> 172.21.15.63:0/91753460 conn(0x7f82180c93e0 msgr2=0x7f821814d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:58:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.960+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 shutdown_connections 2024-09-12T02:58:58.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:58:58.960+0000 7f821ee00640 1 -- 172.21.15.63:0/91753460 wait complete. 2024-09-12T02:58:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:no valid command found; 10 closest matches: 2024-09-12T02:58:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:0 2024-09-12T02:58:58.993 INFO:teuthology.orchestra.run.smithi119.stderr:1 2024-09-12T02:58:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:2 2024-09-12T02:58:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:abort 2024-09-12T02:58:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:assert 2024-09-12T02:58:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:config diff 2024-09-12T02:58:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:config diff get 2024-09-12T02:58:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:config get 2024-09-12T02:58:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:config help [] 2024-09-12T02:58:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:config set ... 2024-09-12T02:58:58.994 INFO:teuthology.orchestra.run.smithi119.stderr:admin_socket: invalid command 2024-09-12T02:58:58.996 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T02:58:58.996 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-09-12T02:58:59.967 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:58:59.962+0000 7f4cbdb8e7c0 -1 Falling back to public interface 2024-09-12T02:59:03.563 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:59:03.567 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:59:03.949 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:59:03.946+0000 7f4cbdb8e7c0 -1 osd.5 51 log_to_monitors true 2024-09-12T02:59:03.997 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T02:59:04.025 INFO:tasks.ceph.osd.5.smithi119.stderr:2024-09-12T02:59:04.022+0000 7f4cb196c640 -1 osd.5 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:59:04.124 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-12T02:59:04.125 INFO:teuthology.orchestra.run.smithi119.stdout: "ops": [], 2024-09-12T02:59:04.125 INFO:teuthology.orchestra.run.smithi119.stdout: "num_ops": 0 2024-09-12T02:59:04.125 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-12T02:59:04.139 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T02:59:04.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6eb200640 1 Processor -- start 2024-09-12T02:59:04.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6eb200640 1 -- start start 2024-09-12T02:59:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6eb200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc6ec0c7de0 0x7fc6ec0c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6eb200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc6ec0c8920 0x7fc6ec071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6eb200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15ac70 0x7fc6ec15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6eb200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ec0c6350 con 0x7fc6ec0c7de0 2024-09-12T02:59:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6eb200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ec15b620 con 0x7fc6ec0c8920 2024-09-12T02:59:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6eb200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ec072bc0 con 0x7fc6ec15ac70 2024-09-12T02:59:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6e9e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc6ec0c7de0 0x7fc6ec0c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6e9e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc6ec0c7de0 0x7fc6ec0c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36658/0 (socket says 172.21.15.63:36658) 2024-09-12T02:59:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6e9e00640 1 -- 172.21.15.63:0/1530271444 learned_addr learned my addr 172.21.15.63:0/1530271444 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6e9400640 1 --2- 172.21.15.63:0/1530271444 >> v2:172.21.15.119:3300/0 conn(0x7fc6ec0c8920 0x7fc6ec071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1530271444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15ac70 0x7fc6ec15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6e9e00640 1 -- 172.21.15.63:0/1530271444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15ac70 msgr2=0x7fc6ec15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:04.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6e9e00640 1 --2- 172.21.15.63:0/1530271444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15ac70 0x7fc6ec15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6e9e00640 1 -- 172.21.15.63:0/1530271444 >> v2:172.21.15.119:3300/0 conn(0x7fc6ec0c8920 msgr2=0x7fc6ec071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:04.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6e9e00640 1 --2- 172.21.15.63:0/1530271444 >> v2:172.21.15.119:3300/0 conn(0x7fc6ec0c8920 0x7fc6ec071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.284+0000 7fc6e9e00640 1 -- 172.21.15.63:0/1530271444 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec072ea0 con 0x7fc6ec0c7de0 2024-09-12T02:59:04.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6e9e00640 1 --2- 172.21.15.63:0/1530271444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c7de0 0x7fc6ec0c81c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009870 tx=0x7fc6dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5e77d82aa3e3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6e8a00640 1 -- 172.21.15.63:0/1530271444 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc0b0070 con 0x7fc6ec0c7de0 2024-09-12T02:59:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6e8a00640 1 -- 172.21.15.63:0/1530271444 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6dc0ab600 con 0x7fc6ec0c7de0 2024-09-12T02:59:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6e8a00640 1 -- 172.21.15.63:0/1530271444 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc0ab9d0 con 0x7fc6ec0c7de0 2024-09-12T02:59:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6eb200640 1 -- 172.21.15.63:0/1530271444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c7de0 msgr2=0x7fc6ec0c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1530271444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c7de0 0x7fc6ec0c81c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009870 tx=0x7fc6dc01c490 comp rx=0 tx=0).stop 2024-09-12T02:59:04.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6eb200640 1 -- 172.21.15.63:0/1530271444 shutdown_connections 2024-09-12T02:59:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1530271444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15ac70 0x7fc6ec15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1530271444 >> v2:172.21.15.119:3300/0 conn(0x7fc6ec0c8920 0x7fc6ec071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1530271444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c7de0 0x7fc6ec0c81c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6eb200640 1 -- 172.21.15.63:0/1530271444 >> 172.21.15.63:0/1530271444 conn(0x7fc6ec0cc740 msgr2=0x7fc6ec0ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6eb200640 1 -- 172.21.15.63:0/1530271444 shutdown_connections 2024-09-12T02:59:04.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.288+0000 7fc6eb200640 1 -- 172.21.15.63:0/1530271444 wait complete. 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 Processor -- start 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 -- start start 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec0c7de0 0x7fc6ec1f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c8920 0x7fc6ec156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ac70 0x7fc6ec06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec072500 con 0x7fc6ec0c8920 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec155040 con 0x7fc6ec15ac70 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ec072680 con 0x7fc6ec0c7de0 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c8920 0x7fc6ec156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c8920 0x7fc6ec156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36666/0 (socket says 172.21.15.63:36666) 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9400640 1 -- 172.21.15.63:0/1956366708 learned_addr learned my addr 172.21.15.63:0/1956366708 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9e00640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec0c7de0 0x7fc6ec1f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ac70 0x7fc6ec06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9400640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec0c7de0 msgr2=0x7fc6ec1f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9400640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec0c7de0 0x7fc6ec1f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9400640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ac70 msgr2=0x7fc6ec06c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9400640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ac70 0x7fc6ec06c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9400640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec1f4750 con 0x7fc6ec0c8920 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e9400640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c8920 0x7fc6ec156500 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800d800 tx=0x7fc6d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8018020 con 0x7fc6ec0c8920 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d80096a0 con 0x7fc6ec0c8920 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8009a50 con 0x7fc6ec0c8920 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ec1f6ec0 con 0x7fc6ec0c8920 2024-09-12T02:59:04.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.292+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ec1f4470 con 0x7fc6ec0c8920 2024-09-12T02:59:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc6ec0c42c0 con 0x7fc6ec0c8920 2024-09-12T02:59:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6d801b020 con 0x7fc6ec0c8920 2024-09-12T02:59:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6cc0678c0 0x7fc6cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6685+0+0 (secure 0 0 0) 0x7fc6d8086560 con 0x7fc6ec0c8920 2024-09-12T02:59:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7fc6d8022020 con 0x7fc6ec0c8920 2024-09-12T02:59:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6e9e00640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6cc0678c0 0x7fc6cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c2ef0 0x7fc6ec155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec1582a0 con 0x7fc6ec0c2ef0 2024-09-12T02:59:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c2ef0 0x7fc6ec155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6ea800640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 2: {"prefix": "get_command_descriptions"}) -- 0x7fc6ec0c7bc0 con 0x7fc6ec0c2ef0 2024-09-12T02:59:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c2ef0 0x7fc6ec155270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4007cf0 tx=0x7fc6e400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6e9e00640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6cc0678c0 0x7fc6cc069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0ad000 tx=0x7fc6dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.296+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4016620 con 0x7fc6ec0c2ef0 2024-09-12T02:59:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.300+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc6e401b070 con 0x7fc6ec0c2ef0 2024-09-12T02:59:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.300+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c2ef0 msgr2=0x7fc6ec155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.300+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c2ef0 0x7fc6ec155270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4007cf0 tx=0x7fc6e400f520 comp rx=0 tx=0).stop 2024-09-12T02:59:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.300+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c2ef0 msgr2=0x7fc6ec155270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:59:04.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.300+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c2ef0 0x7fc6ec155270 secure :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4007cf0 tx=0x7fc6e400f520 comp rx=0 tx=0).stop 2024-09-12T02:59:04.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.304+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec1557b0 0x7fc6ec155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.304+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec1560d0 con 0x7fc6ec1557b0 2024-09-12T02:59:04.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.304+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec1557b0 0x7fc6ec155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.304+0000 7fc6ea800640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 3: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=600"]}) -- 0x7fc6ec0c3920 con 0x7fc6ec1557b0 2024-09-12T02:59:04.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.304+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec1557b0 0x7fc6ec155b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4007cf0 tx=0x7fc6e4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.304+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4026070 con 0x7fc6ec1557b0 2024-09-12T02:59:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.0 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 3: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7fc6e4016e00 con 0x7fc6ec1557b0 2024-09-12T02:59:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec1557b0 msgr2=0x7fc6ec155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec1557b0 0x7fc6ec155b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4007cf0 tx=0x7fc6e4004a50 comp rx=0 tx=0).stop 2024-09-12T02:59:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec1557b0 msgr2=0x7fc6ec155b90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:59:04.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec1557b0 0x7fc6ec155b90 secure :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4007cf0 tx=0x7fc6e4004a50 comp rx=0 tx=0).stop 2024-09-12T02:59:04.311 INFO:teuthology.orchestra.run.smithi063.stdout:mon.a: {} 2024-09-12T02:59:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T02:59:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ba80 0x7fc6ec15be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec15a6c0 con 0x7fc6ec15ba80 2024-09-12T02:59:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ba80 0x7fc6ec15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6ea800640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- command(tid 4: {"prefix": "get_command_descriptions"}) -- 0x7fc6ec15a3e0 con 0x7fc6ec15ba80 2024-09-12T02:59:04.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ba80 0x7fc6ec15be90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec156250 tx=0x7fc6e400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4038020 con 0x7fc6ec15ba80 2024-09-12T02:59:04.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.1 v2:172.21.15.119:3300/0 2 ==== command_reply(tid 4: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc6e4033940 con 0x7fc6ec15ba80 2024-09-12T02:59:04.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ba80 msgr2=0x7fc6ec15be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ba80 0x7fc6ec15be90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec156250 tx=0x7fc6e400b040 comp rx=0 tx=0).stop 2024-09-12T02:59:04.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ba80 msgr2=0x7fc6ec15be90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:59:04.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec15ba80 0x7fc6ec15be90 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec156250 tx=0x7fc6e400b040 comp rx=0 tx=0).stop 2024-09-12T02:59:04.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.308+0000 7fc6ea800640 1 -- 172.21.15.63:0/1956366708 reap_dead start 2024-09-12T02:59:04.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.316+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec1f7960 0x7fc6ec06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.316+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec1f7d40 con 0x7fc6ec1f7960 2024-09-12T02:59:04.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.316+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec1f7960 0x7fc6ec06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.316+0000 7fc6ea800640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- command(tid 5: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=600"]}) -- 0x7fc6ec1f7540 con 0x7fc6ec1f7960 2024-09-12T02:59:04.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.316+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec1f7960 0x7fc6ec06c6e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400f560 tx=0x7fc6e402c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.316+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4038050 con 0x7fc6ec1f7960 2024-09-12T02:59:04.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.320+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.1 v2:172.21.15.119:3300/0 2 ==== command_reply(tid 5: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7fc6e4003ba0 con 0x7fc6ec1f7960 2024-09-12T02:59:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.320+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec1f7960 msgr2=0x7fc6ec06c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.320+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec1f7960 0x7fc6ec06c6e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400f560 tx=0x7fc6e402c000 comp rx=0 tx=0).stop 2024-09-12T02:59:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.320+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec1f7960 msgr2=0x7fc6ec06c6e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:59:04.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.320+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6ec1f7960 0x7fc6ec06c6e0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400f560 tx=0x7fc6e402c000 comp rx=0 tx=0).stop 2024-09-12T02:59:04.325 INFO:teuthology.orchestra.run.smithi063.stdout:mon.b: {} 2024-09-12T02:59:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T02:59:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.320+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c3d0 0x7fc6ec156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.320+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ec164d60 con 0x7fc6ec15c3d0 2024-09-12T02:59:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.320+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c3d0 0x7fc6ec156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.320+0000 7fc6ea800640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- command(tid 6: {"prefix": "get_command_descriptions"}) -- 0x7fc6ec06cc20 con 0x7fc6ec15c3d0 2024-09-12T02:59:04.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.324+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c3d0 0x7fc6ec156d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4007cf0 tx=0x7fc6e4035000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.324+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e403fce0 con 0x7fc6ec15c3d0 2024-09-12T02:59:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.324+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.2 v2:172.21.15.119:3301/0 2 ==== command_reply(tid 6: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc6e403fae0 con 0x7fc6ec15c3d0 2024-09-12T02:59:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.324+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c3d0 msgr2=0x7fc6ec156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.324+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c3d0 0x7fc6ec156d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4007cf0 tx=0x7fc6e4035000 comp rx=0 tx=0).stop 2024-09-12T02:59:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.324+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c3d0 msgr2=0x7fc6ec156d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:59:04.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.324+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c3d0 0x7fc6ec156d30 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4007cf0 tx=0x7fc6e4035000 comp rx=0 tx=0).stop 2024-09-12T02:59:04.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.328+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c7e0 0x7fc6ec157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.328+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ec06d110 con 0x7fc6ec15c7e0 2024-09-12T02:59:04.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.328+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c7e0 0x7fc6ec157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.332+0000 7fc6ea800640 1 -- 172.21.15.63:0/1956366708 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- command(tid 7: {"prefix": "injectargs", "injected_args": ["--mon_osd_down_out_interval=600"]}) -- 0x7fc6ec06d2c0 con 0x7fc6ec15c7e0 2024-09-12T02:59:04.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.332+0000 7fc6ea800640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c7e0 0x7fc6ec157270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400fac0 tx=0x7fc6e4026000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.332+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e405b070 con 0x7fc6ec15c7e0 2024-09-12T02:59:04.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 <== mon.2 v2:172.21.15.119:3301/0 2 ==== command_reply(tid 7: 0 mon_osd_down_out_interval = '' (not observed, change may require restart) ) ==== 82+0+3 (secure 0 0 0) 0x7fc6e4016a50 con 0x7fc6ec15c7e0 2024-09-12T02:59:04.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c7e0 msgr2=0x7fc6ec157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c7e0 0x7fc6ec157270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400fac0 tx=0x7fc6e4026000 comp rx=0 tx=0).stop 2024-09-12T02:59:04.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6e2000640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c7e0 msgr2=0x7fc6ec157270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-12T02:59:04.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6e2000640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6ec15c7e0 0x7fc6ec157270 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400fac0 tx=0x7fc6e4026000 comp rx=0 tx=0).stop 2024-09-12T02:59:04.339 INFO:teuthology.orchestra.run.smithi063.stdout:mon.c: {} 2024-09-12T02:59:04.339 INFO:teuthology.orchestra.run.smithi063.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T02:59:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6cc0678c0 msgr2=0x7fc6cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6cc0678c0 0x7fc6cc069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0ad000 tx=0x7fc6dc008040 comp rx=0 tx=0).stop 2024-09-12T02:59:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c8920 msgr2=0x7fc6ec156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6eb200640 1 --2- 172.21.15.63:0/1956366708 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6ec0c8920 0x7fc6ec156500 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800d800 tx=0x7fc6d800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6ea800640 1 -- 172.21.15.63:0/1956366708 reap_dead start 2024-09-12T02:59:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 shutdown_connections 2024-09-12T02:59:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 >> 172.21.15.63:0/1956366708 conn(0x7fc6ec0cc740 msgr2=0x7fc6ec158580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 shutdown_connections 2024-09-12T02:59:04.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.336+0000 7fc6eb200640 1 -- 172.21.15.63:0/1956366708 wait complete. 2024-09-12T02:59:04.357 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T02:59:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92df200640 1 Processor -- start 2024-09-12T02:59:04.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92df200640 1 -- start start 2024-09-12T02:59:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92df200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 0x7f92e0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92df200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92e015b470 0x7f92e015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92df200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e015ee20 con 0x7f92e006cf30 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92df200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f92e015b900 con 0x7f92e015b470 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92df200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f92e015a9b0 con 0x7f92e006d310 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92dde00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f92e006cf30 0x7f92e0067a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59158/0 (socket says 172.21.15.63:59158) 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92dde00640 1 -- 172.21.15.63:0/4232366688 learned_addr learned my addr 172.21.15.63:0/4232366688 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92de800640 1 --2- 172.21.15.63:0/4232366688 >> v2:172.21.15.63:3300/0 conn(0x7f92e015b470 0x7f92e015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92d7e00640 1 --2- 172.21.15.63:0/4232366688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 0x7f92e0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92de800640 1 -- 172.21.15.63:0/4232366688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 msgr2=0x7f92e0071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92de800640 1 --2- 172.21.15.63:0/4232366688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 0x7f92e0071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92de800640 1 -- 172.21.15.63:0/4232366688 >> v1:172.21.15.63:6789/0 conn(0x7f92e006cf30 legacy=0x7f92e0067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.496+0000 7f92de800640 1 -- 172.21.15.63:0/4232366688 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e00c8940 con 0x7f92e015b470 2024-09-12T02:59:04.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92de800640 1 --2- 172.21.15.63:0/4232366688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e015b470 0x7f92e015e8e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009d90 tx=0x7f92d801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc0290ada8ff014 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92dd400640 1 -- 172.21.15.63:0/4232366688 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80b2070 con 0x7f92e015b470 2024-09-12T02:59:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92dd400640 1 -- 172.21.15.63:0/4232366688 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d80a5a00 con 0x7f92e015b470 2024-09-12T02:59:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92dd400640 1 -- 172.21.15.63:0/4232366688 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d80a5dd0 con 0x7f92e015b470 2024-09-12T02:59:04.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92df200640 1 -- 172.21.15.63:0/4232366688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e015b470 msgr2=0x7f92e015e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92df200640 1 --2- 172.21.15.63:0/4232366688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e015b470 0x7f92e015e8e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009d90 tx=0x7f92d801c940 comp rx=0 tx=0).stop 2024-09-12T02:59:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92df200640 1 -- 172.21.15.63:0/4232366688 shutdown_connections 2024-09-12T02:59:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92df200640 1 --2- 172.21.15.63:0/4232366688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e015b470 0x7f92e015e8e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92df200640 1 --2- 172.21.15.63:0/4232366688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 0x7f92e0071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92df200640 1 -- 172.21.15.63:0/4232366688 >> 172.21.15.63:0/4232366688 conn(0x7f92e006f8b0 msgr2=0x7f92e006fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92df200640 1 -- 172.21.15.63:0/4232366688 shutdown_connections 2024-09-12T02:59:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.500+0000 7f92df200640 1 -- 172.21.15.63:0/4232366688 wait complete. 2024-09-12T02:59:04.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 Processor -- start 2024-09-12T02:59:04.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 -- start start 2024-09-12T02:59:04.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e006cf30 0x7f92e015d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 0x7f92e01f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e015b470 0x7f92e01f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f92e0070930 con 0x7f92e006cf30 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f92e015af50 con 0x7f92e015b470 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f92e0167260 con 0x7f92e006d310 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92dde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e006cf30 0x7f92e015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92dde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e006cf30 0x7f92e015d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36710/0 (socket says 172.21.15.63:36710) 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92dde00640 1 -- 172.21.15.63:0/1287815534 learned_addr learned my addr 172.21.15.63:0/1287815534 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92d7e00640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 0x7f92e01f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92de800640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e015b470 0x7f92e01f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92dde00640 1 -- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 msgr2=0x7f92e01f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92dde00640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 0x7f92e01f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92dde00640 1 -- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e015b470 msgr2=0x7f92e01f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92dde00640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e015b470 0x7f92e01f7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92dde00640 1 -- 172.21.15.63:0/1287815534 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e00c4dc0 con 0x7f92e006cf30 2024-09-12T02:59:04.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92d7e00640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 0x7f92e01f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:04.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92dde00640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e006cf30 0x7f92e015d390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c420 tx=0x7f92d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92d6000640 1 -- 172.21.15.63:0/1287815534 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0017070 con 0x7f92e006cf30 2024-09-12T02:59:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92d6000640 1 -- 172.21.15.63:0/1287815534 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d0005cf0 con 0x7f92e006cf30 2024-09-12T02:59:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e00c48a0 con 0x7f92e006cf30 2024-09-12T02:59:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92d6000640 1 -- 172.21.15.63:0/1287815534 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d00072f0 con 0x7f92e006cf30 2024-09-12T02:59:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e00c45c0 con 0x7f92e006cf30 2024-09-12T02:59:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.504+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e0071fc0 con 0x7f92e006cf30 2024-09-12T02:59:04.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.508+0000 7f92d6000640 1 -- 172.21.15.63:0/1287815534 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92d001a070 con 0x7f92e006cf30 2024-09-12T02:59:04.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.508+0000 7f92d6000640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f92bc0678c0 0x7f92bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:04.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.508+0000 7f92d6000640 1 -- 172.21.15.63:0/1287815534 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6685+0+0 (secure 0 0 0) 0x7f92d0085560 con 0x7f92e006cf30 2024-09-12T02:59:04.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.508+0000 7f92d7e00640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f92bc0678c0 0x7f92bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:04.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.508+0000 7f92d7e00640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f92bc0678c0 0x7f92bc069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92e00c5590 tx=0x7f92c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:04.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.512+0000 7f92d6000640 1 -- 172.21.15.63:0/1287815534 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f92d0055ba0 con 0x7f92e006cf30 2024-09-12T02:59:04.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.688+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 0, "weight": 1.0} v 0) -- 0x7f92e00c8510 con 0x7f92e006cf30 2024-09-12T02:59:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.980+0000 7f92d6000640 1 -- 172.21.15.63:0/1287815534 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 0, "weight": 1.0}]=0 reweighted osd.0 to 1 (10000) v64) ==== 113+0+0 (secure 0 0 0) 0x7f92d00554a0 con 0x7f92e006cf30 2024-09-12T02:59:04.986 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T02:59:04.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f92bc0678c0 msgr2=0x7f92bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f92bc0678c0 0x7f92bc069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f92e00c5590 tx=0x7f92c8008040 comp rx=0 tx=0).stop 2024-09-12T02:59:04.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e006cf30 msgr2=0x7f92e015d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:04.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e006cf30 0x7f92e015d390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f92d000c420 tx=0x7f92d000c8e0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 shutdown_connections 2024-09-12T02:59:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e015b470 0x7f92e01f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f92bc0678c0 0x7f92bc069d80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92e006d310 0x7f92e01f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 --2- 172.21.15.63:0/1287815534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92e006cf30 0x7f92e015d390 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 >> 172.21.15.63:0/1287815534 conn(0x7f92e006f8b0 msgr2=0x7f92e0143e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 shutdown_connections 2024-09-12T02:59:04.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:04.984+0000 7f92df200640 1 -- 172.21.15.63:0/1287815534 wait complete. 2024-09-12T02:59:05.020 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T02:59:05.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.160+0000 7f9451200640 1 Processor -- start 2024-09-12T02:59:05.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.160+0000 7f9451200640 1 -- start start 2024-09-12T02:59:05.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9451200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f944c151a20 0x7f944c073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:05.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9451200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f944c073eb0 con 0x7f944c0c9250 2024-09-12T02:59:05.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9451200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f944c074190 con 0x7f944c0c2080 2024-09-12T02:59:05.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9451200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f944c0717e0 con 0x7f944c151a20 2024-09-12T02:59:05.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9449e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f944c151a20 0x7f944c073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:05.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9449e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f944c151a20 0x7f944c073870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36724/0 (socket says 172.21.15.63:36724) 2024-09-12T02:59:05.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9449e00640 1 -- 172.21.15.63:0/2200736348 learned_addr learned my addr 172.21.15.63:0/2200736348 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:05.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9441400640 1 --1- 172.21.15.63:0/2200736348 >> v1:172.21.15.63:6789/0 conn(0x7f944c0c9250 0x7f944c0c7bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59170/0 (socket says 172.21.15.63:59170) 2024-09-12T02:59:05.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9449e00640 1 -- 172.21.15.63:0/2200736348 >> v1:172.21.15.119:6789/0 conn(0x7f944c0c2080 legacy=0x7f944c0c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:05.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9449e00640 1 -- 172.21.15.63:0/2200736348 >> v1:172.21.15.63:6789/0 conn(0x7f944c0c9250 legacy=0x7f944c0c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:05.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9449e00640 1 -- 172.21.15.63:0/2200736348 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c071ac0 con 0x7f944c151a20 2024-09-12T02:59:05.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9449e00640 1 --2- 172.21.15.63:0/2200736348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c151a20 0x7f944c073870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f943c009e50 tx=0x7f943c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe785b8725ad5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:05.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.164+0000 7f9449400640 1 -- 172.21.15.63:0/2200736348 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c0a5720 con 0x7f944c151a20 2024-09-12T02:59:05.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9449400640 1 -- 172.21.15.63:0/2200736348 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943c0a58c0 con 0x7f944c151a20 2024-09-12T02:59:05.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9449400640 1 -- 172.21.15.63:0/2200736348 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c0a5c90 con 0x7f944c151a20 2024-09-12T02:59:05.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 -- 172.21.15.63:0/2200736348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c151a20 msgr2=0x7f944c073870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:05.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 --2- 172.21.15.63:0/2200736348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c151a20 0x7f944c073870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f943c009e50 tx=0x7f943c01c9f0 comp rx=0 tx=0).stop 2024-09-12T02:59:05.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 -- 172.21.15.63:0/2200736348 shutdown_connections 2024-09-12T02:59:05.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 --2- 172.21.15.63:0/2200736348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c151a20 0x7f944c073870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:05.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 -- 172.21.15.63:0/2200736348 >> 172.21.15.63:0/2200736348 conn(0x7f944c06bcc0 msgr2=0x7f944c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:05.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 -- 172.21.15.63:0/2200736348 shutdown_connections 2024-09-12T02:59:05.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 -- 172.21.15.63:0/2200736348 wait complete. 2024-09-12T02:59:05.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 Processor -- start 2024-09-12T02:59:05.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 -- start start 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f944c0c2080 0x7f944c14de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c0c9250 0x7f944c14c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f944c151a20 0x7f944c1619a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f944c0c8480 con 0x7f944c0c9250 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f944c0c8300 con 0x7f944c0c2080 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9451200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f944c0c9660 con 0x7f944c151a20 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9441400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c0c9250 0x7f944c14c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9441400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c0c9250 0x7f944c14c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36734/0 (socket says 172.21.15.63:36734) 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9441400640 1 -- 172.21.15.63:0/2067556325 learned_addr learned my addr 172.21.15.63:0/2067556325 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9449e00640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f944c0c2080 0x7f944c14de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:05.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f944a800640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f944c151a20 0x7f944c1619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:05.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9441400640 1 -- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f944c151a20 msgr2=0x7f944c1619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:05.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9441400640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f944c151a20 0x7f944c1619a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:05.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9441400640 1 -- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f944c0c2080 msgr2=0x7f944c14de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:05.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9441400640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f944c0c2080 0x7f944c14de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:05.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.168+0000 7f9441400640 1 -- 172.21.15.63:0/2067556325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c148000 con 0x7f944c0c9250 2024-09-12T02:59:05.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9441400640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c0c9250 0x7f944c14c290 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f943400c430 tx=0x7f943400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:05.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9442a00640 1 -- 172.21.15.63:0/2067556325 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434017070 con 0x7f944c0c9250 2024-09-12T02:59:05.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9442a00640 1 -- 172.21.15.63:0/2067556325 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94340074e0 con 0x7f944c0c9250 2024-09-12T02:59:05.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9442a00640 1 -- 172.21.15.63:0/2067556325 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94340059d0 con 0x7f944c0c9250 2024-09-12T02:59:05.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c14e750 con 0x7f944c0c9250 2024-09-12T02:59:05.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c0cb210 con 0x7f944c0c9250 2024-09-12T02:59:05.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944c073870 con 0x7f944c0c9250 2024-09-12T02:59:05.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9442a00640 1 -- 172.21.15.63:0/2067556325 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f943401a070 con 0x7f944c0c9250 2024-09-12T02:59:05.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9442a00640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f94280678c0 0x7f9428069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:05.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9442a00640 1 -- 172.21.15.63:0/2067556325 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6685+0+0 (secure 0 0 0) 0x7f94340853c0 con 0x7f944c0c9250 2024-09-12T02:59:05.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.172+0000 7f9449e00640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f94280678c0 0x7f9428069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:05.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.176+0000 7f9449e00640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f94280678c0 0x7f9428069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f943c0ae000 tx=0x7f943c0a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:05.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.176+0000 7f9442a00640 1 -- 172.21.15.63:0/2067556325 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f944c148000 con 0x7f944c0c9250 2024-09-12T02:59:05.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.352+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 0, "weight": 1.0} v 0) -- 0x7f944c14bbd0 con 0x7f944c0c9250 2024-09-12T02:59:05.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.984+0000 7f9442a00640 1 -- 172.21.15.63:0/2067556325 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 0, "weight": 1.0}]=0 set osd.0 primary-affinity to 1 (8655362) v65) ==== 133+0+0 (secure 0 0 0) 0x7f94340554e0 con 0x7f944c0c9250 2024-09-12T02:59:05.989 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T02:59:05.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f94280678c0 msgr2=0x7f9428069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:05.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f94280678c0 0x7f9428069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f943c0ae000 tx=0x7f943c0a7070 comp rx=0 tx=0).stop 2024-09-12T02:59:05.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c0c9250 msgr2=0x7f944c14c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:05.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c0c9250 0x7f944c14c290 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f943400c430 tx=0x7f943400c8f0 comp rx=0 tx=0).stop 2024-09-12T02:59:05.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 shutdown_connections 2024-09-12T02:59:05.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f94280678c0 0x7f9428069d80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:05.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f944c151a20 0x7f944c1619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:05.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f944c0c9250 0x7f944c14c290 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:05.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 --2- 172.21.15.63:0/2067556325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f944c0c2080 0x7f944c14de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:05.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 >> 172.21.15.63:0/2067556325 conn(0x7f944c06bcc0 msgr2=0x7f944c0c1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:05.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 shutdown_connections 2024-09-12T02:59:05.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:05.988+0000 7f9451200640 1 -- 172.21.15.63:0/2067556325 wait complete. 2024-09-12T02:59:06.025 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T02:59:06.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15e2a00640 1 Processor -- start 2024-09-12T02:59:06.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15e2a00640 1 -- start start 2024-09-12T02:59:06.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15e2a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f15dc0b0c50 0x7f15dc159070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:06.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15e2a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15dc0c4ec0 con 0x7f15dc152640 2024-09-12T02:59:06.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15e2a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15dc0c51a0 con 0x7f15dc0c8c10 2024-09-12T02:59:06.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15e2a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f15dc15bd80 con 0x7f15dc0b0c50 2024-09-12T02:59:06.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15e1600640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f15dc152640 0x7f15dc15c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59184/0 (socket says 172.21.15.63:59184) 2024-09-12T02:59:06.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15e1600640 1 -- 172.21.15.63:0/3340918549 learned_addr learned my addr 172.21.15.63:0/3340918549 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:06.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15e0c00640 1 --2- 172.21.15.63:0/3340918549 >> v2:172.21.15.119:3300/0 conn(0x7f15dc0b0c50 0x7f15dc159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:06.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979116805 0 0) 0x7f15dc0c4ec0 con 0x7f15dc152640 2024-09-12T02:59:06.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c4003530 con 0x7f15dc152640 2024-09-12T02:59:06.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 36870599 0 0) 0x7f15c4003530 con 0x7f15dc152640 2024-09-12T02:59:06.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 >> v2:172.21.15.119:3300/0 conn(0x7f15dc0b0c50 msgr2=0x7f15dc159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:06.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.176+0000 7f15dbe00640 1 --2- 172.21.15.63:0/3340918549 >> v2:172.21.15.119:3300/0 conn(0x7f15dc0b0c50 0x7f15dc159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 >> v1:172.21.15.119:6789/0 conn(0x7f15dc0c8c10 legacy=0x7f15dc06f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc06fd90 con 0x7f15dc152640 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f15d0001680 con 0x7f15dc152640 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 >> v1:172.21.15.63:6789/0 conn(0x7f15dc152640 legacy=0x7f15dc15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c40039c0 0x7f15c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40051d0 0x7f15c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc15bd80 con 0x7f15c4004810 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f15c400c080 con 0x7f15c40051d0 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f15c400c280 con 0x7f15c40039c0 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e0c00640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e1600640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c40039c0 0x7f15c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e2000640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40051d0 0x7f15c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:06.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e0c00640 1 -- 172.21.15.63:0/3340918549 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c40039c0 msgr2=0x7f15c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:06.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e0c00640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15c40039c0 0x7f15c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:06.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e0c00640 1 -- 172.21.15.63:0/3340918549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40051d0 msgr2=0x7f15c400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:06.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e0c00640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15c40051d0 0x7f15c400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:06.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e0c00640 1 -- 172.21.15.63:0/3340918549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c4003530 con 0x7f15c4004810 2024-09-12T02:59:06.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e2000640 1 -- 172.21.15.63:0/3340918549 reap_dead start 2024-09-12T02:59:06.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15e0c00640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15c4004c90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009ae0 tx=0x7f15c801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeed44947ab0910c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:06.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80b2070 con 0x7f15c4004810 2024-09-12T02:59:06.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c80a5660 con 0x7f15c4004810 2024-09-12T02:59:06.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.180+0000 7f15dbe00640 1 -- 172.21.15.63:0/3340918549 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80096b0 con 0x7f15c4004810 2024-09-12T02:59:06.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 -- 172.21.15.63:0/3340918549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 msgr2=0x7f15c4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:06.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15c4004c90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009ae0 tx=0x7f15c801ca70 comp rx=0 tx=0).stop 2024-09-12T02:59:06.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 -- 172.21.15.63:0/3340918549 shutdown_connections 2024-09-12T02:59:06.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 --2- 172.21.15.63:0/3340918549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15c4004c90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:06.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 -- 172.21.15.63:0/3340918549 >> 172.21.15.63:0/3340918549 conn(0x7f15dc06c2c0 msgr2=0x7f15dc073930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:06.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 -- 172.21.15.63:0/3340918549 shutdown_connections 2024-09-12T02:59:06.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 -- 172.21.15.63:0/3340918549 wait complete. 2024-09-12T02:59:06.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 Processor -- start 2024-09-12T02:59:06.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 -- start start 2024-09-12T02:59:06.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15dc1f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:06.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15dc068150 0x7f15dc06e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:06.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc0c6630 0x7f15dc1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:06.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc159070 con 0x7f15c4004810 2024-09-12T02:59:06.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc152c30 con 0x7f15dc0c6630 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc1591f0 con 0x7f15dc068150 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e1600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15dc1f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e1600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15dc1f3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36758/0 (socket says 172.21.15.63:36758) 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e1600640 1 -- 172.21.15.63:0/811087270 learned_addr learned my addr 172.21.15.63:0/811087270 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e0c00640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15dc068150 0x7f15dc06e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e2000640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc0c6630 0x7f15dc1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e1600640 1 -- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15dc068150 msgr2=0x7f15dc06e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e1600640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15dc068150 0x7f15dc06e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e1600640 1 -- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc0c6630 msgr2=0x7f15dc1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e1600640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc0c6630 0x7f15dc1574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.184+0000 7f15e1600640 1 -- 172.21.15.63:0/811087270 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc1598c0 con 0x7f15c4004810 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15e1600640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15dc1f3200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f15d000e730 tx=0x7f15d000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15d9600640 1 -- 172.21.15.63:0/811087270 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d000ee40 con 0x7f15c4004810 2024-09-12T02:59:06.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15d9600640 1 -- 172.21.15.63:0/811087270 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d0018070 con 0x7f15c4004810 2024-09-12T02:59:06.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15d9600640 1 -- 172.21.15.63:0/811087270 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d000ca90 con 0x7f15c4004810 2024-09-12T02:59:06.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc06f820 con 0x7f15c4004810 2024-09-12T02:59:06.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc0c75b0 con 0x7f15c4004810 2024-09-12T02:59:06.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15dc0c3230 con 0x7f15c4004810 2024-09-12T02:59:06.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15d9600640 1 -- 172.21.15.63:0/811087270 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15d000cc30 con 0x7f15c4004810 2024-09-12T02:59:06.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15d9600640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f15bc0678c0 0x7f15bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:06.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15d9600640 1 -- 172.21.15.63:0/811087270 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6717+0+0 (secure 0 0 0) 0x7f15d0085eb0 con 0x7f15c4004810 2024-09-12T02:59:06.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.188+0000 7f15e0c00640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f15bc0678c0 0x7f15bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:06.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.192+0000 7f15e0c00640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f15bc0678c0 0x7f15bc069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f15c80af000 tx=0x7f15c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:06.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.192+0000 7f15d9600640 1 -- 172.21.15.63:0/811087270 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f15d00112e0 con 0x7f15c4004810 2024-09-12T02:59:06.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:06.372+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 1, "weight": 1.0} v 0) -- 0x7f15dc06cae0 con 0x7f15c4004810 2024-09-12T02:59:07.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.032+0000 7f15d9600640 1 -- 172.21.15.63:0/811087270 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 1, "weight": 1.0}]=0 reweighted osd.1 to 1 (10000) v66) ==== 113+0+0 (secure 0 0 0) 0x7f15d00565f0 con 0x7f15c4004810 2024-09-12T02:59:07.035 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T02:59:07.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f15bc0678c0 msgr2=0x7f15bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f15bc0678c0 0x7f15bc069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f15c80af000 tx=0x7f15c8008040 comp rx=0 tx=0).stop 2024-09-12T02:59:07.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 msgr2=0x7f15dc1f3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15dc1f3200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f15d000e730 tx=0x7f15d000ebf0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 shutdown_connections 2024-09-12T02:59:07.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15dc0c6630 0x7f15dc1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f15bc0678c0 0x7f15bc069d80 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f15c80af000 tx=0x7f15c8008040 comp rx=0 tx=0).stop 2024-09-12T02:59:07.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15dc068150 0x7f15dc06e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 --2- 172.21.15.63:0/811087270 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15c4004810 0x7f15dc1f3200 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 >> 172.21.15.63:0/811087270 conn(0x7f15dc06c2c0 msgr2=0x7f15dc0c9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:07.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 shutdown_connections 2024-09-12T02:59:07.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.036+0000 7f15e2a00640 1 -- 172.21.15.63:0/811087270 wait complete. 2024-09-12T02:59:07.074 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T02:59:07.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.216+0000 7f784d600640 1 Processor -- start 2024-09-12T02:59:07.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.216+0000 7f784d600640 1 -- start start 2024-09-12T02:59:07.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f784d600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7848156060 0x7f7848158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f784d600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78480c7c20 0x7f78480c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f784d600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7848159740 con 0x7f78480c6ee0 2024-09-12T02:59:07.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f784d600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f78480c8e50 con 0x7f7848156060 2024-09-12T02:59:07.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f784d600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7848159180 con 0x7f78480c7c20 2024-09-12T02:59:07.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7846a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7848156060 0x7f7848158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7847400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f78480c6ee0 0x7f784815bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59186/0 (socket says 172.21.15.63:59186) 2024-09-12T02:59:07.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7846a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7848156060 0x7f7848158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36762/0 (socket says 172.21.15.63:36762) 2024-09-12T02:59:07.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7847400640 1 -- 172.21.15.63:0/1836382873 learned_addr learned my addr 172.21.15.63:0/1836382873 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:07.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7846000640 1 --2- 172.21.15.63:0/1836382873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78480c7c20 0x7f78480c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7846a00640 1 -- 172.21.15.63:0/1836382873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78480c7c20 msgr2=0x7f78480c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:07.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7846a00640 1 --2- 172.21.15.63:0/1836382873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78480c7c20 0x7f78480c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7846a00640 1 -- 172.21.15.63:0/1836382873 >> v1:172.21.15.63:6789/0 conn(0x7f78480c6ee0 legacy=0x7f784815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7845600640 1 -- 172.21.15.63:0/1836382873 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271273148 0 0) 0x7f7848159740 con 0x7f78480c6ee0 2024-09-12T02:59:07.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7846a00640 1 -- 172.21.15.63:0/1836382873 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7848159460 con 0x7f7848156060 2024-09-12T02:59:07.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.220+0000 7f7846a00640 1 --2- 172.21.15.63:0/1836382873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7848156060 0x7f7848158810 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f78380097c0 tx=0x7f783801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81eb7c280e9cac5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:07.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7845600640 1 -- 172.21.15.63:0/1836382873 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78380b2070 con 0x7f7848156060 2024-09-12T02:59:07.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7845600640 1 -- 172.21.15.63:0/1836382873 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78380ad640 con 0x7f7848156060 2024-09-12T02:59:07.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7845600640 1 -- 172.21.15.63:0/1836382873 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78380ada10 con 0x7f7848156060 2024-09-12T02:59:07.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 -- 172.21.15.63:0/1836382873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7848156060 msgr2=0x7f7848158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 --2- 172.21.15.63:0/1836382873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7848156060 0x7f7848158810 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f78380097c0 tx=0x7f783801c4a0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 -- 172.21.15.63:0/1836382873 shutdown_connections 2024-09-12T02:59:07.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 --2- 172.21.15.63:0/1836382873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78480c7c20 0x7f78480c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 --2- 172.21.15.63:0/1836382873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7848156060 0x7f7848158810 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 -- 172.21.15.63:0/1836382873 >> 172.21.15.63:0/1836382873 conn(0x7f784806bcc0 msgr2=0x7f784806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:07.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 -- 172.21.15.63:0/1836382873 shutdown_connections 2024-09-12T02:59:07.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 -- 172.21.15.63:0/1836382873 wait complete. 2024-09-12T02:59:07.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 Processor -- start 2024-09-12T02:59:07.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 -- start start 2024-09-12T02:59:07.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78480c6ee0 0x7f78481f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78480c7c20 0x7f78480b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7848156060 0x7f784814ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7848071d10 con 0x7f78480c6ee0 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f784806cb30 con 0x7f78480c7c20 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f784d600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7848158d50 con 0x7f7848156060 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7846a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78480c6ee0 0x7f78481f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7846a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78480c6ee0 0x7f78481f4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36776/0 (socket says 172.21.15.63:36776) 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7846a00640 1 -- 172.21.15.63:0/294996674 learned_addr learned my addr 172.21.15.63:0/294996674 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7846000640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78480c7c20 0x7f78480b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7847400640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7848156060 0x7f784814ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7846a00640 1 -- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7848156060 msgr2=0x7f784814ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7846a00640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7848156060 0x7f784814ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7846a00640 1 -- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78480c7c20 msgr2=0x7f78480b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:07.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7846a00640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78480c7c20 0x7f78480b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:07.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7846a00640 1 -- 172.21.15.63:0/294996674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7848149840 con 0x7f78480c6ee0 2024-09-12T02:59:07.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.224+0000 7f7847400640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7848156060 0x7f784814ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:07.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f7846a00640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78480c6ee0 0x7f78481f4f80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f783801a0d0 tx=0x7f7838019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:07.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f783ea00640 1 -- 172.21.15.63:0/294996674 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78380ba020 con 0x7f78480c6ee0 2024-09-12T02:59:07.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f783ea00640 1 -- 172.21.15.63:0/294996674 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78380b6410 con 0x7f78480c6ee0 2024-09-12T02:59:07.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f783ea00640 1 -- 172.21.15.63:0/294996674 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78380b2040 con 0x7f78480c6ee0 2024-09-12T02:59:07.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78480afaf0 con 0x7f78480c6ee0 2024-09-12T02:59:07.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784814a0e0 con 0x7f78480c6ee0 2024-09-12T02:59:07.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7848158810 con 0x7f78480c6ee0 2024-09-12T02:59:07.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f783ea00640 1 -- 172.21.15.63:0/294996674 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78380bd020 con 0x7f78480c6ee0 2024-09-12T02:59:07.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f783ea00640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78280678c0 0x7f7828069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:07.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f783ea00640 1 -- 172.21.15.63:0/294996674 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6717+0+0 (secure 0 0 0) 0x7f783811fe00 con 0x7f78480c6ee0 2024-09-12T02:59:07.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.228+0000 7f7846000640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78280678c0 0x7f7828069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:07.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.232+0000 7f7846000640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78280678c0 0x7f7828069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78480b0a30 tx=0x7f7834008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:07.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.232+0000 7f783ea00640 1 -- 172.21.15.63:0/294996674 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f78380c4030 con 0x7f78480c6ee0 2024-09-12T02:59:07.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:07.412+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 1, "weight": 1.0} v 0) -- 0x7f78480c7a00 con 0x7f78480c6ee0 2024-09-12T02:59:08.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.032+0000 7f783ea00640 1 -- 172.21.15.63:0/294996674 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 1, "weight": 1.0}]=0 set osd.1 primary-affinity to 1 (8655362) v67) ==== 133+0+0 (secure 0 0 0) 0x7f7838016090 con 0x7f78480c6ee0 2024-09-12T02:59:08.037 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T02:59:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.036+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78280678c0 msgr2=0x7f7828069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.036+0000 7f784d600640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78280678c0 0x7f7828069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78480b0a30 tx=0x7f7834008040 comp rx=0 tx=0).stop 2024-09-12T02:59:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78480c6ee0 msgr2=0x7f78481f4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:08.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78480c6ee0 0x7f78481f4f80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f783801a0d0 tx=0x7f7838019240 comp rx=0 tx=0).stop 2024-09-12T02:59:08.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 shutdown_connections 2024-09-12T02:59:08.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f78280678c0 0x7f7828069d80 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f78480b0a30 tx=0x7f7834008040 comp rx=0 tx=0).stop 2024-09-12T02:59:08.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7848156060 0x7f784814ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:08.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78480c7c20 0x7f78480b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:08.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 --2- 172.21.15.63:0/294996674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78480c6ee0 0x7f78481f4f80 secure :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f783801a0d0 tx=0x7f7838019240 comp rx=0 tx=0).stop 2024-09-12T02:59:08.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 >> 172.21.15.63:0/294996674 conn(0x7f784806bcc0 msgr2=0x7f78480ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:08.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 shutdown_connections 2024-09-12T02:59:08.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.040+0000 7f784d600640 1 -- 172.21.15.63:0/294996674 wait complete. 2024-09-12T02:59:08.085 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T02:59:08.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0f600640 1 Processor -- start 2024-09-12T02:59:08.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0f600640 1 -- start start 2024-09-12T02:59:08.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0f600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8d081579a0 0x7f8d08157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:08.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0f600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d0806c740 con 0x7f8d08073fb0 2024-09-12T02:59:08.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0f600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d08072c30 con 0x7f8d08073bd0 2024-09-12T02:59:08.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0f600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f8d08072ef0 con 0x7f8d081579a0 2024-09-12T02:59:08.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d07e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8d08073fb0 0x7f8d080c79e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59198/0 (socket says 172.21.15.63:59198) 2024-09-12T02:59:08.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d07e00640 1 -- 172.21.15.63:0/2579461243 learned_addr learned my addr 172.21.15.63:0/2579461243 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:08.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0d600640 1 --2- 172.21.15.63:0/2579461243 >> v2:172.21.15.119:3300/0 conn(0x7f8d081579a0 0x7f8d08157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d07400640 1 -- 172.21.15.63:0/2579461243 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397557912 0 0) 0x7f8d0806c740 con 0x7f8d08073fb0 2024-09-12T02:59:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d07400640 1 -- 172.21.15.63:0/2579461243 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cf0003530 con 0x7f8d08073fb0 2024-09-12T02:59:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0d600640 1 -- 172.21.15.63:0/2579461243 >> v1:172.21.15.119:6789/0 conn(0x7f8d08073bd0 legacy=0x7f8d0815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d07400640 1 -- 172.21.15.63:0/2579461243 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3869092846 0 0) 0x7f8cf0003530 con 0x7f8d08073fb0 2024-09-12T02:59:08.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0d600640 1 -- 172.21.15.63:0/2579461243 >> v1:172.21.15.63:6789/0 conn(0x7f8d08073fb0 legacy=0x7f8d080c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:08.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.228+0000 7f8d0d600640 1 -- 172.21.15.63:0/2579461243 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d080731d0 con 0x7f8d081579a0 2024-09-12T02:59:08.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d0d600640 1 --2- 172.21.15.63:0/2579461243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d081579a0 0x7f8d08157df0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009d90 tx=0x7f8d0001f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3255a0675dd60b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:08.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d07400640 1 -- 172.21.15.63:0/2579461243 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d000b5070 con 0x7f8d081579a0 2024-09-12T02:59:08.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d07400640 1 -- 172.21.15.63:0/2579461243 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d000a8c10 con 0x7f8d081579a0 2024-09-12T02:59:08.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d07400640 1 -- 172.21.15.63:0/2579461243 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4001680 con 0x7f8d081579a0 2024-09-12T02:59:08.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d0f600640 1 -- 172.21.15.63:0/2579461243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d081579a0 msgr2=0x7f8d08157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:08.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d0f600640 1 --2- 172.21.15.63:0/2579461243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d081579a0 0x7f8d08157df0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009d90 tx=0x7f8d0001f080 comp rx=0 tx=0).stop 2024-09-12T02:59:08.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d0f600640 1 -- 172.21.15.63:0/2579461243 shutdown_connections 2024-09-12T02:59:08.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d0f600640 1 --2- 172.21.15.63:0/2579461243 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d081579a0 0x7f8d08157df0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:08.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d0f600640 1 -- 172.21.15.63:0/2579461243 >> 172.21.15.63:0/2579461243 conn(0x7f8d08070470 msgr2=0x7f8d08070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:08.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d0f600640 1 -- 172.21.15.63:0/2579461243 shutdown_connections 2024-09-12T02:59:08.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.232+0000 7f8d0f600640 1 -- 172.21.15.63:0/2579461243 wait complete. 2024-09-12T02:59:08.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 Processor -- start 2024-09-12T02:59:08.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 -- start start 2024-09-12T02:59:08.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d08073bd0 0x7f8d0815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d08073fb0 0x7f8d080c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d081579a0 0x7f8d080c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8d080c80f0 con 0x7f8d08073fb0 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0815aeb0 con 0x7f8d081579a0 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f8d080728f0 con 0x7f8d08073bd0 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d07e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d08073fb0 0x7f8d080c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d07e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d08073fb0 0x7f8d080c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36782/0 (socket says 172.21.15.63:36782) 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d07e00640 1 -- 172.21.15.63:0/633416092 learned_addr learned my addr 172.21.15.63:0/633416092 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0d600640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d081579a0 0x7f8d080c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:08.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0cc00640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d08073bd0 0x7f8d0815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:08.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d07e00640 1 -- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d08073bd0 msgr2=0x7f8d0815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:08.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d07e00640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d08073bd0 0x7f8d0815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:08.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d07e00640 1 -- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d081579a0 msgr2=0x7f8d080c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:08.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d07e00640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d081579a0 0x7f8d080c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:08.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d07e00640 1 -- 172.21.15.63:0/633416092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d081f0aa0 con 0x7f8d08073fb0 2024-09-12T02:59:08.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d07e00640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d08073fb0 0x7f8d080c4750 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400c720 tx=0x7f8cf400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:08.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d04c00640 1 -- 172.21.15.63:0/633416092 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4005ae0 con 0x7f8d08073fb0 2024-09-12T02:59:08.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d04c00640 1 -- 172.21.15.63:0/633416092 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf4005c80 con 0x7f8d08073fb0 2024-09-12T02:59:08.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d04c00640 1 -- 172.21.15.63:0/633416092 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4007270 con 0x7f8d08073fb0 2024-09-12T02:59:08.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d081f0d40 con 0x7f8d08073fb0 2024-09-12T02:59:08.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d080b1330 con 0x7f8d08073fb0 2024-09-12T02:59:08.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.236+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d080c4050 con 0x7f8d08073fb0 2024-09-12T02:59:08.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.240+0000 7f8d04c00640 1 -- 172.21.15.63:0/633416092 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8cf4007410 con 0x7f8d08073fb0 2024-09-12T02:59:08.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.240+0000 7f8d04c00640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8ce80678c0 0x7f8ce8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:08.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.240+0000 7f8d04c00640 1 -- 172.21.15.63:0/633416092 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6717+0+0 (secure 0 0 0) 0x7f8cf4085df0 con 0x7f8d08073fb0 2024-09-12T02:59:08.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.240+0000 7f8d0cc00640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8ce80678c0 0x7f8ce8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:08.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.240+0000 7f8d0cc00640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8ce80678c0 0x7f8ce8069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc001810 tx=0x7f8cfc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:08.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.244+0000 7f8d04c00640 1 -- 172.21.15.63:0/633416092 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8cf4055ee0 con 0x7f8d08073fb0 2024-09-12T02:59:08.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:08.424+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 2, "weight": 1.0} v 0) -- 0x7f8d080c99a0 con 0x7f8d08073fb0 2024-09-12T02:59:09.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.076+0000 7f8d04c00640 1 -- 172.21.15.63:0/633416092 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 2, "weight": 1.0}]=0 reweighted osd.2 to 1 (10000) v68) ==== 113+0+0 (secure 0 0 0) 0x7f8cf405a1e0 con 0x7f8d08073fb0 2024-09-12T02:59:09.081 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T02:59:09.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8ce80678c0 msgr2=0x7f8ce8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:09.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8ce80678c0 0x7f8ce8069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc001810 tx=0x7f8cfc009040 comp rx=0 tx=0).stop 2024-09-12T02:59:09.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d08073fb0 msgr2=0x7f8d080c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:09.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d08073fb0 0x7f8d080c4750 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400c720 tx=0x7f8cf400cb20 comp rx=0 tx=0).stop 2024-09-12T02:59:09.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 shutdown_connections 2024-09-12T02:59:09.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d081579a0 0x7f8d080c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d08073fb0 0x7f8d080c4750 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8ce80678c0 0x7f8ce8069d80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 --2- 172.21.15.63:0/633416092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d08073bd0 0x7f8d0815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 >> 172.21.15.63:0/633416092 conn(0x7f8d08070470 msgr2=0x7f8d08074da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:09.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 shutdown_connections 2024-09-12T02:59:09.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.080+0000 7f8d0f600640 1 -- 172.21.15.63:0/633416092 wait complete. 2024-09-12T02:59:09.108 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T02:59:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe3a600640 1 Processor -- start 2024-09-12T02:59:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe3a600640 1 -- start start 2024-09-12T02:59:09.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe3a600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbe34073870 0x7fbe340c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:09.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe3a600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe34073eb0 con 0x7fbe340c8130 2024-09-12T02:59:09.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe3a600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe34074190 con 0x7fbe34151a20 2024-09-12T02:59:09.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe3a600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fbe340717e0 con 0x7fbe34073870 2024-09-12T02:59:09.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe33e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbe340c8130 0x7fbe340c2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59204/0 (socket says 172.21.15.63:59204) 2024-09-12T02:59:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe33e00640 1 -- 172.21.15.63:0/456641586 learned_addr learned my addr 172.21.15.63:0/456641586 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe2aa00640 1 --2- 172.21.15.63:0/456641586 >> v2:172.21.15.119:3300/0 conn(0x7fbe34073870 0x7fbe340c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:09.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297791966 0 0) 0x7fbe34073eb0 con 0x7fbe340c8130 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe18003530 con 0x7fbe340c8130 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2066040770 0 0) 0x7fbe18003530 con 0x7fbe340c8130 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 >> v2:172.21.15.119:3300/0 conn(0x7fbe34073870 msgr2=0x7fbe340c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 --2- 172.21.15.63:0/456641586 >> v2:172.21.15.119:3300/0 conn(0x7fbe34073870 0x7fbe340c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 >> v1:172.21.15.119:6789/0 conn(0x7fbe34151a20 legacy=0x7fbe340c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe34071ac0 con 0x7fbe340c8130 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7fbe2c001680 con 0x7fbe340c8130 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 >> v1:172.21.15.63:6789/0 conn(0x7fbe340c8130 legacy=0x7fbe340c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe180039c0 0x7fbe18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe18004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe18005090 0x7fbe1800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbe340717e0 con 0x7fbe180043c0 2024-09-12T02:59:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1800bff0 con 0x7fbe180039c0 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbe1800c1f0 con 0x7fbe18005090 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe2aa00640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe18004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe33400640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe180039c0 0x7fbe18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe33e00640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe18005090 0x7fbe1800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe2aa00640 1 -- 172.21.15.63:0/456641586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe18005090 msgr2=0x7fbe1800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe2aa00640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe18005090 0x7fbe1800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe2aa00640 1 -- 172.21.15.63:0/456641586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe180039c0 msgr2=0x7fbe18003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe2aa00640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe180039c0 0x7fbe18003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe2aa00640 1 -- 172.21.15.63:0/456641586 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe18003530 con 0x7fbe180043c0 2024-09-12T02:59:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.252+0000 7fbe33e00640 1 -- 172.21.15.63:0/456641586 reap_dead start 2024-09-12T02:59:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe2aa00640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe18004890 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009ac0 tx=0x7fbe1c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b16e63eac713910 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c009690 con 0x7fbe180043c0 2024-09-12T02:59:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c0059a0 con 0x7fbe180043c0 2024-09-12T02:59:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe32a00640 1 -- 172.21.15.63:0/456641586 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c005d90 con 0x7fbe180043c0 2024-09-12T02:59:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe3a600640 1 -- 172.21.15.63:0/456641586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 msgr2=0x7fbe18004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe3a600640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe18004890 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009ac0 tx=0x7fbe1c01ca50 comp rx=0 tx=0).stop 2024-09-12T02:59:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe3a600640 1 -- 172.21.15.63:0/456641586 shutdown_connections 2024-09-12T02:59:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe3a600640 1 --2- 172.21.15.63:0/456641586 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe18004890 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe3a600640 1 -- 172.21.15.63:0/456641586 >> 172.21.15.63:0/456641586 conn(0x7fbe3406bcc0 msgr2=0x7fbe3406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe3a600640 1 -- 172.21.15.63:0/456641586 shutdown_connections 2024-09-12T02:59:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.256+0000 7fbe3a600640 1 -- 172.21.15.63:0/456641586 wait complete. 2024-09-12T02:59:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 Processor -- start 2024-09-12T02:59:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 -- start start 2024-09-12T02:59:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe340c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe3406c300 0x7fbe34147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe34147e80 0x7fbe340cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbe340c3040 con 0x7fbe180043c0 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbe34151e00 con 0x7fbe3406c300 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fbe340c31c0 con 0x7fbe34147e80 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe340c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe340c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36802/0 (socket says 172.21.15.63:36802) 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33400640 1 -- 172.21.15.63:0/2541652218 learned_addr learned my addr 172.21.15.63:0/2541652218 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33e00640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe34147e80 0x7fbe340cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe2aa00640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe3406c300 0x7fbe34147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:09.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33400640 1 -- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe34147e80 msgr2=0x7fbe340cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33400640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe34147e80 0x7fbe340cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33400640 1 -- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe3406c300 msgr2=0x7fbe34147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33400640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe3406c300 0x7fbe34147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33400640 1 -- 172.21.15.63:0/2541652218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe341eed40 con 0x7fbe180043c0 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe2aa00640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe3406c300 0x7fbe34147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe33400640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe340c34e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbe24011c10 tx=0x7fbe2400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe2be00640 1 -- 172.21.15.63:0/2541652218 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24019020 con 0x7fbe180043c0 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe2be00640 1 -- 172.21.15.63:0/2541652218 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2400fc50 con 0x7fbe180043c0 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe2be00640 1 -- 172.21.15.63:0/2541652218 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24003980 con 0x7fbe180043c0 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3414db80 con 0x7fbe180043c0 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.260+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3414cdb0 con 0x7fbe180043c0 2024-09-12T02:59:09.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.264+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe34148290 con 0x7fbe180043c0 2024-09-12T02:59:09.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.264+0000 7fbe2be00640 1 -- 172.21.15.63:0/2541652218 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbe2401c020 con 0x7fbe180043c0 2024-09-12T02:59:09.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.264+0000 7fbe2be00640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbe100678f0 0x7fbe10069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:09.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.264+0000 7fbe2be00640 1 -- 172.21.15.63:0/2541652218 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6717+0+0 (secure 0 0 0) 0x7fbe24089930 con 0x7fbe180043c0 2024-09-12T02:59:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.264+0000 7fbe2aa00640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbe100678f0 0x7fbe10069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.264+0000 7fbe2aa00640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbe100678f0 0x7fbe10069db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0ae000 tx=0x7fbe1c0046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:09.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.268+0000 7fbe2be00640 1 -- 172.21.15.63:0/2541652218 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbe24023020 con 0x7fbe180043c0 2024-09-12T02:59:09.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:09.448+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 2, "weight": 1.0} v 0) -- 0x7fbe340c7bf0 con 0x7fbe180043c0 2024-09-12T02:59:10.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.088+0000 7fbe2be00640 1 -- 172.21.15.63:0/2541652218 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 2, "weight": 1.0}]=0 set osd.2 primary-affinity to 1 (8655362) v69) ==== 133+0+0 (secure 0 0 0) 0x7fbe2405a070 con 0x7fbe180043c0 2024-09-12T02:59:10.093 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbe100678f0 msgr2=0x7fbe10069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbe100678f0 0x7fbe10069db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0ae000 tx=0x7fbe1c0046d0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 msgr2=0x7fbe340c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe340c34e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbe24011c10 tx=0x7fbe2400f5a0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 shutdown_connections 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fbe100678f0 0x7fbe10069db0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbe34147e80 0x7fbe340cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbe3406c300 0x7fbe34147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 --2- 172.21.15.63:0/2541652218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe180043c0 0x7fbe340c34e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 >> 172.21.15.63:0/2541652218 conn(0x7fbe3406bcc0 msgr2=0x7fbe34150d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:10.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 shutdown_connections 2024-09-12T02:59:10.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.092+0000 7fbe3a600640 1 -- 172.21.15.63:0/2541652218 wait complete. 2024-09-12T02:59:10.118 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T02:59:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.256+0000 7f9bb6e00640 1 Processor -- start 2024-09-12T02:59:10.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb6e00640 1 -- start start 2024-09-12T02:59:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb6e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00ce9e0 0x7f9bb00cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb6e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9bb00c4f50 0x7f9bb00cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:10.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb6e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb00ceeb0 con 0x7f9bb0152870 2024-09-12T02:59:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb6e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f9bb00ce1d0 con 0x7f9bb00c4f50 2024-09-12T02:59:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb6e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb00cdb50 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb4e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9bb00c4f50 0x7f9bb00cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bafe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9bb0152870 0x7f9bb00714b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59206/0 (socket says 172.21.15.63:59206) 2024-09-12T02:59:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bafe00640 1 -- 172.21.15.63:0/2203752024 learned_addr learned my addr 172.21.15.63:0/2203752024 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9ba7400640 1 --2- 172.21.15.63:0/2203752024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00ce9e0 0x7f9bb00cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:10.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb4e00640 1 -- 172.21.15.63:0/2203752024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00ce9e0 msgr2=0x7f9bb00cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb4e00640 1 --2- 172.21.15.63:0/2203752024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00ce9e0 0x7f9bb00cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb4e00640 1 -- 172.21.15.63:0/2203752024 >> v1:172.21.15.63:6789/0 conn(0x7f9bb0152870 legacy=0x7f9bb00714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:10.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.260+0000 7f9bb4e00640 1 -- 172.21.15.63:0/2203752024 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb00ce420 con 0x7f9bb00c4f50 2024-09-12T02:59:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb4e00640 1 --2- 172.21.15.63:0/2203752024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00c4f50 0x7f9bb00cc800 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009d90 tx=0x7f9ba801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68e2e69e6dc60ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9baf400640 1 -- 172.21.15.63:0/2203752024 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80b2070 con 0x7f9bb00c4f50 2024-09-12T02:59:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9baf400640 1 -- 172.21.15.63:0/2203752024 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba80a5830 con 0x7f9bb00c4f50 2024-09-12T02:59:10.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9baf400640 1 -- 172.21.15.63:0/2203752024 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80a5c00 con 0x7f9bb00c4f50 2024-09-12T02:59:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 -- 172.21.15.63:0/2203752024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00c4f50 msgr2=0x7f9bb00cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 --2- 172.21.15.63:0/2203752024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00c4f50 0x7f9bb00cc800 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009d90 tx=0x7f9ba801c970 comp rx=0 tx=0).stop 2024-09-12T02:59:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 -- 172.21.15.63:0/2203752024 shutdown_connections 2024-09-12T02:59:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 --2- 172.21.15.63:0/2203752024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00c4f50 0x7f9bb00cc800 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 --2- 172.21.15.63:0/2203752024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00ce9e0 0x7f9bb00cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 -- 172.21.15.63:0/2203752024 >> 172.21.15.63:0/2203752024 conn(0x7f9bb006bcc0 msgr2=0x7f9bb006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 -- 172.21.15.63:0/2203752024 shutdown_connections 2024-09-12T02:59:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 -- 172.21.15.63:0/2203752024 wait complete. 2024-09-12T02:59:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 Processor -- start 2024-09-12T02:59:10.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.264+0000 7f9bb6e00640 1 -- start start 2024-09-12T02:59:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb6e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00c4f50 0x7f9bb0153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb6e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00ce9e0 0x7f9bb0154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb6e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bb0152870 0x7f9bb00c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb6e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb0071bc0 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb6e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb00cd150 con 0x7f9bb0152870 2024-09-12T02:59:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb6e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb0071d40 con 0x7f9bb00c4f50 2024-09-12T02:59:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9ba7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00ce9e0 0x7f9bb0154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9ba7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00ce9e0 0x7f9bb0154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36818/0 (socket says 172.21.15.63:36818) 2024-09-12T02:59:10.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9ba7400640 1 -- 172.21.15.63:0/3385343422 learned_addr learned my addr 172.21.15.63:0/3385343422 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bafe00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00c4f50 0x7f9bb0153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb4e00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bb0152870 0x7f9bb00c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9ba7400640 1 -- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00c4f50 msgr2=0x7f9bb0153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9ba7400640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00c4f50 0x7f9bb0153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9ba7400640 1 -- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bb0152870 msgr2=0x7f9bb00c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9ba7400640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bb0152870 0x7f9bb00c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9ba7400640 1 -- 172.21.15.63:0/3385343422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb014fbc0 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9ba7400640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00ce9e0 0x7f9bb0154980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800d800 tx=0x7f9b9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bacc00640 1 -- 172.21.15.63:0/3385343422 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98004030 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bacc00640 1 -- 172.21.15.63:0/3385343422 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b980041d0 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bacc00640 1 -- 172.21.15.63:0/3385343422 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9800b6c0 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb00c7810 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb0155a90 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb00cc800 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.268+0000 7f9bacc00640 1 -- 172.21.15.63:0/3385343422 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9b9800b860 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.272+0000 7f9bacc00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9b8c0678c0 0x7f9b8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:10.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.272+0000 7f9bacc00640 1 -- 172.21.15.63:0/3385343422 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6717+0+0 (secure 0 0 0) 0x7f9b980862f0 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.272+0000 7f9bafe00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9b8c0678c0 0x7f9b8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:10.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.272+0000 7f9bafe00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9b8c0678c0 0x7f9b8c069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0000f70 tx=0x7f9ba0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:10.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.276+0000 7f9bacc00640 1 -- 172.21.15.63:0/3385343422 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9b98056a40 con 0x7f9bb00ce9e0 2024-09-12T02:59:10.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:10.456+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 3, "weight": 1.0} v 0) -- 0x7f9bb014c2d0 con 0x7f9bb00ce9e0 2024-09-12T02:59:11.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.100+0000 7f9bacc00640 1 -- 172.21.15.63:0/3385343422 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 3, "weight": 1.0}]=0 reweighted osd.3 to 1 (10000) v70) ==== 113+0+0 (secure 0 0 0) 0x7f9b98056340 con 0x7f9bb00ce9e0 2024-09-12T02:59:11.104 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T02:59:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9b8c0678c0 msgr2=0x7f9b8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9b8c0678c0 0x7f9b8c069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0000f70 tx=0x7f9ba0009040 comp rx=0 tx=0).stop 2024-09-12T02:59:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00ce9e0 msgr2=0x7f9bb0154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00ce9e0 0x7f9bb0154980 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800d800 tx=0x7f9b9800dcc0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 shutdown_connections 2024-09-12T02:59:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bb0152870 0x7f9bb00c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9bb00ce9e0 0x7f9bb0154980 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f9b8c0678c0 0x7f9b8c069d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 --2- 172.21.15.63:0/3385343422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bb00c4f50 0x7f9bb0153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 >> 172.21.15.63:0/3385343422 conn(0x7f9bb006bcc0 msgr2=0x7f9bb0071280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:11.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 shutdown_connections 2024-09-12T02:59:11.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.104+0000 7f9bb6e00640 1 -- 172.21.15.63:0/3385343422 wait complete. 2024-09-12T02:59:11.131 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-12T02:59:11.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f19400640 1 Processor -- start 2024-09-12T02:59:11.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f19400640 1 -- start start 2024-09-12T02:59:11.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f19400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f14154a60 0x7f6f1415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:11.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f19400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1415bd70 con 0x7f6f1406c590 2024-09-12T02:59:11.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f19400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f14068040 con 0x7f6f140c66f0 2024-09-12T02:59:11.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f19400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140ca6f0 con 0x7f6f14154a60 2024-09-12T02:59:11.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f13200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6f1406c590 0x7f6f1406c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59214/0 (socket says 172.21.15.63:59214) 2024-09-12T02:59:11.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f13200640 1 -- 172.21.15.63:0/2047372331 learned_addr learned my addr 172.21.15.63:0/2047372331 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:11.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f12800640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f14154a60 0x7f6f1415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:11.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614031371 0 0) 0x7f6f1415bd70 con 0x7f6f1406c590 2024-09-12T02:59:11.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ef8003530 con 0x7f6f1406c590 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004928197 0 0) 0x7f6f14068040 con 0x7f6f140c66f0 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f1415bd70 con 0x7f6f140c66f0 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 745496008 0 0) 0x7f6ef8003530 con 0x7f6f1406c590 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f14154a60 msgr2=0x7f6f1415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f14154a60 0x7f6f1415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 >> v1:172.21.15.119:6789/0 conn(0x7f6f140c66f0 legacy=0x7f6f140cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f140ca9d0 con 0x7f6f1406c590 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f6f0c001a00 con 0x7f6f1406c590 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 >> v1:172.21.15.63:6789/0 conn(0x7f6f1406c590 legacy=0x7f6f1406c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef8003b80 0x7f6ef8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f14154a60 0x7f6ef8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6ef80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:11.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140ca6f0 con 0x7f6ef8004d50 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef800ba80 con 0x7f6ef8003b80 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef800bc80 con 0x7f6f14154a60 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f13200640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6ef80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f12800640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef8003b80 0x7f6ef8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.276+0000 7f6f11e00640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f14154a60 0x7f6ef8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f13200640 1 -- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f14154a60 msgr2=0x7f6ef8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f13200640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f14154a60 0x7f6ef8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f13200640 1 -- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef8003b80 msgr2=0x7f6ef8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f13200640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef8003b80 0x7f6ef8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f13200640 1 -- 172.21.15.63:0/2047372331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef8003530 con 0x7f6ef8004d50 2024-09-12T02:59:11.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f13200640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6ef80051d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00a720 tx=0x7f6f0c01f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c42edf14b1d7614 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:11.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00a370 con 0x7f6ef8004d50 2024-09-12T02:59:11.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c0b1070 con 0x7f6ef8004d50 2024-09-12T02:59:11.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f11400640 1 -- 172.21.15.63:0/2047372331 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0ac8b0 con 0x7f6ef8004d50 2024-09-12T02:59:11.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f19400640 1 -- 172.21.15.63:0/2047372331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 msgr2=0x7f6ef80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:11.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f19400640 1 --2- 172.21.15.63:0/2047372331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6ef80051d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00a720 tx=0x7f6f0c01f9a0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f13200640 1 -- 172.21.15.63:0/2047372331 reap_dead start 2024-09-12T02:59:11.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f19400640 1 -- 172.21.15.63:0/2047372331 shutdown_connections 2024-09-12T02:59:11.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f19400640 1 -- 172.21.15.63:0/2047372331 >> 172.21.15.63:0/2047372331 conn(0x7f6f140cc770 msgr2=0x7f6f140ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:11.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f19400640 1 -- 172.21.15.63:0/2047372331 shutdown_connections 2024-09-12T02:59:11.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.280+0000 7f6f19400640 1 -- 172.21.15.63:0/2047372331 wait complete. 2024-09-12T02:59:11.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 Processor -- start 2024-09-12T02:59:11.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 -- start start 2024-09-12T02:59:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6f1415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f1414b870 0x7f6f1414aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f140c9d20 0x7f6f1414b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140cb270 con 0x7f6ef8004d50 2024-09-12T02:59:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f140caf90 con 0x7f6f140c9d20 2024-09-12T02:59:11.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6f140cbea0 con 0x7f6f1414b870 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f12800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6f1415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f12800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6f1415c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36832/0 (socket says 172.21.15.63:36832) 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f12800640 1 -- 172.21.15.63:0/1136478325 learned_addr learned my addr 172.21.15.63:0/1136478325 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f11e00640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f1414b870 0x7f6f1414aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f13200640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f140c9d20 0x7f6f1414b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f12800640 1 -- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f1414b870 msgr2=0x7f6f1414aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f12800640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f1414b870 0x7f6f1414aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f12800640 1 -- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f140c9d20 msgr2=0x7f6f1414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f12800640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f140c9d20 0x7f6f1414b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f12800640 1 -- 172.21.15.63:0/1136478325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f140c7090 con 0x7f6ef8004d50 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f12800640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6f1415c800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f04011a00 tx=0x7f6f04011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f0aa00640 1 -- 172.21.15.63:0/1136478325 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0400fa90 con 0x7f6ef8004d50 2024-09-12T02:59:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f0aa00640 1 -- 172.21.15.63:0/1136478325 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0400fc30 con 0x7f6ef8004d50 2024-09-12T02:59:11.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1414a6a0 con 0x7f6ef8004d50 2024-09-12T02:59:11.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f0aa00640 1 -- 172.21.15.63:0/1136478325 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04014440 con 0x7f6ef8004d50 2024-09-12T02:59:11.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.284+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f140c7630 con 0x7f6ef8004d50 2024-09-12T02:59:11.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.288+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f14154e40 con 0x7f6ef8004d50 2024-09-12T02:59:11.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.288+0000 7f6f0aa00640 1 -- 172.21.15.63:0/1136478325 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f04012040 con 0x7f6ef8004d50 2024-09-12T02:59:11.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.288+0000 7f6f0aa00640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ef40678c0 0x7f6ef4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:11.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.288+0000 7f6f0aa00640 1 -- 172.21.15.63:0/1136478325 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6717+0+0 (secure 0 0 0) 0x7f6f04086780 con 0x7f6ef8004d50 2024-09-12T02:59:11.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.288+0000 7f6f11e00640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ef40678c0 0x7f6ef4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:11.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.288+0000 7f6f11e00640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ef40678c0 0x7f6ef4069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f14073190 tx=0x7f6f00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:11.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.292+0000 7f6f0aa00640 1 -- 172.21.15.63:0/1136478325 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6f04019030 con 0x7f6ef8004d50 2024-09-12T02:59:11.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:11.484+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 3, "weight": 1.0} v 0) -- 0x7f6f14150250 con 0x7f6ef8004d50 2024-09-12T02:59:12.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.112+0000 7f6f0aa00640 1 -- 172.21.15.63:0/1136478325 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 3, "weight": 1.0}]=0 set osd.3 primary-affinity to 1 (8655362) v71) ==== 133+0+0 (secure 0 0 0) 0x7f6f04056e60 con 0x7f6ef8004d50 2024-09-12T02:59:12.116 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-12T02:59:12.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ef40678c0 msgr2=0x7f6ef4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:12.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ef40678c0 0x7f6ef4069d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f14073190 tx=0x7f6f00009040 comp rx=0 tx=0).stop 2024-09-12T02:59:12.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 msgr2=0x7f6f1415c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:12.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6f1415c800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f04011a00 tx=0x7f6f04011e00 comp rx=0 tx=0).stop 2024-09-12T02:59:12.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 shutdown_connections 2024-09-12T02:59:12.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f140c9d20 0x7f6f1414b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:12.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6ef40678c0 0x7f6ef4069d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:12.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f1414b870 0x7f6f1414aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:12.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 --2- 172.21.15.63:0/1136478325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ef8004d50 0x7f6f1415c800 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:12.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 >> 172.21.15.63:0/1136478325 conn(0x7f6f140cc770 msgr2=0x7f6f140731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:12.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 shutdown_connections 2024-09-12T02:59:12.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.116+0000 7f6f19400640 1 -- 172.21.15.63:0/1136478325 wait complete. 2024-09-12T02:59:12.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T02:59:12.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.280+0000 7fde5b800640 1 Processor -- start 2024-09-12T02:59:12.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.280+0000 7fde5b800640 1 -- start start 2024-09-12T02:59:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde5b800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fde54073fb0 0x7fde540c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde5b800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5406c740 con 0x7fde540c7f20 2024-09-12T02:59:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde5b800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde54072c30 con 0x7fde54073bd0 2024-09-12T02:59:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde5b800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fde54072ef0 con 0x7fde54073fb0 2024-09-12T02:59:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde59800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fde540c7f20 0x7fde541579a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59220/0 (socket says 172.21.15.63:59220) 2024-09-12T02:59:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde59800640 1 -- 172.21.15.63:0/3677946909 learned_addr learned my addr 172.21.15.63:0/3677946909 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:12.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde53e00640 1 --2- 172.21.15.63:0/3677946909 >> v2:172.21.15.119:3300/0 conn(0x7fde54073fb0 0x7fde540c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:12.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde53400640 1 -- 172.21.15.63:0/3677946909 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666324162 0 0) 0x7fde5406c740 con 0x7fde540c7f20 2024-09-12T02:59:12.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde53400640 1 -- 172.21.15.63:0/3677946909 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde38003530 con 0x7fde540c7f20 2024-09-12T02:59:12.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde53e00640 1 -- 172.21.15.63:0/3677946909 >> v1:172.21.15.119:6789/0 conn(0x7fde54073bd0 legacy=0x7fde5415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:12.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde53400640 1 -- 172.21.15.63:0/3677946909 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 312952366 0 0) 0x7fde38003530 con 0x7fde540c7f20 2024-09-12T02:59:12.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde53e00640 1 -- 172.21.15.63:0/3677946909 >> v1:172.21.15.63:6789/0 conn(0x7fde540c7f20 legacy=0x7fde541579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:12.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.284+0000 7fde53e00640 1 -- 172.21.15.63:0/3677946909 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde540731d0 con 0x7fde54073fb0 2024-09-12T02:59:12.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde53e00640 1 --2- 172.21.15.63:0/3677946909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073fb0 0x7fde540c79e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde400097c0 tx=0x7fde4001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8ad439d2bb240b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:12.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde53400640 1 -- 172.21.15.63:0/3677946909 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400b0070 con 0x7fde54073fb0 2024-09-12T02:59:12.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde53400640 1 -- 172.21.15.63:0/3677946909 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde400ab400 con 0x7fde54073fb0 2024-09-12T02:59:12.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde53400640 1 -- 172.21.15.63:0/3677946909 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c001a00 con 0x7fde54073fb0 2024-09-12T02:59:12.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde5b800640 1 -- 172.21.15.63:0/3677946909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073fb0 msgr2=0x7fde540c79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:12.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde5b800640 1 --2- 172.21.15.63:0/3677946909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073fb0 0x7fde540c79e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde400097c0 tx=0x7fde4001c3c0 comp rx=0 tx=0).stop 2024-09-12T02:59:12.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde5b800640 1 -- 172.21.15.63:0/3677946909 shutdown_connections 2024-09-12T02:59:12.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde5b800640 1 --2- 172.21.15.63:0/3677946909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073fb0 0x7fde540c79e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:12.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde5b800640 1 -- 172.21.15.63:0/3677946909 >> 172.21.15.63:0/3677946909 conn(0x7fde54070470 msgr2=0x7fde54070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:12.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde5b800640 1 -- 172.21.15.63:0/3677946909 shutdown_connections 2024-09-12T02:59:12.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde5b800640 1 -- 172.21.15.63:0/3677946909 wait complete. 2024-09-12T02:59:12.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde5b800640 1 Processor -- start 2024-09-12T02:59:12.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.288+0000 7fde5b800640 1 -- start start 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde5b800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073bd0 0x7fde541f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde5b800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde54073fb0 0x7fde540ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde5b800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde540c7f20 0x7fde54158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde5b800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fde540c41d0 con 0x7fde540c7f20 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde5b800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fde540c4050 con 0x7fde54073bd0 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde5b800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fde5406df60 con 0x7fde54073fb0 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde59800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde540c7f20 0x7fde54158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde59800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde540c7f20 0x7fde54158a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36842/0 (socket says 172.21.15.63:36842) 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde59800640 1 -- 172.21.15.63:0/4036223466 learned_addr learned my addr 172.21.15.63:0/4036223466 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:12.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde58e00640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073bd0 0x7fde541f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde53e00640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde54073fb0 0x7fde540ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde59800640 1 -- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde54073fb0 msgr2=0x7fde540ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde59800640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde54073fb0 0x7fde540ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde59800640 1 -- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073bd0 msgr2=0x7fde541f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde59800640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073bd0 0x7fde541f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde59800640 1 -- 172.21.15.63:0/4036223466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde541f6be0 con 0x7fde540c7f20 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde58e00640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073bd0 0x7fde541f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde53e00640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde54073fb0 0x7fde540ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde59800640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde540c7f20 0x7fde54158a70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00ccc0 tx=0x7fde4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde50c00640 1 -- 172.21.15.63:0/4036223466 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c012400 con 0x7fde540c7f20 2024-09-12T02:59:12.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde50c00640 1 -- 172.21.15.63:0/4036223466 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4c0125c0 con 0x7fde540c7f20 2024-09-12T02:59:12.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde50c00640 1 -- 172.21.15.63:0/4036223466 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0129b0 con 0x7fde540c7f20 2024-09-12T02:59:12.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde54159120 con 0x7fde540c7f20 2024-09-12T02:59:12.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde541f6e50 con 0x7fde540c7f20 2024-09-12T02:59:12.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde540c79e0 con 0x7fde540c7f20 2024-09-12T02:59:12.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.292+0000 7fde50c00640 1 -- 172.21.15.63:0/4036223466 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fde4c012b50 con 0x7fde540c7f20 2024-09-12T02:59:12.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.296+0000 7fde50c00640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fde340678c0 0x7fde34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:12.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.296+0000 7fde50c00640 1 -- 172.21.15.63:0/4036223466 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6717+0+0 (secure 0 0 0) 0x7fde4c0869f0 con 0x7fde540c7f20 2024-09-12T02:59:12.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.296+0000 7fde58e00640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fde340678c0 0x7fde34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:12.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.296+0000 7fde58e00640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fde340678c0 0x7fde34069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fde44000f70 tx=0x7fde44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:12.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.300+0000 7fde50c00640 1 -- 172.21.15.63:0/4036223466 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fde4c057010 con 0x7fde540c7f20 2024-09-12T02:59:12.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:12.480+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 4, "weight": 1.0} v 0) -- 0x7fde5414faf0 con 0x7fde540c7f20 2024-09-12T02:59:13.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.124+0000 7fde50c00640 1 -- 172.21.15.63:0/4036223466 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 4, "weight": 1.0}]=0 reweighted osd.4 to 1 (10000) v72) ==== 113+0+0 (secure 0 0 0) 0x7fde4c056910 con 0x7fde540c7f20 2024-09-12T02:59:13.129 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T02:59:13.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fde340678c0 msgr2=0x7fde34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fde340678c0 0x7fde34069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fde44000f70 tx=0x7fde44009040 comp rx=0 tx=0).stop 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde540c7f20 msgr2=0x7fde54158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde540c7f20 0x7fde54158a70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00ccc0 tx=0x7fde4c00a430 comp rx=0 tx=0).stop 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 shutdown_connections 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde540c7f20 0x7fde54158a70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fde340678c0 0x7fde34069d80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde54073fb0 0x7fde540ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 --2- 172.21.15.63:0/4036223466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde54073bd0 0x7fde541f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 >> 172.21.15.63:0/4036223466 conn(0x7fde54070470 msgr2=0x7fde54074da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 shutdown_connections 2024-09-12T02:59:13.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.128+0000 7fde5b800640 1 -- 172.21.15.63:0/4036223466 wait complete. 2024-09-12T02:59:13.157 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-12T02:59:13.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f935de00640 1 Processor -- start 2024-09-12T02:59:13.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f935de00640 1 -- start start 2024-09-12T02:59:13.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f935de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f93580ce9e0 0x7f93580cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f935de00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f93580c4f50 0x7f93580cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f935de00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93580ceeb0 con 0x7f9358152870 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f935de00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f93580ce1d0 con 0x7f93580ce9e0 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f935de00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f93580cdb50 con 0x7f93580c4f50 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f9356000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f93580ce9e0 0x7f93580cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f9356000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f93580ce9e0 0x7f93580cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36056/0 (socket says 172.21.15.63:36056) 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f9356000640 1 -- 172.21.15.63:0/3495266401 learned_addr learned my addr 172.21.15.63:0/3495266401 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f9357400640 1 --2- 172.21.15.63:0/3495266401 >> v2:172.21.15.119:3300/0 conn(0x7f93580c4f50 0x7f93580cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f9356000640 1 -- 172.21.15.63:0/3495266401 >> v2:172.21.15.119:3300/0 conn(0x7f93580c4f50 msgr2=0x7f93580cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:13.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f9356000640 1 --2- 172.21.15.63:0/3495266401 >> v2:172.21.15.119:3300/0 conn(0x7f93580c4f50 0x7f93580cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f9356000640 1 -- 172.21.15.63:0/3495266401 >> v1:172.21.15.119:6789/0 conn(0x7f9358152870 legacy=0x7f93580714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:13.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.300+0000 7f9356000640 1 -- 172.21.15.63:0/3495266401 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93580ce420 con 0x7f93580ce9e0 2024-09-12T02:59:13.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f9356000640 1 --2- 172.21.15.63:0/3495266401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 0x7f93580cbf00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f93580720d0 tx=0x7f934401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8809f22a69fb390 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:13.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f9355600640 1 -- 172.21.15.63:0/3495266401 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440b5070 con 0x7f93580ce9e0 2024-09-12T02:59:13.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f9355600640 1 -- 172.21.15.63:0/3495266401 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93440a8a10 con 0x7f93580ce9e0 2024-09-12T02:59:13.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f9355600640 1 -- 172.21.15.63:0/3495266401 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440a8de0 con 0x7f93580ce9e0 2024-09-12T02:59:13.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f935de00640 1 -- 172.21.15.63:0/3495266401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 msgr2=0x7f93580cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:13.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f935de00640 1 --2- 172.21.15.63:0/3495266401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 0x7f93580cbf00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f93580720d0 tx=0x7f934401ed10 comp rx=0 tx=0).stop 2024-09-12T02:59:13.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f935de00640 1 -- 172.21.15.63:0/3495266401 shutdown_connections 2024-09-12T02:59:13.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f935de00640 1 --2- 172.21.15.63:0/3495266401 >> v2:172.21.15.119:3300/0 conn(0x7f93580c4f50 0x7f93580cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:13.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f935de00640 1 --2- 172.21.15.63:0/3495266401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 0x7f93580cbf00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:13.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f935de00640 1 -- 172.21.15.63:0/3495266401 >> 172.21.15.63:0/3495266401 conn(0x7f935806bcc0 msgr2=0x7f935806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:13.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f935de00640 1 -- 172.21.15.63:0/3495266401 shutdown_connections 2024-09-12T02:59:13.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.304+0000 7f935de00640 1 -- 172.21.15.63:0/3495266401 wait complete. 2024-09-12T02:59:13.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 Processor -- start 2024-09-12T02:59:13.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 -- start start 2024-09-12T02:59:13.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93580c4f50 0x7f93580c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:13.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 0x7f93580c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:13.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9358152870 0x7f9358153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9358152c50 con 0x7f93580ce9e0 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f93580cd7e0 con 0x7f9358152870 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9358152dd0 con 0x7f93580c4f50 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 0x7f93580c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 0x7f93580c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36070/0 (socket says 172.21.15.63:36070) 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356000640 1 -- 172.21.15.63:0/1757206944 learned_addr learned my addr 172.21.15.63:0/1757206944 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9357400640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9358152870 0x7f9358153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356a00640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93580c4f50 0x7f93580c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356000640 1 -- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93580c4f50 msgr2=0x7f93580c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356000640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93580c4f50 0x7f93580c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356000640 1 -- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9358152870 msgr2=0x7f9358153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356000640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9358152870 0x7f9358153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356000640 1 -- 172.21.15.63:0/1757206944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93580c65b0 con 0x7f93580ce9e0 2024-09-12T02:59:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f9356000640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 0x7f93580c6bc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f934401b920 tx=0x7f934401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f934f400640 1 -- 172.21.15.63:0/1757206944 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440b5070 con 0x7f93580ce9e0 2024-09-12T02:59:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f934f400640 1 -- 172.21.15.63:0/1757206944 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93440b0b40 con 0x7f93580ce9e0 2024-09-12T02:59:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93581f1090 con 0x7f93580ce9e0 2024-09-12T02:59:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f934f400640 1 -- 172.21.15.63:0/1757206944 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440bb410 con 0x7f93580ce9e0 2024-09-12T02:59:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.308+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93581e3030 con 0x7f93580ce9e0 2024-09-12T02:59:13.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.312+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9358152fd0 con 0x7f93580ce9e0 2024-09-12T02:59:13.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.312+0000 7f934f400640 1 -- 172.21.15.63:0/1757206944 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93440c2060 con 0x7f93580ce9e0 2024-09-12T02:59:13.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.312+0000 7f934f400640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93380678c0 0x7f9338069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:13.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.312+0000 7f934f400640 1 -- 172.21.15.63:0/1757206944 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6717+0+0 (secure 0 0 0) 0x7f9344123270 con 0x7f93580ce9e0 2024-09-12T02:59:13.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.312+0000 7f9356a00640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93380678c0 0x7f9338069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:13.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.312+0000 7f9356a00640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93380678c0 0x7f9338069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93480015b0 tx=0x7f9348009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:13.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.316+0000 7f934f400640 1 -- 172.21.15.63:0/1757206944 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9344018870 con 0x7f93580ce9e0 2024-09-12T02:59:13.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:13.492+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 4, "weight": 1.0} v 0) -- 0x7f93580cbee0 con 0x7f93580ce9e0 2024-09-12T02:59:14.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.136+0000 7f934f400640 1 -- 172.21.15.63:0/1757206944 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 4, "weight": 1.0}]=0 set osd.4 primary-affinity to 1 (8655362) v73) ==== 133+0+0 (secure 0 0 0) 0x7f93440f39b0 con 0x7f93580ce9e0 2024-09-12T02:59:14.142 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93380678c0 msgr2=0x7f9338069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93380678c0 0x7f9338069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93480015b0 tx=0x7f9348009040 comp rx=0 tx=0).stop 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 msgr2=0x7f93580c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 0x7f93580c6bc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f934401b920 tx=0x7f934401bab0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 shutdown_connections 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9358152870 0x7f9358153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93580ce9e0 0x7f93580c6bc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f93380678c0 0x7f9338069d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 --2- 172.21.15.63:0/1757206944 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93580c4f50 0x7f93580c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 >> 172.21.15.63:0/1757206944 conn(0x7f935806bcc0 msgr2=0x7f9358151700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:14.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 shutdown_connections 2024-09-12T02:59:14.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.140+0000 7f935de00640 1 -- 172.21.15.63:0/1757206944 wait complete. 2024-09-12T02:59:14.168 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-12T02:59:14.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f2845200640 1 Processor -- start 2024-09-12T02:59:14.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f2845200640 1 -- start start 2024-09-12T02:59:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f2845200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2840151a20 0x7f2840073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f2845200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28400c2080 0x7f28400c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f2845200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2840073eb0 con 0x7f28400c9250 2024-09-12T02:59:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f2845200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f2840074190 con 0x7f2840151a20 2024-09-12T02:59:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f2845200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f28400717e0 con 0x7f28400c2080 2024-09-12T02:59:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f283de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2840151a20 0x7f2840073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:14.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f283de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2840151a20 0x7f2840073870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36084/0 (socket says 172.21.15.63:36084) 2024-09-12T02:59:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f283de00640 1 -- 172.21.15.63:0/3052738149 learned_addr learned my addr 172.21.15.63:0/3052738149 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f283e800640 1 --2- 172.21.15.63:0/3052738149 >> v2:172.21.15.119:3300/0 conn(0x7f28400c2080 0x7f28400c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f283de00640 1 -- 172.21.15.63:0/3052738149 >> v2:172.21.15.119:3300/0 conn(0x7f28400c2080 msgr2=0x7f28400c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f283de00640 1 --2- 172.21.15.63:0/3052738149 >> v2:172.21.15.119:3300/0 conn(0x7f28400c2080 0x7f28400c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f283de00640 1 -- 172.21.15.63:0/3052738149 >> v1:172.21.15.119:6789/0 conn(0x7f28400c9250 legacy=0x7f28400c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:14.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.308+0000 7f283de00640 1 -- 172.21.15.63:0/3052738149 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2840071ac0 con 0x7f2840151a20 2024-09-12T02:59:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f283de00640 1 --2- 172.21.15.63:0/3052738149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 0x7f2840073870 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f28400c3480 tx=0x7f283001f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cf98d487389eae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f283d400640 1 -- 172.21.15.63:0/3052738149 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28300b4070 con 0x7f2840151a20 2024-09-12T02:59:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f283d400640 1 -- 172.21.15.63:0/3052738149 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28300a7be0 con 0x7f2840151a20 2024-09-12T02:59:14.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f283d400640 1 -- 172.21.15.63:0/3052738149 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28300af440 con 0x7f2840151a20 2024-09-12T02:59:14.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f2845200640 1 -- 172.21.15.63:0/3052738149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 msgr2=0x7f2840073870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:14.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f2845200640 1 --2- 172.21.15.63:0/3052738149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 0x7f2840073870 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f28400c3480 tx=0x7f283001f650 comp rx=0 tx=0).stop 2024-09-12T02:59:14.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f2845200640 1 -- 172.21.15.63:0/3052738149 shutdown_connections 2024-09-12T02:59:14.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f2845200640 1 --2- 172.21.15.63:0/3052738149 >> v2:172.21.15.119:3300/0 conn(0x7f28400c2080 0x7f28400c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f2845200640 1 --2- 172.21.15.63:0/3052738149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 0x7f2840073870 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f2845200640 1 -- 172.21.15.63:0/3052738149 >> 172.21.15.63:0/3052738149 conn(0x7f284006bcc0 msgr2=0x7f284006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:14.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f2845200640 1 -- 172.21.15.63:0/3052738149 shutdown_connections 2024-09-12T02:59:14.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.312+0000 7f2845200640 1 -- 172.21.15.63:0/3052738149 wait complete. 2024-09-12T02:59:14.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 Processor -- start 2024-09-12T02:59:14.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 -- start start 2024-09-12T02:59:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28400c2080 0x7f28400ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28400c9250 0x7f284015b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 0x7f28400c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f28400c31c0 con 0x7f2840151a20 2024-09-12T02:59:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f28400c3040 con 0x7f28400c9250 2024-09-12T02:59:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f28400c8300 con 0x7f28400c2080 2024-09-12T02:59:14.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 0x7f28400c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 0x7f28400c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36092/0 (socket says 172.21.15.63:36092) 2024-09-12T02:59:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283e800640 1 -- 172.21.15.63:0/2926971034 learned_addr learned my addr 172.21.15.63:0/2926971034 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283de00640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28400c2080 0x7f28400ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2835400640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28400c9250 0x7f284015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283e800640 1 -- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28400c2080 msgr2=0x7f28400ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:14.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283e800640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28400c2080 0x7f28400ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283e800640 1 -- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28400c9250 msgr2=0x7f284015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283e800640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28400c9250 0x7f284015b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283e800640 1 -- 172.21.15.63:0/2926971034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2840158e90 con 0x7f2840151a20 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f283e800640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 0x7f28400c4760 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f283800efc0 tx=0x7f283800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2836a00640 1 -- 172.21.15.63:0/2926971034 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838018020 con 0x7f2840151a20 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2836a00640 1 -- 172.21.15.63:0/2926971034 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2838014480 con 0x7f2840151a20 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2840159170 con 0x7f2840151a20 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2836a00640 1 -- 172.21.15.63:0/2926971034 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838014870 con 0x7f2840151a20 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.316+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28400af250 con 0x7f2840151a20 2024-09-12T02:59:14.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.320+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28400c3d50 con 0x7f2840151a20 2024-09-12T02:59:14.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.320+0000 7f2836a00640 1 -- 172.21.15.63:0/2926971034 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f283801b020 con 0x7f2840151a20 2024-09-12T02:59:14.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.320+0000 7f2836a00640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f281c0678c0 0x7f281c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:14.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.320+0000 7f2836a00640 1 -- 172.21.15.63:0/2926971034 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6717+0+0 (secure 0 0 0) 0x7f2838086ab0 con 0x7f2840151a20 2024-09-12T02:59:14.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.320+0000 7f283de00640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f281c0678c0 0x7f281c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:14.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.320+0000 7f283de00640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f281c0678c0 0x7f281c069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28300b1000 tx=0x7f2830008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:14.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.324+0000 7f2836a00640 1 -- 172.21.15.63:0/2926971034 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2838022070 con 0x7f2840151a20 2024-09-12T02:59:14.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:14.504+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 6, "weight": 1.0} v 0) -- 0x7f28400c9660 con 0x7f2840151a20 2024-09-12T02:59:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.148+0000 7f2836a00640 1 -- 172.21.15.63:0/2926971034 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 6, "weight": 1.0}]=0 reweighted osd.6 to 1 (10000) v74) ==== 113+0+0 (secure 0 0 0) 0x7f2838010040 con 0x7f2840151a20 2024-09-12T02:59:15.153 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.6 to 1 (10000) 2024-09-12T02:59:15.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f281c0678c0 msgr2=0x7f281c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:15.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f281c0678c0 0x7f281c069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28300b1000 tx=0x7f2830008040 comp rx=0 tx=0).stop 2024-09-12T02:59:15.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 msgr2=0x7f28400c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:15.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 0x7f28400c4760 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f283800efc0 tx=0x7f283800c490 comp rx=0 tx=0).stop 2024-09-12T02:59:15.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 shutdown_connections 2024-09-12T02:59:15.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2840151a20 0x7f28400c4760 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28400c9250 0x7f284015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f281c0678c0 0x7f281c069d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 --2- 172.21.15.63:0/2926971034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28400c2080 0x7f28400ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 >> 172.21.15.63:0/2926971034 conn(0x7f284006bcc0 msgr2=0x7f28401601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 shutdown_connections 2024-09-12T02:59:15.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.152+0000 7f2845200640 1 -- 172.21.15.63:0/2926971034 wait complete. 2024-09-12T02:59:15.178 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-12T02:59:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955c800640 1 Processor -- start 2024-09-12T02:59:15.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955c800640 1 -- start start 2024-09-12T02:59:15.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955c800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 0x7f955415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955c800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f95540c66f0 0x7f95540cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955c800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f95540cbcd0 0x7f955406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955c800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f955415bd70 con 0x7f95540cbcd0 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955c800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f9554068040 con 0x7f95540c66f0 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955c800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f95540ca6f0 con 0x7f9554154a60 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955a800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f95540cbcd0 0x7f955406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955a800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f95540cbcd0 0x7f955406c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36104/0 (socket says 172.21.15.63:36104) 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955a800640 1 -- 172.21.15.63:0/2743547662 learned_addr learned my addr 172.21.15.63:0/2743547662 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f9559400640 1 --2- 172.21.15.63:0/2743547662 >> v2:172.21.15.119:3300/0 conn(0x7f95540c66f0 0x7f95540cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f9559e00640 1 --2- 172.21.15.63:0/2743547662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 0x7f955415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955a800640 1 -- 172.21.15.63:0/2743547662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 msgr2=0x7f955415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:15.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955a800640 1 --2- 172.21.15.63:0/2743547662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 0x7f955415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955a800640 1 -- 172.21.15.63:0/2743547662 >> v2:172.21.15.119:3300/0 conn(0x7f95540c66f0 msgr2=0x7f95540cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:15.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955a800640 1 --2- 172.21.15.63:0/2743547662 >> v2:172.21.15.119:3300/0 conn(0x7f95540c66f0 0x7f95540cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.320+0000 7f955a800640 1 -- 172.21.15.63:0/2743547662 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95540ca9d0 con 0x7f95540cbcd0 2024-09-12T02:59:15.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955a800640 1 --2- 172.21.15.63:0/2743547662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 0x7f955406c590 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95540cc4b0 tx=0x7f955001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c213c2e93676e9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:15.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f9558a00640 1 -- 172.21.15.63:0/2743547662 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95500a5840 con 0x7f95540cbcd0 2024-09-12T02:59:15.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f9558a00640 1 -- 172.21.15.63:0/2743547662 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95500a59e0 con 0x7f95540cbcd0 2024-09-12T02:59:15.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f9558a00640 1 -- 172.21.15.63:0/2743547662 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95500a5db0 con 0x7f95540cbcd0 2024-09-12T02:59:15.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 -- 172.21.15.63:0/2743547662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 msgr2=0x7f955406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 --2- 172.21.15.63:0/2743547662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 0x7f955406c590 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f95540cc4b0 tx=0x7f955001c9c0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 -- 172.21.15.63:0/2743547662 shutdown_connections 2024-09-12T02:59:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 --2- 172.21.15.63:0/2743547662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 0x7f955406c590 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 --2- 172.21.15.63:0/2743547662 >> v2:172.21.15.119:3300/0 conn(0x7f95540c66f0 0x7f95540cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 --2- 172.21.15.63:0/2743547662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 0x7f955415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 -- 172.21.15.63:0/2743547662 >> 172.21.15.63:0/2743547662 conn(0x7f95540cc770 msgr2=0x7f95540ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 -- 172.21.15.63:0/2743547662 shutdown_connections 2024-09-12T02:59:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 -- 172.21.15.63:0/2743547662 wait complete. 2024-09-12T02:59:15.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.324+0000 7f955c800640 1 Processor -- start 2024-09-12T02:59:15.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 -- start start 2024-09-12T02:59:15.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540c66f0 0x7f955414cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:15.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 0x7f95540c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:15.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 0x7f95540c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9554154fc0 con 0x7f95540cbcd0 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9554154e40 con 0x7f95540c66f0 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f955415de70 con 0x7f9554154a60 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 0x7f95540c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 0x7f95540c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36118/0 (socket says 172.21.15.63:36118) 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559400640 1 -- 172.21.15.63:0/3943046602 learned_addr learned my addr 172.21.15.63:0/3943046602 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559e00640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540c66f0 0x7f955414cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955a800640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 0x7f95540c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559400640 1 -- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 msgr2=0x7f95540c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559400640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 0x7f95540c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559400640 1 -- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540c66f0 msgr2=0x7f955414cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559400640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540c66f0 0x7f955414cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:15.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559400640 1 -- 172.21.15.63:0/3943046602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95541509f0 con 0x7f95540cbcd0 2024-09-12T02:59:15.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955a800640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 0x7f95540c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:15.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f9559400640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 0x7f95540c76d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9544009fd0 tx=0x7f954400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:15.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f954e000640 1 -- 172.21.15.63:0/3943046602 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544017070 con 0x7f95540cbcd0 2024-09-12T02:59:15.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f954e000640 1 -- 172.21.15.63:0/3943046602 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954400c940 con 0x7f95540cbcd0 2024-09-12T02:59:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f954e000640 1 -- 172.21.15.63:0/3943046602 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954400cd10 con 0x7f95540cbcd0 2024-09-12T02:59:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95540c9d70 con 0x7f95540cbcd0 2024-09-12T02:59:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9554072340 con 0x7f95540cbcd0 2024-09-12T02:59:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.328+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95540cb790 con 0x7f95540cbcd0 2024-09-12T02:59:15.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.332+0000 7f954e000640 1 -- 172.21.15.63:0/3943046602 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f954401a070 con 0x7f95540cbcd0 2024-09-12T02:59:15.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.332+0000 7f954e000640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f95380678f0 0x7f9538069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:15.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.332+0000 7f954e000640 1 -- 172.21.15.63:0/3943046602 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6717+0+0 (secure 0 0 0) 0x7f9544085b30 con 0x7f95540cbcd0 2024-09-12T02:59:15.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.332+0000 7f9559e00640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f95380678f0 0x7f9538069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:15.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.332+0000 7f9559e00640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f95380678f0 0x7f9538069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f95480079c0 tx=0x7f9548008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:15.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.336+0000 7f954e000640 1 -- 172.21.15.63:0/3943046602 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9544055cc0 con 0x7f95540cbcd0 2024-09-12T02:59:15.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:15.512+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 6, "weight": 1.0} v 0) -- 0x7f95540cccf0 con 0x7f95540cbcd0 2024-09-12T02:59:16.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f954e000640 1 -- 172.21.15.63:0/3943046602 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 6, "weight": 1.0}]=0 set osd.6 primary-affinity to 1 (8655362) v75) ==== 133+0+0 (secure 0 0 0) 0x7f9544059fc0 con 0x7f95540cbcd0 2024-09-12T02:59:16.174 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-12T02:59:16.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f95380678f0 msgr2=0x7f9538069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:16.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f95380678f0 0x7f9538069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f95480079c0 tx=0x7f9548008040 comp rx=0 tx=0).stop 2024-09-12T02:59:16.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 msgr2=0x7f95540c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:16.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 0x7f95540c76d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9544009fd0 tx=0x7f954400ed40 comp rx=0 tx=0).stop 2024-09-12T02:59:16.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 shutdown_connections 2024-09-12T02:59:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f95380678f0 0x7f9538069db0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9554154a60 0x7f95540c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95540cbcd0 0x7f95540c76d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 --2- 172.21.15.63:0/3943046602 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540c66f0 0x7f955414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 >> 172.21.15.63:0/3943046602 conn(0x7f95540cc770 msgr2=0x7f955414a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 shutdown_connections 2024-09-12T02:59:16.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.172+0000 7f955c800640 1 -- 172.21.15.63:0/3943046602 wait complete. 2024-09-12T02:59:16.200 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-12T02:59:16.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.340+0000 7f84cf200640 1 Processor -- start 2024-09-12T02:59:16.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.340+0000 7f84cf200640 1 -- start start 2024-09-12T02:59:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.340+0000 7f84cf200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84c81515f0 0x7f84c80c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.340+0000 7f84cf200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84c80c1e90 0x7f84c80c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.340+0000 7f84cf200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c80c1520 con 0x7f84c81519d0 2024-09-12T02:59:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.340+0000 7f84cf200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f84c80c84a0 con 0x7f84c80c1e90 2024-09-12T02:59:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.340+0000 7f84cf200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f84c8073810 con 0x7f84c81515f0 2024-09-12T02:59:16.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cd400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f84c81519d0 0x7f84c80717e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37510/0 (socket says 172.21.15.63:37510) 2024-09-12T02:59:16.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cd400640 1 -- 172.21.15.63:0/602582177 learned_addr learned my addr 172.21.15.63:0/602582177 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:16.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cde00640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84c81515f0 0x7f84c80c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:16.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84ce800640 1 --2- 172.21.15.63:0/602582177 >> v2:172.21.15.119:3300/0 conn(0x7f84c80c1e90 0x7f84c80c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:16.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045831845 0 0) 0x7f84c80c1520 con 0x7f84c81519d0 2024-09-12T02:59:16.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84b0003530 con 0x7f84c81519d0 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2477651548 0 0) 0x7f84b0003530 con 0x7f84c81519d0 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84c81515f0 msgr2=0x7f84c80c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84c81515f0 0x7f84c80c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 >> v2:172.21.15.119:3300/0 conn(0x7f84c80c1e90 msgr2=0x7f84c80c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 --2- 172.21.15.63:0/602582177 >> v2:172.21.15.119:3300/0 conn(0x7f84c80c1e90 0x7f84c80c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c8073af0 con 0x7f84c81519d0 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f84b8001680 con 0x7f84c81519d0 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 >> v1:172.21.15.63:6789/0 conn(0x7f84c81519d0 legacy=0x7f84c80717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84b00039c0 0x7f84b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84b0004810 0x7f84b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84c81515f0 0x7f84b00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f84c80c84a0 con 0x7f84b00039c0 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8073810 con 0x7f84b0004810 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f84b000b9d0 con 0x7f84c81515f0 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cde00640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84b00039c0 0x7f84b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cd400640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84b0004810 0x7f84b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84ce800640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84c81515f0 0x7f84b00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cde00640 1 -- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84c81515f0 msgr2=0x7f84b00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cde00640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84c81515f0 0x7f84b00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cde00640 1 -- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84b0004810 msgr2=0x7f84b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cde00640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84b0004810 0x7f84b0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.344+0000 7f84cde00640 1 -- 172.21.15.63:0/602582177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b0003530 con 0x7f84b00039c0 2024-09-12T02:59:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cde00640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84b00039c0 0x7f84b0003de0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009b10 tx=0x7f84bc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2989602f518abe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0096b0 con 0x7f84b00039c0 2024-09-12T02:59:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc0a9470 con 0x7f84b00039c0 2024-09-12T02:59:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cca00640 1 -- 172.21.15.63:0/602582177 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0a9860 con 0x7f84b00039c0 2024-09-12T02:59:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 -- 172.21.15.63:0/602582177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84b00039c0 msgr2=0x7f84b0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 --2- 172.21.15.63:0/602582177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84b00039c0 0x7f84b0003de0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009b10 tx=0x7f84bc01ca70 comp rx=0 tx=0).stop 2024-09-12T02:59:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84ce800640 1 -- 172.21.15.63:0/602582177 reap_dead start 2024-09-12T02:59:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 -- 172.21.15.63:0/602582177 shutdown_connections 2024-09-12T02:59:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 -- 172.21.15.63:0/602582177 >> 172.21.15.63:0/602582177 conn(0x7f84c806f3a0 msgr2=0x7f84c806f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 -- 172.21.15.63:0/602582177 shutdown_connections 2024-09-12T02:59:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 -- 172.21.15.63:0/602582177 wait complete. 2024-09-12T02:59:16.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 Processor -- start 2024-09-12T02:59:16.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 -- start start 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00039c0 0x7f84c8160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84c80c6140 0x7f84c81f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84c81f7730 0x7f84c80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8072070 con 0x7f84c81f7730 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f84c8071ef0 con 0x7f84c80c6140 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.348+0000 7f84cf200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f84c806d3d0 con 0x7f84b00039c0 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84ce800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84c81f7730 0x7f84c80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84ce800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84c81f7730 0x7f84c80cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36124/0 (socket says 172.21.15.63:36124) 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84ce800640 1 -- 172.21.15.63:0/2622793814 learned_addr learned my addr 172.21.15.63:0/2622793814 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84cde00640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00039c0 0x7f84c8160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:16.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84cd400640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84c80c6140 0x7f84c81f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:16.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84ce800640 1 -- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00039c0 msgr2=0x7f84c8160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:16.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84ce800640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00039c0 0x7f84c8160900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84ce800640 1 -- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84c80c6140 msgr2=0x7f84c81f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:16.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84ce800640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84c80c6140 0x7f84c81f71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:16.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84ce800640 1 -- 172.21.15.63:0/2622793814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c81f7ec0 con 0x7f84c81f7730 2024-09-12T02:59:16.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84ce800640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84c81f7730 0x7f84c80cb560 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f84c8070390 tx=0x7f84c40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:16.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84c2000640 1 -- 172.21.15.63:0/2622793814 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c40039a0 con 0x7f84c81f7730 2024-09-12T02:59:16.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84c2000640 1 -- 172.21.15.63:0/2622793814 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c401b070 con 0x7f84c81f7730 2024-09-12T02:59:16.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84c2000640 1 -- 172.21.15.63:0/2622793814 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c4003b80 con 0x7f84c81f7730 2024-09-12T02:59:16.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c81f7be0 con 0x7f84c81f7730 2024-09-12T02:59:16.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c815f050 con 0x7f84c81f7730 2024-09-12T02:59:16.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c80c8810 con 0x7f84c81f7730 2024-09-12T02:59:16.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84c2000640 1 -- 172.21.15.63:0/2622793814 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84c4004030 con 0x7f84c81f7730 2024-09-12T02:59:16.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.352+0000 7f84c2000640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f84ac067860 0x7f84ac069d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:16.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.356+0000 7f84c2000640 1 -- 172.21.15.63:0/2622793814 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6717+0+0 (secure 0 0 0) 0x7f84c4086980 con 0x7f84c81f7730 2024-09-12T02:59:16.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.356+0000 7f84cde00640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f84ac067860 0x7f84ac069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:16.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.356+0000 7f84cde00640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f84ac067860 0x7f84ac069d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0ae000 tx=0x7f84bc0b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:16.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.360+0000 7f84c2000640 1 -- 172.21.15.63:0/2622793814 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f84c4025020 con 0x7f84c81f7730 2024-09-12T02:59:16.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:16.536+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 7, "weight": 1.0} v 0) -- 0x7f84c814cff0 con 0x7f84c81f7730 2024-09-12T02:59:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.172+0000 7f84c2000640 1 -- 172.21.15.63:0/2622793814 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 7, "weight": 1.0}]=0 reweighted osd.7 to 1 (10000) v76) ==== 113+0+0 (secure 0 0 0) 0x7f84c40570d0 con 0x7f84c81f7730 2024-09-12T02:59:17.177 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.7 to 1 (10000) 2024-09-12T02:59:17.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f84ac067860 msgr2=0x7f84ac069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:17.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f84ac067860 0x7f84ac069d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0ae000 tx=0x7f84bc0b3040 comp rx=0 tx=0).stop 2024-09-12T02:59:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84c81f7730 msgr2=0x7f84c80cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84c81f7730 0x7f84c80cb560 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f84c8070390 tx=0x7f84c40115a0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 shutdown_connections 2024-09-12T02:59:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84c81f7730 0x7f84c80cb560 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84c80c6140 0x7f84c81f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f84ac067860 0x7f84ac069d20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 --2- 172.21.15.63:0/2622793814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00039c0 0x7f84c8160900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 >> 172.21.15.63:0/2622793814 conn(0x7f84c806f3a0 msgr2=0x7f84c814beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 shutdown_connections 2024-09-12T02:59:17.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.176+0000 7f84cf200640 1 -- 172.21.15.63:0/2622793814 wait complete. 2024-09-12T02:59:17.204 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-12T02:59:17.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.348+0000 7fb371600640 1 Processor -- start 2024-09-12T02:59:17.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.348+0000 7fb371600640 1 -- start start 2024-09-12T02:59:17.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.348+0000 7fb371600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb36c073870 0x7fb36c0c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.348+0000 7fb371600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c0c8130 0x7fb36c0c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.348+0000 7fb371600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36c073eb0 con 0x7fb36c151a20 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.348+0000 7fb371600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fb36c074190 con 0x7fb36c073870 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.348+0000 7fb371600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb36c0717e0 con 0x7fb36c0c8130 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb36a000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb36c073870 0x7fb36c0c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb36a000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb36c073870 0x7fb36c0c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36134/0 (socket says 172.21.15.63:36134) 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb36a000640 1 -- 172.21.15.63:0/1181725924 learned_addr learned my addr 172.21.15.63:0/1181725924 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb36b400640 1 --2- 172.21.15.63:0/1181725924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c0c8130 0x7fb36c0c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb36a000640 1 -- 172.21.15.63:0/1181725924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c0c8130 msgr2=0x7fb36c0c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:17.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb36a000640 1 --2- 172.21.15.63:0/1181725924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c0c8130 0x7fb36c0c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb36a000640 1 -- 172.21.15.63:0/1181725924 >> v1:172.21.15.119:6789/0 conn(0x7fb36c151a20 legacy=0x7fb36c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:17.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb36a000640 1 -- 172.21.15.63:0/1181725924 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36c071ac0 con 0x7fb36c073870 2024-09-12T02:59:17.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb36a000640 1 --2- 172.21.15.63:0/1181725924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c073870 0x7fb36c0c7bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb358006fd0 tx=0x7fb35801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1a79612bc6665a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:17.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb369600640 1 -- 172.21.15.63:0/1181725924 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580ab650 con 0x7fb36c073870 2024-09-12T02:59:17.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb369600640 1 -- 172.21.15.63:0/1181725924 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3580b0070 con 0x7fb36c073870 2024-09-12T02:59:17.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.352+0000 7fb369600640 1 -- 172.21.15.63:0/1181725924 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580aba10 con 0x7fb36c073870 2024-09-12T02:59:17.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 -- 172.21.15.63:0/1181725924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c073870 msgr2=0x7fb36c0c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:17.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 --2- 172.21.15.63:0/1181725924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c073870 0x7fb36c0c7bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb358006fd0 tx=0x7fb35801c540 comp rx=0 tx=0).stop 2024-09-12T02:59:17.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 -- 172.21.15.63:0/1181725924 shutdown_connections 2024-09-12T02:59:17.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 --2- 172.21.15.63:0/1181725924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c0c8130 0x7fb36c0c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 --2- 172.21.15.63:0/1181725924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c073870 0x7fb36c0c7bf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 -- 172.21.15.63:0/1181725924 >> 172.21.15.63:0/1181725924 conn(0x7fb36c06bcc0 msgr2=0x7fb36c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:17.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 -- 172.21.15.63:0/1181725924 shutdown_connections 2024-09-12T02:59:17.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 -- 172.21.15.63:0/1181725924 wait complete. 2024-09-12T02:59:17.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 Processor -- start 2024-09-12T02:59:17.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 -- start start 2024-09-12T02:59:17.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c073870 0x7fb36c14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:17.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c0c8130 0x7fb36c0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:17.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c151a20 0x7fb36c0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:17.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c0c31c0 con 0x7fb36c0c8130 2024-09-12T02:59:17.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c0c3040 con 0x7fb36c151a20 2024-09-12T02:59:17.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb371600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fb36c164860 con 0x7fb36c073870 2024-09-12T02:59:17.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c0c8130 0x7fb36c0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:17.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c0c8130 0x7fb36c0cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36140/0 (socket says 172.21.15.63:36140) 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36a000640 1 -- 172.21.15.63:0/35672753 learned_addr learned my addr 172.21.15.63:0/35672753 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36aa00640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c073870 0x7fb36c14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36b400640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c151a20 0x7fb36c0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36a000640 1 -- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c073870 msgr2=0x7fb36c14ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36a000640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c073870 0x7fb36c14ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36a000640 1 -- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c151a20 msgr2=0x7fb36c0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36a000640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c151a20 0x7fb36c0cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36a000640 1 -- 172.21.15.63:0/35672753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36c1f3700 con 0x7fb36c0c8130 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.356+0000 7fb36a000640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c0c8130 0x7fb36c0cb320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb35801abf0 tx=0x7fb3580192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb362a00640 1 -- 172.21.15.63:0/35672753 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358003bf0 con 0x7fb36c0c8130 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb362a00640 1 -- 172.21.15.63:0/35672753 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358003d90 con 0x7fb36c0c8130 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb362a00640 1 -- 172.21.15.63:0/35672753 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580ab690 con 0x7fb36c0c8130 2024-09-12T02:59:17.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb36c1f39e0 con 0x7fb36c0c8130 2024-09-12T02:59:17.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb36c0ca410 con 0x7fb36c0c8130 2024-09-12T02:59:17.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36c0c7bf0 con 0x7fb36c0c8130 2024-09-12T02:59:17.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb362a00640 1 -- 172.21.15.63:0/35672753 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3580ab830 con 0x7fb36c0c8130 2024-09-12T02:59:17.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb362a00640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb34c0678f0 0x7fb34c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:17.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb362a00640 1 -- 172.21.15.63:0/35672753 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6717+0+0 (secure 0 0 0) 0x7fb35811fef0 con 0x7fb36c0c8130 2024-09-12T02:59:17.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.360+0000 7fb36aa00640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb34c0678f0 0x7fb34c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:17.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.364+0000 7fb36aa00640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb34c0678f0 0x7fb34c069db0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb35c000f70 tx=0x7fb35c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:17.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.364+0000 7fb362a00640 1 -- 172.21.15.63:0/35672753 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb3580c5070 con 0x7fb36c0c8130 2024-09-12T02:59:17.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:17.544+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 7, "weight": 1.0} v 0) -- 0x7fb36c0c1240 con 0x7fb36c0c8130 2024-09-12T02:59:18.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.184+0000 7fb362a00640 1 -- 172.21.15.63:0/35672753 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 7, "weight": 1.0}]=0 set osd.7 primary-affinity to 1 (8655362) v77) ==== 133+0+0 (secure 0 0 0) 0x7fb358016130 con 0x7fb36c0c8130 2024-09-12T02:59:18.189 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-12T02:59:18.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb34c0678f0 msgr2=0x7fb34c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb34c0678f0 0x7fb34c069db0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb35c000f70 tx=0x7fb35c009040 comp rx=0 tx=0).stop 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c0c8130 msgr2=0x7fb36c0cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c0c8130 0x7fb36c0cb320 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb35801abf0 tx=0x7fb3580192e0 comp rx=0 tx=0).stop 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 shutdown_connections 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb36c151a20 0x7fb36c0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb36c0c8130 0x7fb36c0cb320 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fb34c0678f0 0x7fb34c069db0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 --2- 172.21.15.63:0/35672753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb36c073870 0x7fb36c14ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 >> 172.21.15.63:0/35672753 conn(0x7fb36c06bcc0 msgr2=0x7fb36c06c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 shutdown_connections 2024-09-12T02:59:18.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.188+0000 7fb371600640 1 -- 172.21.15.63:0/35672753 wait complete. 2024-09-12T02:59:18.215 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T02:59:18.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87cd200640 1 Processor -- start 2024-09-12T02:59:18.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87cd200640 1 -- start start 2024-09-12T02:59:18.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87cd200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c80c9ad0 0x7f87c8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:18.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87cd200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c8158480 con 0x7f87c8152910 2024-09-12T02:59:18.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87cd200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c80c34a0 con 0x7f87c8152530 2024-09-12T02:59:18.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87cd200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f87c80c4e70 con 0x7f87c80c9ad0 2024-09-12T02:59:18.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c6a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f87c8152910 0x7f87c8160df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37522/0 (socket says 172.21.15.63:37522) 2024-09-12T02:59:18.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c6a00640 1 -- 172.21.15.63:0/1842399754 learned_addr learned my addr 172.21.15.63:0/1842399754 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:18.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c7e00640 1 --2- 172.21.15.63:0/1842399754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c80c9ad0 0x7f87c8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:18.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c6000640 1 -- 172.21.15.63:0/1842399754 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 581872568 0 0) 0x7f87b4001120 con 0x7f87c8152910 2024-09-12T02:59:18.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c6000640 1 -- 172.21.15.63:0/1842399754 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87ac003530 con 0x7f87c8152910 2024-09-12T02:59:18.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c6000640 1 -- 172.21.15.63:0/1842399754 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492490306 0 0) 0x7f87c80c34a0 con 0x7f87c8152530 2024-09-12T02:59:18.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c6000640 1 -- 172.21.15.63:0/1842399754 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87b4001120 con 0x7f87c8152530 2024-09-12T02:59:18.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c6000640 1 -- 172.21.15.63:0/1842399754 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 846955259 0 0) 0x7f87ac003530 con 0x7f87c8152910 2024-09-12T02:59:18.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c7e00640 1 -- 172.21.15.63:0/1842399754 >> v1:172.21.15.119:6789/0 conn(0x7f87c8152530 legacy=0x7f87c80ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:18.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c7e00640 1 -- 172.21.15.63:0/1842399754 >> v1:172.21.15.63:6789/0 conn(0x7f87c8152910 legacy=0x7f87c8160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:18.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.360+0000 7f87c7e00640 1 -- 172.21.15.63:0/1842399754 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c80c5150 con 0x7f87c80c9ad0 2024-09-12T02:59:18.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87c7e00640 1 --2- 172.21.15.63:0/1842399754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c80c9ad0 0x7f87c8158f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009dc0 tx=0x7f87c001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6f4e7ec757c7cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:18.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87c6000640 1 -- 172.21.15.63:0/1842399754 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4001870 con 0x7f87c80c9ad0 2024-09-12T02:59:18.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87c6000640 1 -- 172.21.15.63:0/1842399754 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c00a6500 con 0x7f87c80c9ad0 2024-09-12T02:59:18.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87c6000640 1 -- 172.21.15.63:0/1842399754 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c00a68b0 con 0x7f87c80c9ad0 2024-09-12T02:59:18.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87cd200640 1 -- 172.21.15.63:0/1842399754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c80c9ad0 msgr2=0x7f87c8158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:18.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87cd200640 1 --2- 172.21.15.63:0/1842399754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c80c9ad0 0x7f87c8158f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009dc0 tx=0x7f87c001c8b0 comp rx=0 tx=0).stop 2024-09-12T02:59:18.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87cd200640 1 -- 172.21.15.63:0/1842399754 shutdown_connections 2024-09-12T02:59:18.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87cd200640 1 --2- 172.21.15.63:0/1842399754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c80c9ad0 0x7f87c8158f00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:18.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87cd200640 1 -- 172.21.15.63:0/1842399754 >> 172.21.15.63:0/1842399754 conn(0x7f87c8073fe0 msgr2=0x7f87c8067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:18.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87cd200640 1 -- 172.21.15.63:0/1842399754 shutdown_connections 2024-09-12T02:59:18.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.364+0000 7f87cd200640 1 -- 172.21.15.63:0/1842399754 wait complete. 2024-09-12T02:59:18.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 Processor -- start 2024-09-12T02:59:18.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 -- start start 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c80c9ad0 0x7f87c81f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87c8152530 0x7f87c8151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c8152910 0x7f87c81f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87c80ce920 con 0x7f87c80c9ad0 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f87c80ce7a0 con 0x7f87c8152530 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f87c8166d40 con 0x7f87c8152910 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c80c9ad0 0x7f87c81f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c80c9ad0 0x7f87c81f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36144/0 (socket says 172.21.15.63:36144) 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7400640 1 -- 172.21.15.63:0/476761372 learned_addr learned my addr 172.21.15.63:0/476761372 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:18.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7e00640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c8152910 0x7f87c81f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c6a00640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87c8152530 0x7f87c8151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7400640 1 -- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c8152910 msgr2=0x7f87c81f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7400640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c8152910 0x7f87c81f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7400640 1 -- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87c8152530 msgr2=0x7f87c8151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7400640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87c8152530 0x7f87c8151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7400640 1 -- 172.21.15.63:0/476761372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c81f5bf0 con 0x7f87c80c9ad0 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c6a00640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87c8152530 0x7f87c8151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7e00640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c8152910 0x7f87c81f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87c7400640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c80c9ad0 0x7f87c81f52b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f87b800c430 tx=0x7f87b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87bf400640 1 -- 172.21.15.63:0/476761372 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8017070 con 0x7f87c80c9ad0 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87bf400640 1 -- 172.21.15.63:0/476761372 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b80052f0 con 0x7f87c80c9ad0 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c80c7700 con 0x7f87c80c9ad0 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87bf400640 1 -- 172.21.15.63:0/476761372 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8003840 con 0x7f87c80c9ad0 2024-09-12T02:59:18.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c81f2ff0 con 0x7f87c80c9ad0 2024-09-12T02:59:18.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.368+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c8158f00 con 0x7f87c80c9ad0 2024-09-12T02:59:18.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.372+0000 7f87bf400640 1 -- 172.21.15.63:0/476761372 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87b801a070 con 0x7f87c80c9ad0 2024-09-12T02:59:18.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.372+0000 7f87bf400640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87a80678c0 0x7f87a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:18.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.372+0000 7f87bf400640 1 -- 172.21.15.63:0/476761372 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6717+0+0 (secure 0 0 0) 0x7f87b80854c0 con 0x7f87c80c9ad0 2024-09-12T02:59:18.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.372+0000 7f87c6a00640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87a80678c0 0x7f87a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:18.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.372+0000 7f87c6a00640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87a80678c0 0x7f87a8069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87b40019e0 tx=0x7f87b40018f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:18.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.376+0000 7f87bf400640 1 -- 172.21.15.63:0/476761372 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f87b8055c00 con 0x7f87c80c9ad0 2024-09-12T02:59:18.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:18.552+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd reweight", "id": 5, "weight": 1.0} v 0) -- 0x7f87c814bdc0 con 0x7f87c80c9ad0 2024-09-12T02:59:19.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.196+0000 7f87bf400640 1 -- 172.21.15.63:0/476761372 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd reweight", "id": 5, "weight": 1.0}]=0 reweighted osd.5 to 1 (10000) v78) ==== 113+0+0 (secure 0 0 0) 0x7f87b8055500 con 0x7f87c80c9ad0 2024-09-12T02:59:19.201 INFO:teuthology.orchestra.run.smithi063.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T02:59:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87a80678c0 msgr2=0x7f87a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87a80678c0 0x7f87a8069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f87b40019e0 tx=0x7f87b40018f0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c80c9ad0 msgr2=0x7f87c81f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c80c9ad0 0x7f87c81f52b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f87b800c430 tx=0x7f87b800c8f0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 shutdown_connections 2024-09-12T02:59:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87a80678c0 0x7f87a8069d80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87c8152910 0x7f87c81f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87c8152530 0x7f87c8151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 --2- 172.21.15.63:0/476761372 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87c80c9ad0 0x7f87c81f52b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 >> 172.21.15.63:0/476761372 conn(0x7f87c8073fe0 msgr2=0x7f87c80ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 shutdown_connections 2024-09-12T02:59:19.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.200+0000 7f87cd200640 1 -- 172.21.15.63:0/476761372 wait complete. 2024-09-12T02:59:19.229 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-12T02:59:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.372+0000 7f6fe9e00640 1 Processor -- start 2024-09-12T02:59:19.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.372+0000 7f6fe9e00640 1 -- start start 2024-09-12T02:59:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.372+0000 7f6fe9e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fe4151a20 0x7f6fe4073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.372+0000 7f6fe9e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe4073eb0 con 0x7f6fe40c2080 2024-09-12T02:59:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.372+0000 7f6fe9e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe4074190 con 0x7f6fe40c9250 2024-09-12T02:59:19.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.372+0000 7f6fe9e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe40717e0 con 0x7f6fe4151a20 2024-09-12T02:59:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe3400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6fe40c2080 0x7f6fe40c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37532/0 (socket says 172.21.15.63:37532) 2024-09-12T02:59:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe3400640 1 -- 172.21.15.63:0/1744019531 learned_addr learned my addr 172.21.15.63:0/1744019531 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe2a00640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fe4151a20 0x7f6fe4073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829478629 0 0) 0x7f6fe4073eb0 con 0x7f6fe40c2080 2024-09-12T02:59:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fc8003530 con 0x7f6fe40c2080 2024-09-12T02:59:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602822886 0 0) 0x7f6fe4074190 con 0x7f6fe40c9250 2024-09-12T02:59:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe4073eb0 con 0x7f6fe40c9250 2024-09-12T02:59:19.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1294035809 0 0) 0x7f6fc8003530 con 0x7f6fe40c2080 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fe4151a20 msgr2=0x7f6fe4073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fe4151a20 0x7f6fe4073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 >> v1:172.21.15.119:6789/0 conn(0x7f6fe40c9250 legacy=0x7f6fe40c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe4071ac0 con 0x7f6fe40c2080 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f6fdc001a00 con 0x7f6fe40c2080 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 >> v1:172.21.15.63:6789/0 conn(0x7f6fe40c2080 legacy=0x7f6fe40c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fc8003b80 0x7f6fc8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fe4151a20 0x7f6fc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc8004d50 0x7f6fc80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe40717e0 con 0x7f6fc8003b80 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc800dc90 con 0x7f6fc8004d50 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6fc800de40 con 0x7f6fe4151a20 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe2a00640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fc8003b80 0x7f6fc8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:19.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe3400640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc8004d50 0x7f6fc80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe2000640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fe4151a20 0x7f6fc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe2a00640 1 -- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fe4151a20 msgr2=0x7f6fc8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe2a00640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fe4151a20 0x7f6fc8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe2a00640 1 -- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc8004d50 msgr2=0x7f6fc80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe2a00640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc8004d50 0x7f6fc80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe2a00640 1 -- 172.21.15.63:0/1744019531 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc8003530 con 0x7f6fc8003b80 2024-09-12T02:59:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.376+0000 7f6fe3400640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fc8004d50 0x7f6fc80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:19.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe2a00640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fc8003b80 0x7f6fc8003f80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009ae0 tx=0x7f6fd401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb45719a8b6f072 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40096b0 con 0x7f6fc8003b80 2024-09-12T02:59:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd40a6460 con 0x7f6fc8003b80 2024-09-12T02:59:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe1600640 1 -- 172.21.15.63:0/1744019531 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd40a6850 con 0x7f6fc8003b80 2024-09-12T02:59:19.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 -- 172.21.15.63:0/1744019531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fc8003b80 msgr2=0x7f6fc8003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 --2- 172.21.15.63:0/1744019531 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fc8003b80 0x7f6fc8003f80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009ae0 tx=0x7f6fd401ca70 comp rx=0 tx=0).stop 2024-09-12T02:59:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe3400640 1 -- 172.21.15.63:0/1744019531 reap_dead start 2024-09-12T02:59:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 -- 172.21.15.63:0/1744019531 shutdown_connections 2024-09-12T02:59:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 -- 172.21.15.63:0/1744019531 >> 172.21.15.63:0/1744019531 conn(0x7f6fe406bcc0 msgr2=0x7f6fe406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 -- 172.21.15.63:0/1744019531 shutdown_connections 2024-09-12T02:59:19.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 -- 172.21.15.63:0/1744019531 wait complete. 2024-09-12T02:59:19.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 Processor -- start 2024-09-12T02:59:19.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 -- start start 2024-09-12T02:59:19.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fc8003b80 0x7f6fe40c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:19.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fe40c5e50 0x7f6fe41f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:19.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe41f2b00 0x7f6fe4146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:19.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe40c8480 con 0x7f6fe41f2b00 2024-09-12T02:59:19.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe40c8300 con 0x7f6fe40c5e50 2024-09-12T02:59:19.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.380+0000 7f6fe9e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe40c9630 con 0x7f6fc8003b80 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe41f2b00 0x7f6fe4146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe41f2b00 0x7f6fe4146bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36162/0 (socket says 172.21.15.63:36162) 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe3400640 1 -- 172.21.15.63:0/3941143257 learned_addr learned my addr 172.21.15.63:0/3941143257 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe2a00640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fc8003b80 0x7f6fe40c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe2000640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fe40c5e50 0x7f6fe41f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe3400640 1 -- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fc8003b80 msgr2=0x7f6fe40c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe3400640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fc8003b80 0x7f6fe40c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe3400640 1 -- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fe40c5e50 msgr2=0x7f6fe41f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe3400640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fe40c5e50 0x7f6fe41f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe3400640 1 -- 172.21.15.63:0/3941143257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe40cc430 con 0x7f6fe41f2b00 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe3400640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe41f2b00 0x7f6fe4146bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40c8f70 tx=0x7f6fdc007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fdb400640 1 -- 172.21.15.63:0/3941143257 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc00eaa0 con 0x7f6fe41f2b00 2024-09-12T02:59:19.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fdb400640 1 -- 172.21.15.63:0/3941143257 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc00ec40 con 0x7f6fe41f2b00 2024-09-12T02:59:19.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe415b760 con 0x7f6fe41f2b00 2024-09-12T02:59:19.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fdb400640 1 -- 172.21.15.63:0/3941143257 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc00ee30 con 0x7f6fe41f2b00 2024-09-12T02:59:19.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe40cb010 con 0x7f6fe41f2b00 2024-09-12T02:59:19.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe40c24d0 con 0x7f6fe41f2b00 2024-09-12T02:59:19.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.384+0000 7f6fdb400640 1 -- 172.21.15.63:0/3941143257 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6fdc01a020 con 0x7f6fe41f2b00 2024-09-12T02:59:19.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.388+0000 7f6fdb400640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6fc40678c0 0x7f6fc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:19.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.388+0000 7f6fdb400640 1 -- 172.21.15.63:0/3941143257 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6717+0+0 (secure 0 0 0) 0x7f6fdc086350 con 0x7f6fe41f2b00 2024-09-12T02:59:19.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.388+0000 7f6fe2a00640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6fc40678c0 0x7f6fc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:19.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.388+0000 7f6fe2a00640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6fc40678c0 0x7f6fc4069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40ad000 tx=0x7f6fd40b2040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:19.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.388+0000 7f6fdb400640 1 -- 172.21.15.63:0/3941143257 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6fdc021020 con 0x7f6fe41f2b00 2024-09-12T02:59:19.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:19.568+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd primary-affinity", "id": 5, "weight": 1.0} v 0) -- 0x7f6fe40c1240 con 0x7f6fe41f2b00 2024-09-12T02:59:20.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.212+0000 7f6fdb400640 1 -- 172.21.15.63:0/3941143257 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd primary-affinity", "id": 5, "weight": 1.0}]=0 set osd.5 primary-affinity to 1 (8655362) v79) ==== 133+0+0 (secure 0 0 0) 0x7f6fdc056c10 con 0x7f6fe41f2b00 2024-09-12T02:59:20.216 INFO:teuthology.orchestra.run.smithi063.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-12T02:59:20.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6fc40678c0 msgr2=0x7f6fc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6fc40678c0 0x7f6fc4069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40ad000 tx=0x7f6fd40b2040 comp rx=0 tx=0).stop 2024-09-12T02:59:20.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe41f2b00 msgr2=0x7f6fe4146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe41f2b00 0x7f6fe4146bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40c8f70 tx=0x7f6fdc007ba0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 shutdown_connections 2024-09-12T02:59:20.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fe41f2b00 0x7f6fe4146bf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6fe40c5e50 0x7f6fe41f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6fc40678c0 0x7f6fc4069d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 --2- 172.21.15.63:0/3941143257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6fc8003b80 0x7f6fe40c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 >> 172.21.15.63:0/3941143257 conn(0x7f6fe406bcc0 msgr2=0x7f6fe41547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:20.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 shutdown_connections 2024-09-12T02:59:20.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.216+0000 7f6fe9e00640 1 -- 172.21.15.63:0/3941143257 wait complete. 2024-09-12T02:59:20.244 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T02:59:20.244 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T02:59:20.244 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T02:59:20.245 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T02:59:20.245 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T02:59:20.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:59:20.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.384+0000 7f0513000640 1 Processor -- start 2024-09-12T02:59:20.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.384+0000 7f0513000640 1 -- start start 2024-09-12T02:59:20.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0513000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f050c1527e0 0x7f050c0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0513000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f050c0c61e0 0x7f050c0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0513000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050c159520 con 0x7f050c0c7a00 2024-09-12T02:59:20.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0513000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f050c1589a0 con 0x7f050c0c61e0 2024-09-12T02:59:20.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0513000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f050c158c80 con 0x7f050c1527e0 2024-09-12T02:59:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0511000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f050c0c61e0 0x7f050c0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0511000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f050c0c61e0 0x7f050c0c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36178/0 (socket says 172.21.15.63:36178) 2024-09-12T02:59:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0511000640 1 -- 172.21.15.63:0/1699463074 learned_addr learned my addr 172.21.15.63:0/1699463074 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f050be00640 1 --2- 172.21.15.63:0/1699463074 >> v2:172.21.15.119:3300/0 conn(0x7f050c1527e0 0x7f050c0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0511000640 1 -- 172.21.15.63:0/1699463074 >> v2:172.21.15.119:3300/0 conn(0x7f050c1527e0 msgr2=0x7f050c0c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0511000640 1 --2- 172.21.15.63:0/1699463074 >> v2:172.21.15.119:3300/0 conn(0x7f050c1527e0 0x7f050c0c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0511000640 1 -- 172.21.15.63:0/1699463074 >> v1:172.21.15.119:6789/0 conn(0x7f050c0c7a00 legacy=0x7f050c0cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.388+0000 7f0511000640 1 -- 172.21.15.63:0/1699463074 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c158f60 con 0x7f050c0c61e0 2024-09-12T02:59:20.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0511000640 1 --2- 172.21.15.63:0/1699463074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 0x7f050c0c6eb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f050c069960 tx=0x7f050401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98185377e9c0f03e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f050aa00640 1 -- 172.21.15.63:0/1699463074 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040a5880 con 0x7f050c0c61e0 2024-09-12T02:59:20.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f050aa00640 1 -- 172.21.15.63:0/1699463074 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05040a5a20 con 0x7f050c0c61e0 2024-09-12T02:59:20.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f050aa00640 1 -- 172.21.15.63:0/1699463074 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040a5df0 con 0x7f050c0c61e0 2024-09-12T02:59:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 -- 172.21.15.63:0/1699463074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 msgr2=0x7f050c0c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 --2- 172.21.15.63:0/1699463074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 0x7f050c0c6eb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f050c069960 tx=0x7f050401c9c0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 -- 172.21.15.63:0/1699463074 shutdown_connections 2024-09-12T02:59:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 --2- 172.21.15.63:0/1699463074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 0x7f050c0c6eb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 --2- 172.21.15.63:0/1699463074 >> v2:172.21.15.119:3300/0 conn(0x7f050c1527e0 0x7f050c0c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 -- 172.21.15.63:0/1699463074 >> 172.21.15.63:0/1699463074 conn(0x7f050c06f3d0 msgr2=0x7f050c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 -- 172.21.15.63:0/1699463074 shutdown_connections 2024-09-12T02:59:20.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 -- 172.21.15.63:0/1699463074 wait complete. 2024-09-12T02:59:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 Processor -- start 2024-09-12T02:59:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 -- start start 2024-09-12T02:59:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 0x7f050c0c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050c0c7a00 0x7f050c0c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f050c1527e0 0x7f050c0c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f050c1586e0 con 0x7f050c0c61e0 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f050c158560 con 0x7f050c0c7a00 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f0513000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f050c165700 con 0x7f050c1527e0 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f050be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 0x7f050c0c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f050be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 0x7f050c0c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36184/0 (socket says 172.21.15.63:36184) 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.392+0000 7f050be00640 1 -- 172.21.15.63:0/69317282 learned_addr learned my addr 172.21.15.63:0/69317282 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f050b400640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050c0c7a00 0x7f050c0c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0511000640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f050c1527e0 0x7f050c0c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f050be00640 1 -- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f050c1527e0 msgr2=0x7f050c0c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f050be00640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f050c1527e0 0x7f050c0c19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f050be00640 1 -- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050c0c7a00 msgr2=0x7f050c0c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f050be00640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050c0c7a00 0x7f050c0c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f050be00640 1 -- 172.21.15.63:0/69317282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c0c2310 con 0x7f050c0c61e0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f050be00640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 0x7f050c0c5080 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00d620 tx=0x7f04fc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0503e00640 1 -- 172.21.15.63:0/69317282 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc00b620 con 0x7f050c0c61e0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0503e00640 1 -- 172.21.15.63:0/69317282 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04fc019070 con 0x7f050c0c61e0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0503e00640 1 -- 172.21.15.63:0/69317282 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc00ba20 con 0x7f050c0c61e0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050c0c2070 con 0x7f050c0c61e0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050c1f41d0 con 0x7f050c0c61e0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f050c0cc550 con 0x7f050c0c61e0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0503e00640 1 -- 172.21.15.63:0/69317282 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04fc00bbc0 con 0x7f050c0c61e0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0503e00640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f04ec0678c0 0x7f04ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.396+0000 7f0503e00640 1 -- 172.21.15.63:0/69317282 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f04fc086480 con 0x7f050c0c61e0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.400+0000 7f050b400640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f04ec0678c0 0x7f04ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.400+0000 7f050b400640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f04ec0678c0 0x7f04ec069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f050c156660 tx=0x7f04f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.404+0000 7f0503e00640 1 -- 172.21.15.63:0/69317282 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f04fc056bc0 con 0x7f050c0c61e0 2024-09-12T02:59:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.568+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f050c0c55c0 con 0x7f050c0c61e0 2024-09-12T02:59:20.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.568+0000 7f0503e00640 1 -- 172.21.15.63:0/69317282 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+18821 (secure 0 0 0) 0x7f04fc0564c0 con 0x7f050c0c61e0 2024-09-12T02:59:20.574 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":79,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:59:20.214537+0000","last_up_change":"2024-09-12T02:59:04.984510+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":51,"up_from":64,"up_thru":64,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6825","nonce":2412795190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6827","nonce":2412795190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6831","nonce":2412795190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6829","nonce":2412795190}]},"public_addr":"172.21.15.119:6825/2412795190","cluster_addr":"172.21.15.119:6827/2412795190","heartbeat_back_addr":"172.21.15.119:6831/2412795190","heartbeat_front_addr":"172.21.15.119:6829/2412795190","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":52},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.4","osds":[5,7,4,6]}],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:59:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f04ec0678c0 msgr2=0x7f04ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f04ec0678c0 0x7f04ec069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f050c156660 tx=0x7f04f8009040 comp rx=0 tx=0).stop 2024-09-12T02:59:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 msgr2=0x7f050c0c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 0x7f050c0c5080 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00d620 tx=0x7f04fc00dae0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 shutdown_connections 2024-09-12T02:59:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f04ec0678c0 0x7f04ec069d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f050c1527e0 0x7f050c0c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f050c0c7a00 0x7f050c0c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 --2- 172.21.15.63:0/69317282 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f050c0c61e0 0x7f050c0c5080 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 >> 172.21.15.63:0/69317282 conn(0x7f050c06f3d0 msgr2=0x7f050c071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 shutdown_connections 2024-09-12T02:59:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.572+0000 7f0513000640 1 -- 172.21.15.63:0/69317282 wait complete. 2024-09-12T02:59:20.596 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T02:59:20.597 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:59:20.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.732+0000 7f1c7d200640 1 Processor -- start 2024-09-12T02:59:20.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.732+0000 7f1c7d200640 1 -- start start 2024-09-12T02:59:20.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c7d200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c781527e0 0x7f1c780c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c7d200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 0x7f1c780c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c7d200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c78159520 con 0x7f1c780c7a00 2024-09-12T02:59:20.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c7d200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f1c781589a0 con 0x7f1c781527e0 2024-09-12T02:59:20.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c7d200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1c78158c80 con 0x7f1c780c61e0 2024-09-12T02:59:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c75e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c781527e0 0x7f1c780c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c75e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1c781527e0 0x7f1c780c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36190/0 (socket says 172.21.15.63:36190) 2024-09-12T02:59:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c75e00640 1 -- 172.21.15.63:0/3366378423 learned_addr learned my addr 172.21.15.63:0/3366378423 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c76800640 1 --2- 172.21.15.63:0/3366378423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 0x7f1c780c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c75e00640 1 -- 172.21.15.63:0/3366378423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 msgr2=0x7f1c780c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c75e00640 1 --2- 172.21.15.63:0/3366378423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 0x7f1c780c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c75e00640 1 -- 172.21.15.63:0/3366378423 >> v1:172.21.15.119:6789/0 conn(0x7f1c780c7a00 legacy=0x7f1c780cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:20.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c75e00640 1 -- 172.21.15.63:0/3366378423 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c78158f60 con 0x7f1c781527e0 2024-09-12T02:59:20.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.736+0000 7f1c75e00640 1 --2- 172.21.15.63:0/3366378423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c781527e0 0x7f1c780c6970 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009870 tx=0x7f1c6801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64c1eec65d7622b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c75400640 1 -- 172.21.15.63:0/3366378423 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c680a95f0 con 0x7f1c781527e0 2024-09-12T02:59:20.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c75400640 1 -- 172.21.15.63:0/3366378423 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c680a9790 con 0x7f1c781527e0 2024-09-12T02:59:20.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c75400640 1 -- 172.21.15.63:0/3366378423 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c680a9b60 con 0x7f1c781527e0 2024-09-12T02:59:20.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 -- 172.21.15.63:0/3366378423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c781527e0 msgr2=0x7f1c780c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 --2- 172.21.15.63:0/3366378423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c781527e0 0x7f1c780c6970 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009870 tx=0x7f1c6801c530 comp rx=0 tx=0).stop 2024-09-12T02:59:20.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 -- 172.21.15.63:0/3366378423 shutdown_connections 2024-09-12T02:59:20.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 --2- 172.21.15.63:0/3366378423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 0x7f1c780c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 --2- 172.21.15.63:0/3366378423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c781527e0 0x7f1c780c6970 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 -- 172.21.15.63:0/3366378423 >> 172.21.15.63:0/3366378423 conn(0x7f1c7806f3d0 msgr2=0x7f1c7806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:20.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 -- 172.21.15.63:0/3366378423 shutdown_connections 2024-09-12T02:59:20.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 -- 172.21.15.63:0/3366378423 wait complete. 2024-09-12T02:59:20.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 Processor -- start 2024-09-12T02:59:20.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 -- start start 2024-09-12T02:59:20.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 0x7f1c781f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780c7a00 0x7f1c78159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c781527e0 0x7f1c781f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781586e0 con 0x7f1c780c7a00 2024-09-12T02:59:20.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78158560 con 0x7f1c781527e0 2024-09-12T02:59:20.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c7d200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1c78165700 con 0x7f1c780c61e0 2024-09-12T02:59:20.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c6d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780c7a00 0x7f1c78159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c6d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780c7a00 0x7f1c78159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36206/0 (socket says 172.21.15.63:36206) 2024-09-12T02:59:20.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c6d400640 1 -- 172.21.15.63:0/382192922 learned_addr learned my addr 172.21.15.63:0/382192922 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:20.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c75e00640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 0x7f1c781f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c76800640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c781527e0 0x7f1c781f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.740+0000 7f1c6d400640 1 -- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 msgr2=0x7f1c781f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6d400640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 0x7f1c781f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6d400640 1 -- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c781527e0 msgr2=0x7f1c781f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6d400640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c781527e0 0x7f1c781f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6d400640 1 -- 172.21.15.63:0/382192922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c781f3830 con 0x7f1c780c7a00 2024-09-12T02:59:20.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6d400640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780c7a00 0x7f1c78159930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000c450 tx=0x7f1c6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6ea00640 1 -- 172.21.15.63:0/382192922 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60016020 con 0x7f1c780c7a00 2024-09-12T02:59:20.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6ea00640 1 -- 172.21.15.63:0/382192922 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c600052d0 con 0x7f1c780c7a00 2024-09-12T02:59:20.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7815c3c0 con 0x7f1c780c7a00 2024-09-12T02:59:20.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6ea00640 1 -- 172.21.15.63:0/382192922 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60007260 con 0x7f1c780c7a00 2024-09-12T02:59:20.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c781f3aa0 con 0x7f1c780c7a00 2024-09-12T02:59:20.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7814ea70 con 0x7f1c780c7a00 2024-09-12T02:59:20.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6ea00640 1 -- 172.21.15.63:0/382192922 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c60007400 con 0x7f1c780c7a00 2024-09-12T02:59:20.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6ea00640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c540678f0 0x7f1c54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:20.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c6ea00640 1 -- 172.21.15.63:0/382192922 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f1c60085910 con 0x7f1c780c7a00 2024-09-12T02:59:20.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.744+0000 7f1c75e00640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c540678f0 0x7f1c54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:20.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.748+0000 7f1c75e00640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c540678f0 0x7f1c54069db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c680ae000 tx=0x7f1c68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:20.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.748+0000 7f1c6ea00640 1 -- 172.21.15.63:0/382192922 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1c60020020 con 0x7f1c780c7a00 2024-09-12T02:59:20.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.920+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c780c8c90 con 0x7f1c780c7a00 2024-09-12T02:59:20.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.920+0000 7f1c6ea00640 1 -- 172.21.15.63:0/382192922 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+18821 (secure 0 0 0) 0x7f1c60005480 con 0x7f1c780c7a00 2024-09-12T02:59:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:20.925 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":79,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:59:20.214537+0000","last_up_change":"2024-09-12T02:59:04.984510+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":51,"up_from":64,"up_thru":64,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6825","nonce":2412795190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6827","nonce":2412795190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6831","nonce":2412795190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6829","nonce":2412795190}]},"public_addr":"172.21.15.119:6825/2412795190","cluster_addr":"172.21.15.119:6827/2412795190","heartbeat_back_addr":"172.21.15.119:6831/2412795190","heartbeat_front_addr":"172.21.15.119:6829/2412795190","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":52},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.4","osds":[5,7,4,6]}],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:59:20.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c540678f0 msgr2=0x7f1c54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c540678f0 0x7f1c54069db0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c680ae000 tx=0x7f1c68009040 comp rx=0 tx=0).stop 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780c7a00 msgr2=0x7f1c78159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780c7a00 0x7f1c78159930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000c450 tx=0x7f1c6000c910 comp rx=0 tx=0).stop 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 shutdown_connections 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c781527e0 0x7f1c781f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c780c7a00 0x7f1c78159930 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1c540678f0 0x7f1c54069db0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 --2- 172.21.15.63:0/382192922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c780c61e0 0x7f1c781f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 >> 172.21.15.63:0/382192922 conn(0x7f1c7806f3d0 msgr2=0x7f1c780c6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:20.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 shutdown_connections 2024-09-12T02:59:20.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:20.924+0000 7f1c7d200640 1 -- 172.21.15.63:0/382192922 wait complete. 2024-09-12T02:59:20.946 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T02:59:20.947 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T02:59:20.947 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T02:59:20.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T02:59:20.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T02:59:20.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T02:59:20.949 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T02:59:20.949 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T02:59:21.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.188+0000 7f32f5600640 1 Processor -- start 2024-09-12T02:59:21.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.188+0000 7f32f5600640 1 -- start start 2024-09-12T02:59:21.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d3400640 1 Processor -- start 2024-09-12T02:59:21.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d3400640 1 -- start start 2024-09-12T02:59:21.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32f5600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32f00c1810 0x7f32f015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32f5600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f32f0160ac0 0x7f32f00c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32eea00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32f00c1810 0x7f32f015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32eea00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32f00c1810 0x7f32f015ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35380/0 (socket says 172.21.15.63:35380) 2024-09-12T02:59:21.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32ee000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f32f00c9690 0x7f32f01603b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37538/0 (socket says 172.21.15.63:37538) 2024-09-12T02:59:21.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32ef400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f32f0160ac0 0x7f32f00c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32ef400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f32f0160ac0 0x7f32f00c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36214/0 (socket says 172.21.15.63:36214) 2024-09-12T02:59:21.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32eea00640 1 -- 172.21.15.63:0/2488553890 learned_addr learned my addr 172.21.15.63:0/2488553890 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f7b8b600640 1 Processor -- start 2024-09-12T02:59:21.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d3400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98cc157fc0 0x7f98cc06d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d3400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c9690 0x7f98cc06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d3400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98cc0c0f90 0x7f98cc0c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d3400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f98cc06cec0 con 0x7f98cc0c0f90 2024-09-12T02:59:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d3400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f98cc15b450 con 0x7f98cc157fc0 2024-09-12T02:59:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d3400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f98cc1583a0 con 0x7f98cc0c9690 2024-09-12T02:59:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d0a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98cc157fc0 0x7f98cc06d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98cc0c0f90 0x7f98cc0c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f7b8b600640 1 -- start start 2024-09-12T02:59:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f98cc0c0f90 0x7f98cc0c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36218/0 (socket says 172.21.15.63:36218) 2024-09-12T02:59:21.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98d1400640 1 -- 172.21.15.63:0/3118276390 learned_addr learned my addr 172.21.15.63:0/3118276390 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32f5600640 1 -- 172.21.15.63:0/2488553890 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f006dec0 con 0x7f32f00c9690 2024-09-12T02:59:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32f5600640 1 -- 172.21.15.63:0/2488553890 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f32f006cfd0 con 0x7f32f0160ac0 2024-09-12T02:59:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32f5600640 1 -- 172.21.15.63:0/2488553890 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f32f006d2b0 con 0x7f32f00c1810 2024-09-12T02:59:21.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f98cbe00640 1 --2- 172.21.15.63:0/3118276390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c9690 0x7f98cc06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195543080 0 0) 0x7f32f006dec0 con 0x7f32f00c9690 2024-09-12T02:59:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.192+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d4003530 con 0x7f32f00c9690 2024-09-12T02:59:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f98d1400640 1 -- 172.21.15.63:0/3118276390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c9690 msgr2=0x7f98cc06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f98d1400640 1 --2- 172.21.15.63:0/3118276390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c9690 0x7f98cc06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f98d1400640 1 -- 172.21.15.63:0/3118276390 >> v2:172.21.15.119:3300/0 conn(0x7f98cc157fc0 msgr2=0x7f98cc06d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f98d1400640 1 --2- 172.21.15.63:0/3118276390 >> v2:172.21.15.119:3300/0 conn(0x7f98cc157fc0 0x7f98cc06d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f98d1400640 1 -- 172.21.15.63:0/3118276390 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc0c6aa0 con 0x7f98cc0c0f90 2024-09-12T02:59:21.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f98d0a00640 1 --2- 172.21.15.63:0/3118276390 >> v2:172.21.15.119:3300/0 conn(0x7f98cc157fc0 0x7f98cc06d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3273906801 0 0) 0x7f32d4003530 con 0x7f32f00c9690 2024-09-12T02:59:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32f00c1810 msgr2=0x7f32f015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32f00c1810 0x7f32f015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 >> v2:172.21.15.63:3300/0 conn(0x7f32f0160ac0 msgr2=0x7f32f00c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 --2- 172.21.15.63:0/2488553890 >> v2:172.21.15.63:3300/0 conn(0x7f32f0160ac0 0x7f32f00c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f006d590 con 0x7f32f00c9690 2024-09-12T02:59:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f32e0001680 con 0x7f32f00c9690 2024-09-12T02:59:21.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 >> v1:172.21.15.63:6789/0 conn(0x7f32f00c9690 legacy=0x7f32f01603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32d40039c0 0x7f32d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32d40043b0 0x7f32d4004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d4004f00 0x7f32d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f32f006cfd0 con 0x7f32d40043b0 2024-09-12T02:59:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32f006d2b0 con 0x7f32d4004f00 2024-09-12T02:59:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f32d400bf10 con 0x7f32d40039c0 2024-09-12T02:59:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b8b600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7b8406fef0 0x7f7b8414d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b8b600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7b840c8210 0x7f7b840c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b8b600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b840c6970 0x7f7b840c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b8b600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7b840c1d00 con 0x7f7b840c8210 2024-09-12T02:59:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b8b600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7b840c1fe0 con 0x7f7b8406fef0 2024-09-12T02:59:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b8b600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7b840c22c0 con 0x7f7b840c6970 2024-09-12T02:59:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b89600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b840c6970 0x7f7b840c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b88c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7b8406fef0 0x7f7b8414d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b89600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b840c6970 0x7f7b840c6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35412/0 (socket says 172.21.15.63:35412) 2024-09-12T02:59:21.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b89600640 1 -- 172.21.15.63:0/2267975158 learned_addr learned my addr 172.21.15.63:0/2267975158 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32eea00640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32d40039c0 0x7f32d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ee000640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32d40043b0 0x7f32d4004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ef400640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d4004f00 0x7f32d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32eea00640 1 -- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d4004f00 msgr2=0x7f32d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b83e00640 1 --2- 172.21.15.63:0/2267975158 >> v2:172.21.15.63:3300/0 conn(0x7f7b840c8210 0x7f7b840c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b89600640 1 -- 172.21.15.63:0/2267975158 >> v2:172.21.15.119:3300/0 conn(0x7f7b8406fef0 msgr2=0x7f7b8414d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b89600640 1 --2- 172.21.15.63:0/2267975158 >> v2:172.21.15.119:3300/0 conn(0x7f7b8406fef0 0x7f7b8414d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32eea00640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d4004f00 0x7f32d400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32eea00640 1 -- 172.21.15.63:0/2488553890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32d40043b0 msgr2=0x7f32d4004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32eea00640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32d40043b0 0x7f32d4004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32eea00640 1 -- 172.21.15.63:0/2488553890 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f006d590 con 0x7f32d40039c0 2024-09-12T02:59:21.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ef400640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d4004f00 0x7f32d400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:21.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b89600640 1 -- 172.21.15.63:0/2267975158 >> v2:172.21.15.63:3300/0 conn(0x7f7b840c8210 msgr2=0x7f7b840c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b89600640 1 --2- 172.21.15.63:0/2267975158 >> v2:172.21.15.63:3300/0 conn(0x7f7b840c8210 0x7f7b840c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b89600640 1 -- 172.21.15.63:0/2267975158 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b840c25a0 con 0x7f7b840c6970 2024-09-12T02:59:21.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f7b83e00640 1 --2- 172.21.15.63:0/2267975158 >> v2:172.21.15.63:3300/0 conn(0x7f7b840c8210 0x7f7b840c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:21.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.196+0000 7f32ee000640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32d40043b0 0x7f32d4004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:21.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.200+0000 7f98d1400640 1 --2- 172.21.15.63:0/3118276390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98cc0c0f90 0x7f98cc0c1910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f98cc071500 tx=0x7f98c401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c73137e1c43e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.200+0000 7f98cb400640 1 -- 172.21.15.63:0/3118276390 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c40a5870 con 0x7f98cc0c0f90 2024-09-12T02:59:21.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.200+0000 7f98cb400640 1 -- 172.21.15.63:0/3118276390 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c40a5a10 con 0x7f98cc0c0f90 2024-09-12T02:59:21.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.200+0000 7f98cb400640 1 -- 172.21.15.63:0/3118276390 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c40a5de0 con 0x7f98cc0c0f90 2024-09-12T02:59:21.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.200+0000 7f32eea00640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32d40039c0 0x7f32d4003de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32f00699b0 tx=0x7f32e801cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5320aa41bec5a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.200+0000 7f7b89600640 1 --2- 172.21.15.63:0/2267975158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b840c6970 0x7f7b840c6e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b840714a0 tx=0x7f7b7c01f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ec458cd5e70c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f98d3400640 1 -- 172.21.15.63:0/3118276390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98cc0c0f90 msgr2=0x7f98cc0c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8009c90 con 0x7f32d40039c0 2024-09-12T02:59:21.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f7b83400640 1 -- 172.21.15.63:0/2267975158 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c0b4070 con 0x7f7b840c6970 2024-09-12T02:59:21.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f7b83400640 1 -- 172.21.15.63:0/2267975158 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c0af400 con 0x7f7b840c6970 2024-09-12T02:59:21.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f98d3400640 1 --2- 172.21.15.63:0/3118276390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98cc0c0f90 0x7f98cc0c1910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f98cc071500 tx=0x7f98c401c9f0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f7b83400640 1 -- 172.21.15.63:0/2267975158 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c0af7d0 con 0x7f7b840c6970 2024-09-12T02:59:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f98d3400640 1 -- 172.21.15.63:0/3118276390 shutdown_connections 2024-09-12T02:59:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f98d3400640 1 --2- 172.21.15.63:0/3118276390 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98cc0c0f90 0x7f98cc0c1910 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f98d3400640 1 --2- 172.21.15.63:0/3118276390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c9690 0x7f98cc06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f98d3400640 1 --2- 172.21.15.63:0/3118276390 >> v2:172.21.15.119:3300/0 conn(0x7f98cc157fc0 0x7f98cc06d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f98d3400640 1 -- 172.21.15.63:0/3118276390 >> 172.21.15.63:0/3118276390 conn(0x7f98cc06f3d0 msgr2=0x7f98cc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e80a5a10 con 0x7f32d40039c0 2024-09-12T02:59:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32ed600640 1 -- 172.21.15.63:0/2488553890 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e80a5dc0 con 0x7f32d40039c0 2024-09-12T02:59:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32f5600640 1 -- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32d40039c0 msgr2=0x7f32d4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32f5600640 1 --2- 172.21.15.63:0/2488553890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32d40039c0 0x7f32d4003de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f32f00699b0 tx=0x7f32e801cc80 comp rx=0 tx=0).stop 2024-09-12T02:59:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32ef400640 1 -- 172.21.15.63:0/2488553890 reap_dead start 2024-09-12T02:59:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32f5600640 1 -- 172.21.15.63:0/2488553890 shutdown_connections 2024-09-12T02:59:21.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32f5600640 1 -- 172.21.15.63:0/2488553890 >> 172.21.15.63:0/2488553890 conn(0x7f32f006f3d0 msgr2=0x7f32f006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32f5600640 1 -- 172.21.15.63:0/2488553890 shutdown_connections 2024-09-12T02:59:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f32f5600640 1 -- 172.21.15.63:0/2488553890 wait complete. 2024-09-12T02:59:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f98d3400640 1 -- 172.21.15.63:0/3118276390 shutdown_connections 2024-09-12T02:59:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f98d3400640 1 -- 172.21.15.63:0/3118276390 wait complete. 2024-09-12T02:59:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f7b8b600640 1 -- 172.21.15.63:0/2267975158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b840c6970 msgr2=0x7f7b840c6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.204+0000 7f7b8b600640 1 --2- 172.21.15.63:0/2267975158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b840c6970 0x7f7b840c6e00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b840714a0 tx=0x7f7b7c01f1e0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32f5600640 1 Processor -- start 2024-09-12T02:59:21.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32f5600640 1 -- start start 2024-09-12T02:59:21.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7fcadfc00640 1 Processor -- start 2024-09-12T02:59:21.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7fcadfc00640 1 -- start start 2024-09-12T02:59:21.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c9bc00640 1 Processor -- start 2024-09-12T02:59:21.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f98d3400640 1 Processor -- start 2024-09-12T02:59:21.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c9bc00640 1 -- start start 2024-09-12T02:59:21.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f841e600640 1 Processor -- start 2024-09-12T02:59:21.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7b8b600640 1 -- 172.21.15.63:0/2267975158 shutdown_connections 2024-09-12T02:59:21.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f841e600640 1 -- start start 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7b8b600640 1 --2- 172.21.15.63:0/2267975158 >> v2:172.21.15.63:3300/0 conn(0x7f7b840c8210 0x7f7b840c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7b8b600640 1 --2- 172.21.15.63:0/2267975158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b840c6970 0x7f7b840c6e00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7b8b600640 1 --2- 172.21.15.63:0/2267975158 >> v2:172.21.15.119:3300/0 conn(0x7f7b8406fef0 0x7f7b8414d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7b8b600640 1 -- 172.21.15.63:0/2267975158 >> 172.21.15.63:0/2267975158 conn(0x7f7b8406f3d0 msgr2=0x7f7b8406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7b8b600640 1 -- 172.21.15.63:0/2267975158 shutdown_connections 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32f5600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d40039c0 0x7f32f01f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32f5600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f00cc5c0 0x7f32f01f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32f5600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32f0158060 0x7f32f01f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32f5600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00c0f90 con 0x7f32f00cc5c0 2024-09-12T02:59:21.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32f5600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32f006db50 con 0x7f32d40039c0 2024-09-12T02:59:21.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32f5600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f32f01592d0 con 0x7f32f0158060 2024-09-12T02:59:21.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7fcadfc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcad80c9e10 0x7fcad80cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7fcadfc00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad80cc020 con 0x7fcad806d420 2024-09-12T02:59:21.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7fcadfc00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad80cc620 con 0x7fcad80ca1f0 2024-09-12T02:59:21.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7fcadfc00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fcad80cc8e0 con 0x7fcad80c9e10 2024-09-12T02:59:21.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32eea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d40039c0 0x7f32f01f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32eea00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d40039c0 0x7f32f01f8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38020/0 (socket says 172.21.15.63:38020) 2024-09-12T02:59:21.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32eea00640 1 -- 172.21.15.63:0/1259149795 learned_addr learned my addr 172.21.15.63:0/1259149795 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32ef400640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32f0158060 0x7f32f01f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f98d3400640 1 -- start start 2024-09-12T02:59:21.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c9bc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c940cb330 0x7f7c940b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c9bc00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c940cb710 0x7f7c940c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c9bc00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c940c76e0 0x7f7c940c6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c9bc00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7c940c7c20 con 0x7f7c940cb710 2024-09-12T02:59:21.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c9bc00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7c9415a960 con 0x7f7c940c76e0 2024-09-12T02:59:21.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c9bc00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9415aba0 con 0x7f7c940cb330 2024-09-12T02:59:21.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f98d3400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c0f90 0x7f98cc156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f98d3400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98cc0c9690 0x7f98cc1f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f98d3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98cc157fc0 0x7f98cc1f8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f98d3400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc15e830 con 0x7f98cc157fc0 2024-09-12T02:59:21.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f98d3400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f98cc15e6b0 con 0x7f98cc0c9690 2024-09-12T02:59:21.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f98d3400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f98cc15e9b0 con 0x7f98cc0c0f90 2024-09-12T02:59:21.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7fcadd200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcad80c9e10 0x7fcad80cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f841e600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84180c9e10 0x7f84180cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f841e600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84180cc020 con 0x7f841806d420 2024-09-12T02:59:21.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f841e600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84180cc620 con 0x7f84180ca1f0 2024-09-12T02:59:21.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7fcad7e00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fcad80ca1f0 0x7fcad806cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:51838/0 (socket says 172.21.15.63:51838) 2024-09-12T02:59:21.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7fcad7e00640 1 -- 172.21.15.63:0/415257315 learned_addr learned my addr 172.21.15.63:0/415257315 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:21.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f841e600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f84180cc8e0 con 0x7f84180c9e10 2024-09-12T02:59:21.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f8417e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f841806d420 0x7f84181622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37552/0 (socket says 172.21.15.63:37552) 2024-09-12T02:59:21.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f8417e00640 1 -- 172.21.15.63:0/3164399753 learned_addr learned my addr 172.21.15.63:0/3164399753 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:21.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c99c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c940c76e0 0x7f7c940c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7c99200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c940cb330 0x7f7c940b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7c99c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c940c76e0 0x7f7c940c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38034/0 (socket says 172.21.15.63:38034) 2024-09-12T02:59:21.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7c99c00640 1 -- 172.21.15.63:0/3636126554 learned_addr learned my addr 172.21.15.63:0/3636126554 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7c93e00640 1 --2- 172.21.15.63:0/3636126554 >> v2:172.21.15.63:3300/0 conn(0x7f7c940cb710 0x7f7c940c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d0a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c0f90 0x7f98cc156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f7b8b600640 1 -- 172.21.15.63:0/2267975158 wait complete. 2024-09-12T02:59:21.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f8417400640 1 --2- 172.21.15.63:0/3164399753 >> v2:172.21.15.119:3300/0 conn(0x7f84180c9e10 0x7f84180cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.208+0000 7f32ee000640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f00cc5c0 0x7f32f01f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7b8b600640 1 Processor -- start 2024-09-12T02:59:21.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d0a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c0f90 0x7f98cc156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35434/0 (socket says 172.21.15.63:35434) 2024-09-12T02:59:21.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d0a00640 1 -- 172.21.15.63:0/723044432 learned_addr learned my addr 172.21.15.63:0/723044432 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7fcad7400640 1 -- 172.21.15.63:0/415257315 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2667968661 0 0) 0x7fcad80cc620 con 0x7fcad80ca1f0 2024-09-12T02:59:21.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32eea00640 1 -- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32f0158060 msgr2=0x7f32f01f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32eea00640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32f0158060 0x7f32f01f65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32eea00640 1 -- 172.21.15.63:0/1259149795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f00cc5c0 msgr2=0x7f32f01f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32eea00640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f00cc5c0 0x7f32f01f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7fcad7400640 1 -- 172.21.15.63:0/415257315 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcabc003530 con 0x7fcad80ca1f0 2024-09-12T02:59:21.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7fcadd200640 1 -- 172.21.15.63:0/415257315 >> v1:172.21.15.119:6789/0 conn(0x7fcad80ca1f0 legacy=0x7fcad806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7fcadd200640 1 -- 172.21.15.63:0/415257315 >> v1:172.21.15.63:6789/0 conn(0x7fcad806d420 legacy=0x7fcad81622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32eea00640 1 -- 172.21.15.63:0/1259149795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f01f8ee0 con 0x7f32d40039c0 2024-09-12T02:59:21.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d1400640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98cc157fc0 0x7f98cc1f8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98cbe00640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98cc0c9690 0x7f98cc1f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7b8b600640 1 -- start start 2024-09-12T02:59:21.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7c99c00640 1 -- 172.21.15.63:0/3636126554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c940cb330 msgr2=0x7f7c940b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7c99c00640 1 --2- 172.21.15.63:0/3636126554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c940cb330 0x7f7c940b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f8416000640 1 -- 172.21.15.63:0/3164399753 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162326725 0 0) 0x7f84180cc020 con 0x7f841806d420 2024-09-12T02:59:21.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f8416000640 1 -- 172.21.15.63:0/3164399753 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83fc003530 con 0x7f841806d420 2024-09-12T02:59:21.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d0a00640 1 -- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98cc0c9690 msgr2=0x7f98cc1f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d0a00640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98cc0c9690 0x7f98cc1f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d0a00640 1 -- 172.21.15.63:0/723044432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98cc157fc0 msgr2=0x7f98cc1f8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d0a00640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f98cc157fc0 0x7f98cc1f8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d0a00640 1 -- 172.21.15.63:0/723044432 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98cc1fc410 con 0x7f98cc0c0f90 2024-09-12T02:59:21.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f8417400640 1 -- 172.21.15.63:0/3164399753 >> v1:172.21.15.119:6789/0 conn(0x7f84180ca1f0 legacy=0x7f841806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f8417400640 1 -- 172.21.15.63:0/3164399753 >> v1:172.21.15.63:6789/0 conn(0x7f841806d420 legacy=0x7f84181622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7fcadd200640 1 -- 172.21.15.63:0/415257315 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad806bf50 con 0x7fcad80c9e10 2024-09-12T02:59:21.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f8417400640 1 -- 172.21.15.63:0/3164399753 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841806bf50 con 0x7f84180c9e10 2024-09-12T02:59:21.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32eea00640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d40039c0 0x7f32f01f8410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009040 tx=0x7f32e8009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7c99c00640 1 -- 172.21.15.63:0/3636126554 >> v2:172.21.15.63:3300/0 conn(0x7f7c940cb710 msgr2=0x7f7c940c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7c99c00640 1 --2- 172.21.15.63:0/3636126554 >> v2:172.21.15.63:3300/0 conn(0x7f7c940cb710 0x7f7c940c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7c99c00640 1 -- 172.21.15.63:0/3636126554 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9415ae40 con 0x7f7c940c76e0 2024-09-12T02:59:21.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d0a00640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c0f90 0x7f98cc156ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98c000d830 tx=0x7f98c000dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32e6a00640 1 -- 172.21.15.63:0/1259149795 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e80bd070 con 0x7f32d40039c0 2024-09-12T02:59:21.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32e6a00640 1 -- 172.21.15.63:0/1259149795 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e8003ba0 con 0x7f32d40039c0 2024-09-12T02:59:21.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7fd10c000640 1 Processor -- start 2024-09-12T02:59:21.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32e6a00640 1 -- 172.21.15.63:0/1259149795 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e80ad740 con 0x7f32d40039c0 2024-09-12T02:59:21.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f00ca900 con 0x7f32d40039c0 2024-09-12T02:59:21.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f997b200640 1 Processor -- start 2024-09-12T02:59:21.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98c8c00640 1 -- 172.21.15.63:0/723044432 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c000b6c0 con 0x7f98cc0c0f90 2024-09-12T02:59:21.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7b8b600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b8406fef0 0x7f7b8414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7b8b600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b840c6970 0x7f7b840c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7b8b600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b840c8210 0x7f7b840c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7b8b600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7b840c7d90 con 0x7f7b840c8210 2024-09-12T02:59:21.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7b8b600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7b840c7c10 con 0x7f7b840c6970 2024-09-12T02:59:21.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7b8b600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7b84156d10 con 0x7f7b8406fef0 2024-09-12T02:59:21.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98c8c00640 1 -- 172.21.15.63:0/723044432 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98c0019070 con 0x7f98cc0c0f90 2024-09-12T02:59:21.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98c8c00640 1 -- 172.21.15.63:0/723044432 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c000b6c0 con 0x7f98cc0c0f90 2024-09-12T02:59:21.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f00caec0 con 0x7f32d40039c0 2024-09-12T02:59:21.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f7b88c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b8406fef0 0x7f7b8414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b83e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b840c6970 0x7f7b840c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b89600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b840c8210 0x7f7b840c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b83e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b840c6970 0x7f7b840c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38060/0 (socket says 172.21.15.63:38060) 2024-09-12T02:59:21.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b83e00640 1 -- 172.21.15.63:0/3654338867 learned_addr learned my addr 172.21.15.63:0/3654338867 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd10c000640 1 -- start start 2024-09-12T02:59:21.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.212+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98cc158ac0 con 0x7f98cc0c0f90 2024-09-12T02:59:21.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f98cc159080 con 0x7f98cc0c0f90 2024-09-12T02:59:21.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b83e00640 1 -- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b8406fef0 msgr2=0x7f7b8414e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b83e00640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b8406fef0 0x7f7b8414e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b83e00640 1 -- 172.21.15.63:0/3654338867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b840c8210 msgr2=0x7f7b840c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b83e00640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7b840c8210 0x7f7b840c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b83e00640 1 -- 172.21.15.63:0/3654338867 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8413bf30 con 0x7f7b840c6970 2024-09-12T02:59:21.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f997b200640 1 -- start start 2024-09-12T02:59:21.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32f0153360 con 0x7f32d40039c0 2024-09-12T02:59:21.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b83e00640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b840c6970 0x7f7b840c43c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c7f0 tx=0x7f7b7000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98cc0c1910 con 0x7f98cc0c0f90 2024-09-12T02:59:21.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fcadd200640 1 --2- 172.21.15.63:0/415257315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcad80c9e10 0x7fcad80cbae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097c0 tx=0x7fcac401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68cf903c02d01919 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b80c00640 1 -- 172.21.15.63:0/3654338867 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70007a30 con 0x7f7b840c6970 2024-09-12T02:59:21.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b80c00640 1 -- 172.21.15.63:0/3654338867 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b70007bd0 con 0x7f7b840c6970 2024-09-12T02:59:21.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b80c00640 1 -- 172.21.15.63:0/3654338867 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b700113f0 con 0x7f7b840c6970 2024-09-12T02:59:21.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b840cb020 con 0x7f7b840c6970 2024-09-12T02:59:21.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fcad7400640 1 -- 172.21.15.63:0/415257315 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40b0070 con 0x7fcad80c9e10 2024-09-12T02:59:21.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fcad7400640 1 -- 172.21.15.63:0/415257315 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac4004230 con 0x7fcad80c9e10 2024-09-12T02:59:21.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fcad7400640 1 -- 172.21.15.63:0/415257315 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40b0070 con 0x7fcad80c9e10 2024-09-12T02:59:21.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f8417400640 1 --2- 172.21.15.63:0/3164399753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84180c9e10 0x7f84180cbae0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8410009d90 tx=0x7f841001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef031b82adfd8286 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd10c000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd1041548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd10c000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd104154df0 0x7fd10415add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd10c000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd10415e090 con 0x7fd10406edf0 2024-09-12T02:59:21.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd10c000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd10415ef40 con 0x7fd104154df0 2024-09-12T02:59:21.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd10c000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fd10415e330 con 0x7fd10406f1d0 2024-09-12T02:59:21.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b8413b000 con 0x7f7b840c6970 2024-09-12T02:59:21.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd108c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd1041548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f7c99c00640 1 --2- 172.21.15.63:0/3636126554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c940c76e0 0x7f7c940c6860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c940cbb10 tx=0x7f7c8001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=829a9472daa8d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f32e6a00640 1 -- 172.21.15.63:0/1259149795 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32e80c0070 con 0x7f32d40039c0 2024-09-12T02:59:21.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fcadfc00640 1 -- 172.21.15.63:0/415257315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcad80c9e10 msgr2=0x7fcad80cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fcadfc00640 1 --2- 172.21.15.63:0/415257315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcad80c9e10 0x7fcad80cbae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097c0 tx=0x7fcac401c460 comp rx=0 tx=0).stop 2024-09-12T02:59:21.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd10a000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd104154df0 0x7fd10415add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd108c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd1041548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35454/0 (socket says 172.21.15.63:35454) 2024-09-12T02:59:21.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7fd108c00640 1 -- 172.21.15.63:0/900770209 learned_addr learned my addr 172.21.15.63:0/900770209 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f997b200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f997c0c7610 0x7f997c156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9979e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f997c1509c0 0x7f997c0c8a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37564/0 (socket says 172.21.15.63:37564) 2024-09-12T02:59:21.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9979e00640 1 -- 172.21.15.63:0/1153999143 learned_addr learned my addr 172.21.15.63:0/1153999143 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:21.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f8416000640 1 -- 172.21.15.63:0/3164399753 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100b2070 con 0x7f84180c9e10 2024-09-12T02:59:21.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f8416000640 1 -- 172.21.15.63:0/3164399753 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84100a5920 con 0x7f84180c9e10 2024-09-12T02:59:21.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.216+0000 7f8416000640 1 -- 172.21.15.63:0/3164399753 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100a5cf0 con 0x7f84180c9e10 2024-09-12T02:59:21.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b8413c1d0 con 0x7f7b840c6970 2024-09-12T02:59:21.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f997b200640 1 -- 172.21.15.63:0/1153999143 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997c15a9f0 con 0x7f997c1509c0 2024-09-12T02:59:21.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fd108c00640 1 -- 172.21.15.63:0/900770209 >> v2:172.21.15.63:3300/0 conn(0x7fd104154df0 msgr2=0x7fd10415add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f997b200640 1 -- 172.21.15.63:0/1153999143 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997c15acd0 con 0x7f997c156f90 2024-09-12T02:59:21.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f997b200640 1 -- 172.21.15.63:0/1153999143 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f997c0c8690 con 0x7f997c0c7610 2024-09-12T02:59:21.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9979400640 1 --2- 172.21.15.63:0/1153999143 >> v2:172.21.15.63:3300/0 conn(0x7f997c0c7610 0x7f997c156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fcadfc00640 1 -- 172.21.15.63:0/415257315 shutdown_connections 2024-09-12T02:59:21.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fcadfc00640 1 --2- 172.21.15.63:0/415257315 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcad80c9e10 0x7fcad80cbae0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fcadfc00640 1 -- 172.21.15.63:0/415257315 >> 172.21.15.63:0/415257315 conn(0x7fcad80d02e0 msgr2=0x7fcad80d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fd108c00640 1 --2- 172.21.15.63:0/900770209 >> v2:172.21.15.63:3300/0 conn(0x7fd104154df0 0x7fd10415add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fd108c00640 1 -- 172.21.15.63:0/900770209 >> v1:172.21.15.63:6789/0 conn(0x7fd10406edf0 legacy=0x7fd1040cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fcadfc00640 1 -- 172.21.15.63:0/415257315 shutdown_connections 2024-09-12T02:59:21.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fd108c00640 1 -- 172.21.15.63:0/900770209 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10415e610 con 0x7fd10406f1d0 2024-09-12T02:59:21.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f98c8c00640 1 -- 172.21.15.63:0/723044432 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f98c000ba70 con 0x7f98cc0c0f90 2024-09-12T02:59:21.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f7c93400640 1 -- 172.21.15.63:0/3636126554 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c800b5070 con 0x7f7c940c76e0 2024-09-12T02:59:21.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f841e600640 1 -- 172.21.15.63:0/3164399753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84180c9e10 msgr2=0x7f84180cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f841e600640 1 --2- 172.21.15.63:0/3164399753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84180c9e10 0x7f84180cbae0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8410009d90 tx=0x7f841001c970 comp rx=0 tx=0).stop 2024-09-12T02:59:21.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f32e6a00640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32d00679c0 0x7f32d0069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f32e6a00640 1 -- 172.21.15.63:0/1259149795 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f32e8120b20 con 0x7f32d40039c0 2024-09-12T02:59:21.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f32e6a00640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f32d00713e0 0x7f32d0073880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f32e6a00640 1 -- 172.21.15.63:0/1259149795 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32e80a7ea0 con 0x7f32d00713e0 2024-09-12T02:59:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f32e6a00640 1 -- 172.21.15.63:0/1259149795 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f32e8120f10 con 0x7f32d40039c0 2024-09-12T02:59:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f7c93400640 1 -- 172.21.15.63:0/3636126554 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c800a89d0 con 0x7f7c940c76e0 2024-09-12T02:59:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f7c93400640 1 -- 172.21.15.63:0/3636126554 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c800a8da0 con 0x7f7c940c76e0 2024-09-12T02:59:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338581172 0 0) 0x7f997c15a9f0 con 0x7f997c1509c0 2024-09-12T02:59:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9960003530 con 0x7f997c1509c0 2024-09-12T02:59:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812125479 0 0) 0x7f997c15acd0 con 0x7f997c156f90 2024-09-12T02:59:21.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f997c15a9f0 con 0x7f997c156f90 2024-09-12T02:59:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f98c8c00640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f98ac067af0 0x7f98ac069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f98c8c00640 1 -- 172.21.15.63:0/723044432 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f98c0086270 con 0x7f98cc0c0f90 2024-09-12T02:59:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f98c8c00640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f98ac071400 0x7f98ac0738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f98c8c00640 1 -- 172.21.15.63:0/723044432 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98c001ee50 con 0x7f98ac071400 2024-09-12T02:59:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f98c8c00640 1 -- 172.21.15.63:0/723044432 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f98c008d050 con 0x7f98cc0c0f90 2024-09-12T02:59:21.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1904870651 0 0) 0x7f9960003530 con 0x7f997c1509c0 2024-09-12T02:59:21.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 >> v2:172.21.15.63:3300/0 conn(0x7f997c0c7610 msgr2=0x7f997c156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 --2- 172.21.15.63:0/1153999143 >> v2:172.21.15.63:3300/0 conn(0x7f997c0c7610 0x7f997c156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f32ee000640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32d00679c0 0x7f32d0069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f98cbe00640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f98ac067af0 0x7f98ac069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f7c9bc00640 1 -- 172.21.15.63:0/3636126554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c940c76e0 msgr2=0x7f7c940c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f7c9bc00640 1 --2- 172.21.15.63:0/3636126554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c940c76e0 0x7f7c940c6860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c940cbb10 tx=0x7f7c8001ed10 comp rx=0 tx=0).stop 2024-09-12T02:59:21.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 >> v1:172.21.15.119:6789/0 conn(0x7f997c156f90 legacy=0x7f997c1611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997c0c8040 con 0x7f997c1509c0 2024-09-12T02:59:21.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f996c001680 con 0x7f997c1509c0 2024-09-12T02:59:21.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 >> v1:172.21.15.63:6789/0 conn(0x7f997c1509c0 legacy=0x7f997c0c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9960004bb0 0x7f9960004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99600037b0 0x7f9960003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99600041e0 0x7f99600079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f997c0c8690 con 0x7f99600041e0 2024-09-12T02:59:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9960008100 con 0x7f99600037b0 2024-09-12T02:59:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9960008300 con 0x7f9960004bb0 2024-09-12T02:59:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f9979400640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99600037b0 0x7f9960003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7fcadfc00640 1 -- 172.21.15.63:0/415257315 wait complete. 2024-09-12T02:59:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7fcadfc00640 1 Processor -- start 2024-09-12T02:59:21.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7c9bc00640 1 -- 172.21.15.63:0/3636126554 shutdown_connections 2024-09-12T02:59:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7c9bc00640 1 --2- 172.21.15.63:0/3636126554 >> v2:172.21.15.63:3300/0 conn(0x7f7c940cb710 0x7f7c940c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7c9bc00640 1 --2- 172.21.15.63:0/3636126554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c940c76e0 0x7f7c940c6860 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7c9bc00640 1 --2- 172.21.15.63:0/3636126554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c940cb330 0x7f7c940b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7c9bc00640 1 -- 172.21.15.63:0/3636126554 >> 172.21.15.63:0/3636126554 conn(0x7f7c940d02e0 msgr2=0x7f7c940d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f9979e00640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9960004bb0 0x7f9960004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f841e600640 1 -- 172.21.15.63:0/3164399753 shutdown_connections 2024-09-12T02:59:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f841e600640 1 --2- 172.21.15.63:0/3164399753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84180c9e10 0x7f84180cbae0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f841e600640 1 -- 172.21.15.63:0/3164399753 >> 172.21.15.63:0/3164399753 conn(0x7f84180d02e0 msgr2=0x7f84180d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.220+0000 7f98d1400640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f98ac071400 0x7f98ac0738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f98cbe00640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f98ac067af0 0x7f98ac069fb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0b0a30 tx=0x7f98b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f9979400640 1 -- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9960004bb0 msgr2=0x7f9960004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f9979400640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9960004bb0 0x7f9960004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f9979400640 1 -- 172.21.15.63:0/1153999143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99600041e0 msgr2=0x7f99600079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f9979400640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99600041e0 0x7f99600079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f9979400640 1 -- 172.21.15.63:0/1153999143 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997c0c8040 con 0x7f99600037b0 2024-09-12T02:59:21.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f841e600640 1 -- 172.21.15.63:0/3164399753 shutdown_connections 2024-09-12T02:59:21.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f98d1400640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f98ac071400 0x7f98ac0738a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f841e600640 1 -- 172.21.15.63:0/3164399753 wait complete. 2024-09-12T02:59:21.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7b80c00640 1 -- 172.21.15.63:0/3654338867 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b70011590 con 0x7f7b840c6970 2024-09-12T02:59:21.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7fcadfc00640 1 -- start start 2024-09-12T02:59:21.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f997a800640 1 -- 172.21.15.63:0/1153999143 reap_dead start 2024-09-12T02:59:21.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7c9bc00640 1 -- 172.21.15.63:0/3636126554 shutdown_connections 2024-09-12T02:59:21.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f32ee000640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32d00679c0 0x7f32d0069e80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f32f00c92e0 tx=0x7f32e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f32ef400640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f32d00713e0 0x7f32d0073880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7b80c00640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b64067910 0x7f7b64069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7b80c00640 1 -- 172.21.15.63:0/3654338867 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f7b700866a0 con 0x7f7b840c6970 2024-09-12T02:59:21.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7c9bc00640 1 -- 172.21.15.63:0/3636126554 wait complete. 2024-09-12T02:59:21.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7fd108c00640 1 --2- 172.21.15.63:0/900770209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd1041548b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009870 tx=0x7fd0f001c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79826a90dc3f14b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7b80c00640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f7b64071320 0x7f7b640737c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7b88c00640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b64067910 0x7f7b64069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7b80c00640 1 -- 172.21.15.63:0/3654338867 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b70018ec0 con 0x7f7b64071320 2024-09-12T02:59:21.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7b80c00640 1 -- 172.21.15.63:0/3654338867 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f7b70086b80 con 0x7f7b840c6970 2024-09-12T02:59:21.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7fcadfc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcad806d420 0x7fcad8153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f841e600640 1 Processor -- start 2024-09-12T02:59:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f32ef400640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f32d00713e0 0x7f32d0073880 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7fcadfc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcad80c9e10 0x7fcad80c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f7b89600640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f7b64071320 0x7f7b640737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7fcadfc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcad80ca1f0 0x7fcad8203a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7f841e600640 1 -- start start 2024-09-12T02:59:21.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7fcadd200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcad806d420 0x7fcad8153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7b88c00640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b64067910 0x7f7b64069dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7b740099d0 tx=0x7f7b74008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.224+0000 7fcadd200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcad806d420 0x7fcad8153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38084/0 (socket says 172.21.15.63:38084) 2024-09-12T02:59:21.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7b89600640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f7b64071320 0x7f7b640737c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c9bc00640 1 Processor -- start 2024-09-12T02:59:21.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcaddc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcad80ca1f0 0x7fcad8203a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcad7e00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcad80c9e10 0x7fcad80c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcadd200640 1 -- 172.21.15.63:0/3829411667 learned_addr learned my addr 172.21.15.63:0/3829411667 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f98c8c00640 1 -- 172.21.15.63:0/723044432 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f98c001ee50 con 0x7f98ac071400 2024-09-12T02:59:21.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcad816c770 con 0x7fcad80ca1f0 2024-09-12T02:59:21.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcad816c5f0 con 0x7fcad806d420 2024-09-12T02:59:21.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fcad816c8f0 con 0x7fcad80c9e10 2024-09-12T02:59:21.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c9bc00640 1 -- start start 2024-09-12T02:59:21.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f841e600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841806d420 0x7f84181fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f841e600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84180c9e10 0x7f8418153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f841e600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84180ca1f0 0x7f8418153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f841e600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f841816c770 con 0x7f84180ca1f0 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f841e600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f841816c5f0 con 0x7f84180c9e10 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f841e600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f841816c8f0 con 0x7f841806d420 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841806d420 0x7f84181fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841806d420 0x7f84181fafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35482/0 (socket says 172.21.15.63:35482) 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417400640 1 -- 172.21.15.63:0/1187006053 learned_addr learned my addr 172.21.15.63:0/1187006053 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8416a00640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84180c9e10 0x7f8418153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f32e6a00640 1 -- 172.21.15.63:0/1259149795 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32e80a7ea0 con 0x7f32d00713e0 2024-09-12T02:59:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f9979400640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99600037b0 0x7f9960003c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f996800a970 tx=0x7f996801c570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7de219a316a3de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417e00640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84180ca1f0 0x7f8418153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7b80c00640 1 -- 172.21.15.63:0/3654338867 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b70018ec0 con 0x7f7b64071320 2024-09-12T02:59:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcaddc00640 1 -- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcad80c9e10 msgr2=0x7fcad80c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcaddc00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcad80c9e10 0x7fcad80c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcaddc00640 1 -- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcad806d420 msgr2=0x7fcad8153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcaddc00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcad806d420 0x7fcad8153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcaddc00640 1 -- 172.21.15.63:0/3829411667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad80cfdd0 con 0x7fcad80ca1f0 2024-09-12T02:59:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c9bc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c940c76e0 0x7f7c94155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417400640 1 -- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84180c9e10 msgr2=0x7f8418153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417400640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84180c9e10 0x7f8418153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417400640 1 -- 172.21.15.63:0/1187006053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84180ca1f0 msgr2=0x7f8418153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417400640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84180ca1f0 0x7f8418153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417400640 1 -- 172.21.15.63:0/1187006053 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84180c9100 con 0x7f841806d420 2024-09-12T02:59:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c9bc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c940cb330 0x7f7c941f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417e00640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84180ca1f0 0x7f8418153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c9bc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c940cb710 0x7f7c9415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c9bc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9415b6e0 con 0x7f7c940c76e0 2024-09-12T02:59:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c9bc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9415b400 con 0x7f7c940cb710 2024-09-12T02:59:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c9bc00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7c940c7dc0 con 0x7f7c940cb330 2024-09-12T02:59:21.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f8417400640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841806d420 0x7f84181fafb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f841001a5a0 tx=0x7f8410019710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7fcaddc00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcad80ca1f0 0x7fcad8203a80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcad000be00 tx=0x7fcad000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c99200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c940c76e0 0x7f7c94155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c99200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c940c76e0 0x7f7c94155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36330/0 (socket says 172.21.15.63:36330) 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c99200640 1 -- 172.21.15.63:0/92354793 learned_addr learned my addr 172.21.15.63:0/92354793 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c93e00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c940cb330 0x7f7c941f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c99200640 1 -- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c940cb330 msgr2=0x7f7c941f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c99200640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c940cb330 0x7f7c941f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c99200640 1 -- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c940cb710 msgr2=0x7f7c9415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c99200640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c940cb710 0x7f7c9415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c99200640 1 -- 172.21.15.63:0/92354793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c941f8870 con 0x7f7c940c76e0 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.228+0000 7f7c99200640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c940c76e0 0x7f7c94155300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00efc0 tx=0x7f7c8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7fcad4c00640 1 -- 172.21.15.63:0/3829411667 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0003980 con 0x7fcad80ca1f0 2024-09-12T02:59:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7fcad4c00640 1 -- 172.21.15.63:0/3829411667 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad0003b20 con 0x7fcad80ca1f0 2024-09-12T02:59:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7fcad4c00640 1 -- 172.21.15.63:0/3829411667 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0004020 con 0x7fcad80ca1f0 2024-09-12T02:59:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad8159490 con 0x7fcad80ca1f0 2024-09-12T02:59:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f7c90c00640 1 -- 172.21.15.63:0/92354793 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c018020 con 0x7f7c940c76e0 2024-09-12T02:59:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f7c90c00640 1 -- 172.21.15.63:0/92354793 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8c014480 con 0x7f7c940c76e0 2024-09-12T02:59:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f7c90c00640 1 -- 172.21.15.63:0/92354793 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c014870 con 0x7f7c940c76e0 2024-09-12T02:59:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c940b5390 con 0x7f7c940c76e0 2024-09-12T02:59:21.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c941f5950 con 0x7f7c940c76e0 2024-09-12T02:59:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad8153480 con 0x7fcad80ca1f0 2024-09-12T02:59:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996800a570 con 0x7f99600037b0 2024-09-12T02:59:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9960008b10 con 0x7f99600037b0 2024-09-12T02:59:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f9978a00640 1 -- 172.21.15.63:0/1153999143 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99680a98b0 con 0x7f99600037b0 2024-09-12T02:59:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f997b200640 1 -- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99600037b0 msgr2=0x7f9960003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f997b200640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99600037b0 0x7f9960003c30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f996800a970 tx=0x7f996801c570 comp rx=0 tx=0).stop 2024-09-12T02:59:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f840f400640 1 -- 172.21.15.63:0/1187006053 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100b2040 con 0x7f841806d420 2024-09-12T02:59:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f840f400640 1 -- 172.21.15.63:0/1187006053 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84100bd070 con 0x7f841806d420 2024-09-12T02:59:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f840f400640 1 -- 172.21.15.63:0/1187006053 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84100ad880 con 0x7f841806d420 2024-09-12T02:59:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7fd103e00640 1 -- 172.21.15.63:0/900770209 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00b2070 con 0x7fd10406f1d0 2024-09-12T02:59:21.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8418162490 con 0x7f841806d420 2024-09-12T02:59:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8418153510 con 0x7f841806d420 2024-09-12T02:59:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7fd103e00640 1 -- 172.21.15.63:0/900770209 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f00a9070 con 0x7fd10406f1d0 2024-09-12T02:59:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84180cbae0 con 0x7f841806d420 2024-09-12T02:59:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f997b200640 1 -- 172.21.15.63:0/1153999143 shutdown_connections 2024-09-12T02:59:21.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f997b200640 1 --2- 172.21.15.63:0/1153999143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99600037b0 0x7f9960003c30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7f997b200640 1 -- 172.21.15.63:0/1153999143 >> 172.21.15.63:0/1153999143 conn(0x7f997c06d900 msgr2=0x7f997c06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcad4c00640 1 -- 172.21.15.63:0/3829411667 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcad0006d10 con 0x7fcad80ca1f0 2024-09-12T02:59:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcad8153230 con 0x7fcad80ca1f0 2024-09-12T02:59:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f997b200640 1 -- 172.21.15.63:0/1153999143 shutdown_connections 2024-09-12T02:59:21.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcad4c00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcab80678c0 0x7fcab8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcad4c00640 1 -- 172.21.15.63:0/3829411667 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fcad0085e40 con 0x7fcad80ca1f0 2024-09-12T02:59:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcad4c00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcab80711d0 0x7fcab8073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcadd200640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcab80678c0 0x7fcab8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcad4c00640 1 -- 172.21.15.63:0/3829411667 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcab8073d40 con 0x7fcab80711d0 2024-09-12T02:59:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcad4c00640 1 -- 172.21.15.63:0/3829411667 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fcad00521e0 con 0x7fcad80ca1f0 2024-09-12T02:59:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcad7e00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcab80711d0 0x7fcab8073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c940b5950 con 0x7f7c940c76e0 2024-09-12T02:59:21.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f997b200640 1 -- 172.21.15.63:0/1153999143 wait complete. 2024-09-12T02:59:21.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7fcad7e00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcab80711d0 0x7fcab8073670 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f840f400640 1 -- 172.21.15.63:0/1187006053 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f84100ada20 con 0x7f841806d420 2024-09-12T02:59:21.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f7c90c00640 1 -- 172.21.15.63:0/92354793 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c8c01b020 con 0x7f7c940c76e0 2024-09-12T02:59:21.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f7c90c00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7c740678c0 0x7f7c74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f7c90c00640 1 -- 172.21.15.63:0/92354793 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f7c8c086b30 con 0x7f7c940c76e0 2024-09-12T02:59:21.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f7c90c00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7c74071250 0x7f7c740736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f7c90c00640 1 -- 172.21.15.63:0/92354793 --> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c8c01bec0 con 0x7f7c74071250 2024-09-12T02:59:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f997b200640 1 Processor -- start 2024-09-12T02:59:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.236+0000 7f7c90c00640 1 -- 172.21.15.63:0/92354793 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f7c8c052d80 con 0x7f7c940c76e0 2024-09-12T02:59:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fcadd200640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcab80678c0 0x7fcab8069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcac401ab10 tx=0x7fcac40a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fcad4c00640 1 -- 172.21.15.63:0/3829411667 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcab8073d40 con 0x7fcab80711d0 2024-09-12T02:59:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.232+0000 7fd103e00640 1 -- 172.21.15.63:0/900770209 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00b2070 con 0x7fd10406f1d0 2024-09-12T02:59:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997b200640 1 -- start start 2024-09-12T02:59:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f840f400640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f8067990 0x7f83f8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f7c93e00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7c740678c0 0x7f7c74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f840f400640 1 -- 172.21.15.63:0/1187006053 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f8410002020 con 0x7f841806d420 2024-09-12T02:59:21.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f7c99c00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7c74071250 0x7f7c740736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f840f400640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f83f80713a0 0x7f83f8073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f840f400640 1 -- 172.21.15.63:0/1187006053 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84100091a0 con 0x7f83f80713a0 2024-09-12T02:59:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f840f400640 1 -- 172.21.15.63:0/1187006053 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f84101213e0 con 0x7f841806d420 2024-09-12T02:59:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f8416a00640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f8067990 0x7f83f8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 -- 172.21.15.63:0/900770209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 msgr2=0x7fd1041548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 --2- 172.21.15.63:0/900770209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd1041548b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009870 tx=0x7fd0f001c580 comp rx=0 tx=0).stop 2024-09-12T02:59:21.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f8417e00640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f83f80713a0 0x7f83f8073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 -- 172.21.15.63:0/900770209 shutdown_connections 2024-09-12T02:59:21.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 --2- 172.21.15.63:0/900770209 >> v2:172.21.15.63:3300/0 conn(0x7fd104154df0 0x7fd10415add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 --2- 172.21.15.63:0/900770209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd1041548b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 -- 172.21.15.63:0/900770209 >> 172.21.15.63:0/900770209 conn(0x7fd104072960 msgr2=0x7fd104072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f7c93e00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7c740678c0 0x7f7c74069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7c940c5b40 tx=0x7f7c84009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 -- 172.21.15.63:0/900770209 shutdown_connections 2024-09-12T02:59:21.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f8416a00640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f8067990 0x7f83f8069e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f84180c9320 tx=0x7f8408009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f8417e00640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f83f80713a0 0x7f83f8073840 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 -- 172.21.15.63:0/900770209 wait complete. 2024-09-12T02:59:21.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99600037b0 0x7f997c1efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 Processor -- start 2024-09-12T02:59:21.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997b200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1ed1e0 0x7f997c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997b200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f997c153860 0x7f997c153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f997c0c6f30 con 0x7f99600037b0 2024-09-12T02:59:21.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997b200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1573a0 con 0x7f997c1ed1e0 2024-09-12T02:59:21.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997b200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f997c150da0 con 0x7f997c153860 2024-09-12T02:59:21.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f9979e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99600037b0 0x7f997c1efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7fd10c000640 1 -- start start 2024-09-12T02:59:21.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997a800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f997c153860 0x7f997c153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f9979400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1ed1e0 0x7f997c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997a800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f997c153860 0x7f997c153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35502/0 (socket says 172.21.15.63:35502) 2024-09-12T02:59:21.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.240+0000 7f997a800640 1 -- 172.21.15.63:0/3181025893 learned_addr learned my addr 172.21.15.63:0/3181025893 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f840f400640 1 -- 172.21.15.63:0/1187006053 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f84100091a0 con 0x7f83f80713a0 2024-09-12T02:59:21.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f7c99c00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7c74071250 0x7f7c740736f0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd10c000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10406edf0 0x7fd104156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f997a800640 1 -- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1ed1e0 msgr2=0x7f997c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f997a800640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1ed1e0 0x7f997c0cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f997a800640 1 -- 172.21.15.63:0/3181025893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99600037b0 msgr2=0x7f997c1efe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f997a800640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f99600037b0 0x7f997c1efe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f997a800640 1 -- 172.21.15.63:0/3181025893 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997c14efd0 con 0x7f997c153860 2024-09-12T02:59:21.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd10c000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd104070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f9979400640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f997c1ed1e0 0x7f997c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:21.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd10c000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd104154df0 0x7fd1041faf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd10c000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040cdf00 con 0x7fd10406edf0 2024-09-12T02:59:21.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd10c000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040cdd80 con 0x7fd104154df0 2024-09-12T02:59:21.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd10c000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fd1040ccfd0 con 0x7fd10406f1d0 2024-09-12T02:59:21.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd108c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd104070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd108c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd104070570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35516/0 (socket says 172.21.15.63:35516) 2024-09-12T02:59:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd108c00640 1 -- 172.21.15.63:0/2863392352 learned_addr learned my addr 172.21.15.63:0/2863392352 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd109600640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10406edf0 0x7fd104156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd10a000640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd104154df0 0x7fd1041faf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f997a800640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f997c153860 0x7f997c153ce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f997c0b1ab0 tx=0x7f997400cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd108c00640 1 -- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd104154df0 msgr2=0x7fd1041faf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd108c00640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd104154df0 0x7fd1041faf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd108c00640 1 -- 172.21.15.63:0/2863392352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10406edf0 msgr2=0x7fd104156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd108c00640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd10406edf0 0x7fd104156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd108c00640 1 -- 172.21.15.63:0/2863392352 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd104156d40 con 0x7fd10406f1d0 2024-09-12T02:59:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f9972000640 1 -- 172.21.15.63:0/3181025893 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9974017070 con 0x7f997c153860 2024-09-12T02:59:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f9972000640 1 -- 172.21.15.63:0/3181025893 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9974005d50 con 0x7f997c153860 2024-09-12T02:59:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f9972000640 1 -- 172.21.15.63:0/3181025893 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997400a850 con 0x7f997c153860 2024-09-12T02:59:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f997b200640 1 -- 172.21.15.63:0/3181025893 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997c1ec8a0 con 0x7f997c153860 2024-09-12T02:59:21.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7f997b200640 1 -- 172.21.15.63:0/3181025893 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f997c1ef660 con 0x7f997c153860 2024-09-12T02:59:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd108c00640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd104070570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0f001ac30 tx=0x7fd0f0019320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd101600640 1 -- 172.21.15.63:0/2863392352 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00bb070 con 0x7fd10406f1d0 2024-09-12T02:59:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10415a350 con 0x7fd10406f1d0 2024-09-12T02:59:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd104157560 con 0x7fd10406f1d0 2024-09-12T02:59:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd101600640 1 -- 172.21.15.63:0/2863392352 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f00038a0 con 0x7fd10406f1d0 2024-09-12T02:59:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.244+0000 7fd101600640 1 -- 172.21.15.63:0/2863392352 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00b2040 con 0x7fd10406f1d0 2024-09-12T02:59:21.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.248+0000 7f7c90c00640 1 -- 172.21.15.63:0/92354793 <== osd.5 v2:172.21.15.119:6824/2412795190 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c8c01bec0 con 0x7f7c74071250 2024-09-12T02:59:21.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.248+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0e0001040 con 0x7fd10406f1d0 2024-09-12T02:59:21.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7fd101600640 1 -- 172.21.15.63:0/2863392352 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0f00be070 con 0x7fd10406f1d0 2024-09-12T02:59:21.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.248+0000 7f9972000640 1 -- 172.21.15.63:0/3181025893 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f997401a070 con 0x7f997c153860 2024-09-12T02:59:21.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7f997b200640 1 -- 172.21.15.63:0/3181025893 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f997c0c6970 con 0x7f997c153860 2024-09-12T02:59:21.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7f9972000640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f995c0679c0 0x7f995c069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7f9972000640 1 -- 172.21.15.63:0/3181025893 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f9974085400 con 0x7f997c153860 2024-09-12T02:59:21.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7fd101600640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e4067990 0x7fd0e4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7f9979e00640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f995c0679c0 0x7f995c069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7fd101600640 1 -- 172.21.15.63:0/2863392352 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fd0f011f300 con 0x7fd10406f1d0 2024-09-12T02:59:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7fd101600640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fd0e40713b0 0x7fd0e4073850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7fd101600640 1 -- 172.21.15.63:0/2863392352 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0e4073f20 con 0x7fd0e40713b0 2024-09-12T02:59:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7fd101600640 1 -- 172.21.15.63:0/2863392352 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fd0f011f6f0 con 0x7fd10406f1d0 2024-09-12T02:59:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7fd109600640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e4067990 0x7fd0e4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7f9972000640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f995c071350 0x7f995c0737f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7f9972000640 1 -- 172.21.15.63:0/3181025893 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f995c073ec0 con 0x7f995c071350 2024-09-12T02:59:21.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7f9972000640 1 -- 172.21.15.63:0/3181025893 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f997408c050 con 0x7f997c153860 2024-09-12T02:59:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7fd10a000640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fd0e40713b0 0x7fd0e4073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7f9979400640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f995c071350 0x7f995c0737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.252+0000 7f9979e00640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f995c0679c0 0x7f995c069e80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f996c001cc0 tx=0x7f996c000bd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.256+0000 7fd109600640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e4067990 0x7fd0e4069e50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8001810 tx=0x7fd0f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.256+0000 7fd10a000640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fd0e40713b0 0x7fd0e4073850 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.256+0000 7f9979400640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f995c071350 0x7f995c0737f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.256+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b8414d7c0 con 0x7f7b64071320 2024-09-12T02:59:21.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.256+0000 7f7b80c00640 1 -- 172.21.15.63:0/3654338867 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7b8414d7c0 con 0x7f7b64071320 2024-09-12T02:59:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.256+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32f00c7030 con 0x7f32d00713e0 2024-09-12T02:59:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f7b64071320 msgr2=0x7f7b640737c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7f7b64071320 0x7f7b640737c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f9972000640 1 -- 172.21.15.63:0/3181025893 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f995c073ec0 con 0x7f995c071350 2024-09-12T02:59:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f32e6a00640 1 -- 172.21.15.63:0/1259149795 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f32f00c7030 con 0x7f32d00713e0 2024-09-12T02:59:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b64067910 msgr2=0x7f7b64069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b64067910 0x7f7b64069dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7b740099d0 tx=0x7f7b74008040 comp rx=0 tx=0).stop 2024-09-12T02:59:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b840c6970 msgr2=0x7f7b840c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 --2- 172.21.15.63:0/3654338867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b840c6970 0x7f7b840c43c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c7f0 tx=0x7f7b7000ccb0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b89600640 1 -- 172.21.15.63:0/3654338867 reap_dead start 2024-09-12T02:59:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 shutdown_connections 2024-09-12T02:59:21.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 >> 172.21.15.63:0/3654338867 conn(0x7f7b8406f3d0 msgr2=0x7f7b8414b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 shutdown_connections 2024-09-12T02:59:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f7b8b600640 1 -- 172.21.15.63:0/3654338867 wait complete. 2024-09-12T02:59:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7fd101600640 1 -- 172.21.15.63:0/2863392352 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0e4073f20 con 0x7fd0e40713b0 2024-09-12T02:59:21.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f32d00713e0 msgr2=0x7f32d0073880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f32f5600640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7f32d00713e0 0x7f32d0073880 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f98cc0c7030 con 0x7f98ac071400 2024-09-12T02:59:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32d00679c0 msgr2=0x7f32d0069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f32f5600640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32d00679c0 0x7f32d0069e80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f32f00c92e0 tx=0x7f32e0009040 comp rx=0 tx=0).stop 2024-09-12T02:59:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d40039c0 msgr2=0x7f32f01f8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.260+0000 7f32f5600640 1 --2- 172.21.15.63:0/1259149795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32d40039c0 0x7f32f01f8410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f32e8009040 tx=0x7f32e8009810 comp rx=0 tx=0).stop 2024-09-12T02:59:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98c8c00640 1 -- 172.21.15.63:0/723044432 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f98cc0c7030 con 0x7f98ac071400 2024-09-12T02:59:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f32ef400640 1 -- 172.21.15.63:0/1259149795 reap_dead start 2024-09-12T02:59:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 shutdown_connections 2024-09-12T02:59:21.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 >> 172.21.15.63:0/1259149795 conn(0x7f32f006f3d0 msgr2=0x7f32f0154770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 shutdown_connections 2024-09-12T02:59:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f32f5600640 1 -- 172.21.15.63:0/1259149795 wait complete. 2024-09-12T02:59:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f98ac071400 msgr2=0x7f98ac0738a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7f98ac071400 0x7f98ac0738a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f98ac067af0 msgr2=0x7f98ac069fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f98ac067af0 0x7f98ac069fb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0b0a30 tx=0x7f98b8008040 comp rx=0 tx=0).stop 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c0f90 msgr2=0x7f98cc156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 --2- 172.21.15.63:0/723044432 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98cc0c0f90 0x7f98cc156ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98c000d830 tx=0x7f98c000dcf0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d1400640 1 -- 172.21.15.63:0/723044432 reap_dead start 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 shutdown_connections 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 >> 172.21.15.63:0/723044432 conn(0x7f98cc06f3d0 msgr2=0x7f98cc0c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 shutdown_connections 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.264+0000 7f98d3400640 1 -- 172.21.15.63:0/723044432 wait complete. 2024-09-12T02:59:21.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.272+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8418153750 con 0x7f83f80713a0 2024-09-12T02:59:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f840f400640 1 -- 172.21.15.63:0/1187006053 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f84100091a0 con 0x7f83f80713a0 2024-09-12T02:59:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcad80ca930 con 0x7fcab80711d0 2024-09-12T02:59:21.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f83f80713a0 msgr2=0x7f83f8073840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f841e600640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f83f80713a0 0x7f83f8073840 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f8067990 msgr2=0x7f83f8069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f841e600640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f83f8067990 0x7f83f8069e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f84180c9320 tx=0x7f8408009040 comp rx=0 tx=0).stop 2024-09-12T02:59:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841806d420 msgr2=0x7f84181fafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f841e600640 1 --2- 172.21.15.63:0/1187006053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f841806d420 0x7f84181fafb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f841001a5a0 tx=0x7f8410019710 comp rx=0 tx=0).stop 2024-09-12T02:59:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f8417e00640 1 -- 172.21.15.63:0/1187006053 reap_dead start 2024-09-12T02:59:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7fcad4c00640 1 -- 172.21.15.63:0/3829411667 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcad80ca930 con 0x7fcab80711d0 2024-09-12T02:59:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 shutdown_connections 2024-09-12T02:59:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 >> 172.21.15.63:0/1187006053 conn(0x7f84180d02e0 msgr2=0x7f84180ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcab80711d0 msgr2=0x7fcab8073670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.276+0000 7fcadfc00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7fcab80711d0 0x7fcab8073670 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcab80678c0 msgr2=0x7fcab8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7fcadfc00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcab80678c0 0x7fcab8069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcac401ab10 tx=0x7fcac40a6000 comp rx=0 tx=0).stop 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcad80ca1f0 msgr2=0x7fcad8203a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7fcadfc00640 1 --2- 172.21.15.63:0/3829411667 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcad80ca1f0 0x7fcad8203a80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcad000be00 tx=0x7fcad000bef0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7fcaddc00640 1 -- 172.21.15.63:0/3829411667 reap_dead start 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 shutdown_connections 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 >> 172.21.15.63:0/3829411667 conn(0x7fcad80d02e0 msgr2=0x7fcad80c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 shutdown_connections 2024-09-12T02:59:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 --> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c940b5ef0 con 0x7f7c74071250 2024-09-12T02:59:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7fcadfc00640 1 -- 172.21.15.63:0/3829411667 wait complete. 2024-09-12T02:59:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 shutdown_connections 2024-09-12T02:59:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f841e600640 1 -- 172.21.15.63:0/1187006053 wait complete. 2024-09-12T02:59:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f7c90c00640 1 -- 172.21.15.63:0/92354793 <== osd.5 v2:172.21.15.119:6824/2412795190 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7c940b5ef0 con 0x7f7c74071250 2024-09-12T02:59:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7c74071250 msgr2=0x7f7c740736f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f7c9bc00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7c74071250 0x7f7c740736f0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7c740678c0 msgr2=0x7f7c74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f7c9bc00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7c740678c0 0x7f7c74069d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7c940c5b40 tx=0x7f7c84009190 comp rx=0 tx=0).stop 2024-09-12T02:59:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c940c76e0 msgr2=0x7f7c94155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f7c9bc00640 1 --2- 172.21.15.63:0/92354793 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c940c76e0 0x7f7c94155300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00efc0 tx=0x7f7c8c00c490 comp rx=0 tx=0).stop 2024-09-12T02:59:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.280+0000 7f7c99c00640 1 -- 172.21.15.63:0/92354793 reap_dead start 2024-09-12T02:59:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.284+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 shutdown_connections 2024-09-12T02:59:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.284+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 >> 172.21.15.63:0/92354793 conn(0x7f7c940d02e0 msgr2=0x7f7c940ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.284+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 shutdown_connections 2024-09-12T02:59:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.284+0000 7f7c9bc00640 1 -- 172.21.15.63:0/92354793 wait complete. 2024-09-12T02:59:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.288+0000 7f997b200640 1 -- 172.21.15.63:0/3181025893 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f997c1ed5c0 con 0x7f995c071350 2024-09-12T02:59:21.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.288+0000 7f9972000640 1 -- 172.21.15.63:0/3181025893 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f997c1ed5c0 con 0x7f995c071350 2024-09-12T02:59:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.288+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0e0002d60 con 0x7fd0e40713b0 2024-09-12T02:59:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.288+0000 7f9967400640 1 -- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f995c071350 msgr2=0x7f995c0737f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.288+0000 7f9967400640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f995c071350 0x7f995c0737f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7f9967400640 1 -- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f995c0679c0 msgr2=0x7f995c069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7f9967400640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f995c0679c0 0x7f995c069e80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f996c001cc0 tx=0x7f996c000bd0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7f9967400640 1 -- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f997c153860 msgr2=0x7f997c153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7f9967400640 1 --2- 172.21.15.63:0/3181025893 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f997c153860 0x7f997c153ce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f997c0b1ab0 tx=0x7f997400cb90 comp rx=0 tx=0).stop 2024-09-12T02:59:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7f997a800640 1 -- 172.21.15.63:0/3181025893 reap_dead start 2024-09-12T02:59:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7f9967400640 1 -- 172.21.15.63:0/3181025893 shutdown_connections 2024-09-12T02:59:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7f9967400640 1 -- 172.21.15.63:0/3181025893 >> 172.21.15.63:0/3181025893 conn(0x7f997c06d900 msgr2=0x7f997c0c8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd101600640 1 -- 172.21.15.63:0/2863392352 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd0e0002d60 con 0x7fd0e40713b0 2024-09-12T02:59:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7f9967400640 1 -- 172.21.15.63:0/3181025893 shutdown_connections 2024-09-12T02:59:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7f9967400640 1 -- 172.21.15.63:0/3181025893 wait complete. 2024-09-12T02:59:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fd0e40713b0 msgr2=0x7fd0e4073850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7fd0e40713b0 0x7fd0e4073850 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e4067990 msgr2=0x7fd0e4069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e4067990 0x7fd0e4069e50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8001810 tx=0x7fd0f8009040 comp rx=0 tx=0).stop 2024-09-12T02:59:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 msgr2=0x7fd104070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 --2- 172.21.15.63:0/2863392352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd10406f1d0 0x7fd104070570 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0f001ac30 tx=0x7fd0f0019320 comp rx=0 tx=0).stop 2024-09-12T02:59:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10a000640 1 -- 172.21.15.63:0/2863392352 reap_dead start 2024-09-12T02:59:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 shutdown_connections 2024-09-12T02:59:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 >> 172.21.15.63:0/2863392352 conn(0x7fd104072960 msgr2=0x7fd104152980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 shutdown_connections 2024-09-12T02:59:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.292+0000 7fd10c000640 1 -- 172.21.15.63:0/2863392352 wait complete. 2024-09-12T02:59:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:64424509475 2024-09-12T02:59:21.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:59:21.316 INFO:teuthology.orchestra.run.smithi063.stdout:55834574882 2024-09-12T02:59:21.316 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:59:21.317 INFO:teuthology.orchestra.run.smithi063.stdout:64424509475 2024-09-12T02:59:21.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:59:21.323 INFO:teuthology.orchestra.run.smithi063.stdout:60129542179 2024-09-12T02:59:21.323 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:59:21.329 INFO:teuthology.orchestra.run.smithi063.stdout:60129542177 2024-09-12T02:59:21.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:59:21.334 INFO:teuthology.orchestra.run.smithi063.stdout:64424509473 2024-09-12T02:59:21.334 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:59:21.335 INFO:teuthology.orchestra.run.smithi063.stdout:60129542177 2024-09-12T02:59:21.335 INFO:teuthology.orchestra.run.smithi063.stdout:274877906949 2024-09-12T02:59:21.335 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:59:21.336 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:59:21.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.532+0000 7f0e44400640 1 Processor -- start 2024-09-12T02:59:21.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e44400640 1 -- start start 2024-09-12T02:59:21.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e44400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e3c0c8210 0x7f0e3c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e44400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0e3c157250 0x7f0e3c0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e44400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3c1576e0 con 0x7f0e3c06fef0 2024-09-12T02:59:21.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e44400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3c0c1a40 con 0x7f0e3c157250 2024-09-12T02:59:21.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e44400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3c0c1d00 con 0x7f0e3c0c8210 2024-09-12T02:59:21.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f2641400640 1 Processor -- start 2024-09-12T02:59:21.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e41a00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f0e3c06fef0 0x7f0e3c0c6970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:51878/0 (socket says 172.21.15.63:51878) 2024-09-12T02:59:21.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e41a00640 1 -- 172.21.15.63:0/201396629 learned_addr learned my addr 172.21.15.63:0/201396629 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:21.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e41000640 1 --2- 172.21.15.63:0/201396629 >> v2:172.21.15.119:3300/0 conn(0x7f0e3c0c8210 0x7f0e3c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f0e42400640 1 --2- 172.21.15.63:0/201396629 >> v2:172.21.15.63:3300/0 conn(0x7f0e3c157250 0x7f0e3c0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.536+0000 7f2641400640 1 -- start start 2024-09-12T02:59:21.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f0e41000640 1 -- 172.21.15.63:0/201396629 >> v2:172.21.15.63:3300/0 conn(0x7f0e3c157250 msgr2=0x7f0e3c0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f0e41000640 1 --2- 172.21.15.63:0/201396629 >> v2:172.21.15.63:3300/0 conn(0x7f0e3c157250 0x7f0e3c0c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f0e41000640 1 -- 172.21.15.63:0/201396629 >> v1:172.21.15.119:6789/0 conn(0x7f0e3c06fef0 legacy=0x7f0e3c0c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f0e3be00640 1 -- 172.21.15.63:0/201396629 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679918829 0 0) 0x7f0e3c1576e0 con 0x7f0e3c06fef0 2024-09-12T02:59:21.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f78aca00640 1 Processor -- start 2024-09-12T02:59:21.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f78aca00640 1 -- start start 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f78aca00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f78a004b360 0x7f78a004b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f78aca00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a0046510 con 0x7f78a0035a90 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f78aca00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a0045990 con 0x7f78a00dcd90 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f78aca00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f78a00355d0 con 0x7f78a004b360 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f2641400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26340dcd90 0x7f2634035a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f2641400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2634046510 con 0x7f263404b360 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f2641400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2634045990 con 0x7f2634044d50 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f2641400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f26340355d0 con 0x7f26340dcd90 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f263be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26340dcd90 0x7f2634035a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f263be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26340dcd90 0x7f2634035a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38150/0 (socket says 172.21.15.63:38150) 2024-09-12T02:59:21.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f263be00640 1 -- 172.21.15.63:0/420827216 learned_addr learned my addr 172.21.15.63:0/420827216 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f78a7e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f78a004b360 0x7f78a004b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f78a7e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f78a004b360 0x7f78a004b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36364/0 (socket says 172.21.15.63:36364) 2024-09-12T02:59:21.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f78a7e00640 1 -- 172.21.15.63:0/2693973065 learned_addr learned my addr 172.21.15.63:0/2693973065 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f263be00640 1 -- 172.21.15.63:0/420827216 >> v1:172.21.15.119:6789/0 conn(0x7f2634044d50 legacy=0x7f26340e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f263be00640 1 -- 172.21.15.63:0/420827216 >> v1:172.21.15.63:6789/0 conn(0x7f263404b360 legacy=0x7f26340ed2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f263be00640 1 -- 172.21.15.63:0/420827216 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2634045c70 con 0x7f26340dcd90 2024-09-12T02:59:21.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f0e41000640 1 -- 172.21.15.63:0/201396629 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3c0c1fe0 con 0x7f0e3c0c8210 2024-09-12T02:59:21.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.540+0000 7f0e42400640 1 --2- 172.21.15.63:0/201396629 >> v2:172.21.15.63:3300/0 conn(0x7f0e3c157250 0x7f0e3c0c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:21.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138570110 0 0) 0x7f78a0045990 con 0x7f78a00dcd90 2024-09-12T02:59:21.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7890003530 con 0x7f78a00dcd90 2024-09-12T02:59:21.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 593672326 0 0) 0x7f7890003530 con 0x7f78a00dcd90 2024-09-12T02:59:21.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f0e41000640 1 --2- 172.21.15.63:0/201396629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c0c8210 0x7f0e3c156d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c071420 tx=0x7f0e2801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a57a6ebd7c1507b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 >> v2:172.21.15.63:3300/0 conn(0x7f78a004b360 msgr2=0x7f78a004b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 --2- 172.21.15.63:0/2693973065 >> v2:172.21.15.63:3300/0 conn(0x7f78a004b360 0x7f78a004b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 >> v1:172.21.15.63:6789/0 conn(0x7f78a0035a90 legacy=0x7f78a00e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a0045c70 con 0x7f78a00dcd90 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f789c001680 con 0x7f78a00dcd90 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a7e00640 1 --2- 172.21.15.63:0/2693973065 >> v2:172.21.15.63:3300/0 conn(0x7f78a004b360 0x7f78a004b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 >> v1:172.21.15.119:6789/0 conn(0x7f78a00dcd90 legacy=0x7f78a0044d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78900039c0 0x7f7890003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f7890004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78900051d0 0x7f789000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f789000c040 con 0x7f78900051d0 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f789000c1f0 con 0x7f7890004810 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f789000c3f0 con 0x7f78900039c0 2024-09-12T02:59:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f0e3be00640 1 -- 172.21.15.63:0/201396629 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b5070 con 0x7f0e3c0c8210 2024-09-12T02:59:21.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a7400640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78900039c0 0x7f7890003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f0e3be00640 1 -- 172.21.15.63:0/201396629 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e280a8970 con 0x7f0e3c0c8210 2024-09-12T02:59:21.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a7e00640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78900051d0 0x7f789000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6a00640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f7890004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6a00640 1 -- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78900039c0 msgr2=0x7f7890003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6a00640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78900039c0 0x7f7890003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6a00640 1 -- 172.21.15.63:0/2693973065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78900051d0 msgr2=0x7f789000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6a00640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78900051d0 0x7f789000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a6a00640 1 -- 172.21.15.63:0/2693973065 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a0045c70 con 0x7f7890004810 2024-09-12T02:59:21.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f78a7e00640 1 -- 172.21.15.63:0/2693973065 reap_dead start 2024-09-12T02:59:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f0e3be00640 1 -- 172.21.15.63:0/201396629 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b5070 con 0x7f0e3c0c8210 2024-09-12T02:59:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f0e44400640 1 -- 172.21.15.63:0/201396629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c0c8210 msgr2=0x7f0e3c156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f0e44400640 1 --2- 172.21.15.63:0/201396629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c0c8210 0x7f0e3c156d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c071420 tx=0x7f0e2801ec70 comp rx=0 tx=0).stop 2024-09-12T02:59:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f0e44400640 1 -- 172.21.15.63:0/201396629 shutdown_connections 2024-09-12T02:59:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f0e44400640 1 --2- 172.21.15.63:0/201396629 >> v2:172.21.15.63:3300/0 conn(0x7f0e3c157250 0x7f0e3c0c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.544+0000 7f0e44400640 1 --2- 172.21.15.63:0/201396629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c0c8210 0x7f0e3c156d10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f0e44400640 1 -- 172.21.15.63:0/201396629 >> 172.21.15.63:0/201396629 conn(0x7f0e3c06f3d0 msgr2=0x7f0e3c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f0e44400640 1 -- 172.21.15.63:0/201396629 shutdown_connections 2024-09-12T02:59:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f0e44400640 1 -- 172.21.15.63:0/201396629 wait complete. 2024-09-12T02:59:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f07e0a00640 1 Processor -- start 2024-09-12T02:59:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f263be00640 1 --2- 172.21.15.63:0/420827216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26340dcd90 0x7f2634035a90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f26280098a0 tx=0x7f262801c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=479db6abe81221c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f07e0a00640 1 -- start start 2024-09-12T02:59:21.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f263aa00640 1 -- 172.21.15.63:0/420827216 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26280b0070 con 0x7f26340dcd90 2024-09-12T02:59:21.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f263aa00640 1 -- 172.21.15.63:0/420827216 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26280ab600 con 0x7f26340dcd90 2024-09-12T02:59:21.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f2641400640 1 -- 172.21.15.63:0/420827216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26340dcd90 msgr2=0x7f2634035a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f263aa00640 1 -- 172.21.15.63:0/420827216 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26280b0070 con 0x7f26340dcd90 2024-09-12T02:59:21.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f2641400640 1 --2- 172.21.15.63:0/420827216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26340dcd90 0x7f2634035a90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f26280098a0 tx=0x7f262801c340 comp rx=0 tx=0).stop 2024-09-12T02:59:21.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f2641400640 1 -- 172.21.15.63:0/420827216 shutdown_connections 2024-09-12T02:59:21.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f2641400640 1 --2- 172.21.15.63:0/420827216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26340dcd90 0x7f2634035a90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f2641400640 1 -- 172.21.15.63:0/420827216 >> 172.21.15.63:0/420827216 conn(0x7f263404fc60 msgr2=0x7f2634050070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f2641400640 1 -- 172.21.15.63:0/420827216 shutdown_connections 2024-09-12T02:59:21.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f2641400640 1 -- 172.21.15.63:0/420827216 wait complete. 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f07e0a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07dc0c6fb0 0x7f07dc0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f07e0a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f07dc06fcb0 0x7f07dc158800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f07d9e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07dc0c6fb0 0x7f07dc0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f07d9e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07dc0c6fb0 0x7f07dc0c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36386/0 (socket says 172.21.15.63:36386) 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.548+0000 7f07d9e00640 1 -- 172.21.15.63:0/1188096829 learned_addr learned my addr 172.21.15.63:0/1188096829 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f07e0a00640 1 -- 172.21.15.63:0/1188096829 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07dc1621a0 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f07e0a00640 1 -- 172.21.15.63:0/1188096829 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f07dc0c7bf0 con 0x7f07dc0c6fb0 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f07e0a00640 1 -- 172.21.15.63:0/1188096829 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f07dc0c7ed0 con 0x7f07dc06fcb0 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f07db200640 1 --2- 172.21.15.63:0/1188096829 >> v2:172.21.15.119:3300/0 conn(0x7f07dc06fcb0 0x7f07dc158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f07db200640 1 -- 172.21.15.63:0/1188096829 >> v2:172.21.15.63:3300/0 conn(0x7f07dc0c6fb0 msgr2=0x7f07dc0c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f07db200640 1 --2- 172.21.15.63:0/1188096829 >> v2:172.21.15.63:3300/0 conn(0x7f07dc0c6fb0 0x7f07dc0c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e44400640 1 Processor -- start 2024-09-12T02:59:21.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e44400640 1 -- start start 2024-09-12T02:59:21.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f07db200640 1 -- 172.21.15.63:0/1188096829 >> v1:172.21.15.63:6789/0 conn(0x7f07dc0c6bd0 legacy=0x7f07dc1626a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.902 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f07db200640 1 -- 172.21.15.63:0/1188096829 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc0c81b0 con 0x7f07dc06fcb0 2024-09-12T02:59:21.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e44400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c06fef0 0x7f0e3c1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e44400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e3c0c8210 0x7f0e3c162450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e44400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e3c157250 0x7f0e3c162990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e44400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c0c1660 con 0x7f0e3c0c8210 2024-09-12T02:59:21.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e44400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3c0c25a0 con 0x7f0e3c06fef0 2024-09-12T02:59:21.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e44400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3c14da20 con 0x7f0e3c157250 2024-09-12T02:59:21.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e41000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e3c0c8210 0x7f0e3c162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e41a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c06fef0 0x7f0e3c1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e41000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e3c0c8210 0x7f0e3c162450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36388/0 (socket says 172.21.15.63:36388) 2024-09-12T02:59:21.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f0e41000640 1 -- 172.21.15.63:0/4126753593 learned_addr learned my addr 172.21.15.63:0/4126753593 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f78a6a00640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f7890004c90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7894001780 tx=0x7f789401c220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3ee3c314bad2e81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.552+0000 7f2641400640 1 Processor -- start 2024-09-12T02:59:21.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e41000640 1 -- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e3c157250 msgr2=0x7f0e3c162990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:59:21.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78940013a0 con 0x7f7890004810 2024-09-12T02:59:21.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e41000640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e3c157250 0x7f0e3c162990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e41000640 1 -- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c06fef0 msgr2=0x7f0e3c1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e41000640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c06fef0 0x7f0e3c1557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e41000640 1 -- 172.21.15.63:0/4126753593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3c1560a0 con 0x7f0e3c0c8210 2024-09-12T02:59:21.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78940052f0 con 0x7f7890004810 2024-09-12T02:59:21.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f78a6000640 1 -- 172.21.15.63:0/2693973065 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7894003840 con 0x7f7890004810 2024-09-12T02:59:21.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e41000640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e3c0c8210 0x7f0e3c162450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009880 tx=0x7f0e2801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f2641400640 1 -- start start 2024-09-12T02:59:21.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f78aca00640 1 -- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 msgr2=0x7f7890004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f78aca00640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f7890004c90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7894001780 tx=0x7f789401c220 comp rx=0 tx=0).stop 2024-09-12T02:59:21.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e39600640 1 -- 172.21.15.63:0/4126753593 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b5040 con 0x7f0e3c0c8210 2024-09-12T02:59:21.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e39600640 1 -- 172.21.15.63:0/4126753593 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e280c0070 con 0x7f0e3c0c8210 2024-09-12T02:59:21.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e39600640 1 -- 172.21.15.63:0/4126753593 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28003820 con 0x7f0e3c0c8210 2024-09-12T02:59:21.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3c147900 con 0x7f0e3c0c8210 2024-09-12T02:59:21.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3c163cf0 con 0x7f0e3c0c8210 2024-09-12T02:59:21.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f2641400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2634044d50 0x7f263417c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f2641400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f263404b360 0x7f26340d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f2641400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26340dcd90 0x7f26340d53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f78aca00640 1 -- 172.21.15.63:0/2693973065 shutdown_connections 2024-09-12T02:59:21.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f78aca00640 1 --2- 172.21.15.63:0/2693973065 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f7890004c90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f78aca00640 1 -- 172.21.15.63:0/2693973065 >> 172.21.15.63:0/2693973065 conn(0x7f78a004fc60 msgr2=0x7f78a0050070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f263b400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f263404b360 0x7f26340d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f263b400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f263404b360 0x7f26340d4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35536/0 (socket says 172.21.15.63:35536) 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f263be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2634044d50 0x7f263417c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f263be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2634044d50 0x7f263417c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38192/0 (socket says 172.21.15.63:38192) 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f2640a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26340dcd90 0x7f26340d53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.556+0000 7f2640a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26340dcd90 0x7f26340d53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36404/0 (socket says 172.21.15.63:36404) 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f263b400640 1 -- 172.21.15.63:0/3364685028 learned_addr learned my addr 172.21.15.63:0/3364685028 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f26340451a0 con 0x7f26340dcd90 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f263404bba0 con 0x7f2634044d50 2024-09-12T02:59:21.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2634045320 con 0x7f263404b360 2024-09-12T02:59:21.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07db200640 1 --2- 172.21.15.63:0/1188096829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc06fcb0 0x7f07dc158800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07dc06e2f0 tx=0x7f07cc01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91a94c0ebcde0a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f78aca00640 1 -- 172.21.15.63:0/2693973065 shutdown_connections 2024-09-12T02:59:21.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e3c069060 con 0x7f0e3c0c8210 2024-09-12T02:59:21.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07d9400640 1 -- 172.21.15.63:0/1188096829 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0b0070 con 0x7f07dc06fcb0 2024-09-12T02:59:21.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07d9400640 1 -- 172.21.15.63:0/1188096829 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07cc0ab600 con 0x7f07dc06fcb0 2024-09-12T02:59:21.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07d9400640 1 -- 172.21.15.63:0/1188096829 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc0ab9d0 con 0x7f07dc06fcb0 2024-09-12T02:59:21.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f0e39600640 1 -- 172.21.15.63:0/4126753593 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e280039c0 con 0x7f0e3c0c8210 2024-09-12T02:59:21.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f263b400640 1 -- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2634044d50 msgr2=0x7f263417c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f263b400640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2634044d50 0x7f263417c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f263b400640 1 -- 172.21.15.63:0/3364685028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26340dcd90 msgr2=0x7f26340d53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f263b400640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26340dcd90 0x7f26340d53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f263b400640 1 -- 172.21.15.63:0/3364685028 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2634049f70 con 0x7f263404b360 2024-09-12T02:59:21.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f2640a00640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26340dcd90 0x7f26340d53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:21.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07e0a00640 1 -- 172.21.15.63:0/1188096829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc06fcb0 msgr2=0x7f07dc158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07e0a00640 1 --2- 172.21.15.63:0/1188096829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc06fcb0 0x7f07dc158800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f07dc06e2f0 tx=0x7f07cc01c310 comp rx=0 tx=0).stop 2024-09-12T02:59:21.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f78aca00640 1 -- 172.21.15.63:0/2693973065 wait complete. 2024-09-12T02:59:21.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f0e39600640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e1c067990 0x7f0e1c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f0e39600640 1 -- 172.21.15.63:0/4126753593 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f0e28123000 con 0x7f0e3c0c8210 2024-09-12T02:59:21.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07e0a00640 1 -- 172.21.15.63:0/1188096829 shutdown_connections 2024-09-12T02:59:21.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07e0a00640 1 --2- 172.21.15.63:0/1188096829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc06fcb0 0x7f07dc158800 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07e0a00640 1 --2- 172.21.15.63:0/1188096829 >> v2:172.21.15.63:3300/0 conn(0x7f07dc0c6fb0 0x7f07dc0c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07e0a00640 1 -- 172.21.15.63:0/1188096829 >> 172.21.15.63:0/1188096829 conn(0x7f07dc06d900 msgr2=0x7f07dc06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07e0a00640 1 -- 172.21.15.63:0/1188096829 shutdown_connections 2024-09-12T02:59:21.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f263b400640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f263404b360 0x7f26340d4e90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f263c02dd60 tx=0x7f263c069920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f262fe00640 1 -- 172.21.15.63:0/3364685028 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c091070 con 0x7f263404b360 2024-09-12T02:59:21.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f262fe00640 1 -- 172.21.15.63:0/3364685028 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263c071630 con 0x7f263404b360 2024-09-12T02:59:21.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f262fe00640 1 -- 172.21.15.63:0/3364685028 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c071a40 con 0x7f263404b360 2024-09-12T02:59:21.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f0e41a00640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e1c067990 0x7f0e1c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f78aca00640 1 Processor -- start 2024-09-12T02:59:21.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f78aca00640 1 -- start start 2024-09-12T02:59:21.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263417c9e0 con 0x7f263404b360 2024-09-12T02:59:21.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2634049c90 con 0x7f263404b360 2024-09-12T02:59:21.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.560+0000 7f07e0a00640 1 -- 172.21.15.63:0/1188096829 wait complete. 2024-09-12T02:59:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78aca00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f78a00d5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78aca00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78a00d84a0 0x7f78a0048090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78aca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78a00d88d0 0x7f78a00485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78a6a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78a00d84a0 0x7f78a0048090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78a6a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78a00d84a0 0x7f78a0048090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35550/0 (socket says 172.21.15.63:35550) 2024-09-12T02:59:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78a7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f78a00d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78a7400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f78a00d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38200/0 (socket says 172.21.15.63:38200) 2024-09-12T02:59:21.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f07e0a00640 1 Processor -- start 2024-09-12T02:59:21.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78a7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78a00d88d0 0x7f78a00485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26180052a0 con 0x7f263404b360 2024-09-12T02:59:21.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f07e0a00640 1 -- start start 2024-09-12T02:59:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78a6a00640 1 -- 172.21.15.63:0/1592670310 learned_addr learned my addr 172.21.15.63:0/1592670310 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f78a0046230 con 0x7f78a00d88d0 2024-09-12T02:59:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f78a00e2b70 con 0x7f7890004810 2024-09-12T02:59:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f78a0045550 con 0x7f78a00d84a0 2024-09-12T02:59:21.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.564+0000 7f0e41a00640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e1c067990 0x7f0e1c069e50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000f70 tx=0x7f0e30007df0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07e0a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07dc06fcb0 0x7f07dc14db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07e0a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc0c6bd0 0x7f07dc14bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07e0a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07dc0c6fb0 0x7f07dc14c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78a7400640 1 -- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78a00d84a0 msgr2=0x7f78a0048090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78a7400640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78a00d84a0 0x7f78a0048090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78a7400640 1 -- 172.21.15.63:0/1592670310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78a00d88d0 msgr2=0x7f78a00485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78a7400640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78a00d88d0 0x7f78a00485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07e0a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc162f30 con 0x7f07dc0c6fb0 2024-09-12T02:59:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78a7400640 1 -- 172.21.15.63:0/1592670310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a00d66e0 con 0x7f7890004810 2024-09-12T02:59:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78a6a00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78a00d84a0 0x7f78a0048090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:21.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78a7e00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78a00d88d0 0x7f78a00485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:21.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f262fe00640 1 -- 172.21.15.63:0/3364685028 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f263c094070 con 0x7f263404b360 2024-09-12T02:59:21.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07e0a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc162db0 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07e0a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f07dc16bbd0 con 0x7f07dc06fcb0 2024-09-12T02:59:21.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d9e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc0c6bd0 0x7f07dc14bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07db200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07dc0c6fb0 0x7f07dc14c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d9e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc0c6bd0 0x7f07dc14bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38208/0 (socket says 172.21.15.63:38208) 2024-09-12T02:59:21.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d9e00640 1 -- 172.21.15.63:0/2021560511 learned_addr learned my addr 172.21.15.63:0/2021560511 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07db200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07dc0c6fb0 0x7f07dc14c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36418/0 (socket says 172.21.15.63:36418) 2024-09-12T02:59:21.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07da800640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07dc06fcb0 0x7f07dc14db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78a7400640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f78a00d5160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f789c00f7e0 tx=0x7f789c00fca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d9e00640 1 -- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07dc06fcb0 msgr2=0x7f07dc14db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d9e00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07dc06fcb0 0x7f07dc14db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d9e00640 1 -- 172.21.15.63:0/2021560511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07dc0c6fb0 msgr2=0x7f07dc14c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d9e00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07dc0c6fb0 0x7f07dc14c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d9e00640 1 -- 172.21.15.63:0/2021560511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc1582c0 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d9e00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc0c6bd0 0x7f07dc14bb80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07c800e8a0 tx=0x7f07c800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f789b400640 1 -- 172.21.15.63:0/1592670310 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c0052e0 con 0x7f7890004810 2024-09-12T02:59:21.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a00d69c0 con 0x7f7890004810 2024-09-12T02:59:21.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a00d6f80 con 0x7f7890004810 2024-09-12T02:59:21.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f789b400640 1 -- 172.21.15.63:0/1592670310 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c018070 con 0x7f7890004810 2024-09-12T02:59:21.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f789b400640 1 -- 172.21.15.63:0/1592670310 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c0052e0 con 0x7f7890004810 2024-09-12T02:59:21.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f262fe00640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f261c067990 0x7f261c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f262fe00640 1 -- 172.21.15.63:0/3364685028 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f263c102150 con 0x7f263404b360 2024-09-12T02:59:21.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f07d2a00640 1 -- 172.21.15.63:0/2021560511 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c8017070 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.568+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78840052a0 con 0x7f7890004810 2024-09-12T02:59:21.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07dc161a70 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f07d2a00640 1 -- 172.21.15.63:0/2021560511 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c800c940 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07dc14e880 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f263be00640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f261c067990 0x7f261c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f07d2a00640 1 -- 172.21.15.63:0/2021560511 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c8017070 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f0e39600640 1 -- 172.21.15.63:0/4126753593 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e280c9020 con 0x7f0e3c0c8210 2024-09-12T02:59:21.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f263be00640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f261c067990 0x7f261c069e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f26280ad000 tx=0x7f26280a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07dc158800 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f789b400640 1 -- 172.21.15.63:0/1592670310 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f789c039890 con 0x7f7890004810 2024-09-12T02:59:21.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.572+0000 7f789b400640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7888067ac0 0x7f7888069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.576+0000 7f789b400640 1 -- 172.21.15.63:0/1592670310 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f789c053f70 con 0x7f7890004810 2024-09-12T02:59:21.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.576+0000 7f78a6a00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7888067ac0 0x7f7888069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.576+0000 7f78a6a00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7888067ac0 0x7f7888069f80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7894000c10 tx=0x7f78940011a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.580+0000 7f262fe00640 1 -- 172.21.15.63:0/3364685028 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f263c0d22c0 con 0x7f263404b360 2024-09-12T02:59:21.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.584+0000 7f789b400640 1 -- 172.21.15.63:0/1592670310 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f789c005480 con 0x7f7890004810 2024-09-12T02:59:21.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.592+0000 7f07d2a00640 1 -- 172.21.15.63:0/2021560511 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07c801a070 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.592+0000 7f07d2a00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07bc067ac0 0x7f07bc069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.596+0000 7f07d2a00640 1 -- 172.21.15.63:0/2021560511 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f07c80544a0 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.596+0000 7f07da800640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07bc067ac0 0x7f07bc069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.596+0000 7f07da800640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07bc067ac0 0x7f07bc069f80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0c3340 tx=0x7f07d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.600+0000 7f07d2a00640 1 -- 172.21.15.63:0/2021560511 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f07c8056400 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.624+0000 7f17bf200640 1 Processor -- start 2024-09-12T02:59:21.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.624+0000 7f17bf200640 1 -- start start 2024-09-12T02:59:21.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.624+0000 7fd6a0400640 1 Processor -- start 2024-09-12T02:59:21.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.624+0000 7f17bf200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f17b80d65e0 0x7f17b80e0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.624+0000 7f17bf200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17b80dcbf0 con 0x7f17b804dd30 2024-09-12T02:59:21.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.624+0000 7f17bf200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17b80dced0 con 0x7f17b8046d50 2024-09-12T02:59:21.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.624+0000 7f17bf200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f17b80df9c0 con 0x7f17b80d65e0 2024-09-12T02:59:21.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.624+0000 7fd6a0400640 1 -- start start 2024-09-12T02:59:21.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7f17be800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f17b804dd30 0x7f17b8051d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37606/0 (socket says 172.21.15.63:37606) 2024-09-12T02:59:21.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7f17bd400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f17b8046d50 0x7f17b80dc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:51918/0 (socket says 172.21.15.63:51918) 2024-09-12T02:59:21.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7f17be800640 1 -- 172.21.15.63:0/3008608486 learned_addr learned my addr 172.21.15.63:0/3008608486 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:21.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7f17bde00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f17b80d65e0 0x7f17b80e0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd6a0400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd6980c7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd6a0400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6980c34a0 0x7fd69806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd6a0400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd69806d210 0x7fd6980c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd6a0400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd698151450 con 0x7fd6980c34a0 2024-09-12T02:59:21.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd6a0400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd698157070 con 0x7fd69806d210 2024-09-12T02:59:21.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd6a0400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fd698157350 con 0x7fd698151070 2024-09-12T02:59:21.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd69da00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd6980c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd69e400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd69806d210 0x7fd6980c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd69e400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd69806d210 0x7fd6980c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38230/0 (socket says 172.21.15.63:38230) 2024-09-12T02:59:21.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd69e400640 1 -- 172.21.15.63:0/3931736643 learned_addr learned my addr 172.21.15.63:0/3931736643 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fc11be00640 1 Processor -- start 2024-09-12T02:59:21.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd69e400640 1 -- 172.21.15.63:0/3931736643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 msgr2=0x7fd6980c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd69e400640 1 --2- 172.21.15.63:0/3931736643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd6980c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fd69e400640 1 -- 172.21.15.63:0/3931736643 >> v2:172.21.15.63:3300/0 conn(0x7fd6980c34a0 msgr2=0x7fd69806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fd69e400640 1 --2- 172.21.15.63:0/3931736643 >> v2:172.21.15.63:3300/0 conn(0x7fd6980c34a0 0x7fd69806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fd69e400640 1 -- 172.21.15.63:0/3931736643 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd698157630 con 0x7fd69806d210 2024-09-12T02:59:21.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fd69da00640 1 --2- 172.21.15.63:0/3931736643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd6980c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:21.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7f17bde00640 1 -- 172.21.15.63:0/3008608486 >> v1:172.21.15.119:6789/0 conn(0x7f17b8046d50 legacy=0x7f17b80dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7f17bde00640 1 -- 172.21.15.63:0/3008608486 >> v1:172.21.15.63:6789/0 conn(0x7f17b804dd30 legacy=0x7f17b8051d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7f17bde00640 1 -- 172.21.15.63:0/3008608486 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b80097c0 con 0x7f17b80d65e0 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.628+0000 7fc11be00640 1 -- start start 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc11be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140d8a00 0x7fc114007250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc11a000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc1140df0c0 0x7fc1140491f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37616/0 (socket says 172.21.15.63:37616) 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc11aa00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140d8a00 0x7fc114007250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc11aa00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140d8a00 0x7fc114007250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35578/0 (socket says 172.21.15.63:35578) 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc11a000640 1 -- 172.21.15.63:0/1387585648 learned_addr learned my addr 172.21.15.63:0/1387585648 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc11be00640 1 -- 172.21.15.63:0/1387585648 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1140d8de0 con 0x7fc1140df0c0 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc11be00640 1 -- 172.21.15.63:0/1387585648 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc114050660 con 0x7fc11400e3b0 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc11be00640 1 -- 172.21.15.63:0/1387585648 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc114050940 con 0x7fc1140d8a00 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1207843898 0 0) 0x7fc114050660 con 0x7fc11400e3b0 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc100003530 con 0x7fc11400e3b0 2024-09-12T02:59:21.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830354962 0 0) 0x7fc1140d8de0 con 0x7fc1140df0c0 2024-09-12T02:59:21.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc114050660 con 0x7fc1140df0c0 2024-09-12T02:59:21.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1004328061 0 0) 0x7fc100003530 con 0x7fc11400e3b0 2024-09-12T02:59:21.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140d8a00 msgr2=0x7fc114007250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140d8a00 0x7fc114007250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 >> v1:172.21.15.63:6789/0 conn(0x7fc1140df0c0 legacy=0x7fc1140491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bde00640 1 --2- 172.21.15.63:0/3008608486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17b80d65e0 0x7f17b80e0410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=954856f72b6ebf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1140e1d60 con 0x7fc11400e3b0 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7fc11c050810 con 0x7fc11400e3b0 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.632+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 >> v1:172.21.15.119:6789/0 conn(0x7fc11400e3b0 legacy=0x7fc1140e8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc119600640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc100003b70 0x7fc100003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc119600640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100004810 0x7fc100004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc119600640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1000051d0 0x7fc1000141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc114050940 con 0x7fc100003b70 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc100014780 con 0x7fc100004810 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc100014980 con 0x7fc1000051d0 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc11b400640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1000051d0 0x7fc1000141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc11a000640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100004810 0x7fc100004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bca00640 1 -- 172.21.15.63:0/3008608486 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00b0070 con 0x7f17b80d65e0 2024-09-12T02:59:21.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bca00640 1 -- 172.21.15.63:0/3008608486 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b00ab600 con 0x7f17b80d65e0 2024-09-12T02:59:21.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bca00640 1 -- 172.21.15.63:0/3008608486 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00ab9d0 con 0x7f17b80d65e0 2024-09-12T02:59:21.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc11aa00640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc100003b70 0x7fc100003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f6ddc200640 1 Processor -- start 2024-09-12T02:59:21.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f6ddc200640 1 -- start start 2024-09-12T02:59:21.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc11b400640 1 -- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100004810 msgr2=0x7fc100004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc11b400640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc100004810 0x7fc100004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc11b400640 1 -- 172.21.15.63:0/1387585648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc100003b70 msgr2=0x7fc100003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc11b400640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc100003b70 0x7fc100003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fc11b400640 1 -- 172.21.15.63:0/1387585648 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1140e1d60 con 0x7fc1000051d0 2024-09-12T02:59:21.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fd69e400640 1 --2- 172.21.15.63:0/3931736643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd69806d210 0x7fd6980c8410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd698072010 tx=0x7fd69001f1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b84eceae1a8d928a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fd697e00640 1 -- 172.21.15.63:0/3931736643 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6900b4070 con 0x7fd69806d210 2024-09-12T02:59:21.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fd697e00640 1 -- 172.21.15.63:0/3931736643 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6900af400 con 0x7fd69806d210 2024-09-12T02:59:21.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fd697e00640 1 -- 172.21.15.63:0/3931736643 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6900af7d0 con 0x7fd69806d210 2024-09-12T02:59:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bf200640 1 -- 172.21.15.63:0/3008608486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17b80d65e0 msgr2=0x7f17b80e0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bf200640 1 --2- 172.21.15.63:0/3008608486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17b80d65e0 0x7f17b80e0410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b001c370 comp rx=0 tx=0).stop 2024-09-12T02:59:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bf200640 1 -- 172.21.15.63:0/3008608486 shutdown_connections 2024-09-12T02:59:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bf200640 1 --2- 172.21.15.63:0/3008608486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17b80d65e0 0x7f17b80e0410 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bf200640 1 -- 172.21.15.63:0/3008608486 >> 172.21.15.63:0/3008608486 conn(0x7f17b80099b0 msgr2=0x7f17b8009dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bf200640 1 -- 172.21.15.63:0/3008608486 shutdown_connections 2024-09-12T02:59:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fd6a0400640 1 -- 172.21.15.63:0/3931736643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd69806d210 msgr2=0x7fd6980c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7fd6a0400640 1 --2- 172.21.15.63:0/3931736643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd69806d210 0x7fd6980c8410 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd698072010 tx=0x7fd69001f1d0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f6ddc200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6dd4152640 0x7f6dd41590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f6ddc200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6dd4071850 0x7f6dd40c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.636+0000 7f17bf200640 1 -- 172.21.15.63:0/3008608486 wait complete. 2024-09-12T02:59:21.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd9800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6dd4152640 0x7f6dd41590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd9800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6dd4152640 0x7f6dd41590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38246/0 (socket says 172.21.15.63:38246) 2024-09-12T02:59:21.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd9800640 1 -- 172.21.15.63:0/3945757105 learned_addr learned my addr 172.21.15.63:0/3945757105 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd8e00640 1 --2- 172.21.15.63:0/3945757105 >> v2:172.21.15.63:3300/0 conn(0x7f6dd4071850 0x7f6dd40c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6ddc200640 1 -- 172.21.15.63:0/3945757105 --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd40c6970 con 0x7f6dd4071ca0 2024-09-12T02:59:21.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6ddc200640 1 -- 172.21.15.63:0/3945757105 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd40c8160 con 0x7f6dd4071850 2024-09-12T02:59:21.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fc11b400640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1000051d0 0x7fc1000141e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc11c051900 tx=0x7fc11c0996f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=369dc4d205531606 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fd6a0400640 1 -- 172.21.15.63:0/3931736643 shutdown_connections 2024-09-12T02:59:21.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fd6a0400640 1 --2- 172.21.15.63:0/3931736643 >> v2:172.21.15.63:3300/0 conn(0x7fd6980c34a0 0x7fd69806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fd6a0400640 1 --2- 172.21.15.63:0/3931736643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd69806d210 0x7fd6980c8410 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fd6a0400640 1 --2- 172.21.15.63:0/3931736643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd6980c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c076300 con 0x7fc1000051d0 2024-09-12T02:59:21.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c128430 con 0x7fc1000051d0 2024-09-12T02:59:21.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6ddc200640 1 -- 172.21.15.63:0/3945757105 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd40c6c30 con 0x7f6dd4152640 2024-09-12T02:59:21.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f17bf200640 1 Processor -- start 2024-09-12T02:59:21.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f17bf200640 1 -- start start 2024-09-12T02:59:21.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fd6a0400640 1 -- 172.21.15.63:0/3931736643 >> 172.21.15.63:0/3931736643 conn(0x7fd69806dcb0 msgr2=0x7fd69806e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fd6a0400640 1 -- 172.21.15.63:0/3931736643 shutdown_connections 2024-09-12T02:59:21.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fd6a0400640 1 -- 172.21.15.63:0/3931736643 wait complete. 2024-09-12T02:59:21.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fc119600640 1 -- 172.21.15.63:0/1387585648 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c128700 con 0x7fc1000051d0 2024-09-12T02:59:21.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fc11be00640 1 -- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1000051d0 msgr2=0x7fc1000141e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fc11be00640 1 --2- 172.21.15.63:0/1387585648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1000051d0 0x7fc1000141e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc11c051900 tx=0x7fc11c0996f0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fc11b400640 1 -- 172.21.15.63:0/1387585648 reap_dead start 2024-09-12T02:59:21.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fc11be00640 1 -- 172.21.15.63:0/1387585648 shutdown_connections 2024-09-12T02:59:21.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7fc11be00640 1 -- 172.21.15.63:0/1387585648 >> 172.21.15.63:0/1387585648 conn(0x7fc114054470 msgr2=0x7fc114054880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd3e00640 1 -- 172.21.15.63:0/3945757105 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039170768 0 0) 0x7f6dd40c6970 con 0x7f6dd4071ca0 2024-09-12T02:59:21.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd3e00640 1 -- 172.21.15.63:0/3945757105 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dbc00bd40 con 0x7f6dd4071ca0 2024-09-12T02:59:21.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd8e00640 1 -- 172.21.15.63:0/3945757105 >> v2:172.21.15.119:3300/0 conn(0x7f6dd4152640 msgr2=0x7f6dd41590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:21.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd8e00640 1 --2- 172.21.15.63:0/3945757105 >> v2:172.21.15.119:3300/0 conn(0x7f6dd4152640 0x7f6dd41590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd8e00640 1 -- 172.21.15.63:0/3945757105 >> v1:172.21.15.119:6789/0 conn(0x7f6dd4071ca0 legacy=0x7f6dd40c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.640+0000 7f6dd8e00640 1 -- 172.21.15.63:0/3945757105 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd40c7830 con 0x7f6dd4071850 2024-09-12T02:59:21.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fc11be00640 1 -- 172.21.15.63:0/1387585648 shutdown_connections 2024-09-12T02:59:21.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17bf200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8046d50 0x7f17b80da480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17bf200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17b804dd30 0x7f17b80da9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fd6a0400640 1 Processor -- start 2024-09-12T02:59:21.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fc11be00640 1 -- 172.21.15.63:0/1387585648 wait complete. 2024-09-12T02:59:21.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17bde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8046d50 0x7f17b80da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17bde00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8046d50 0x7f17b80da480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36452/0 (socket says 172.21.15.63:36452) 2024-09-12T02:59:21.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17bde00640 1 -- 172.21.15.63:0/880382508 learned_addr learned my addr 172.21.15.63:0/880382508 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17bf200640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17b80d65e0 0x7f17b80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17bd400640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17b804dd30 0x7f17b80da9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f17b80e0950 con 0x7f17b8046d50 2024-09-12T02:59:21.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17be800640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17b80d65e0 0x7f17b80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f17b80dff80 con 0x7f17b80d65e0 2024-09-12T02:59:21.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fd6a0400640 1 -- start start 2024-09-12T02:59:21.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fc11be00640 1 Processor -- start 2024-09-12T02:59:21.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fd6a0400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69806d210 0x7fd69806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fd6a0400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980c34a0 0x7fd69813f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fd6a0400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd69813f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fd6a0400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd6980c7ef0 con 0x7fd69806d210 2024-09-12T02:59:21.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fd6a0400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd698157bf0 con 0x7fd6980c34a0 2024-09-12T02:59:21.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fd6a0400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fd6980cc5a0 con 0x7fd698151070 2024-09-12T02:59:21.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.644+0000 7fc11be00640 1 -- start start 2024-09-12T02:59:21.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f17b80dfc10 con 0x7f17b804dd30 2024-09-12T02:59:21.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69da00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69806d210 0x7fd69806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69da00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69806d210 0x7fd69806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36464/0 (socket says 172.21.15.63:36464) 2024-09-12T02:59:21.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69da00640 1 -- 172.21.15.63:0/1258325563 learned_addr learned my addr 172.21.15.63:0/1258325563 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69e400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd69813f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69d000640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980c34a0 0x7fd69813f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1000051d0 0x7fc1140da750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140de730 0x7fc1140db1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc114173600 0x7fc114173a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc1140e2b00 con 0x7fc114173600 2024-09-12T02:59:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11be00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc11400ec00 con 0x7fc1000051d0 2024-09-12T02:59:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11be00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc114049900 con 0x7fc1140de730 2024-09-12T02:59:21.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f6dd8e00640 1 --2- 172.21.15.63:0/3945757105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4071850 0x7f6dd40c8a00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40c82e0 tx=0x7f6dc001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6a04f7d531c028 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17bd400640 1 -- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17b80d65e0 msgr2=0x7f17b80cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17bd400640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17b80d65e0 0x7f17b80cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17bd400640 1 -- 172.21.15.63:0/880382508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8046d50 msgr2=0x7f17b80da480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17bd400640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8046d50 0x7f17b80da480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17bd400640 1 -- 172.21.15.63:0/880382508 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b80ceab0 con 0x7f17b804dd30 2024-09-12T02:59:21.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1000051d0 0x7fc1140da750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69e400640 1 -- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980c34a0 msgr2=0x7fd69813f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69e400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980c34a0 0x7fd69813f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69e400640 1 -- 172.21.15.63:0/1258325563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69806d210 msgr2=0x7fd69806bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69e400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69806d210 0x7fd69806bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69e400640 1 -- 172.21.15.63:0/1258325563 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6981f85c0 con 0x7fd698151070 2024-09-12T02:59:21.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1000051d0 0x7fc1140da750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38276/0 (socket says 172.21.15.63:38276) 2024-09-12T02:59:21.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11aa00640 1 -- 172.21.15.63:0/2879789985 learned_addr learned my addr 172.21.15.63:0/2879789985 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17bd400640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17b804dd30 0x7f17b80da9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c410 tx=0x7f17ac005790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd69e400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd69813f5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6900ae000 tx=0x7fd69001bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11b400640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc114173600 0x7fc114173a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f6dd3e00640 1 -- 172.21.15.63:0/3945757105 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00b0070 con 0x7f6dd4071850 2024-09-12T02:59:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17b6000640 1 -- 172.21.15.63:0/880382508 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac017070 con 0x7f17b804dd30 2024-09-12T02:59:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17b6000640 1 -- 172.21.15.63:0/880382508 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ac007520 con 0x7f17b804dd30 2024-09-12T02:59:21.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17b6000640 1 -- 172.21.15.63:0/880382508 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac005a60 con 0x7f17b804dd30 2024-09-12T02:59:21.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f6dd3e00640 1 -- 172.21.15.63:0/3945757105 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc000d0d0 con 0x7f6dd4071850 2024-09-12T02:59:21.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f6dd3e00640 1 -- 172.21.15.63:0/3945757105 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000b670 con 0x7f6dd4071850 2024-09-12T02:59:21.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b80ced50 con 0x7f17b804dd30 2024-09-12T02:59:21.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd695600640 1 -- 172.21.15.63:0/1258325563 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6900c0070 con 0x7fd698151070 2024-09-12T02:59:21.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd695600640 1 -- 172.21.15.63:0/1258325563 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6900afc80 con 0x7fd698151070 2024-09-12T02:59:21.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd695600640 1 -- 172.21.15.63:0/1258325563 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6900b4040 con 0x7fd698151070 2024-09-12T02:59:21.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6981f82f0 con 0x7fd698151070 2024-09-12T02:59:21.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69806c890 con 0x7fd698151070 2024-09-12T02:59:21.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f6ddc200640 1 -- 172.21.15.63:0/3945757105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4071850 msgr2=0x7f6dd40c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f6ddc200640 1 --2- 172.21.15.63:0/3945757105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4071850 0x7f6dd40c8a00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40c82e0 tx=0x7f6dc001c350 comp rx=0 tx=0).stop 2024-09-12T02:59:21.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7fc11a000640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140de730 0x7fc1140db1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc11aa00640 1 -- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140de730 msgr2=0x7fc1140db1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc11aa00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140de730 0x7fc1140db1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc11aa00640 1 -- 172.21.15.63:0/2879789985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc114173600 msgr2=0x7fc114173a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc11aa00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc114173600 0x7fc114173a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc11aa00640 1 -- 172.21.15.63:0/2879789985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1140dbac0 con 0x7fc1000051d0 2024-09-12T02:59:21.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd698156ca0 con 0x7fd698151070 2024-09-12T02:59:21.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.648+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b80516c0 con 0x7f17b804dd30 2024-09-12T02:59:21.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc11aa00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1000051d0 0x7fc1140da750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0114c0 tx=0x7fc10c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7f6ddc200640 1 -- 172.21.15.63:0/3945757105 shutdown_connections 2024-09-12T02:59:21.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7f6ddc200640 1 --2- 172.21.15.63:0/3945757105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4071850 0x7f6dd40c8a00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7f6ddc200640 1 --2- 172.21.15.63:0/3945757105 >> v2:172.21.15.119:3300/0 conn(0x7f6dd4152640 0x7f6dd41590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7f6ddc200640 1 -- 172.21.15.63:0/3945757105 >> 172.21.15.63:0/3945757105 conn(0x7f6dd406f3d0 msgr2=0x7f6dd406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7f6ddc200640 1 -- 172.21.15.63:0/3945757105 shutdown_connections 2024-09-12T02:59:21.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b8051d80 con 0x7f17b804dd30 2024-09-12T02:59:21.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc112a00640 1 -- 172.21.15.63:0/2879789985 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c015870 con 0x7fc1000051d0 2024-09-12T02:59:21.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc112a00640 1 -- 172.21.15.63:0/2879789985 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c015a10 con 0x7fc1000051d0 2024-09-12T02:59:21.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc112a00640 1 -- 172.21.15.63:0/2879789985 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c015e40 con 0x7fc1000051d0 2024-09-12T02:59:21.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc114176dc0 con 0x7fc1000051d0 2024-09-12T02:59:21.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc114177380 con 0x7fc1000051d0 2024-09-12T02:59:21.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7f6ddc200640 1 -- 172.21.15.63:0/3945757105 wait complete. 2024-09-12T02:59:21.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fd695600640 1 -- 172.21.15.63:0/1258325563 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6900dc660 con 0x7fd698151070 2024-09-12T02:59:21.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc114177a80 con 0x7fc1000051d0 2024-09-12T02:59:21.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7f6ddc200640 1 Processor -- start 2024-09-12T02:59:21.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6ddc200640 1 -- start start 2024-09-12T02:59:21.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.652+0000 7fd695600640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd6780678c0 0x7fd678069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7fd695600640 1 -- 172.21.15.63:0/1258325563 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fd690002020 con 0x7fd698151070 2024-09-12T02:59:21.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7fd69da00640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd6780678c0 0x7fd678069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6ddc200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd4071850 0x7f6dd414e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6ddc200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd4071ca0 0x7f6dd4158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6ddc200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4152640 0x7f6dd41569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6ddc200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd40c9650 con 0x7f6dd4152640 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6ddc200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4152a20 con 0x7f6dd4071ca0 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6ddc200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd40c97d0 con 0x7f6dd4071850 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dda200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4152640 0x7f6dd41569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dda200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4152640 0x7f6dd41569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36472/0 (socket says 172.21.15.63:36472) 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dda200640 1 -- 172.21.15.63:0/3301071922 learned_addr learned my addr 172.21.15.63:0/3301071922 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dd9800640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd4071850 0x7f6dd414e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dd8e00640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd4071ca0 0x7f6dd4158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7fd69da00640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd6780678c0 0x7fd678069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009600 tx=0x7fd68c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dd9800640 1 -- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd4071ca0 msgr2=0x7f6dd4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dd9800640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd4071ca0 0x7f6dd4158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dd9800640 1 -- 172.21.15.63:0/3301071922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4152640 msgr2=0x7f6dd41569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dd9800640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4152640 0x7f6dd41569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dd9800640 1 -- 172.21.15.63:0/3301071922 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd4156540 con 0x7f6dd4071850 2024-09-12T02:59:21.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7f6dd9800640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd4071850 0x7f6dd414e400 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e8a0 tx=0x7f6dc800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.656+0000 7fc112a00640 1 -- 172.21.15.63:0/2879789985 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc10c01d400 con 0x7fc1000051d0 2024-09-12T02:59:21.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.660+0000 7fc112a00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0fc067940 0x7fc0fc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.660+0000 7fc112a00640 1 -- 172.21.15.63:0/2879789985 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fc10c086c90 con 0x7fc1000051d0 2024-09-12T02:59:21.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.660+0000 7fc11a000640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0fc067940 0x7fc0fc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.660+0000 7fc11a000640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0fc067940 0x7fc0fc069e00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc114007190 tx=0x7fc108009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.668+0000 7fd695600640 1 -- 172.21.15.63:0/1258325563 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd690018d30 con 0x7fd698151070 2024-09-12T02:59:21.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.668+0000 7f6dd1600640 1 -- 172.21.15.63:0/3301071922 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8017070 con 0x7f6dd4071850 2024-09-12T02:59:21.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.668+0000 7f6dd1600640 1 -- 172.21.15.63:0/3301071922 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc800c940 con 0x7f6dd4071850 2024-09-12T02:59:21.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.668+0000 7f6dd1600640 1 -- 172.21.15.63:0/3301071922 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800ccf0 con 0x7f6dd4071850 2024-09-12T02:59:21.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.668+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd414c630 con 0x7f6dd4071850 2024-09-12T02:59:21.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.668+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd414cbf0 con 0x7f6dd4071850 2024-09-12T02:59:21.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.668+0000 7fc112a00640 1 -- 172.21.15.63:0/2879789985 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc114177a80 con 0x7fc1000051d0 2024-09-12T02:59:21.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.668+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd406e060 con 0x7f6dd4071850 2024-09-12T02:59:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.672+0000 7f17b6000640 1 -- 172.21.15.63:0/880382508 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17ac01a070 con 0x7f17b804dd30 2024-09-12T02:59:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.672+0000 7f17b6000640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f17a0067910 0x7f17a0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.672+0000 7f17b6000640 1 -- 172.21.15.63:0/880382508 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f17ac053d80 con 0x7f17b804dd30 2024-09-12T02:59:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.672+0000 7f17bde00640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f17a0067910 0x7f17a0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.672+0000 7f17bde00640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f17a0067910 0x7f17a0069dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.680+0000 7f17b6000640 1 -- 172.21.15.63:0/880382508 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f17ac055ce0 con 0x7f17b804dd30 2024-09-12T02:59:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.684+0000 7f6dd1600640 1 -- 172.21.15.63:0/3301071922 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6dc801a070 con 0x7f6dd4071850 2024-09-12T02:59:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.684+0000 7f6dd1600640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6db40678f0 0x7f6db4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.684+0000 7f6dd1600640 1 -- 172.21.15.63:0/3301071922 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f6dc8086620 con 0x7f6dd4071850 2024-09-12T02:59:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.692+0000 7f6dd8e00640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6db40678f0 0x7f6db4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.692+0000 7f6dd8e00640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6db40678f0 0x7f6db4069db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00ad000 tx=0x7f6dc00a6000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.696+0000 7f6dd1600640 1 -- 172.21.15.63:0/3301071922 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6dc8056700 con 0x7f6dd4071850 2024-09-12T02:59:21.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.904+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7884005860 con 0x7f7890004810 2024-09-12T02:59:21.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.904+0000 7f789b400640 1 -- 172.21.15.63:0/1592670310 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f789c055ed0 con 0x7f7890004810 2024-09-12T02:59:21.974 INFO:teuthology.orchestra.run.smithi063.stdout:64424509474 2024-09-12T02:59:21.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.908+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7888067ac0 msgr2=0x7f7888069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.908+0000 7f78aca00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7888067ac0 0x7f7888069f80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7894000c10 tx=0x7f78940011a0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.908+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 msgr2=0x7f78a00d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.908+0000 7f78aca00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f78a00d5160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f789c00f7e0 tx=0x7f789c00fca0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.912+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 shutdown_connections 2024-09-12T02:59:21.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.912+0000 7f78aca00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78a00d88d0 0x7f78a00485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.912+0000 7f78aca00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7888067ac0 0x7f7888069f80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.912+0000 7f78aca00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78a00d84a0 0x7f78a0048090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.912+0000 7f78aca00640 1 --2- 172.21.15.63:0/1592670310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7890004810 0x7f78a00d5160 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.912+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 >> 172.21.15.63:0/1592670310 conn(0x7f78a004fc60 msgr2=0x7f78a00e0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.912+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 shutdown_connections 2024-09-12T02:59:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.912+0000 7f78aca00640 1 -- 172.21.15.63:0/1592670310 wait complete. 2024-09-12T02:59:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.920+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2618005860 con 0x7f263404b360 2024-09-12T02:59:21.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.920+0000 7f262fe00640 1 -- 172.21.15.63:0/3364685028 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f263c0d65c0 con 0x7f263404b360 2024-09-12T02:59:21.977 INFO:teuthology.orchestra.run.smithi063.stdout:55834574881 2024-09-12T02:59:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.924+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f261c067990 msgr2=0x7f261c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.924+0000 7f2641400640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f261c067990 0x7f261c069e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f26280ad000 tx=0x7f26280a6000 comp rx=0 tx=0).stop 2024-09-12T02:59:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.924+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f263404b360 msgr2=0x7f26340d4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.924+0000 7f2641400640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f263404b360 0x7f26340d4e90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f263c02dd60 tx=0x7f263c069920 comp rx=0 tx=0).stop 2024-09-12T02:59:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 shutdown_connections 2024-09-12T02:59:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f2641400640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f26340dcd90 0x7f26340d53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f2641400640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f261c067990 0x7f261c069e50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f2641400640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f263404b360 0x7f26340d4e90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f2641400640 1 --2- 172.21.15.63:0/3364685028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2634044d50 0x7f263417c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 >> 172.21.15.63:0/3364685028 conn(0x7f263404fc60 msgr2=0x7f26340e64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 shutdown_connections 2024-09-12T02:59:21.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f2641400640 1 -- 172.21.15.63:0/3364685028 wait complete. 2024-09-12T02:59:21.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0e3c071d40 con 0x7f0e3c0c8210 2024-09-12T02:59:21.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.928+0000 7f0e39600640 1 -- 172.21.15.63:0/4126753593 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e280187d0 con 0x7f0e3c0c8210 2024-09-12T02:59:21.979 INFO:teuthology.orchestra.run.smithi063.stdout:64424509474 2024-09-12T02:59:21.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e1c067990 msgr2=0x7f0e1c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e1c067990 0x7f0e1c069e50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0e30000f70 tx=0x7f0e30007df0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e3c0c8210 msgr2=0x7f0e3c162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e3c0c8210 0x7f0e3c162450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009880 tx=0x7f0e2801ba10 comp rx=0 tx=0).stop 2024-09-12T02:59:21.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 shutdown_connections 2024-09-12T02:59:21.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0e1c067990 0x7f0e1c069e50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e3c157250 0x7f0e3c162990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e3c0c8210 0x7f0e3c162450 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 --2- 172.21.15.63:0/4126753593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e3c06fef0 0x7f0e3c1557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 >> 172.21.15.63:0/4126753593 conn(0x7f0e3c06f3d0 msgr2=0x7f0e3c14b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 shutdown_connections 2024-09-12T02:59:21.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.936+0000 7f0e44400640 1 -- 172.21.15.63:0/4126753593 wait complete. 2024-09-12T02:59:21.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509474 for osd.0 2024-09-12T02:59:21.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.960+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f07dc06e230 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.960+0000 7f07d2a00640 1 -- 172.21.15.63:0/2021560511 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f07c805a700 con 0x7f07dc0c6bd0 2024-09-12T02:59:21.983 INFO:teuthology.orchestra.run.smithi063.stdout:60129542178 2024-09-12T02:59:21.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07bc067ac0 msgr2=0x7f07bc069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07bc067ac0 0x7f07bc069f80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0c3340 tx=0x7f07d4009040 comp rx=0 tx=0).stop 2024-09-12T02:59:21.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc0c6bd0 msgr2=0x7f07dc14bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:21.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc0c6bd0 0x7f07dc14bb80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07c800e8a0 tx=0x7f07c800ed60 comp rx=0 tx=0).stop 2024-09-12T02:59:21.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 shutdown_connections 2024-09-12T02:59:21.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574881 for osd.1 2024-09-12T02:59:21.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07dc0c6fb0 0x7f07dc14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07dc0c6bd0 0x7f07dc14bb80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f07bc067ac0 0x7f07bc069f80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 --2- 172.21.15.63:0/2021560511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07dc06fcb0 0x7f07dc14db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:21.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 >> 172.21.15.63:0/2021560511 conn(0x7f07dc06d900 msgr2=0x7f07dc14f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:21.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 shutdown_connections 2024-09-12T02:59:21.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.964+0000 7f07e0a00640 1 -- 172.21.15.63:0/2021560511 wait complete. 2024-09-12T02:59:21.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509474 for osd.2 2024-09-12T02:59:21.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.7 2024-09-12T02:59:21.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f17b8048cd0 con 0x7f17b804dd30 2024-09-12T02:59:21.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6dd40c6970 con 0x7f6dd4071850 2024-09-12T02:59:21.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17b6000640 1 -- 172.21.15.63:0/880382508 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f17ac059fe0 con 0x7f17b804dd30 2024-09-12T02:59:21.999 INFO:teuthology.orchestra.run.smithi063.stdout:64424509472 2024-09-12T02:59:22.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6dd1600640 1 -- 172.21.15.63:0/3301071922 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6dc805aa00 con 0x7f6dd4071850 2024-09-12T02:59:22.000 INFO:teuthology.orchestra.run.smithi063.stdout:274877906948 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f17a0067910 msgr2=0x7f17a0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f17a0067910 0x7f17a0069dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f17b00097c0 tx=0x7f17b0008040 comp rx=0 tx=0).stop 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17b804dd30 msgr2=0x7f17b80da9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17b804dd30 0x7f17b80da9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c410 tx=0x7f17ac005790 comp rx=0 tx=0).stop 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 shutdown_connections 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17b80d65e0 0x7f17b80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f17a0067910 0x7f17a0069dd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f17b804dd30 0x7f17b80da9c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 --2- 172.21.15.63:0/880382508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17b8046d50 0x7f17b80da480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 >> 172.21.15.63:0/880382508 conn(0x7f17b80099b0 msgr2=0x7f17b8008a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:22.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6db40678f0 msgr2=0x7f6db4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:22.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6db40678f0 0x7f6db4069db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00ad000 tx=0x7f6dc00a6000 comp rx=0 tx=0).stop 2024-09-12T02:59:22.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd4071850 msgr2=0x7f6dd414e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:22.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd4071850 0x7f6dd414e400 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800e8a0 tx=0x7f6dc800ed60 comp rx=0 tx=0).stop 2024-09-12T02:59:22.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 shutdown_connections 2024-09-12T02:59:22.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dd4152640 0x7f6dd41569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 shutdown_connections 2024-09-12T02:59:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f17bf200640 1 -- 172.21.15.63:0/880382508 wait complete. 2024-09-12T02:59:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd4071ca0 0x7f6dd4158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6db40678f0 0x7f6db4069db0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 --2- 172.21.15.63:0/3301071922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd4071850 0x7f6dd414e400 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:21.996+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 >> 172.21.15.63:0/3301071922 conn(0x7f6dd406f3d0 msgr2=0x7f6dd40cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:22.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.000+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 shutdown_connections 2024-09-12T02:59:22.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.000+0000 7f6ddc200640 1 -- 172.21.15.63:0/3301071922 wait complete. 2024-09-12T02:59:22.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.024+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd6980c7bd0 con 0x7fd698151070 2024-09-12T02:59:22.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.024+0000 7fd695600640 1 -- 172.21.15.63:0/1258325563 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd6900f3330 con 0x7fd698151070 2024-09-12T02:59:22.028 INFO:teuthology.orchestra.run.smithi063.stdout:60129542176 2024-09-12T02:59:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc114050280 con 0x7fc1000051d0 2024-09-12T02:59:22.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd6780678c0 msgr2=0x7fd678069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:22.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd6780678c0 0x7fd678069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009600 tx=0x7fd68c009190 comp rx=0 tx=0).stop 2024-09-12T02:59:22.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fc112a00640 1 -- 172.21.15.63:0/2879789985 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc10c019030 con 0x7fc1000051d0 2024-09-12T02:59:22.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 msgr2=0x7fd69813f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:22.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd69813f5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6900ae000 tx=0x7fd69001bf70 comp rx=0 tx=0).stop 2024-09-12T02:59:22.032 INFO:teuthology.orchestra.run.smithi063.stdout:60129542176 2024-09-12T02:59:22.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 shutdown_connections 2024-09-12T02:59:22.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd6780678c0 0x7fd678069d80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd698151070 0x7fd69813f5e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6980c34a0 0x7fd69813f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 --2- 172.21.15.63:0/1258325563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd69806d210 0x7fd69806bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 >> 172.21.15.63:0/1258325563 conn(0x7fd69806dcb0 msgr2=0x7fd6980cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:22.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 shutdown_connections 2024-09-12T02:59:22.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.028+0000 7fd6a0400640 1 -- 172.21.15.63:0/1258325563 wait complete. 2024-09-12T02:59:22.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906949 got 274877906948 for osd.5 2024-09-12T02:59:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0fc067940 msgr2=0x7fc0fc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0fc067940 0x7fc0fc069e00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc114007190 tx=0x7fc108009040 comp rx=0 tx=0).stop 2024-09-12T02:59:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1000051d0 msgr2=0x7fc1140da750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1000051d0 0x7fc1140da750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0114c0 tx=0x7fc10c009f90 comp rx=0 tx=0).stop 2024-09-12T02:59:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 shutdown_connections 2024-09-12T02:59:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc114173600 0x7fc114173a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc0fc067940 0x7fc0fc069e00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1140de730 0x7fc1140db1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 --2- 172.21.15.63:0/2879789985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1000051d0 0x7fc1140da750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:22.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 >> 172.21.15.63:0/2879789985 conn(0x7fc114054470 msgr2=0x7fc11404f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:22.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 shutdown_connections 2024-09-12T02:59:22.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:22.032+0000 7fc11be00640 1 -- 172.21.15.63:0/2879789985 wait complete. 2024-09-12T02:59:22.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509473 got 64424509472 for osd.3 2024-09-12T02:59:22.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.6 2024-09-12T02:59:22.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.4 2024-09-12T02:59:22.983 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T02:59:22.984 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T02:59:22.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T02:59:22.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T02:59:23.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T02:59:23.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T02:59:23.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T02:59:23.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T02:59:23.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.160+0000 7fc863000640 1 Processor -- start 2024-09-12T02:59:23.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.164+0000 7fc863000640 1 -- start start 2024-09-12T02:59:23.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.164+0000 7fc863000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc85c0c6bd0 0x7fc85c073f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.164+0000 7fc863000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85c15e6f0 con 0x7fc85c06fcb0 2024-09-12T02:59:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.164+0000 7fc863000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85c15e990 con 0x7fc85c15b440 2024-09-12T02:59:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.164+0000 7fc863000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fc85c15ec70 con 0x7fc85c0c6bd0 2024-09-12T02:59:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.164+0000 7fc861c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc85c0c6bd0 0x7fc85c073f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.168+0000 7fc861200640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc85c15b440 0x7fc85c0c0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:51940/0 (socket says 172.21.15.63:51940) 2024-09-12T02:59:23.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.168+0000 7fc861200640 1 -- 172.21.15.63:0/1944083054 learned_addr learned my addr 172.21.15.63:0/1944083054 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:23.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.168+0000 7fc861c00640 1 -- 172.21.15.63:0/1944083054 >> v1:172.21.15.119:6789/0 conn(0x7fc85c15b440 legacy=0x7fc85c0c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.168+0000 7fc861c00640 1 -- 172.21.15.63:0/1944083054 >> v1:172.21.15.63:6789/0 conn(0x7fc85c06fcb0 legacy=0x7fc85c0c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.168+0000 7fc861c00640 1 -- 172.21.15.63:0/1944083054 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c15a960 con 0x7fc85c0c6bd0 2024-09-12T02:59:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc861c00640 1 --2- 172.21.15.63:0/1944083054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c0c6bd0 0x7fc85c073f10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc8500097c0 tx=0x7fc85001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713b6bbf23519e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc85be00640 1 -- 172.21.15.63:0/1944083054 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8500b5070 con 0x7fc85c0c6bd0 2024-09-12T02:59:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc85be00640 1 -- 172.21.15.63:0/1944083054 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8500a8990 con 0x7fc85c0c6bd0 2024-09-12T02:59:23.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc85be00640 1 -- 172.21.15.63:0/1944083054 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8500a8d60 con 0x7fc85c0c6bd0 2024-09-12T02:59:23.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc863000640 1 -- 172.21.15.63:0/1944083054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c0c6bd0 msgr2=0x7fc85c073f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc863000640 1 --2- 172.21.15.63:0/1944083054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c0c6bd0 0x7fc85c073f10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc8500097c0 tx=0x7fc85001ecb0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc863000640 1 -- 172.21.15.63:0/1944083054 shutdown_connections 2024-09-12T02:59:23.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc863000640 1 --2- 172.21.15.63:0/1944083054 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c0c6bd0 0x7fc85c073f10 secure :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc8500097c0 tx=0x7fc85001ecb0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc863000640 1 -- 172.21.15.63:0/1944083054 >> 172.21.15.63:0/1944083054 conn(0x7fc85c06d900 msgr2=0x7fc85c06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7fc863000640 1 -- 172.21.15.63:0/1944083054 shutdown_connections 2024-09-12T02:59:23.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7f3dafe00640 1 Processor -- start 2024-09-12T02:59:23.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.180+0000 7f3dafe00640 1 -- start start 2024-09-12T02:59:23.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7fc863000640 1 -- 172.21.15.63:0/1944083054 wait complete. 2024-09-12T02:59:23.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7f3dafe00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3db0071b10 0x7f3db00c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7f3dafe00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db006cae0 con 0x7f3db006fcb0 2024-09-12T02:59:23.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7f3dafe00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db0073f20 con 0x7f3db00c1fd0 2024-09-12T02:59:23.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7f3dafe00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f3db0073cd0 con 0x7f3db0071b10 2024-09-12T02:59:23.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7fc863000640 1 Processor -- start 2024-09-12T02:59:23.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7f3dae000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3db0071b10 0x7f3db00c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7f3daf400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3db006fcb0 0x7f3db006c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37642/0 (socket says 172.21.15.63:37642) 2024-09-12T02:59:23.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7f3daf400640 1 -- 172.21.15.63:0/313706110 learned_addr learned my addr 172.21.15.63:0/313706110 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:23.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7fc863000640 1 -- start start 2024-09-12T02:59:23.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.184+0000 7f3dad600640 1 -- 172.21.15.63:0/313706110 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997282239 0 0) 0x7f3db006cae0 con 0x7f3db006fcb0 2024-09-12T02:59:23.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7f3dad600640 1 -- 172.21.15.63:0/313706110 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d94003530 con 0x7f3db006fcb0 2024-09-12T02:59:23.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7f3dae000640 1 -- 172.21.15.63:0/313706110 >> v1:172.21.15.119:6789/0 conn(0x7f3db00c1fd0 legacy=0x7f3db006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc863000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c06fcb0 0x7fc85c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc863000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85c15b440 0x7fc85c1e5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7f3dae000640 1 -- 172.21.15.63:0/313706110 >> v1:172.21.15.63:6789/0 conn(0x7f3db006fcb0 legacy=0x7f3db006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7f3dae000640 1 -- 172.21.15.63:0/313706110 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db0167410 con 0x7f3db0071b10 2024-09-12T02:59:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc863000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85c1e3d90 0x7fc85c0c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc863000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c0c18d0 con 0x7fc85c06fcb0 2024-09-12T02:59:23.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc861200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85c15b440 0x7fc85c1e5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc863000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c0c76c0 con 0x7fc85c15b440 2024-09-12T02:59:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc863000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc85c0c1a50 con 0x7fc85c1e3d90 2024-09-12T02:59:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc861200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85c15b440 0x7fc85c1e5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:38296/0 (socket says 172.21.15.63:38296) 2024-09-12T02:59:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc861200640 1 -- 172.21.15.63:0/2270951823 learned_addr learned my addr 172.21.15.63:0/2270951823 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc862600640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85c1e3d90 0x7fc85c0c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc861200640 1 -- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85c1e3d90 msgr2=0x7fc85c0c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc861200640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85c1e3d90 0x7fc85c0c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc861200640 1 -- 172.21.15.63:0/2270951823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c06fcb0 msgr2=0x7fc85c0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc861200640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c06fcb0 0x7fc85c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc861200640 1 -- 172.21.15.63:0/2270951823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c0b0e30 con 0x7fc85c15b440 2024-09-12T02:59:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.188+0000 7fc861200640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85c15b440 0x7fc85c1e5170 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc848001a30 tx=0x7fc848014050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.192+0000 7fc859600640 1 -- 172.21.15.63:0/2270951823 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848005af0 con 0x7fc85c15b440 2024-09-12T02:59:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.192+0000 7fc859600640 1 -- 172.21.15.63:0/2270951823 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc848005c90 con 0x7fc85c15b440 2024-09-12T02:59:23.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.192+0000 7fc859600640 1 -- 172.21.15.63:0/2270951823 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848014aa0 con 0x7fc85c15b440 2024-09-12T02:59:23.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.192+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c1f0300 con 0x7fc85c15b440 2024-09-12T02:59:23.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.192+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c1f08a0 con 0x7fc85c15b440 2024-09-12T02:59:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.196+0000 7f3dae000640 1 --2- 172.21.15.63:0/313706110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 0x7f3db00c7200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3db0073e50 tx=0x7f3da001fda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8604a1809bfdc5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.192+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85c1f1280 con 0x7fc85c15b440 2024-09-12T02:59:23.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.196+0000 7fc859600640 1 -- 172.21.15.63:0/2270951823 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc848014c40 con 0x7fc85c15b440 2024-09-12T02:59:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.196+0000 7fc859600640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc83c067910 0x7fc83c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.196+0000 7fc859600640 1 -- 172.21.15.63:0/2270951823 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fc84808e090 con 0x7fc85c15b440 2024-09-12T02:59:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.196+0000 7fc861c00640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc83c067910 0x7fc83c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.200+0000 7fc861c00640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc83c067910 0x7fc83c069dd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc8500b2000 tx=0x7fc850004740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7fc859600640 1 -- 172.21.15.63:0/2270951823 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc85c1f1280 con 0x7fc85c15b440 2024-09-12T02:59:23.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dad600640 1 -- 172.21.15.63:0/313706110 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da00b6070 con 0x7f3db0071b10 2024-09-12T02:59:23.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dad600640 1 -- 172.21.15.63:0/313706110 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da00a9aa0 con 0x7f3db0071b10 2024-09-12T02:59:23.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dad600640 1 -- 172.21.15.63:0/313706110 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da00b1440 con 0x7f3db0071b10 2024-09-12T02:59:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dafe00640 1 -- 172.21.15.63:0/313706110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 msgr2=0x7f3db00c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dafe00640 1 --2- 172.21.15.63:0/313706110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 0x7f3db00c7200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3db0073e50 tx=0x7f3da001fda0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dafe00640 1 -- 172.21.15.63:0/313706110 shutdown_connections 2024-09-12T02:59:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dafe00640 1 --2- 172.21.15.63:0/313706110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 0x7f3db00c7200 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dafe00640 1 -- 172.21.15.63:0/313706110 >> 172.21.15.63:0/313706110 conn(0x7f3db006d900 msgr2=0x7f3db006f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dafe00640 1 -- 172.21.15.63:0/313706110 shutdown_connections 2024-09-12T02:59:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.208+0000 7f3dafe00640 1 -- 172.21.15.63:0/313706110 wait complete. 2024-09-12T02:59:23.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3dafe00640 1 Processor -- start 2024-09-12T02:59:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3dafe00640 1 -- start start 2024-09-12T02:59:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3dafe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3db006fcb0 0x7f3db020eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3dafe00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 0x7f3db00c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3dafe00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3db00c1fd0 0x7f3db0168bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3dafe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3db00c2e70 con 0x7f3db006fcb0 2024-09-12T02:59:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3dafe00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0074200 con 0x7f3db0071b10 2024-09-12T02:59:23.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3dafe00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f3db00c2ff0 con 0x7f3db00c1fd0 2024-09-12T02:59:23.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3daf400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3db00c1fd0 0x7f3db0168bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3daf400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3db00c1fd0 0x7f3db0168bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:35658/0 (socket says 172.21.15.63:35658) 2024-09-12T02:59:23.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.216+0000 7f3daf400640 1 -- 172.21.15.63:0/110060340 learned_addr learned my addr 172.21.15.63:0/110060340 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3dae000640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 0x7f3db00c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3daf400640 1 -- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 msgr2=0x7f3db00c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3daea00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3db006fcb0 0x7f3db020eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3daf400640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 0x7f3db00c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3daf400640 1 -- 172.21.15.63:0/110060340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3db006fcb0 msgr2=0x7f3db020eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3daf400640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3db006fcb0 0x7f3db020eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3daf400640 1 -- 172.21.15.63:0/110060340 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db01f3950 con 0x7f3db00c1fd0 2024-09-12T02:59:23.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3dae000640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 0x7f3db00c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:23.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3daea00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3db006fcb0 0x7f3db020eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:23.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3daf400640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3db00c1fd0 0x7f3db0168bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00c430 tx=0x7f3d9c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3da7400640 1 -- 172.21.15.63:0/110060340 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c017070 con 0x7f3db00c1fd0 2024-09-12T02:59:23.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3da7400640 1 -- 172.21.15.63:0/110060340 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c005cf0 con 0x7f3db00c1fd0 2024-09-12T02:59:23.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db020f0b0 con 0x7f3db00c1fd0 2024-09-12T02:59:23.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3da7400640 1 -- 172.21.15.63:0/110060340 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0072f0 con 0x7f3db00c1fd0 2024-09-12T02:59:23.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.220+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db016a1b0 con 0x7f3db00c1fd0 2024-09-12T02:59:23.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.224+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db0167ef0 con 0x7f3db00c1fd0 2024-09-12T02:59:23.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.224+0000 7f3da7400640 1 -- 172.21.15.63:0/110060340 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d9c01a070 con 0x7f3db00c1fd0 2024-09-12T02:59:23.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.228+0000 7f3da7400640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d900678c0 0x7f3d90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.228+0000 7f3da7400640 1 -- 172.21.15.63:0/110060340 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f3d9c085860 con 0x7f3db00c1fd0 2024-09-12T02:59:23.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.228+0000 7f3daea00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d900678c0 0x7f3d90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.228+0000 7f3daea00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d900678c0 0x7f3d90069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3da8007fd0 tx=0x7f3da8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.236+0000 7f3da7400640 1 -- 172.21.15.63:0/110060340 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d9c021020 con 0x7f3db00c1fd0 2024-09-12T02:59:23.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.252+0000 7f330c800640 1 Processor -- start 2024-09-12T02:59:23.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.252+0000 7f330c800640 1 -- start start 2024-09-12T02:59:23.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.252+0000 7f330c800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3304159220 0x7f33040ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.252+0000 7f330c800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 0x7f33040ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f7bc3e00640 1 Processor -- start 2024-09-12T02:59:23.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f3309e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3304158e40 0x7f330415f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57546/0 (socket says 172.21.15.63:57546) 2024-09-12T02:59:23.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f7bc3e00640 1 -- start start 2024-09-12T02:59:23.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f330a800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 0x7f33040ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f330a800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 0x7f33040ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:51786/0 (socket says 172.21.15.63:51786) 2024-09-12T02:59:23.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f3309400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3304159220 0x7f33040ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f3309400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3304159220 0x7f33040ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42232/0 (socket says 172.21.15.63:42232) 2024-09-12T02:59:23.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f3309e00640 1 -- 172.21.15.63:0/264582070 learned_addr learned my addr 172.21.15.63:0/264582070 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:23.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f7bc3e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7bbc06fef0 0x7f7bbc14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f7bc3e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bbc0c8210 0x7f7bbc0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f7bc3e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bbc0c1d00 con 0x7f7bbc0c6970 2024-09-12T02:59:23.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f330c800640 1 -- 172.21.15.63:0/264582070 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33040c5310 con 0x7f3304158e40 2024-09-12T02:59:23.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f7bc1e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7bbc0c6970 0x7f7bbc156d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57556/0 (socket says 172.21.15.63:57556) 2024-09-12T02:59:23.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.256+0000 7f7bc1e00640 1 -- 172.21.15.63:0/1548528312 learned_addr learned my addr 172.21.15.63:0/1548528312 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:23.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721193176 0 0) 0x7f33040c5310 con 0x7f3304158e40 2024-09-12T02:59:23.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f330c800640 1 -- 172.21.15.63:0/264582070 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f3304070560 con 0x7f3304159220 2024-09-12T02:59:23.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bc1400640 1 --2- 172.21.15.63:0/1548528312 >> v2:172.21.15.63:3300/0 conn(0x7f7bbc06fef0 0x7f7bbc14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931228116 0 0) 0x7f7bbc0c1d00 con 0x7f7bbc0c6970 2024-09-12T02:59:23.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f330c800640 1 -- 172.21.15.63:0/264582070 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f330406edf0 con 0x7f33040c3170 2024-09-12T02:59:23.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bc3e00640 1 -- 172.21.15.63:0/1548528312 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7bbc0c1fe0 con 0x7f7bbc06fef0 2024-09-12T02:59:23.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bc3e00640 1 -- 172.21.15.63:0/1548528312 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7bbc0c22c0 con 0x7f7bbc0c8210 2024-09-12T02:59:23.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32ec003530 con 0x7f3304158e40 2024-09-12T02:59:23.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bc0a00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bbc0c8210 0x7f7bbc0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2442359679 0 0) 0x7f32ec003530 con 0x7f3304158e40 2024-09-12T02:59:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 msgr2=0x7f33040ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 0x7f33040ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 >> v2:172.21.15.63:3300/0 conn(0x7f3304159220 msgr2=0x7f33040ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 --2- 172.21.15.63:0/264582070 >> v2:172.21.15.63:3300/0 conn(0x7f3304159220 0x7f33040ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330406ffa0 con 0x7f3304158e40 2024-09-12T02:59:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f32f8001680 con 0x7f3304158e40 2024-09-12T02:59:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 >> v1:172.21.15.63:6789/0 conn(0x7f3304158e40 legacy=0x7f330415f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec0039c0 0x7f32ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 0x7f32ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32ec004d50 0x7f32ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f330406edf0 con 0x7f32ec0039c0 2024-09-12T02:59:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec00bb10 con 0x7f32ec004d50 2024-09-12T02:59:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec00bd10 con 0x7f33040c3170 2024-09-12T02:59:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3309e00640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec0039c0 0x7f32ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3309400640 1 --2- 172.21.15.63:0/264582070 >> v2:172.21.15.63:3300/0 conn(0x7f3304159220 0x7f33040ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:23.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ba0003530 con 0x7f7bbc0c6970 2024-09-12T02:59:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f3309400640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 0x7f32ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2077375964 0 0) 0x7f7ba0003530 con 0x7f7bbc0c6970 2024-09-12T02:59:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bbc0c8210 msgr2=0x7f7bbc0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7bbc0c8210 0x7f7bbc0c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 >> v2:172.21.15.63:3300/0 conn(0x7f7bbc06fef0 msgr2=0x7f7bbc14d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 --2- 172.21.15.63:0/1548528312 >> v2:172.21.15.63:3300/0 conn(0x7f7bbc06fef0 0x7f7bbc14d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc0c25a0 con 0x7f7bbc0c6970 2024-09-12T02:59:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f7ba8001680 con 0x7f7bbc0c6970 2024-09-12T02:59:23.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 >> v1:172.21.15.63:6789/0 conn(0x7f7bbc0c6970 legacy=0x7f7bbc156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba00039c0 0x7f7ba0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ba00043b0 0x7f7ba0004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba0004f00 0x7f7ba000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc0c1fe0 con 0x7f7ba00043b0 2024-09-12T02:59:23.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc0c22c0 con 0x7f7ba0004f00 2024-09-12T02:59:23.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba000bf10 con 0x7f7ba00039c0 2024-09-12T02:59:23.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f330a800640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32ec004d50 0x7f32ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bc1400640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba00039c0 0x7f7ba0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f7bc1e00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba0004f00 0x7f7ba000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f330a800640 1 -- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 msgr2=0x7f32ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f330a800640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 0x7f32ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.260+0000 7f330a800640 1 -- 172.21.15.63:0/264582070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec0039c0 msgr2=0x7f32ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.264+0000 7f7bc1e00640 1 -- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba00039c0 msgr2=0x7f7ba0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.264+0000 7f7bc1e00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba00039c0 0x7f7ba0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.264+0000 7f7bc1e00640 1 -- 172.21.15.63:0/1548528312 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ba00043b0 msgr2=0x7f7ba0004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.264+0000 7f7bc1e00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ba00043b0 0x7f7ba0004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.264+0000 7f7bc1e00640 1 -- 172.21.15.63:0/1548528312 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc0c25a0 con 0x7f7ba0004f00 2024-09-12T02:59:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.264+0000 7f330a800640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec0039c0 0x7f32ec003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.264+0000 7f330a800640 1 -- 172.21.15.63:0/264582070 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec003530 con 0x7f32ec004d50 2024-09-12T02:59:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.264+0000 7f3309400640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33040c3170 0x7f32ec004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f330a800640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32ec004d50 0x7f32ec0051d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32f400ba10 tx=0x7f32f401c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f68021c4d25939b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f40ae070 con 0x7f32ec004d50 2024-09-12T02:59:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f7bc1e00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba0004f00 0x7f7ba000b9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c340 tx=0x7f7ba801cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c631066fe07a4683 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f40a9660 con 0x7f32ec004d50 2024-09-12T02:59:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f3308a00640 1 -- 172.21.15.63:0/264582070 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f400b610 con 0x7f32ec004d50 2024-09-12T02:59:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8007d80 con 0x7f7ba0004f00 2024-09-12T02:59:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba80a9020 con 0x7f7ba0004f00 2024-09-12T02:59:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f7bc3e00640 1 -- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba0004f00 msgr2=0x7f7ba000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f330c800640 1 -- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32ec004d50 msgr2=0x7f32ec0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f330c800640 1 --2- 172.21.15.63:0/264582070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32ec004d50 0x7f32ec0051d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32f400ba10 tx=0x7f32f401c680 comp rx=0 tx=0).stop 2024-09-12T02:59:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.268+0000 7f330a800640 1 -- 172.21.15.63:0/264582070 reap_dead start 2024-09-12T02:59:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f7bbbe00640 1 -- 172.21.15.63:0/1548528312 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8007d80 con 0x7f7ba0004f00 2024-09-12T02:59:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f7bc3e00640 1 --2- 172.21.15.63:0/1548528312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ba0004f00 0x7f7ba000b9d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c340 tx=0x7f7ba801cd60 comp rx=0 tx=0).stop 2024-09-12T02:59:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f7bc1e00640 1 -- 172.21.15.63:0/1548528312 reap_dead start 2024-09-12T02:59:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f7bc3e00640 1 -- 172.21.15.63:0/1548528312 shutdown_connections 2024-09-12T02:59:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f7bc3e00640 1 -- 172.21.15.63:0/1548528312 >> 172.21.15.63:0/1548528312 conn(0x7f7bbc06f3d0 msgr2=0x7f7bbc06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f330c800640 1 -- 172.21.15.63:0/264582070 shutdown_connections 2024-09-12T02:59:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f330c800640 1 -- 172.21.15.63:0/264582070 >> 172.21.15.63:0/264582070 conn(0x7f3304067a00 msgr2=0x7f3304067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f7bc3e00640 1 -- 172.21.15.63:0/1548528312 shutdown_connections 2024-09-12T02:59:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f7bc3e00640 1 -- 172.21.15.63:0/1548528312 wait complete. 2024-09-12T02:59:23.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f330c800640 1 -- 172.21.15.63:0/264582070 shutdown_connections 2024-09-12T02:59:23.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f330c800640 1 -- 172.21.15.63:0/264582070 wait complete. 2024-09-12T02:59:23.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f7bc3e00640 1 Processor -- start 2024-09-12T02:59:23.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f7bc3e00640 1 -- start start 2024-09-12T02:59:23.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f330c800640 1 Processor -- start 2024-09-12T02:59:23.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.272+0000 7f330c800640 1 -- start start 2024-09-12T02:59:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f330c800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec004d50 0x7f33040c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f330c800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f330415b010 0x7f3304151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f330c800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3304159610 0x7f3304159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f330c800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f330415f190 con 0x7f32ec004d50 2024-09-12T02:59:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f330c800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f330415eeb0 con 0x7f330415b010 2024-09-12T02:59:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f330c800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f330406f110 con 0x7f3304159610 2024-09-12T02:59:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f3309e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec004d50 0x7f33040c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc3e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba0004f00 0x7f7bbc158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bbc14c450 0x7f7bbc201ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bbc149cc0 0x7f7bbc201080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc3e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc1575a0 con 0x7f7bbc14c450 2024-09-12T02:59:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc3e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc157420 con 0x7f7bbc149cc0 2024-09-12T02:59:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc3e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7bbc1569d0 con 0x7f7ba0004f00 2024-09-12T02:59:23.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f3309e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec004d50 0x7f33040c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42272/0 (socket says 172.21.15.63:42272) 2024-09-12T02:59:23.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f3309e00640 1 -- 172.21.15.63:0/3732687777 learned_addr learned my addr 172.21.15.63:0/3732687777 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bbc149cc0 0x7f7bbc201080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc1e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bbc149cc0 0x7f7bbc201080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:34716/0 (socket says 172.21.15.63:34716) 2024-09-12T02:59:23.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc1e00640 1 -- 172.21.15.63:0/3966962985 learned_addr learned my addr 172.21.15.63:0/3966962985 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc0a00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bbc14c450 0x7f7bbc201ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f3309400640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f330415b010 0x7f3304151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f330a800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3304159610 0x7f3304159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc1e00640 1 -- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba0004f00 msgr2=0x7f7bbc158950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:59:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc1e00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba0004f00 0x7f7bbc158950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc1e00640 1 -- 172.21.15.63:0/3966962985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bbc14c450 msgr2=0x7f7bbc201ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc1e00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bbc14c450 0x7f7bbc201ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.276+0000 7f7bc1e00640 1 -- 172.21.15.63:0/3966962985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc14c940 con 0x7f7bbc149cc0 2024-09-12T02:59:23.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f330a800640 1 -- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f330415b010 msgr2=0x7f3304151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f7bc0a00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bbc14c450 0x7f7bbc201ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f330a800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f330415b010 0x7f3304151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f330a800640 1 -- 172.21.15.63:0/3732687777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec004d50 msgr2=0x7f33040c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f330a800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec004d50 0x7f33040c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f330a800640 1 -- 172.21.15.63:0/3732687777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3304205cc0 con 0x7f3304159610 2024-09-12T02:59:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f3309400640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f330415b010 0x7f3304151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f330a800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3304159610 0x7f3304159a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ad000 tx=0x7f32ec005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f7bc1e00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bbc149cc0 0x7f7bbc201080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c340 tx=0x7f7ba0005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f32fe000640 1 -- 172.21.15.63:0/3732687777 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f40ae040 con 0x7f3304159610 2024-09-12T02:59:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f32fe000640 1 -- 172.21.15.63:0/3732687777 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f40b7070 con 0x7f3304159610 2024-09-12T02:59:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f32fe000640 1 -- 172.21.15.63:0/3732687777 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300007d00 con 0x7f3304159610 2024-09-12T02:59:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3304205f80 con 0x7f3304159610 2024-09-12T02:59:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3304152a60 con 0x7f3304159610 2024-09-12T02:59:23.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f7bb9600640 1 -- 172.21.15.63:0/3966962985 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8007d80 con 0x7f7bbc149cc0 2024-09-12T02:59:23.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bbc157be0 con 0x7f7bbc149cc0 2024-09-12T02:59:23.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bbc14a600 con 0x7f7bbc149cc0 2024-09-12T02:59:23.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f7bb9600640 1 -- 172.21.15.63:0/3966962985 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba80b3070 con 0x7f7bbc149cc0 2024-09-12T02:59:23.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f7bb9600640 1 -- 172.21.15.63:0/3966962985 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8007d80 con 0x7f7bbc149cc0 2024-09-12T02:59:23.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b940052a0 con 0x7f7bbc149cc0 2024-09-12T02:59:23.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.280+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3304152ca0 con 0x7f3304159610 2024-09-12T02:59:23.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.284+0000 7f7bb9600640 1 -- 172.21.15.63:0/3966962985 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ba80049f0 con 0x7f7bbc149cc0 2024-09-12T02:59:23.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.284+0000 7f32fe000640 1 -- 172.21.15.63:0/3732687777 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32f40b1070 con 0x7f3304159610 2024-09-12T02:59:23.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.288+0000 7f32fe000640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32e80678c0 0x7f32e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.284+0000 7f7bb9600640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b9c067cc0 0x7f7b9c06a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.288+0000 7f7bb9600640 1 -- 172.21.15.63:0/3966962985 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f7ba80047f0 con 0x7f7bbc149cc0 2024-09-12T02:59:23.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.288+0000 7f32fe000640 1 -- 172.21.15.63:0/3732687777 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f32f4120230 con 0x7f3304159610 2024-09-12T02:59:23.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.288+0000 7f7bc1400640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b9c067cc0 0x7f7b9c06a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.288+0000 7f3309e00640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32e80678c0 0x7f32e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.288+0000 7f7bc1400640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b9c067cc0 0x7f7b9c06a180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009fc0 tx=0x7f7bb400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.288+0000 7f3309e00640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32e80678c0 0x7f32e8069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c10 tx=0x7f32f800a8e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.296+0000 7f7bb9600640 1 -- 172.21.15.63:0/3966962985 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ba8016a70 con 0x7f7bbc149cc0 2024-09-12T02:59:23.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.296+0000 7f32fe000640 1 -- 172.21.15.63:0/3732687777 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3304152ca0 con 0x7f3304159610 2024-09-12T02:59:23.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.328+0000 7fa18e000640 1 Processor -- start 2024-09-12T02:59:23.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.328+0000 7fa18e000640 1 -- start start 2024-09-12T02:59:23.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.328+0000 7fa18e000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1880c3690 0x7fa18815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.328+0000 7fa18e000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1880c8730 con 0x7fa188070420 2024-09-12T02:59:23.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.328+0000 7fa18e000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1880c8a10 con 0x7fa188067a00 2024-09-12T02:59:23.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.328+0000 7fa18e000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa188070990 con 0x7fa1880c3690 2024-09-12T02:59:23.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.328+0000 7fa18cc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1880c3690 0x7fa18815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.328+0000 7fa187e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa188070420 0x7fa18806cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57560/0 (socket says 172.21.15.63:57560) 2024-09-12T02:59:23.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.328+0000 7fa187e00640 1 -- 172.21.15.63:0/3343675152 learned_addr learned my addr 172.21.15.63:0/3343675152 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:23.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.332+0000 7fa18cc00640 1 -- 172.21.15.63:0/3343675152 >> v1:172.21.15.119:6789/0 conn(0x7fa188067a00 legacy=0x7fa1880c7ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T02:59:23.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.332+0000 7fa187400640 1 -- 172.21.15.63:0/3343675152 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842094356 0 0) 0x7fa1880c8730 con 0x7fa188070420 2024-09-12T02:59:23.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.332+0000 7fa18cc00640 1 -- 172.21.15.63:0/3343675152 >> v1:172.21.15.63:6789/0 conn(0x7fa188070420 legacy=0x7fa18806cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.332+0000 7fa18cc00640 1 -- 172.21.15.63:0/3343675152 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1880c72e0 con 0x7fa1880c3690 2024-09-12T02:59:23.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96ab000640 1 Processor -- start 2024-09-12T02:59:23.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f3200640 1 Processor -- start 2024-09-12T02:59:23.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa18cc00640 1 --2- 172.21.15.63:0/3343675152 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1880c3690 0x7fa18815ac10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0097f0 tx=0x7fa17c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df5d11f7311c4da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f3200640 1 -- start start 2024-09-12T02:59:23.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa187400640 1 -- 172.21.15.63:0/3343675152 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b1070 con 0x7fa1880c3690 2024-09-12T02:59:23.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa187400640 1 -- 172.21.15.63:0/3343675152 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17c0ac440 con 0x7fa1880c3690 2024-09-12T02:59:23.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa187400640 1 -- 172.21.15.63:0/3343675152 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0ac810 con 0x7fa1880c3690 2024-09-12T02:59:23.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96ab000640 1 -- start start 2024-09-12T02:59:23.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa18e000640 1 -- 172.21.15.63:0/3343675152 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1880c3690 msgr2=0x7fa18815ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa18e000640 1 --2- 172.21.15.63:0/3343675152 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1880c3690 0x7fa18815ac10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0097f0 tx=0x7fa17c01c410 comp rx=0 tx=0).stop 2024-09-12T02:59:23.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f3200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f87f415f740 0x7f87f4160260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f3200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f415fb20 0x7f87f40cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f3200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f87f40c9230 0x7f87f40c7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f3200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f87f40cb1c0 con 0x7f87f415f740 2024-09-12T02:59:23.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f3200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f87f40c8b30 con 0x7f87f40c9230 2024-09-12T02:59:23.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f3200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f87f40ca4e0 con 0x7f87f415fb20 2024-09-12T02:59:23.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa18e000640 1 -- 172.21.15.63:0/3343675152 shutdown_connections 2024-09-12T02:59:23.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa18e000640 1 --2- 172.21.15.63:0/3343675152 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1880c3690 0x7fa18815ac10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa18e000640 1 -- 172.21.15.63:0/3343675152 >> 172.21.15.63:0/3343675152 conn(0x7fa18806f900 msgr2=0x7fa18806fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7fa18e000640 1 -- 172.21.15.63:0/3343675152 shutdown_connections 2024-09-12T02:59:23.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f2800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f87f40c9230 0x7f87f40c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f2800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f87f40c9230 0x7f87f40c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:34728/0 (socket says 172.21.15.63:34728) 2024-09-12T02:59:23.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f87f2800640 1 -- 172.21.15.63:0/3536768533 learned_addr learned my addr 172.21.15.63:0/3536768533 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f87f1e00640 1 --2- 172.21.15.63:0/3536768533 >> v2:172.21.15.63:3300/0 conn(0x7f87f415f740 0x7f87f4160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7fa18e000640 1 -- 172.21.15.63:0/3343675152 wait complete. 2024-09-12T02:59:23.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96ab000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f96a4158e20 0x7f96a406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96ab000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f96a4162fa0 0x7f96a406f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96ab000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a415fc40 con 0x7f96a40cd6b0 2024-09-12T02:59:23.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96ab000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f96a406bd60 con 0x7f96a4158e20 2024-09-12T02:59:23.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96ab000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f96a415f710 con 0x7f96a4162fa0 2024-09-12T02:59:23.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96a3400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f96a40cd6b0 0x7f96a4162890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:60742/0 (socket says 172.21.15.63:60742) 2024-09-12T02:59:23.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96a3400640 1 -- 172.21.15.63:0/4169785392 learned_addr learned my addr 172.21.15.63:0/4169785392 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:23.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.340+0000 7f96a9000640 1 --2- 172.21.15.63:0/4169785392 >> v2:172.21.15.119:3300/0 conn(0x7f96a4162fa0 0x7f96a406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f96a9000640 1 -- 172.21.15.63:0/4169785392 >> v2:172.21.15.63:3300/0 conn(0x7f96a4158e20 msgr2=0x7f96a406ead0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:59:23.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f96a9000640 1 --2- 172.21.15.63:0/4169785392 >> v2:172.21.15.63:3300/0 conn(0x7f96a4158e20 0x7f96a406ead0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f96a9000640 1 -- 172.21.15.63:0/4169785392 >> v1:172.21.15.119:6789/0 conn(0x7f96a40cd6b0 legacy=0x7f96a4162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f96a9000640 1 -- 172.21.15.63:0/4169785392 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a406bfb0 con 0x7f96a4162fa0 2024-09-12T02:59:23.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7fa18e000640 1 Processor -- start 2024-09-12T02:59:23.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7fa18e000640 1 -- start start 2024-09-12T02:59:23.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f87f2800640 1 -- 172.21.15.63:0/3536768533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f415fb20 msgr2=0x7f87f40cb650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T02:59:23.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f87f2800640 1 --2- 172.21.15.63:0/3536768533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f415fb20 0x7f87f40cb650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f87f2800640 1 -- 172.21.15.63:0/3536768533 >> v2:172.21.15.63:3300/0 conn(0x7f87f415f740 msgr2=0x7f87f4160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f87f2800640 1 --2- 172.21.15.63:0/3536768533 >> v2:172.21.15.63:3300/0 conn(0x7f87f415f740 0x7f87f4160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.344+0000 7f87f2800640 1 -- 172.21.15.63:0/3536768533 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f40c9720 con 0x7f87f40c9230 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18e000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa188067a00 0x7fa188149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18e000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa188070420 0x7fa188149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18e000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880c3690 0x7fa1880cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18e000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa1880c7650 con 0x7fa188070420 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18e000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa18815e680 con 0x7fa1880c3690 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18e000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fa18815e800 con 0x7fa188067a00 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18cc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa188067a00 0x7fa188149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18cc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa188067a00 0x7fa188149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:51846/0 (socket says 172.21.15.63:51846) 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18cc00640 1 -- 172.21.15.63:0/447550343 learned_addr learned my addr 172.21.15.63:0/447550343 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18d600640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880c3690 0x7fa1880cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa187e00640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa188070420 0x7fa188149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18cc00640 1 -- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880c3690 msgr2=0x7fa1880cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18cc00640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880c3690 0x7fa1880cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18cc00640 1 -- 172.21.15.63:0/447550343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa188070420 msgr2=0x7fa188149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18cc00640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa188070420 0x7fa188149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18cc00640 1 -- 172.21.15.63:0/447550343 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1881f6e00 con 0x7fa188067a00 2024-09-12T02:59:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7f87f2800640 1 --2- 172.21.15.63:0/3536768533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f40c9230 0x7f87f40c7610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f87f4162290 tx=0x7f87ec01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b5458990fb844e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa187e00640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa188070420 0x7fa188149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:23.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7f96a9000640 1 --2- 172.21.15.63:0/4169785392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a4162fa0 0x7f96a406f010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f96a40c4f80 tx=0x7f969c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e9783185fe3dccd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18cc00640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa188067a00 0x7fa188149770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009740 tx=0x7fa17c0191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7f96a2a00640 1 -- 172.21.15.63:0/4169785392 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b2070 con 0x7f96a4162fa0 2024-09-12T02:59:23.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa184c00640 1 -- 172.21.15.63:0/447550343 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b1040 con 0x7fa188067a00 2024-09-12T02:59:23.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7f96a2a00640 1 -- 172.21.15.63:0/4169785392 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c0a5810 con 0x7f96a4162fa0 2024-09-12T02:59:23.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7f96a2a00640 1 -- 172.21.15.63:0/4169785392 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b2070 con 0x7f96a4162fa0 2024-09-12T02:59:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1881f70e0 con 0x7fa188067a00 2024-09-12T02:59:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.348+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1881f76a0 con 0x7fa188067a00 2024-09-12T02:59:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f0a00640 1 -- 172.21.15.63:0/3536768533 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0a5600 con 0x7f87f40c9230 2024-09-12T02:59:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f0a00640 1 -- 172.21.15.63:0/3536768533 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ec0a57a0 con 0x7f87f40c9230 2024-09-12T02:59:23.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f0a00640 1 -- 172.21.15.63:0/3536768533 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0a5b70 con 0x7f87f40c9230 2024-09-12T02:59:23.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7fa184c00640 1 -- 172.21.15.63:0/447550343 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17c0bc070 con 0x7fa188067a00 2024-09-12T02:59:23.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7fa184c00640 1 -- 172.21.15.63:0/447550343 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0b1040 con 0x7fa188067a00 2024-09-12T02:59:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f96ab000640 1 -- 172.21.15.63:0/4169785392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a4162fa0 msgr2=0x7f96a406f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f96ab000640 1 --2- 172.21.15.63:0/4169785392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a4162fa0 0x7f96a406f010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f96a40c4f80 tx=0x7f969c01c970 comp rx=0 tx=0).stop 2024-09-12T02:59:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f96ab000640 1 -- 172.21.15.63:0/4169785392 shutdown_connections 2024-09-12T02:59:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f96ab000640 1 --2- 172.21.15.63:0/4169785392 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a4162fa0 0x7f96a406f010 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f96ab000640 1 --2- 172.21.15.63:0/4169785392 >> v2:172.21.15.63:3300/0 conn(0x7f96a4158e20 0x7f96a406ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f96ab000640 1 -- 172.21.15.63:0/4169785392 >> 172.21.15.63:0/4169785392 conn(0x7f96a4072960 msgr2=0x7f96a4072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f96ab000640 1 -- 172.21.15.63:0/4169785392 shutdown_connections 2024-09-12T02:59:23.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f96ab000640 1 -- 172.21.15.63:0/4169785392 wait complete. 2024-09-12T02:59:23.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1640052a0 con 0x7fa188067a00 2024-09-12T02:59:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f3200640 1 -- 172.21.15.63:0/3536768533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f40c9230 msgr2=0x7f87f40c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f3200640 1 --2- 172.21.15.63:0/3536768533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f40c9230 0x7f87f40c7610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f87f4162290 tx=0x7f87ec01c9a0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f3200640 1 -- 172.21.15.63:0/3536768533 shutdown_connections 2024-09-12T02:59:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f3200640 1 --2- 172.21.15.63:0/3536768533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f40c9230 0x7f87f40c7610 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f3200640 1 --2- 172.21.15.63:0/3536768533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f415fb20 0x7f87f40cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f3200640 1 --2- 172.21.15.63:0/3536768533 >> v2:172.21.15.63:3300/0 conn(0x7f87f415f740 0x7f87f4160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f3200640 1 -- 172.21.15.63:0/3536768533 >> 172.21.15.63:0/3536768533 conn(0x7f87f4067bd0 msgr2=0x7f87f4067fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f3200640 1 -- 172.21.15.63:0/3536768533 shutdown_connections 2024-09-12T02:59:23.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f96ab000640 1 Processor -- start 2024-09-12T02:59:23.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f2552200640 1 Processor -- start 2024-09-12T02:59:23.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f2552200640 1 -- start start 2024-09-12T02:59:23.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f96ab000640 1 -- start start 2024-09-12T02:59:23.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f2552200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f254c0c9690 0x7f254c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f2552200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f254c06dec0 con 0x7f254c0c1810 2024-09-12T02:59:23.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.352+0000 7f87f3200640 1 -- 172.21.15.63:0/3536768533 wait complete. 2024-09-12T02:59:23.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f2552200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f254c06cfd0 con 0x7f254c160ac0 2024-09-12T02:59:23.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f2552200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f254c06d2b0 con 0x7f254c0c9690 2024-09-12T02:59:23.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f87f3200640 1 Processor -- start 2024-09-12T02:59:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7fa184c00640 1 -- 172.21.15.63:0/447550343 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa17c0dd890 con 0x7fa188067a00 2024-09-12T02:59:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7fa184c00640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa168067ac0 0x7fa168069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7fa184c00640 1 -- 172.21.15.63:0/447550343 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fa17c1204a0 con 0x7fa188067a00 2024-09-12T02:59:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f254be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f254c0c9690 0x7f254c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f254be00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f254c0c9690 0x7f254c15ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:34754/0 (socket says 172.21.15.63:34754) 2024-09-12T02:59:23.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f254be00640 1 -- 172.21.15.63:0/3107048344 learned_addr learned my addr 172.21.15.63:0/3107048344 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f87f3200640 1 -- start start 2024-09-12T02:59:23.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f254be00640 1 -- 172.21.15.63:0/3107048344 >> v1:172.21.15.119:6789/0 conn(0x7f254c160ac0 legacy=0x7f254c167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f254be00640 1 -- 172.21.15.63:0/3107048344 >> v1:172.21.15.63:6789/0 conn(0x7f254c0c1810 legacy=0x7f254c1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f96ab000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40cd6b0 0x7f96a414e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7fa187e00640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa168067ac0 0x7fa168069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.356+0000 7f254be00640 1 -- 172.21.15.63:0/3107048344 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c06d590 con 0x7f254c0c9690 2024-09-12T02:59:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96ab000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96a4158e20 0x7f96a414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96ab000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a4162fa0 0x7f96a41f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96ab000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f96a406c410 con 0x7f96a4158e20 2024-09-12T02:59:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f3200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f40c9230 0x7f87f42004b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87f415f740 0x7f87f415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96ab000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f96a406c290 con 0x7f96a40cd6b0 2024-09-12T02:59:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96ab000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f96a416be30 con 0x7f96a4162fa0 2024-09-12T02:59:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40cd6b0 0x7f96a414e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40cd6b0 0x7f96a414e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:34756/0 (socket says 172.21.15.63:34756) 2024-09-12T02:59:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3e00640 1 -- 172.21.15.63:0/2780227641 learned_addr learned my addr 172.21.15.63:0/2780227641 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3400640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96a4158e20 0x7f96a414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7fa187e00640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa168067ac0 0x7fa168069f80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa174007fd0 tx=0x7fa174007c20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f3200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f415fb20 0x7f87f415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87f40c7b50 con 0x7f87f415f740 2024-09-12T02:59:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f40c9230 0x7f87f42004b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f3200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f87f40cae50 con 0x7f87f415fb20 2024-09-12T02:59:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f3200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f87f40c7cd0 con 0x7f87f40c9230 2024-09-12T02:59:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f40c9230 0x7f87f42004b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:51856/0 (socket says 172.21.15.63:51856) 2024-09-12T02:59:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1e00640 1 -- 172.21.15.63:0/1374183465 learned_addr learned my addr 172.21.15.63:0/1374183465 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f2800640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f415fb20 0x7f87f415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3e00640 1 -- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a4162fa0 msgr2=0x7f96a41f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3e00640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a4162fa0 0x7f96a41f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3e00640 1 -- 172.21.15.63:0/2780227641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96a4158e20 msgr2=0x7f96a414eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3e00640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96a4158e20 0x7f96a414eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3e00640 1 -- 172.21.15.63:0/2780227641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a41462c0 con 0x7f96a40cd6b0 2024-09-12T02:59:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96a3e00640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40cd6b0 0x7f96a414e080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f969000b4d0 tx=0x7f969000b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1400640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87f415f740 0x7f87f415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f969be00640 1 -- 172.21.15.63:0/2780227641 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690014070 con 0x7f96a40cd6b0 2024-09-12T02:59:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f969be00640 1 -- 172.21.15.63:0/2780227641 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9690010610 con 0x7f96a40cd6b0 2024-09-12T02:59:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f969be00640 1 -- 172.21.15.63:0/2780227641 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690010a00 con 0x7f96a40cd6b0 2024-09-12T02:59:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a414e5c0 con 0x7f96a40cd6b0 2024-09-12T02:59:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1e00640 1 -- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f415fb20 msgr2=0x7f87f415a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1e00640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f415fb20 0x7f87f415a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1e00640 1 -- 172.21.15.63:0/1374183465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87f415f740 msgr2=0x7f87f415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1e00640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87f415f740 0x7f87f415b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a41584e0 con 0x7f96a40cd6b0 2024-09-12T02:59:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1e00640 1 -- 172.21.15.63:0/1374183465 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f4162dd0 con 0x7f87f40c9230 2024-09-12T02:59:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f2800640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f415fb20 0x7f87f415a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1400640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87f415f740 0x7f87f415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f87f1e00640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f40c9230 0x7f87f42004b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f87e400e930 tx=0x7f87e400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.360+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a40c4b60 con 0x7f96a40cd6b0 2024-09-12T02:59:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.364+0000 7f254be00640 1 --2- 172.21.15.63:0/3107048344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 0x7f254c15ec40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e50 tx=0x7f254401ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbef7fb8619922cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.364+0000 7f969be00640 1 -- 172.21.15.63:0/2780227641 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9690017070 con 0x7f96a40cd6b0 2024-09-12T02:59:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.364+0000 7f969be00640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f96840678c0 0x7f9684069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.364+0000 7f969be00640 1 -- 172.21.15.63:0/2780227641 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f9690085bd0 con 0x7f96a40cd6b0 2024-09-12T02:59:23.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.368+0000 7f96a3400640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f96840678c0 0x7f9684069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.368+0000 7f87ea000640 1 -- 172.21.15.63:0/1374183465 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4017070 con 0x7f87f40c9230 2024-09-12T02:59:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.368+0000 7f87ea000640 1 -- 172.21.15.63:0/1374183465 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e400ca00 con 0x7f87f40c9230 2024-09-12T02:59:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.368+0000 7f87ea000640 1 -- 172.21.15.63:0/1374183465 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e400cdb0 con 0x7f87f40c9230 2024-09-12T02:59:23.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.368+0000 7fa184c00640 1 -- 172.21.15.63:0/447550343 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa17c016090 con 0x7fa188067a00 2024-09-12T02:59:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.368+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f41669d0 con 0x7f87f40c9230 2024-09-12T02:59:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.368+0000 7f96a3400640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f96840678c0 0x7f9684069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f96a4157f80 tx=0x7f9694009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.368+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f4162af0 con 0x7f87f40c9230 2024-09-12T02:59:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.368+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f40c7080 con 0x7f87f40c9230 2024-09-12T02:59:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.372+0000 7f87ea000640 1 -- 172.21.15.63:0/1374183465 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87e401a070 con 0x7f87f40c9230 2024-09-12T02:59:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.372+0000 7f87ea000640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87d4067990 0x7f87d4069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.372+0000 7f87ea000640 1 -- 172.21.15.63:0/1374183465 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f87e40860f0 con 0x7f87f40c9230 2024-09-12T02:59:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.372+0000 7f87f1400640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87d4067990 0x7f87d4069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.372+0000 7f87f1400640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87d4067990 0x7f87d4069e50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f87f41640f0 tx=0x7f87e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f254a000640 1 -- 172.21.15.63:0/3107048344 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440a58d0 con 0x7f254c0c9690 2024-09-12T02:59:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f254a000640 1 -- 172.21.15.63:0/3107048344 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25440a5a70 con 0x7f254c0c9690 2024-09-12T02:59:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f254a000640 1 -- 172.21.15.63:0/3107048344 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440a58d0 con 0x7f254c0c9690 2024-09-12T02:59:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f969be00640 1 -- 172.21.15.63:0/2780227641 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9690055d40 con 0x7f96a40cd6b0 2024-09-12T02:59:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f2552200640 1 -- 172.21.15.63:0/3107048344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 msgr2=0x7f254c15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f2552200640 1 --2- 172.21.15.63:0/3107048344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 0x7f254c15ec40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2544009e50 tx=0x7f254401ca00 comp rx=0 tx=0).stop 2024-09-12T02:59:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f2552200640 1 -- 172.21.15.63:0/3107048344 shutdown_connections 2024-09-12T02:59:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f2552200640 1 --2- 172.21.15.63:0/3107048344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 0x7f254c15ec40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f2552200640 1 -- 172.21.15.63:0/3107048344 >> 172.21.15.63:0/3107048344 conn(0x7f254c06f3d0 msgr2=0x7f254c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f2552200640 1 -- 172.21.15.63:0/3107048344 shutdown_connections 2024-09-12T02:59:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.376+0000 7f2552200640 1 -- 172.21.15.63:0/3107048344 wait complete. 2024-09-12T02:59:23.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.380+0000 7f2552200640 1 Processor -- start 2024-09-12T02:59:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.380+0000 7f2552200640 1 -- start start 2024-09-12T02:59:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.380+0000 7f2552200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f254c0c1810 0x7f254c0734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.380+0000 7f2552200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 0x7f254c149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.380+0000 7f2552200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f254c160ac0 0x7f254c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f2552200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f254c0c2000 con 0x7f254c0c1810 2024-09-12T02:59:23.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f2552200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f254c1592d0 con 0x7f254c0c9690 2024-09-12T02:59:23.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f2552200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f254c0c6cc0 con 0x7f254c160ac0 2024-09-12T02:59:23.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 0x7f254c149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254aa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 0x7f254c149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:34766/0 (socket says 172.21.15.63:34766) 2024-09-12T02:59:23.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254aa00640 1 -- 172.21.15.63:0/1095286463 learned_addr learned my addr 172.21.15.63:0/1095286463 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254be00640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f254c160ac0 0x7f254c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254b400640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f254c0c1810 0x7f254c0734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f87ea000640 1 -- 172.21.15.63:0/1374183465 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f87e4056290 con 0x7f87f40c9230 2024-09-12T02:59:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254be00640 1 -- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 msgr2=0x7f254c149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254be00640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 0x7f254c149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254be00640 1 -- 172.21.15.63:0/1095286463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f254c0c1810 msgr2=0x7f254c0734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254be00640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f254c0c1810 0x7f254c0734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254be00640 1 -- 172.21.15.63:0/1095286463 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c14aef0 con 0x7f254c160ac0 2024-09-12T02:59:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254b400640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f254c0c1810 0x7f254c0734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254aa00640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 0x7f254c149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.384+0000 7f254be00640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f254c160ac0 0x7f254c0c8500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f25440ab000 tx=0x7f25440197a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.388+0000 7f2543400640 1 -- 172.21.15.63:0/1095286463 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544003d70 con 0x7f254c160ac0 2024-09-12T02:59:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.388+0000 7f2543400640 1 -- 172.21.15.63:0/1095286463 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2544004040 con 0x7f254c160ac0 2024-09-12T02:59:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.388+0000 7f2543400640 1 -- 172.21.15.63:0/1095286463 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544004410 con 0x7f254c160ac0 2024-09-12T02:59:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.388+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254c1f8660 con 0x7f254c160ac0 2024-09-12T02:59:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.388+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f254c1f8c20 con 0x7f254c160ac0 2024-09-12T02:59:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.388+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f254c0b14b0 con 0x7f254c160ac0 2024-09-12T02:59:23.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.392+0000 7f2543400640 1 -- 172.21.15.63:0/1095286463 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f25440c0030 con 0x7f254c160ac0 2024-09-12T02:59:23.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.392+0000 7f2543400640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f252c067990 0x7f252c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.392+0000 7f2543400640 1 -- 172.21.15.63:0/1095286463 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f2544121300 con 0x7f254c160ac0 2024-09-12T02:59:23.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.392+0000 7f254b400640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f252c067990 0x7f252c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.396+0000 7f254b400640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f252c067990 0x7f252c069e50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f253c000f70 tx=0x7f253c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.404+0000 7f2543400640 1 -- 172.21.15.63:0/1095286463 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f25440c7060 con 0x7f254c160ac0 2024-09-12T02:59:23.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.532+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc85c073f10 con 0x7fc85c15b440 2024-09-12T02:59:23.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.532+0000 7fc859600640 1 -- 172.21.15.63:0/2270951823 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc84805e730 con 0x7fc85c15b440 2024-09-12T02:59:23.537 INFO:teuthology.orchestra.run.smithi063.stdout:64424509475 2024-09-12T02:59:23.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc83c067910 msgr2=0x7fc83c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc83c067910 0x7fc83c069dd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc8500b2000 tx=0x7fc850004740 comp rx=0 tx=0).stop 2024-09-12T02:59:23.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85c15b440 msgr2=0x7fc85c1e5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85c15b440 0x7fc85c1e5170 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc848001a30 tx=0x7fc848014050 comp rx=0 tx=0).stop 2024-09-12T02:59:23.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 shutdown_connections 2024-09-12T02:59:23.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc83c067910 0x7fc83c069dd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85c1e3d90 0x7fc85c0c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85c15b440 0x7fc85c1e5170 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 --2- 172.21.15.63:0/2270951823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc85c06fcb0 0x7fc85c0b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.536+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 >> 172.21.15.63:0/2270951823 conn(0x7fc85c06d900 msgr2=0x7fc85c0c9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.540+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 shutdown_connections 2024-09-12T02:59:23.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.540+0000 7fc863000640 1 -- 172.21.15.63:0/2270951823 wait complete. 2024-09-12T02:59:23.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509475 for osd.0 2024-09-12T02:59:23.576 DEBUG:teuthology.parallel:result is None 2024-09-12T02:59:23.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.580+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3db00c2c50 con 0x7f3db00c1fd0 2024-09-12T02:59:23.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.584+0000 7f3da7400640 1 -- 172.21.15.63:0/110060340 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3db020f0b0 con 0x7f3db00c1fd0 2024-09-12T02:59:23.587 INFO:teuthology.orchestra.run.smithi063.stdout:55834574882 2024-09-12T02:59:23.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d900678c0 msgr2=0x7f3d90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d900678c0 0x7f3d90069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3da8007fd0 tx=0x7f3da8009040 comp rx=0 tx=0).stop 2024-09-12T02:59:23.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3db00c1fd0 msgr2=0x7f3db0168bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3db00c1fd0 0x7f3db0168bd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00c430 tx=0x7f3d9c00c8f0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 shutdown_connections 2024-09-12T02:59:23.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f3d900678c0 0x7f3d90069d80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3db00c1fd0 0x7f3db0168bd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3db0071b10 0x7f3db00c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 --2- 172.21.15.63:0/110060340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3db006fcb0 0x7f3db020eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 >> 172.21.15.63:0/110060340 conn(0x7f3db006d900 msgr2=0x7f3db00c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 shutdown_connections 2024-09-12T02:59:23.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.588+0000 7f3dafe00640 1 -- 172.21.15.63:0/110060340 wait complete. 2024-09-12T02:59:23.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.1 2024-09-12T02:59:23.626 DEBUG:teuthology.parallel:result is None 2024-09-12T02:59:23.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.640+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f33040c8b50 con 0x7f3304159610 2024-09-12T02:59:23.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.644+0000 7f32fe000640 1 -- 172.21.15.63:0/3732687777 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32f40c3030 con 0x7f3304159610 2024-09-12T02:59:23.647 INFO:teuthology.orchestra.run.smithi063.stdout:64424509475 2024-09-12T02:59:23.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32e80678c0 msgr2=0x7f32e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32e80678c0 0x7f32e8069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c10 tx=0x7f32f800a8e0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3304159610 msgr2=0x7f3304159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3304159610 0x7f3304159a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ad000 tx=0x7f32ec005840 comp rx=0 tx=0).stop 2024-09-12T02:59:23.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 shutdown_connections 2024-09-12T02:59:23.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f32e80678c0 0x7f32e8069d80 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f32f8000c10 tx=0x7f32f800a8e0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3304159610 0x7f3304159a90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f330415b010 0x7f3304151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 --2- 172.21.15.63:0/3732687777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32ec004d50 0x7f33040c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 >> 172.21.15.63:0/3732687777 conn(0x7f3304067a00 msgr2=0x7f330415e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 shutdown_connections 2024-09-12T02:59:23.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.648+0000 7f330c800640 1 -- 172.21.15.63:0/3732687777 wait complete. 2024-09-12T02:59:23.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.660+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7b94005860 con 0x7f7bbc149cc0 2024-09-12T02:59:23.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.660+0000 7f7bb9600640 1 -- 172.21.15.63:0/3966962985 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7ba80f03f0 con 0x7f7bbc149cc0 2024-09-12T02:59:23.666 INFO:teuthology.orchestra.run.smithi063.stdout:60129542179 2024-09-12T02:59:23.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f254c0c7030 con 0x7f254c160ac0 2024-09-12T02:59:23.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b9c067cc0 msgr2=0x7f7b9c06a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b9c067cc0 0x7f7b9c06a180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009fc0 tx=0x7f7bb400b040 comp rx=0 tx=0).stop 2024-09-12T02:59:23.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bbc149cc0 msgr2=0x7f7bbc201080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bbc149cc0 0x7f7bbc201080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c340 tx=0x7f7ba0005840 comp rx=0 tx=0).stop 2024-09-12T02:59:23.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f2543400640 1 -- 172.21.15.63:0/1095286463 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2544016620 con 0x7f254c160ac0 2024-09-12T02:59:23.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 shutdown_connections 2024-09-12T02:59:23.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7bbc149cc0 0x7f7bbc201080 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7bbc14c450 0x7f7bbc201ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7b9c067cc0 0x7f7b9c06a180 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 --2- 172.21.15.63:0/3966962985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ba0004f00 0x7f7bbc158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 >> 172.21.15.63:0/3966962985 conn(0x7f7bbc06f3d0 msgr2=0x7f7bbc13f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.670 INFO:teuthology.orchestra.run.smithi063.stdout:60129542177 2024-09-12T02:59:23.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 shutdown_connections 2024-09-12T02:59:23.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.664+0000 7f7bc3e00640 1 -- 172.21.15.63:0/3966962985 wait complete. 2024-09-12T02:59:23.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f252c067990 msgr2=0x7f252c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f252c067990 0x7f252c069e50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f253c000f70 tx=0x7f253c009040 comp rx=0 tx=0).stop 2024-09-12T02:59:23.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f254c160ac0 msgr2=0x7f254c0c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f254c160ac0 0x7f254c0c8500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f25440ab000 tx=0x7f25440197a0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 shutdown_connections 2024-09-12T02:59:23.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f252c067990 0x7f252c069e50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f254c160ac0 0x7f254c0c8500 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f254c0c9690 0x7f254c149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 --2- 172.21.15.63:0/1095286463 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f254c0c1810 0x7f254c0734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 >> 172.21.15.63:0/1095286463 conn(0x7f254c06f3d0 msgr2=0x7f254c1603b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 shutdown_connections 2024-09-12T02:59:23.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.668+0000 7f2552200640 1 -- 172.21.15.63:0/1095286463 wait complete. 2024-09-12T02:59:23.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.676+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f96a406c660 con 0x7f96a40cd6b0 2024-09-12T02:59:23.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.676+0000 7f969be00640 1 -- 172.21.15.63:0/2780227641 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f969005a040 con 0x7f96a40cd6b0 2024-09-12T02:59:23.680 INFO:teuthology.orchestra.run.smithi063.stdout:274877906949 2024-09-12T02:59:23.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509475 for osd.2 2024-09-12T02:59:23.682 DEBUG:teuthology.parallel:result is None 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f96840678c0 msgr2=0x7f9684069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f96840678c0 0x7f9684069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f96a4157f80 tx=0x7f9694009040 comp rx=0 tx=0).stop 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40cd6b0 msgr2=0x7f96a414e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40cd6b0 0x7f96a414e080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f969000b4d0 tx=0x7f969000b990 comp rx=0 tx=0).stop 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 shutdown_connections 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f96840678c0 0x7f9684069d80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a4162fa0 0x7f96a41f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96a4158e20 0x7f96a414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 --2- 172.21.15.63:0/2780227641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40cd6b0 0x7f96a414e080 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 >> 172.21.15.63:0/2780227641 conn(0x7f96a4072960 msgr2=0x7f96a406eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 shutdown_connections 2024-09-12T02:59:23.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.680+0000 7f96ab000640 1 -- 172.21.15.63:0/2780227641 wait complete. 2024-09-12T02:59:23.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542177 for osd.4 2024-09-12T02:59:23.697 DEBUG:teuthology.parallel:result is None 2024-09-12T02:59:23.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.7 2024-09-12T02:59:23.704 DEBUG:teuthology.parallel:result is None 2024-09-12T02:59:23.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa164005860 con 0x7fa188067a00 2024-09-12T02:59:23.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa184c00640 1 -- 172.21.15.63:0/447550343 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa17c0f0b40 con 0x7fa188067a00 2024-09-12T02:59:23.712 INFO:teuthology.orchestra.run.smithi063.stdout:64424509473 2024-09-12T02:59:23.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa168067ac0 msgr2=0x7fa168069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa168067ac0 0x7fa168069f80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa174007fd0 tx=0x7fa174007c20 comp rx=0 tx=0).stop 2024-09-12T02:59:23.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa188067a00 msgr2=0x7fa188149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa188067a00 0x7fa188149770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009740 tx=0x7fa17c0191b0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 shutdown_connections 2024-09-12T02:59:23.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1880c3690 0x7fa1880cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa188070420 0x7fa188149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fa168067ac0 0x7fa168069f80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 --2- 172.21.15.63:0/447550343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa188067a00 0x7fa188149770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 >> 172.21.15.63:0/447550343 conn(0x7fa18806f900 msgr2=0x7fa1880c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 shutdown_connections 2024-09-12T02:59:23.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.708+0000 7fa18e000640 1 -- 172.21.15.63:0/447550343 wait complete. 2024-09-12T02:59:23.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 274877906949 got 274877906949 for osd.5 2024-09-12T02:59:23.720 DEBUG:teuthology.parallel:result is None 2024-09-12T02:59:23.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f87f40c7930 con 0x7f87f40c9230 2024-09-12T02:59:23.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87ea000640 1 -- 172.21.15.63:0/1374183465 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f87e405a590 con 0x7f87f40c9230 2024-09-12T02:59:23.723 INFO:teuthology.orchestra.run.smithi063.stdout:60129542177 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87d4067990 msgr2=0x7f87d4069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87d4067990 0x7f87d4069e50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f87f41640f0 tx=0x7f87e0008040 comp rx=0 tx=0).stop 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f40c9230 msgr2=0x7f87f42004b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f40c9230 0x7f87f42004b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f87e400e930 tx=0x7f87e400edf0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 shutdown_connections 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87f415fb20 0x7f87f415a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87f415f740 0x7f87f415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f87d4067990 0x7f87d4069e50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 --2- 172.21.15.63:0/1374183465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87f40c9230 0x7f87f42004b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 >> 172.21.15.63:0/1374183465 conn(0x7f87f4067bd0 msgr2=0x7f87f415ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 shutdown_connections 2024-09-12T02:59:23.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.720+0000 7f87f3200640 1 -- 172.21.15.63:0/1374183465 wait complete. 2024-09-12T02:59:23.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509473 got 64424509473 for osd.3 2024-09-12T02:59:23.735 DEBUG:teuthology.parallel:result is None 2024-09-12T02:59:23.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542177 for osd.6 2024-09-12T02:59:23.745 DEBUG:teuthology.parallel:result is None 2024-09-12T02:59:23.745 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T02:59:23.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:59:23.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783e00640 1 Processor -- start 2024-09-12T02:59:23.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783e00640 1 -- start start 2024-09-12T02:59:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 0x7f57840cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5784071450 0x7f5784071900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57840b1260 con 0x7f5784152790 2024-09-12T02:59:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f578415ba70 con 0x7f5784071450 2024-09-12T02:59:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5784158720 con 0x7f57840c8b00 2024-09-12T02:59:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5782a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5784152790 0x7f5784158bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57574/0 (socket says 172.21.15.63:57574) 2024-09-12T02:59:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5782a00640 1 -- 172.21.15.63:0/3592484932 learned_addr learned my addr 172.21.15.63:0/3592484932 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:23.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783400640 1 --2- 172.21.15.63:0/3592484932 >> v2:172.21.15.63:3300/0 conn(0x7f5784071450 0x7f5784071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5782000640 1 --2- 172.21.15.63:0/3592484932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 0x7f57840cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5781600640 1 -- 172.21.15.63:0/3592484932 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534245530 0 0) 0x7f57840b1260 con 0x7f5784152790 2024-09-12T02:59:23.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5781600640 1 -- 172.21.15.63:0/3592484932 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5768003530 con 0x7f5784152790 2024-09-12T02:59:23.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783400640 1 -- 172.21.15.63:0/3592484932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 msgr2=0x7f57840cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:23.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783400640 1 --2- 172.21.15.63:0/3592484932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 0x7f57840cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783400640 1 -- 172.21.15.63:0/3592484932 >> v1:172.21.15.63:6789/0 conn(0x7f5784152790 legacy=0x7f5784158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.924+0000 7f5783400640 1 -- 172.21.15.63:0/3592484932 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57840c95b0 con 0x7f5784071450 2024-09-12T02:59:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783400640 1 --2- 172.21.15.63:0/3592484932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 0x7f5784071900 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f577c009d90 tx=0x7f577c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded508e86d2701c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5781600640 1 -- 172.21.15.63:0/3592484932 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c0b4070 con 0x7f5784071450 2024-09-12T02:59:23.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5781600640 1 -- 172.21.15.63:0/3592484932 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577c0af600 con 0x7f5784071450 2024-09-12T02:59:23.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5781600640 1 -- 172.21.15.63:0/3592484932 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c0af9d0 con 0x7f5784071450 2024-09-12T02:59:23.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 -- 172.21.15.63:0/3592484932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 msgr2=0x7f5784071900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 --2- 172.21.15.63:0/3592484932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 0x7f5784071900 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f577c009d90 tx=0x7f577c01f150 comp rx=0 tx=0).stop 2024-09-12T02:59:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 -- 172.21.15.63:0/3592484932 shutdown_connections 2024-09-12T02:59:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 --2- 172.21.15.63:0/3592484932 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 0x7f5784071900 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 --2- 172.21.15.63:0/3592484932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 0x7f57840cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 -- 172.21.15.63:0/3592484932 >> 172.21.15.63:0/3592484932 conn(0x7f578406f6e0 msgr2=0x7f578406faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 -- 172.21.15.63:0/3592484932 shutdown_connections 2024-09-12T02:59:23.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 -- 172.21.15.63:0/3592484932 wait complete. 2024-09-12T02:59:23.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 Processor -- start 2024-09-12T02:59:23.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.928+0000 7f5783e00640 1 -- start start 2024-09-12T02:59:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 0x7f5784157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 0x7f57840cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5784152790 0x7f57841567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f57840b0f80 con 0x7f5784071450 2024-09-12T02:59:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f57840cbb40 con 0x7f5784152790 2024-09-12T02:59:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5784152b70 con 0x7f57840c8b00 2024-09-12T02:59:23.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 0x7f5784157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 0x7f5784157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42350/0 (socket says 172.21.15.63:42350) 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782a00640 1 -- 172.21.15.63:0/2701203868 learned_addr learned my addr 172.21.15.63:0/2701203868 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782000640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 0x7f57840cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783400640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5784152790 0x7f57841567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782a00640 1 -- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 msgr2=0x7f57840cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782a00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 0x7f57840cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782a00640 1 -- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5784152790 msgr2=0x7f57841567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782a00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5784152790 0x7f57841567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782a00640 1 -- 172.21.15.63:0/2701203868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57841f32d0 con 0x7f5784071450 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5782a00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 0x7f5784157d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f577400c450 tx=0x7f577400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f577aa00640 1 -- 172.21.15.63:0/2701203868 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5774017070 con 0x7f5784071450 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f577aa00640 1 -- 172.21.15.63:0/2701203868 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5774005cf0 con 0x7f5784071450 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f577aa00640 1 -- 172.21.15.63:0/2701203868 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5774007290 con 0x7f5784071450 2024-09-12T02:59:23.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57841f35b0 con 0x7f5784071450 2024-09-12T02:59:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57841f3b70 con 0x7f5784071450 2024-09-12T02:59:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.932+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57840c91e0 con 0x7f5784071450 2024-09-12T02:59:23.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.936+0000 7f577aa00640 1 -- 172.21.15.63:0/2701203868 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f577401a070 con 0x7f5784071450 2024-09-12T02:59:23.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.936+0000 7f577aa00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f57640678c0 0x7f5764069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:23.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.936+0000 7f577aa00640 1 -- 172.21.15.63:0/2701203868 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f57740854a0 con 0x7f5784071450 2024-09-12T02:59:23.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.936+0000 7f5782000640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f57640678c0 0x7f5764069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:23.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.936+0000 7f5782000640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f57640678c0 0x7f5764069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f57840b0420 tx=0x7f5770008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:23.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:23.940+0000 7f577aa00640 1 -- 172.21.15.63:0/2701203868 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5774055bf0 con 0x7f5784071450 2024-09-12T02:59:24.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.104+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f578406ca70 con 0x7f57640678c0 2024-09-12T02:59:24.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.128+0000 7f577aa00640 1 -- 172.21.15.63:0/2701203868 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332736 (secure 0 0 0) 0x7f578406ca70 con 0x7f57640678c0 2024-09-12T02:59:24.136 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:24.138 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:59:24.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f57640678c0 msgr2=0x7f5764069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f57640678c0 0x7f5764069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f57840b0420 tx=0x7f5770008040 comp rx=0 tx=0).stop 2024-09-12T02:59:24.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 msgr2=0x7f5784157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 0x7f5784157d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f577400c450 tx=0x7f577400c910 comp rx=0 tx=0).stop 2024-09-12T02:59:24.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 shutdown_connections 2024-09-12T02:59:24.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5784152790 0x7f57841567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f57640678c0 0x7f5764069d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57840c8b00 0x7f57840cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 --2- 172.21.15.63:0/2701203868 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5784071450 0x7f5784157d90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 >> 172.21.15.63:0/2701203868 conn(0x7f578406f6e0 msgr2=0x7f5784158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:24.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 shutdown_connections 2024-09-12T02:59:24.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.132+0000 7f5783e00640 1 -- 172.21.15.63:0/2701203868 wait complete. 2024-09-12T02:59:24.156 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-09-12T02:59:23.797798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629078,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":244,"num_write_kb":2486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234116,"kb_used_data":8468,"kb_used_omap":15,"kb_used_meta":225456,"kb_avail":754740604,"statfs":{"total":773094113280,"available":772854378496,"internally_reserved":0,"allocated":8671232,"data_stored":5062285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":230867630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002294"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093498+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:59:21.093498+0000","last_peered":"2024-09-12T02:59:21.093498+0000","last_clean":"2024-09-12T02:59:21.093498+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:21.093498+0000","last_undegraded":"2024-09-12T02:59:21.093498+0000","last_fullsized":"2024-09-12T02:59:21.093498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555874+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:59:20.555874+0000","last_peered":"2024-09-12T02:59:20.555874+0000","last_clean":"2024-09-12T02:59:20.555874+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:20.555874+0000","last_undegraded":"2024-09-12T02:59:20.555874+0000","last_fullsized":"2024-09-12T02:59:20.555874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554951+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:59:20.554951+0000","last_peered":"2024-09-12T02:59:20.554951+0000","last_clean":"2024-09-12T02:59:20.554951+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:20.554951+0000","last_undegraded":"2024-09-12T02:59:20.554951+0000","last_fullsized":"2024-09-12T02:59:20.554951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555984+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:59:20.555984+0000","last_peered":"2024-09-12T02:59:20.555984+0000","last_clean":"2024-09-12T02:59:20.555984+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:20.555984+0000","last_undegraded":"2024-09-12T02:59:20.555984+0000","last_fullsized":"2024-09-12T02:59:20.555984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093267+0000","last_change":"2024-09-12T02:59:06.040714+0000","last_active":"2024-09-12T02:59:21.093267+0000","last_peered":"2024-09-12T02:59:21.093267+0000","last_clean":"2024-09-12T02:59:21.093267+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:21.093267+0000","last_undegraded":"2024-09-12T02:59:21.093267+0000","last_fullsized":"2024-09-12T02:59:21.093267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:54.289352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":141,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221118+0000","last_change":"2024-09-12T02:59:08.071320+0000","last_active":"2024-09-12T02:59:20.221118+0000","last_peered":"2024-09-12T02:59:20.221118+0000","last_clean":"2024-09-12T02:59:20.221118+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:20.221118+0000","last_undegraded":"2024-09-12T02:59:20.221118+0000","last_fullsized":"2024-09-12T02:59:20.221118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:38.378285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572534+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:59:20.572534+0000","last_peered":"2024-09-12T02:59:20.572534+0000","last_clean":"2024-09-12T02:59:20.572534+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:20.572534+0000","last_undegraded":"2024-09-12T02:59:20.572534+0000","last_fullsized":"2024-09-12T02:59:20.572534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226154+0000","last_change":"2024-09-12T02:59:06.046085+0000","last_active":"2024-09-12T02:59:20.226154+0000","last_peered":"2024-09-12T02:59:20.226154+0000","last_clean":"2024-09-12T02:59:20.226154+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:20.226154+0000","last_undegraded":"2024-09-12T02:59:20.226154+0000","last_fullsized":"2024-09-12T02:59:20.226154+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:35.684141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223813+0000","last_change":"2024-09-12T02:59:08.073058+0000","last_active":"2024-09-12T02:59:20.223813+0000","last_peered":"2024-09-12T02:59:20.223813+0000","last_clean":"2024-09-12T02:59:20.223813+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:20.223813+0000","last_undegraded":"2024-09-12T02:59:20.223813+0000","last_fullsized":"2024-09-12T02:59:20.223813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.609541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572259+0000","last_change":"2024-09-12T02:59:06.053365+0000","last_active":"2024-09-12T02:59:20.572259+0000","last_peered":"2024-09-12T02:59:20.572259+0000","last_clean":"2024-09-12T02:59:20.572259+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:20.572259+0000","last_undegraded":"2024-09-12T02:59:20.572259+0000","last_fullsized":"2024-09-12T02:59:20.572259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227143+0000","last_change":"2024-09-12T02:59:06.040820+0000","last_active":"2024-09-12T02:59:20.227143+0000","last_peered":"2024-09-12T02:59:20.227143+0000","last_clean":"2024-09-12T02:59:20.227143+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:20.227143+0000","last_undegraded":"2024-09-12T02:59:20.227143+0000","last_fullsized":"2024-09-12T02:59:20.227143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:41.411962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223290+0000","last_change":"2024-09-12T02:59:06.058963+0000","last_active":"2024-09-12T02:59:20.223290+0000","last_peered":"2024-09-12T02:59:20.223290+0000","last_clean":"2024-09-12T02:59:20.223290+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:20.223290+0000","last_undegraded":"2024-09-12T02:59:20.223290+0000","last_fullsized":"2024-09-12T02:59:20.223290+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651357+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:59:20.651357+0000","last_peered":"2024-09-12T02:59:20.651357+0000","last_clean":"2024-09-12T02:59:20.651357+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:20.651357+0000","last_undegraded":"2024-09-12T02:59:20.651357+0000","last_fullsized":"2024-09-12T02:59:20.651357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572449+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:59:20.572449+0000","last_peered":"2024-09-12T02:59:20.572449+0000","last_clean":"2024-09-12T02:59:20.572449+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:20.572449+0000","last_undegraded":"2024-09-12T02:59:20.572449+0000","last_fullsized":"2024-09-12T02:59:20.572449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223073+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:59:20.223073+0000","last_peered":"2024-09-12T02:59:20.223073+0000","last_clean":"2024-09-12T02:59:20.223073+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:20.223073+0000","last_undegraded":"2024-09-12T02:59:20.223073+0000","last_fullsized":"2024-09-12T02:59:20.223073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555282+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:59:20.555282+0000","last_peered":"2024-09-12T02:59:20.555282+0000","last_clean":"2024-09-12T02:59:20.555282+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:20.555282+0000","last_undegraded":"2024-09-12T02:59:20.555282+0000","last_fullsized":"2024-09-12T02:59:20.555282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220179+0000","last_change":"2024-09-12T02:59:08.061938+0000","last_active":"2024-09-12T02:59:20.220179+0000","last_peered":"2024-09-12T02:59:20.220179+0000","last_clean":"2024-09-12T02:59:20.220179+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:20.220179+0000","last_undegraded":"2024-09-12T02:59:20.220179+0000","last_fullsized":"2024-09-12T02:59:20.220179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.137585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221866+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:59:20.221866+0000","last_peered":"2024-09-12T02:59:20.221866+0000","last_clean":"2024-09-12T02:59:20.221866+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:20.221866+0000","last_undegraded":"2024-09-12T02:59:20.221866+0000","last_fullsized":"2024-09-12T02:59:20.221866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555522+0000","last_change":"2024-09-12T02:59:08.063392+0000","last_active":"2024-09-12T02:59:20.555522+0000","last_peered":"2024-09-12T02:59:20.555522+0000","last_clean":"2024-09-12T02:59:20.555522+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:20.555522+0000","last_undegraded":"2024-09-12T02:59:20.555522+0000","last_fullsized":"2024-09-12T02:59:20.555522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:39.814573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219716+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:59:20.219716+0000","last_peered":"2024-09-12T02:59:20.219716+0000","last_clean":"2024-09-12T02:59:20.219716+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:20.219716+0000","last_undegraded":"2024-09-12T02:59:20.219716+0000","last_fullsized":"2024-09-12T02:59:20.219716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221264+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:59:20.221264+0000","last_peered":"2024-09-12T02:59:20.221264+0000","last_clean":"2024-09-12T02:59:20.221264+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:20.221264+0000","last_undegraded":"2024-09-12T02:59:20.221264+0000","last_fullsized":"2024-09-12T02:59:20.221264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222869+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:59:20.222869+0000","last_peered":"2024-09-12T02:59:20.222869+0000","last_clean":"2024-09-12T02:59:20.222869+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:20.222869+0000","last_undegraded":"2024-09-12T02:59:20.222869+0000","last_fullsized":"2024-09-12T02:59:20.222869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571430+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:59:20.571430+0000","last_peered":"2024-09-12T02:59:20.571430+0000","last_clean":"2024-09-12T02:59:20.571430+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:20.571430+0000","last_undegraded":"2024-09-12T02:59:20.571430+0000","last_fullsized":"2024-09-12T02:59:20.571430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224226+0000","last_change":"2024-09-12T02:59:08.080501+0000","last_active":"2024-09-12T02:59:20.224226+0000","last_peered":"2024-09-12T02:59:20.224226+0000","last_clean":"2024-09-12T02:59:20.224226+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:20.224226+0000","last_undegraded":"2024-09-12T02:59:20.224226+0000","last_fullsized":"2024-09-12T02:59:20.224226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:19.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094222+0000","last_change":"2024-09-12T02:59:08.061926+0000","last_active":"2024-09-12T02:59:21.094222+0000","last_peered":"2024-09-12T02:59:21.094222+0000","last_clean":"2024-09-12T02:59:21.094222+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:21.094222+0000","last_undegraded":"2024-09-12T02:59:21.094222+0000","last_fullsized":"2024-09-12T02:59:21.094222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652743+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:59:20.652743+0000","last_peered":"2024-09-12T02:59:20.652743+0000","last_clean":"2024-09-12T02:59:20.652743+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:20.652743+0000","last_undegraded":"2024-09-12T02:59:20.652743+0000","last_fullsized":"2024-09-12T02:59:20.652743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222216+0000","last_change":"2024-09-12T02:59:06.042311+0000","last_active":"2024-09-12T02:59:20.222216+0000","last_peered":"2024-09-12T02:59:20.222216+0000","last_clean":"2024-09-12T02:59:20.222216+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:20.222216+0000","last_undegraded":"2024-09-12T02:59:20.222216+0000","last_fullsized":"2024-09-12T02:59:20.222216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.556036+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:59:20.556036+0000","last_peered":"2024-09-12T02:59:20.556036+0000","last_clean":"2024-09-12T02:59:20.556036+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:20.556036+0000","last_undegraded":"2024-09-12T02:59:20.556036+0000","last_fullsized":"2024-09-12T02:59:20.556036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'10","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220976+0000","last_change":"2024-09-12T02:59:08.080132+0000","last_active":"2024-09-12T02:59:20.220976+0000","last_peered":"2024-09-12T02:59:20.220976+0000","last_clean":"2024-09-12T02:59:20.220976+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:20.220976+0000","last_undegraded":"2024-09-12T02:59:20.220976+0000","last_fullsized":"2024-09-12T02:59:20.220976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:33.297534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554880+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:59:20.554880+0000","last_peered":"2024-09-12T02:59:20.554880+0000","last_clean":"2024-09-12T02:59:20.554880+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:59:20.554880+0000","last_undegraded":"2024-09-12T02:59:20.554880+0000","last_fullsized":"2024-09-12T02:59:20.554880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220394+0000","last_change":"2024-09-12T02:59:08.052379+0000","last_active":"2024-09-12T02:59:20.220394+0000","last_peered":"2024-09-12T02:59:20.220394+0000","last_clean":"2024-09-12T02:59:20.220394+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:20.220394+0000","last_undegraded":"2024-09-12T02:59:20.220394+0000","last_fullsized":"2024-09-12T02:59:20.220394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.582966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572839+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:59:20.572839+0000","last_peered":"2024-09-12T02:59:20.572839+0000","last_clean":"2024-09-12T02:59:20.572839+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:20.572839+0000","last_undegraded":"2024-09-12T02:59:20.572839+0000","last_fullsized":"2024-09-12T02:59:20.572839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094850+0000","last_change":"2024-09-12T02:59:06.034354+0000","last_active":"2024-09-12T02:59:21.094850+0000","last_peered":"2024-09-12T02:59:21.094850+0000","last_clean":"2024-09-12T02:59:21.094850+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:21.094850+0000","last_undegraded":"2024-09-12T02:59:21.094850+0000","last_fullsized":"2024-09-12T02:59:21.094850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:05.155351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226589+0000","last_change":"2024-09-12T02:59:06.034822+0000","last_active":"2024-09-12T02:59:20.226589+0000","last_peered":"2024-09-12T02:59:20.226589+0000","last_clean":"2024-09-12T02:59:20.226589+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:20.226589+0000","last_undegraded":"2024-09-12T02:59:20.226589+0000","last_fullsized":"2024-09-12T02:59:20.226589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:00.839140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220548+0000","last_change":"2024-09-12T02:59:08.054413+0000","last_active":"2024-09-12T02:59:20.220548+0000","last_peered":"2024-09-12T02:59:20.220548+0000","last_clean":"2024-09-12T02:59:20.220548+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:20.220548+0000","last_undegraded":"2024-09-12T02:59:20.220548+0000","last_fullsized":"2024-09-12T02:59:20.220548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:21.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220362+0000","last_change":"2024-09-12T02:59:08.063077+0000","last_active":"2024-09-12T02:59:20.220362+0000","last_peered":"2024-09-12T02:59:20.220362+0000","last_clean":"2024-09-12T02:59:20.220362+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:20.220362+0000","last_undegraded":"2024-09-12T02:59:20.220362+0000","last_fullsized":"2024-09-12T02:59:20.220362+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224154+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:59:20.224154+0000","last_peered":"2024-09-12T02:59:20.224154+0000","last_clean":"2024-09-12T02:59:20.224154+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:20.224154+0000","last_undegraded":"2024-09-12T02:59:20.224154+0000","last_fullsized":"2024-09-12T02:59:20.224154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224740+0000","last_change":"2024-09-12T02:59:06.046884+0000","last_active":"2024-09-12T02:59:20.224740+0000","last_peered":"2024-09-12T02:59:20.224740+0000","last_clean":"2024-09-12T02:59:20.224740+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:20.224740+0000","last_undegraded":"2024-09-12T02:59:20.224740+0000","last_fullsized":"2024-09-12T02:59:20.224740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:52.145202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227571+0000","last_change":"2024-09-12T02:59:06.062554+0000","last_active":"2024-09-12T02:59:20.227571+0000","last_peered":"2024-09-12T02:59:20.227571+0000","last_clean":"2024-09-12T02:59:20.227571+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:20.227571+0000","last_undegraded":"2024-09-12T02:59:20.227571+0000","last_fullsized":"2024-09-12T02:59:20.227571+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:27.156770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220124+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:59:20.220124+0000","last_peered":"2024-09-12T02:59:20.220124+0000","last_clean":"2024-09-12T02:59:20.220124+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:20.220124+0000","last_undegraded":"2024-09-12T02:59:20.220124+0000","last_fullsized":"2024-09-12T02:59:20.220124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"60'2","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893199+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:59:20.893199+0000","last_peered":"2024-09-12T02:59:20.893199+0000","last_clean":"2024-09-12T02:59:20.893199+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:20.893199+0000","last_undegraded":"2024-09-12T02:59:20.893199+0000","last_fullsized":"2024-09-12T02:59:20.893199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220885+0000","last_change":"2024-09-12T02:59:08.057364+0000","last_active":"2024-09-12T02:59:20.220885+0000","last_peered":"2024-09-12T02:59:20.220885+0000","last_clean":"2024-09-12T02:59:20.220885+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:20.220885+0000","last_undegraded":"2024-09-12T02:59:20.220885+0000","last_fullsized":"2024-09-12T02:59:20.220885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.092701+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:59:21.092701+0000","last_peered":"2024-09-12T02:59:21.092701+0000","last_clean":"2024-09-12T02:59:21.092701+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:21.092701+0000","last_undegraded":"2024-09-12T02:59:21.092701+0000","last_fullsized":"2024-09-12T02:59:21.092701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571447+0000","last_change":"2024-09-12T02:59:08.070124+0000","last_active":"2024-09-12T02:59:20.571447+0000","last_peered":"2024-09-12T02:59:20.571447+0000","last_clean":"2024-09-12T02:59:20.571447+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:20.571447+0000","last_undegraded":"2024-09-12T02:59:20.571447+0000","last_fullsized":"2024-09-12T02:59:20.571447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:14.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093938+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:59:21.093938+0000","last_peered":"2024-09-12T02:59:21.093938+0000","last_clean":"2024-09-12T02:59:21.093938+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:21.093938+0000","last_undegraded":"2024-09-12T02:59:21.093938+0000","last_fullsized":"2024-09-12T02:59:21.093938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555055+0000","last_change":"2024-09-12T02:59:06.063289+0000","last_active":"2024-09-12T02:59:20.555055+0000","last_peered":"2024-09-12T02:59:20.555055+0000","last_clean":"2024-09-12T02:59:20.555055+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:20.555055+0000","last_undegraded":"2024-09-12T02:59:20.555055+0000","last_fullsized":"2024-09-12T02:59:20.555055+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225192+0000","last_change":"2024-09-12T02:59:06.038764+0000","last_active":"2024-09-12T02:59:20.225192+0000","last_peered":"2024-09-12T02:59:20.225192+0000","last_clean":"2024-09-12T02:59:20.225192+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:20.225192+0000","last_undegraded":"2024-09-12T02:59:20.225192+0000","last_fullsized":"2024-09-12T02:59:20.225192+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.748521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":283,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571685+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:59:20.571685+0000","last_peered":"2024-09-12T02:59:20.571685+0000","last_clean":"2024-09-12T02:59:20.571685+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:20.571685+0000","last_undegraded":"2024-09-12T02:59:20.571685+0000","last_fullsized":"2024-09-12T02:59:20.571685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651983+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:59:20.651983+0000","last_peered":"2024-09-12T02:59:20.651983+0000","last_clean":"2024-09-12T02:59:20.651983+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:20.651983+0000","last_undegraded":"2024-09-12T02:59:20.651983+0000","last_fullsized":"2024-09-12T02:59:20.651983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220781+0000","last_change":"2024-09-12T02:59:06.041259+0000","last_active":"2024-09-12T02:59:20.220781+0000","last_peered":"2024-09-12T02:59:20.220781+0000","last_clean":"2024-09-12T02:59:20.220781+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:20.220781+0000","last_undegraded":"2024-09-12T02:59:20.220781+0000","last_fullsized":"2024-09-12T02:59:20.220781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:50.481819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893814+0000","last_change":"2024-09-12T02:59:06.053023+0000","last_active":"2024-09-12T02:59:20.893814+0000","last_peered":"2024-09-12T02:59:20.893814+0000","last_clean":"2024-09-12T02:59:20.893814+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:20.893814+0000","last_undegraded":"2024-09-12T02:59:20.893814+0000","last_fullsized":"2024-09-12T02:59:20.893814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:23.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651340+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:59:20.651340+0000","last_peered":"2024-09-12T02:59:20.651340+0000","last_clean":"2024-09-12T02:59:20.651340+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:20.651340+0000","last_undegraded":"2024-09-12T02:59:20.651340+0000","last_fullsized":"2024-09-12T02:59:20.651340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227193+0000","last_change":"2024-09-12T02:59:06.048181+0000","last_active":"2024-09-12T02:59:20.227193+0000","last_peered":"2024-09-12T02:59:20.227193+0000","last_clean":"2024-09-12T02:59:20.227193+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:20.227193+0000","last_undegraded":"2024-09-12T02:59:20.227193+0000","last_fullsized":"2024-09-12T02:59:20.227193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:18.582473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219594+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:59:20.219594+0000","last_peered":"2024-09-12T02:59:20.219594+0000","last_clean":"2024-09-12T02:59:20.219594+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:20.219594+0000","last_undegraded":"2024-09-12T02:59:20.219594+0000","last_fullsized":"2024-09-12T02:59:20.219594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095006+0000","last_change":"2024-09-12T02:59:06.034598+0000","last_active":"2024-09-12T02:59:21.095006+0000","last_peered":"2024-09-12T02:59:21.095006+0000","last_clean":"2024-09-12T02:59:21.095006+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:21.095006+0000","last_undegraded":"2024-09-12T02:59:21.095006+0000","last_fullsized":"2024-09-12T02:59:21.095006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:16.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573065+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:59:20.573065+0000","last_peered":"2024-09-12T02:59:20.573065+0000","last_clean":"2024-09-12T02:59:20.573065+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:20.573065+0000","last_undegraded":"2024-09-12T02:59:20.573065+0000","last_fullsized":"2024-09-12T02:59:20.573065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893238+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:59:20.893238+0000","last_peered":"2024-09-12T02:59:20.893238+0000","last_clean":"2024-09-12T02:59:20.893238+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:20.893238+0000","last_undegraded":"2024-09-12T02:59:20.893238+0000","last_fullsized":"2024-09-12T02:59:20.893238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222460+0000","last_change":"2024-09-12T02:59:06.062947+0000","last_active":"2024-09-12T02:59:20.222460+0000","last_peered":"2024-09-12T02:59:20.222460+0000","last_clean":"2024-09-12T02:59:20.222460+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:20.222460+0000","last_undegraded":"2024-09-12T02:59:20.222460+0000","last_fullsized":"2024-09-12T02:59:20.222460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:19.386600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573025+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:59:20.573025+0000","last_peered":"2024-09-12T02:59:20.573025+0000","last_clean":"2024-09-12T02:59:20.573025+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:20.573025+0000","last_undegraded":"2024-09-12T02:59:20.573025+0000","last_fullsized":"2024-09-12T02:59:20.573025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224723+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:59:20.224723+0000","last_peered":"2024-09-12T02:59:20.224723+0000","last_clean":"2024-09-12T02:59:20.224723+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:20.224723+0000","last_undegraded":"2024-09-12T02:59:20.224723+0000","last_fullsized":"2024-09-12T02:59:20.224723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221617+0000","last_change":"2024-09-12T02:59:08.073044+0000","last_active":"2024-09-12T02:59:20.221617+0000","last_peered":"2024-09-12T02:59:20.221617+0000","last_clean":"2024-09-12T02:59:20.221617+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:20.221617+0000","last_undegraded":"2024-09-12T02:59:20.221617+0000","last_fullsized":"2024-09-12T02:59:20.221617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571812+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:59:20.571812+0000","last_peered":"2024-09-12T02:59:20.571812+0000","last_clean":"2024-09-12T02:59:20.571812+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:20.571812+0000","last_undegraded":"2024-09-12T02:59:20.571812+0000","last_fullsized":"2024-09-12T02:59:20.571812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893455+0000","last_change":"2024-09-12T02:59:08.079372+0000","last_active":"2024-09-12T02:59:20.893455+0000","last_peered":"2024-09-12T02:59:20.893455+0000","last_clean":"2024-09-12T02:59:20.893455+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:20.893455+0000","last_undegraded":"2024-09-12T02:59:20.893455+0000","last_fullsized":"2024-09-12T02:59:20.893455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:04.951763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093850+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:59:21.093850+0000","last_peered":"2024-09-12T02:59:21.093850+0000","last_clean":"2024-09-12T02:59:21.093850+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:21.093850+0000","last_undegraded":"2024-09-12T02:59:21.093850+0000","last_fullsized":"2024-09-12T02:59:21.093850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651401+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:59:20.651401+0000","last_peered":"2024-09-12T02:59:20.651401+0000","last_clean":"2024-09-12T02:59:20.651401+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:20.651401+0000","last_undegraded":"2024-09-12T02:59:20.651401+0000","last_fullsized":"2024-09-12T02:59:20.651401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651642+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:59:20.651642+0000","last_peered":"2024-09-12T02:59:20.651642+0000","last_clean":"2024-09-12T02:59:20.651642+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:20.651642+0000","last_undegraded":"2024-09-12T02:59:20.651642+0000","last_fullsized":"2024-09-12T02:59:20.651642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555842+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:59:20.555842+0000","last_peered":"2024-09-12T02:59:20.555842+0000","last_clean":"2024-09-12T02:59:20.555842+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:20.555842+0000","last_undegraded":"2024-09-12T02:59:20.555842+0000","last_fullsized":"2024-09-12T02:59:20.555842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572178+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:59:20.572178+0000","last_peered":"2024-09-12T02:59:20.572178+0000","last_clean":"2024-09-12T02:59:20.572178+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:20.572178+0000","last_undegraded":"2024-09-12T02:59:20.572178+0000","last_fullsized":"2024-09-12T02:59:20.572178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221668+0000","last_change":"2024-09-12T02:59:06.050751+0000","last_active":"2024-09-12T02:59:20.221668+0000","last_peered":"2024-09-12T02:59:20.221668+0000","last_clean":"2024-09-12T02:59:20.221668+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:20.221668+0000","last_undegraded":"2024-09-12T02:59:20.221668+0000","last_fullsized":"2024-09-12T02:59:20.221668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.271840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555505+0000","last_change":"2024-09-12T02:59:08.061102+0000","last_active":"2024-09-12T02:59:20.555505+0000","last_peered":"2024-09-12T02:59:20.555505+0000","last_clean":"2024-09-12T02:59:20.555505+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:20.555505+0000","last_undegraded":"2024-09-12T02:59:20.555505+0000","last_fullsized":"2024-09-12T02:59:20.555505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:58.125545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093457+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:59:21.093457+0000","last_peered":"2024-09-12T02:59:21.093457+0000","last_clean":"2024-09-12T02:59:21.093457+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:21.093457+0000","last_undegraded":"2024-09-12T02:59:21.093457+0000","last_fullsized":"2024-09-12T02:59:21.093457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095077+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:59:21.095077+0000","last_peered":"2024-09-12T02:59:21.095077+0000","last_clean":"2024-09-12T02:59:21.095077+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:21.095077+0000","last_undegraded":"2024-09-12T02:59:21.095077+0000","last_fullsized":"2024-09-12T02:59:21.095077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227503+0000","last_change":"2024-09-12T02:59:06.046162+0000","last_active":"2024-09-12T02:59:20.227503+0000","last_peered":"2024-09-12T02:59:20.227503+0000","last_clean":"2024-09-12T02:59:20.227503+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:20.227503+0000","last_undegraded":"2024-09-12T02:59:20.227503+0000","last_fullsized":"2024-09-12T02:59:20.227503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.056594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572297+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:59:20.572297+0000","last_peered":"2024-09-12T02:59:20.572297+0000","last_clean":"2024-09-12T02:59:20.572297+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:20.572297+0000","last_undegraded":"2024-09-12T02:59:20.572297+0000","last_fullsized":"2024-09-12T02:59:20.572297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"62'23","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.650946+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:59:20.650946+0000","last_peered":"2024-09-12T02:59:20.650946+0000","last_clean":"2024-09-12T02:59:20.650946+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:20.650946+0000","last_undegraded":"2024-09-12T02:59:20.650946+0000","last_fullsized":"2024-09-12T02:59:20.650946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37601,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220586+0000","last_change":"2024-09-12T02:59:08.086853+0000","last_active":"2024-09-12T02:59:20.220586+0000","last_peered":"2024-09-12T02:59:20.220586+0000","last_clean":"2024-09-12T02:59:20.220586+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:20.220586+0000","last_undegraded":"2024-09-12T02:59:20.220586+0000","last_fullsized":"2024-09-12T02:59:20.220586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222774+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:59:20.222774+0000","last_peered":"2024-09-12T02:59:20.222774+0000","last_clean":"2024-09-12T02:59:20.222774+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:20.222774+0000","last_undegraded":"2024-09-12T02:59:20.222774+0000","last_fullsized":"2024-09-12T02:59:20.222774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"60'5","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220978+0000","last_change":"2024-09-12T02:59:08.072309+0000","last_active":"2024-09-12T02:59:20.220978+0000","last_peered":"2024-09-12T02:59:20.220978+0000","last_clean":"2024-09-12T02:59:20.220978+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:20.220978+0000","last_undegraded":"2024-09-12T02:59:20.220978+0000","last_fullsized":"2024-09-12T02:59:20.220978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223587+0000","last_change":"2024-09-12T02:59:08.080949+0000","last_active":"2024-09-12T02:59:20.223587+0000","last_peered":"2024-09-12T02:59:20.223587+0000","last_clean":"2024-09-12T02:59:20.223587+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:20.223587+0000","last_undegraded":"2024-09-12T02:59:20.223587+0000","last_fullsized":"2024-09-12T02:59:20.223587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:41.284531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093410+0000","last_change":"2024-09-12T02:59:06.040772+0000","last_active":"2024-09-12T02:59:21.093410+0000","last_peered":"2024-09-12T02:59:21.093410+0000","last_clean":"2024-09-12T02:59:21.093410+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:21.093410+0000","last_undegraded":"2024-09-12T02:59:21.093410+0000","last_fullsized":"2024-09-12T02:59:21.093410+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:31.077375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225642+0000","last_change":"2024-09-12T02:59:06.033384+0000","last_active":"2024-09-12T02:59:20.225642+0000","last_peered":"2024-09-12T02:59:20.225642+0000","last_clean":"2024-09-12T02:59:20.225642+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:20.225642+0000","last_undegraded":"2024-09-12T02:59:20.225642+0000","last_fullsized":"2024-09-12T02:59:20.225642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:41.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555370+0000","last_change":"2024-09-12T02:59:08.074397+0000","last_active":"2024-09-12T02:59:20.555370+0000","last_peered":"2024-09-12T02:59:20.555370+0000","last_clean":"2024-09-12T02:59:20.555370+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:20.555370+0000","last_undegraded":"2024-09-12T02:59:20.555370+0000","last_fullsized":"2024-09-12T02:59:20.555370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:11.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225923+0000","last_change":"2024-09-12T02:59:06.035397+0000","last_active":"2024-09-12T02:59:20.225923+0000","last_peered":"2024-09-12T02:59:20.225923+0000","last_clean":"2024-09-12T02:59:20.225923+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:20.225923+0000","last_undegraded":"2024-09-12T02:59:20.225923+0000","last_fullsized":"2024-09-12T02:59:20.225923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:13.552932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652530+0000","last_change":"2024-09-12T02:59:06.055518+0000","last_active":"2024-09-12T02:59:20.652530+0000","last_peered":"2024-09-12T02:59:20.652530+0000","last_clean":"2024-09-12T02:59:20.652530+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:20.652530+0000","last_undegraded":"2024-09-12T02:59:20.652530+0000","last_fullsized":"2024-09-12T02:59:20.652530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:09.456324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555259+0000","last_change":"2024-09-12T02:59:06.038606+0000","last_active":"2024-09-12T02:59:20.555259+0000","last_peered":"2024-09-12T02:59:20.555259+0000","last_clean":"2024-09-12T02:59:20.555259+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:20.555259+0000","last_undegraded":"2024-09-12T02:59:20.555259+0000","last_fullsized":"2024-09-12T02:59:20.555259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.456399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093743+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:59:21.093743+0000","last_peered":"2024-09-12T02:59:21.093743+0000","last_clean":"2024-09-12T02:59:21.093743+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:21.093743+0000","last_undegraded":"2024-09-12T02:59:21.093743+0000","last_fullsized":"2024-09-12T02:59:21.093743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220149+0000","last_change":"2024-09-12T02:59:08.058453+0000","last_active":"2024-09-12T02:59:20.220149+0000","last_peered":"2024-09-12T02:59:20.220149+0000","last_clean":"2024-09-12T02:59:20.220149+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:20.220149+0000","last_undegraded":"2024-09-12T02:59:20.220149+0000","last_fullsized":"2024-09-12T02:59:20.220149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221549+0000","last_change":"2024-09-12T02:59:06.065547+0000","last_active":"2024-09-12T02:59:20.221549+0000","last_peered":"2024-09-12T02:59:20.221549+0000","last_clean":"2024-09-12T02:59:20.221549+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:20.221549+0000","last_undegraded":"2024-09-12T02:59:20.221549+0000","last_fullsized":"2024-09-12T02:59:20.221549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.274480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652330+0000","last_change":"2024-09-12T02:59:06.057027+0000","last_active":"2024-09-12T02:59:20.652330+0000","last_peered":"2024-09-12T02:59:20.652330+0000","last_clean":"2024-09-12T02:59:20.652330+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:20.652330+0000","last_undegraded":"2024-09-12T02:59:20.652330+0000","last_fullsized":"2024-09-12T02:59:20.652330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:00.045309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555400+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:59:20.555400+0000","last_peered":"2024-09-12T02:59:20.555400+0000","last_clean":"2024-09-12T02:59:20.555400+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:20.555400+0000","last_undegraded":"2024-09-12T02:59:20.555400+0000","last_fullsized":"2024-09-12T02:59:20.555400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554671+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:59:20.554671+0000","last_peered":"2024-09-12T02:59:20.554671+0000","last_clean":"2024-09-12T02:59:20.554671+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:20.554671+0000","last_undegraded":"2024-09-12T02:59:20.554671+0000","last_fullsized":"2024-09-12T02:59:20.554671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651664+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:59:20.651664+0000","last_peered":"2024-09-12T02:59:20.651664+0000","last_clean":"2024-09-12T02:59:20.651664+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:20.651664+0000","last_undegraded":"2024-09-12T02:59:20.651664+0000","last_fullsized":"2024-09-12T02:59:20.651664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094328+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:59:21.094328+0000","last_peered":"2024-09-12T02:59:21.094328+0000","last_clean":"2024-09-12T02:59:21.094328+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:21.094328+0000","last_undegraded":"2024-09-12T02:59:21.094328+0000","last_fullsized":"2024-09-12T02:59:21.094328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893710+0000","last_change":"2024-09-12T02:59:06.049017+0000","last_active":"2024-09-12T02:59:20.893710+0000","last_peered":"2024-09-12T02:59:20.893710+0000","last_clean":"2024-09-12T02:59:20.893710+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:20.893710+0000","last_undegraded":"2024-09-12T02:59:20.893710+0000","last_fullsized":"2024-09-12T02:59:20.893710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.513391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554672+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:59:20.554672+0000","last_peered":"2024-09-12T02:59:20.554672+0000","last_clean":"2024-09-12T02:59:20.554672+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:20.554672+0000","last_undegraded":"2024-09-12T02:59:20.554672+0000","last_fullsized":"2024-09-12T02:59:20.554672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223808+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:59:20.223808+0000","last_peered":"2024-09-12T02:59:20.223808+0000","last_clean":"2024-09-12T02:59:20.223808+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:20.223808+0000","last_undegraded":"2024-09-12T02:59:20.223808+0000","last_fullsized":"2024-09-12T02:59:20.223808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555699+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:59:20.555699+0000","last_peered":"2024-09-12T02:59:20.555699+0000","last_clean":"2024-09-12T02:59:20.555699+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:20.555699+0000","last_undegraded":"2024-09-12T02:59:20.555699+0000","last_fullsized":"2024-09-12T02:59:20.555699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651209+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:59:20.651209+0000","last_peered":"2024-09-12T02:59:20.651209+0000","last_clean":"2024-09-12T02:59:20.651209+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:20.651209+0000","last_undegraded":"2024-09-12T02:59:20.651209+0000","last_fullsized":"2024-09-12T02:59:20.651209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893469+0000","last_change":"2024-09-12T02:59:06.035202+0000","last_active":"2024-09-12T02:59:20.893469+0000","last_peered":"2024-09-12T02:59:20.893469+0000","last_clean":"2024-09-12T02:59:20.893469+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:20.893469+0000","last_undegraded":"2024-09-12T02:59:20.893469+0000","last_fullsized":"2024-09-12T02:59:20.893469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:38.826721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224631+0000","last_change":"2024-09-12T02:59:06.039795+0000","last_active":"2024-09-12T02:59:20.224631+0000","last_peered":"2024-09-12T02:59:20.224631+0000","last_clean":"2024-09-12T02:59:20.224631+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:20.224631+0000","last_undegraded":"2024-09-12T02:59:20.224631+0000","last_fullsized":"2024-09-12T02:59:20.224631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094428+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:59:21.094428+0000","last_peered":"2024-09-12T02:59:21.094428+0000","last_clean":"2024-09-12T02:59:21.094428+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:21.094428+0000","last_undegraded":"2024-09-12T02:59:21.094428+0000","last_fullsized":"2024-09-12T02:59:21.094428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555831+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:59:20.555831+0000","last_peered":"2024-09-12T02:59:20.555831+0000","last_clean":"2024-09-12T02:59:20.555831+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:20.555831+0000","last_undegraded":"2024-09-12T02:59:20.555831+0000","last_fullsized":"2024-09-12T02:59:20.555831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220580+0000","last_change":"2024-09-12T02:59:08.055950+0000","last_active":"2024-09-12T02:59:20.220580+0000","last_peered":"2024-09-12T02:59:20.220580+0000","last_clean":"2024-09-12T02:59:20.220580+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:20.220580+0000","last_undegraded":"2024-09-12T02:59:20.220580+0000","last_fullsized":"2024-09-12T02:59:20.220580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.808972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652436+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:59:20.652436+0000","last_peered":"2024-09-12T02:59:20.652436+0000","last_clean":"2024-09-12T02:59:20.652436+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:20.652436+0000","last_undegraded":"2024-09-12T02:59:20.652436+0000","last_fullsized":"2024-09-12T02:59:20.652436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555996+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:59:20.555996+0000","last_peered":"2024-09-12T02:59:20.555996+0000","last_clean":"2024-09-12T02:59:20.555996+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:20.555996+0000","last_undegraded":"2024-09-12T02:59:20.555996+0000","last_fullsized":"2024-09-12T02:59:20.555996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221900+0000","last_change":"2024-09-12T02:59:06.064508+0000","last_active":"2024-09-12T02:59:20.221900+0000","last_peered":"2024-09-12T02:59:20.221900+0000","last_clean":"2024-09-12T02:59:20.221900+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:20.221900+0000","last_undegraded":"2024-09-12T02:59:20.221900+0000","last_fullsized":"2024-09-12T02:59:20.221900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:09.089943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554994+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:59:20.554994+0000","last_peered":"2024-09-12T02:59:20.554994+0000","last_clean":"2024-09-12T02:59:20.554994+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:20.554994+0000","last_undegraded":"2024-09-12T02:59:20.554994+0000","last_fullsized":"2024-09-12T02:59:20.554994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224351+0000","last_change":"2024-09-12T02:59:06.039130+0000","last_active":"2024-09-12T02:59:20.224351+0000","last_peered":"2024-09-12T02:59:20.224351+0000","last_clean":"2024-09-12T02:59:20.224351+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:20.224351+0000","last_undegraded":"2024-09-12T02:59:20.224351+0000","last_fullsized":"2024-09-12T02:59:20.224351+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:47.700652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094518+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:59:21.094518+0000","last_peered":"2024-09-12T02:59:21.094518+0000","last_clean":"2024-09-12T02:59:21.094518+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:21.094518+0000","last_undegraded":"2024-09-12T02:59:21.094518+0000","last_fullsized":"2024-09-12T02:59:21.094518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652175+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:59:20.652175+0000","last_peered":"2024-09-12T02:59:20.652175+0000","last_clean":"2024-09-12T02:59:20.652175+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:20.652175+0000","last_undegraded":"2024-09-12T02:59:20.652175+0000","last_fullsized":"2024-09-12T02:59:20.652175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572669+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:59:20.572669+0000","last_peered":"2024-09-12T02:59:20.572669+0000","last_clean":"2024-09-12T02:59:20.572669+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:20.572669+0000","last_undegraded":"2024-09-12T02:59:20.572669+0000","last_fullsized":"2024-09-12T02:59:20.572669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893383+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:59:20.893383+0000","last_peered":"2024-09-12T02:59:20.893383+0000","last_clean":"2024-09-12T02:59:20.893383+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:20.893383+0000","last_undegraded":"2024-09-12T02:59:20.893383+0000","last_fullsized":"2024-09-12T02:59:20.893383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226422+0000","last_change":"2024-09-12T02:59:06.052737+0000","last_active":"2024-09-12T02:59:20.226422+0000","last_peered":"2024-09-12T02:59:20.226422+0000","last_clean":"2024-09-12T02:59:20.226422+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:20.226422+0000","last_undegraded":"2024-09-12T02:59:20.226422+0000","last_fullsized":"2024-09-12T02:59:20.226422+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:35.122045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222235+0000","last_change":"2024-09-12T02:59:06.033376+0000","last_active":"2024-09-12T02:59:20.222235+0000","last_peered":"2024-09-12T02:59:20.222235+0000","last_clean":"2024-09-12T02:59:20.222235+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:20.222235+0000","last_undegraded":"2024-09-12T02:59:20.222235+0000","last_fullsized":"2024-09-12T02:59:20.222235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:58.904459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220371+0000","last_change":"2024-09-12T02:59:08.058142+0000","last_active":"2024-09-12T02:59:20.220371+0000","last_peered":"2024-09-12T02:59:20.220371+0000","last_clean":"2024-09-12T02:59:20.220371+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:20.220371+0000","last_undegraded":"2024-09-12T02:59:20.220371+0000","last_fullsized":"2024-09-12T02:59:20.220371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:34.922114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"60'1","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093570+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:59:21.093570+0000","last_peered":"2024-09-12T02:59:21.093570+0000","last_clean":"2024-09-12T02:59:21.093570+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:21.093570+0000","last_undegraded":"2024-09-12T02:59:21.093570+0000","last_fullsized":"2024-09-12T02:59:21.093570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555233+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:59:20.555233+0000","last_peered":"2024-09-12T02:59:20.555233+0000","last_clean":"2024-09-12T02:59:20.555233+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:20.555233+0000","last_undegraded":"2024-09-12T02:59:20.555233+0000","last_fullsized":"2024-09-12T02:59:20.555233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222303+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:59:20.222303+0000","last_peered":"2024-09-12T02:59:20.222303+0000","last_clean":"2024-09-12T02:59:20.222303+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:20.222303+0000","last_undegraded":"2024-09-12T02:59:20.222303+0000","last_fullsized":"2024-09-12T02:59:20.222303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652209+0000","last_change":"2024-09-12T02:59:06.053463+0000","last_active":"2024-09-12T02:59:20.652209+0000","last_peered":"2024-09-12T02:59:20.652209+0000","last_clean":"2024-09-12T02:59:20.652209+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:20.652209+0000","last_undegraded":"2024-09-12T02:59:20.652209+0000","last_fullsized":"2024-09-12T02:59:20.652209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:12.272345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652306+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:59:20.652306+0000","last_peered":"2024-09-12T02:59:20.652306+0000","last_clean":"2024-09-12T02:59:20.652306+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:20.652306+0000","last_undegraded":"2024-09-12T02:59:20.652306+0000","last_fullsized":"2024-09-12T02:59:20.652306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572981+0000","last_change":"2024-09-12T02:59:06.058593+0000","last_active":"2024-09-12T02:59:20.572981+0000","last_peered":"2024-09-12T02:59:20.572981+0000","last_clean":"2024-09-12T02:59:20.572981+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:20.572981+0000","last_undegraded":"2024-09-12T02:59:20.572981+0000","last_fullsized":"2024-09-12T02:59:20.572981+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.306038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555202+0000","last_change":"2024-09-12T02:59:06.066878+0000","last_active":"2024-09-12T02:59:20.555202+0000","last_peered":"2024-09-12T02:59:20.555202+0000","last_clean":"2024-09-12T02:59:20.555202+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:20.555202+0000","last_undegraded":"2024-09-12T02:59:20.555202+0000","last_fullsized":"2024-09-12T02:59:20.555202+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.621838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571689+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:59:20.571689+0000","last_peered":"2024-09-12T02:59:20.571689+0000","last_clean":"2024-09-12T02:59:20.571689+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:20.571689+0000","last_undegraded":"2024-09-12T02:59:20.571689+0000","last_fullsized":"2024-09-12T02:59:20.571689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225014+0000","last_change":"2024-09-12T02:59:06.052855+0000","last_active":"2024-09-12T02:59:20.225014+0000","last_peered":"2024-09-12T02:59:20.225014+0000","last_clean":"2024-09-12T02:59:20.225014+0000","last_became_active":"2024-09-12T02:59:06.051893+0000","last_became_peered":"2024-09-12T02:59:06.051893+0000","last_unstale":"2024-09-12T02:59:20.225014+0000","last_undegraded":"2024-09-12T02:59:20.225014+0000","last_fullsized":"2024-09-12T02:59:20.225014+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:59.682086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571964+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:59:20.571964+0000","last_peered":"2024-09-12T02:59:20.571964+0000","last_clean":"2024-09-12T02:59:20.571964+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:20.571964+0000","last_undegraded":"2024-09-12T02:59:20.571964+0000","last_fullsized":"2024-09-12T02:59:20.571964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226513+0000","last_change":"2024-09-12T02:59:06.050998+0000","last_active":"2024-09-12T02:59:20.226513+0000","last_peered":"2024-09-12T02:59:20.226513+0000","last_clean":"2024-09-12T02:59:20.226513+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:20.226513+0000","last_undegraded":"2024-09-12T02:59:20.226513+0000","last_fullsized":"2024-09-12T02:59:20.226513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:41.882534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094247+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:59:21.094247+0000","last_peered":"2024-09-12T02:59:21.094247+0000","last_clean":"2024-09-12T02:59:21.094247+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:21.094247+0000","last_undegraded":"2024-09-12T02:59:21.094247+0000","last_fullsized":"2024-09-12T02:59:21.094247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221167+0000","last_change":"2024-09-12T02:59:08.055576+0000","last_active":"2024-09-12T02:59:20.221167+0000","last_peered":"2024-09-12T02:59:20.221167+0000","last_clean":"2024-09-12T02:59:20.221167+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:20.221167+0000","last_undegraded":"2024-09-12T02:59:20.221167+0000","last_fullsized":"2024-09-12T02:59:20.221167+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:55.285218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572731+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:59:20.572731+0000","last_peered":"2024-09-12T02:59:20.572731+0000","last_clean":"2024-09-12T02:59:20.572731+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:20.572731+0000","last_undegraded":"2024-09-12T02:59:20.572731+0000","last_fullsized":"2024-09-12T02:59:20.572731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38710,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":502175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":913408,"data_stored":471499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1527808,"data_stored":1069119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28512,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343328,"statfs":{"total":96636764160,"available":96607567872,"internally_reserved":0,"allocated":1519616,"data_stored":1069063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":515714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906949,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29020,"kb_used_data":904,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342820,"statfs":{"total":96636764160,"available":96607047680,"internally_reserved":0,"allocated":925696,"data_stored":478203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":933888,"data_stored":478239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":478273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:59:24.162 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:59:24.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff426000640 1 Processor -- start 2024-09-12T02:59:24.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff426000640 1 -- start start 2024-09-12T02:59:24.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff426000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff420073950 0x7ff4200c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff426000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff4200c7f00 0x7ff4200c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff426000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42006d820 con 0x7ff420154a70 2024-09-12T02:59:24.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff426000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff4200728a0 con 0x7ff4200c7f00 2024-09-12T02:59:24.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff426000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff42015acc0 con 0x7ff420073950 2024-09-12T02:59:24.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff424c00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ff420154a70 0x7ff42015b150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:60770/0 (socket says 172.21.15.63:60770) 2024-09-12T02:59:24.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff424c00640 1 -- 172.21.15.63:0/1640116400 learned_addr learned my addr 172.21.15.63:0/1640116400 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:24.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff41fe00640 1 --2- 172.21.15.63:0/1640116400 >> v2:172.21.15.119:3300/0 conn(0x7ff420073950 0x7ff4200c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff425600640 1 --2- 172.21.15.63:0/1640116400 >> v2:172.21.15.63:3300/0 conn(0x7ff4200c7f00 0x7ff4200c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff425600640 1 -- 172.21.15.63:0/1640116400 >> v2:172.21.15.119:3300/0 conn(0x7ff420073950 msgr2=0x7ff4200c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:24.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff425600640 1 --2- 172.21.15.63:0/1640116400 >> v2:172.21.15.119:3300/0 conn(0x7ff420073950 0x7ff4200c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff425600640 1 -- 172.21.15.63:0/1640116400 >> v1:172.21.15.119:6789/0 conn(0x7ff420154a70 legacy=0x7ff42015b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.336+0000 7ff425600640 1 -- 172.21.15.63:0/1640116400 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff420073460 con 0x7ff4200c7f00 2024-09-12T02:59:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff425600640 1 --2- 172.21.15.63:0/1640116400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4200c7f00 0x7ff4200c9eb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff4200c77b0 tx=0x7ff41801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78368c2ca9814f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff41f400640 1 -- 172.21.15.63:0/1640116400 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4180b2070 con 0x7ff4200c7f00 2024-09-12T02:59:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff41f400640 1 -- 172.21.15.63:0/1640116400 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4180a5760 con 0x7ff4200c7f00 2024-09-12T02:59:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff41f400640 1 -- 172.21.15.63:0/1640116400 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4180a5b30 con 0x7ff4200c7f00 2024-09-12T02:59:24.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff426000640 1 -- 172.21.15.63:0/1640116400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4200c7f00 msgr2=0x7ff4200c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff426000640 1 --2- 172.21.15.63:0/1640116400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4200c7f00 0x7ff4200c9eb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff4200c77b0 tx=0x7ff41801c8a0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff426000640 1 -- 172.21.15.63:0/1640116400 shutdown_connections 2024-09-12T02:59:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff426000640 1 --2- 172.21.15.63:0/1640116400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4200c7f00 0x7ff4200c9eb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff426000640 1 --2- 172.21.15.63:0/1640116400 >> v2:172.21.15.119:3300/0 conn(0x7ff420073950 0x7ff4200c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff426000640 1 -- 172.21.15.63:0/1640116400 >> 172.21.15.63:0/1640116400 conn(0x7ff420070460 msgr2=0x7ff420070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff426000640 1 -- 172.21.15.63:0/1640116400 shutdown_connections 2024-09-12T02:59:24.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.340+0000 7ff426000640 1 -- 172.21.15.63:0/1640116400 wait complete. 2024-09-12T02:59:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 Processor -- start 2024-09-12T02:59:24.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 -- start start 2024-09-12T02:59:24.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff420073950 0x7ff4200c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4200c7f00 0x7ff42015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420154a70 0x7ff42014a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff420154e50 con 0x7ff420073950 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff420072dd0 con 0x7ff420154a70 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff420154fd0 con 0x7ff4200c7f00 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff424c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff420073950 0x7ff4200c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff424c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff420073950 0x7ff4200c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42376/0 (socket says 172.21.15.63:42376) 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff424c00640 1 -- 172.21.15.63:0/1128026264 learned_addr learned my addr 172.21.15.63:0/1128026264 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff41fe00640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4200c7f00 0x7ff42015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff425600640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420154a70 0x7ff42014a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff424c00640 1 -- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4200c7f00 msgr2=0x7ff42015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff424c00640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4200c7f00 0x7ff42015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff424c00640 1 -- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420154a70 msgr2=0x7ff42014a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff424c00640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420154a70 0x7ff42014a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff424c00640 1 -- 172.21.15.63:0/1128026264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4201514a0 con 0x7ff420073950 2024-09-12T02:59:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff424c00640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff420073950 0x7ff4200c99d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c400 tx=0x7ff41400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff41cc00640 1 -- 172.21.15.63:0/1128026264 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414017070 con 0x7ff420073950 2024-09-12T02:59:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff41cc00640 1 -- 172.21.15.63:0/1128026264 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414005cf0 con 0x7ff420073950 2024-09-12T02:59:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff41cc00640 1 -- 172.21.15.63:0/1128026264 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4140072d0 con 0x7ff420073950 2024-09-12T02:59:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4201f7f20 con 0x7ff420073950 2024-09-12T02:59:24.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4201f7160 con 0x7ff420073950 2024-09-12T02:59:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.344+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4200730a0 con 0x7ff420073950 2024-09-12T02:59:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.348+0000 7ff41cc00640 1 -- 172.21.15.63:0/1128026264 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff41401a070 con 0x7ff420073950 2024-09-12T02:59:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.348+0000 7ff41cc00640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4000678c0 0x7ff400069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.348+0000 7ff41cc00640 1 -- 172.21.15.63:0/1128026264 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7ff414085370 con 0x7ff420073950 2024-09-12T02:59:24.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.348+0000 7ff41fe00640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4000678c0 0x7ff400069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.348+0000 7ff41fe00640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4000678c0 0x7ff400069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff4200c3100 tx=0x7ff40c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:24.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.352+0000 7ff41cc00640 1 -- 172.21.15.63:0/1128026264 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff42006d820 con 0x7ff420073950 2024-09-12T02:59:24.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.512+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4200c2cc0 con 0x7ff4000678c0 2024-09-12T02:59:24.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.536+0000 7ff41cc00640 1 -- 172.21.15.63:0/1128026264 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332736 (secure 0 0 0) 0x7ff4200c2cc0 con 0x7ff4000678c0 2024-09-12T02:59:24.543 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:24.545 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:59:24.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4000678c0 msgr2=0x7ff400069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4000678c0 0x7ff400069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff4200c3100 tx=0x7ff40c008040 comp rx=0 tx=0).stop 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff420073950 msgr2=0x7ff4200c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff420073950 0x7ff4200c99d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c400 tx=0x7ff41400c8c0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 shutdown_connections 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff420154a70 0x7ff42014a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff4000678c0 0x7ff400069d80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4200c7f00 0x7ff42015bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 --2- 172.21.15.63:0/1128026264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff420073950 0x7ff4200c99d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 >> 172.21.15.63:0/1128026264 conn(0x7ff420070460 msgr2=0x7ff420159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 shutdown_connections 2024-09-12T02:59:24.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.540+0000 7ff426000640 1 -- 172.21.15.63:0/1128026264 wait complete. 2024-09-12T02:59:24.563 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-09-12T02:59:23.797798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629078,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":244,"num_write_kb":2486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234116,"kb_used_data":8468,"kb_used_omap":15,"kb_used_meta":225456,"kb_avail":754740604,"statfs":{"total":773094113280,"available":772854378496,"internally_reserved":0,"allocated":8671232,"data_stored":5062285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":230867630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002294"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093498+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:59:21.093498+0000","last_peered":"2024-09-12T02:59:21.093498+0000","last_clean":"2024-09-12T02:59:21.093498+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:21.093498+0000","last_undegraded":"2024-09-12T02:59:21.093498+0000","last_fullsized":"2024-09-12T02:59:21.093498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555874+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:59:20.555874+0000","last_peered":"2024-09-12T02:59:20.555874+0000","last_clean":"2024-09-12T02:59:20.555874+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:20.555874+0000","last_undegraded":"2024-09-12T02:59:20.555874+0000","last_fullsized":"2024-09-12T02:59:20.555874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554951+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:59:20.554951+0000","last_peered":"2024-09-12T02:59:20.554951+0000","last_clean":"2024-09-12T02:59:20.554951+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:20.554951+0000","last_undegraded":"2024-09-12T02:59:20.554951+0000","last_fullsized":"2024-09-12T02:59:20.554951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555984+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:59:20.555984+0000","last_peered":"2024-09-12T02:59:20.555984+0000","last_clean":"2024-09-12T02:59:20.555984+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:20.555984+0000","last_undegraded":"2024-09-12T02:59:20.555984+0000","last_fullsized":"2024-09-12T02:59:20.555984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093267+0000","last_change":"2024-09-12T02:59:06.040714+0000","last_active":"2024-09-12T02:59:21.093267+0000","last_peered":"2024-09-12T02:59:21.093267+0000","last_clean":"2024-09-12T02:59:21.093267+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:21.093267+0000","last_undegraded":"2024-09-12T02:59:21.093267+0000","last_fullsized":"2024-09-12T02:59:21.093267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:54.289352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":141,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221118+0000","last_change":"2024-09-12T02:59:08.071320+0000","last_active":"2024-09-12T02:59:20.221118+0000","last_peered":"2024-09-12T02:59:20.221118+0000","last_clean":"2024-09-12T02:59:20.221118+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:20.221118+0000","last_undegraded":"2024-09-12T02:59:20.221118+0000","last_fullsized":"2024-09-12T02:59:20.221118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:38.378285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572534+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:59:20.572534+0000","last_peered":"2024-09-12T02:59:20.572534+0000","last_clean":"2024-09-12T02:59:20.572534+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:20.572534+0000","last_undegraded":"2024-09-12T02:59:20.572534+0000","last_fullsized":"2024-09-12T02:59:20.572534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226154+0000","last_change":"2024-09-12T02:59:06.046085+0000","last_active":"2024-09-12T02:59:20.226154+0000","last_peered":"2024-09-12T02:59:20.226154+0000","last_clean":"2024-09-12T02:59:20.226154+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:20.226154+0000","last_undegraded":"2024-09-12T02:59:20.226154+0000","last_fullsized":"2024-09-12T02:59:20.226154+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:35.684141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223813+0000","last_change":"2024-09-12T02:59:08.073058+0000","last_active":"2024-09-12T02:59:20.223813+0000","last_peered":"2024-09-12T02:59:20.223813+0000","last_clean":"2024-09-12T02:59:20.223813+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:20.223813+0000","last_undegraded":"2024-09-12T02:59:20.223813+0000","last_fullsized":"2024-09-12T02:59:20.223813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.609541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572259+0000","last_change":"2024-09-12T02:59:06.053365+0000","last_active":"2024-09-12T02:59:20.572259+0000","last_peered":"2024-09-12T02:59:20.572259+0000","last_clean":"2024-09-12T02:59:20.572259+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:20.572259+0000","last_undegraded":"2024-09-12T02:59:20.572259+0000","last_fullsized":"2024-09-12T02:59:20.572259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227143+0000","last_change":"2024-09-12T02:59:06.040820+0000","last_active":"2024-09-12T02:59:20.227143+0000","last_peered":"2024-09-12T02:59:20.227143+0000","last_clean":"2024-09-12T02:59:20.227143+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:20.227143+0000","last_undegraded":"2024-09-12T02:59:20.227143+0000","last_fullsized":"2024-09-12T02:59:20.227143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:41.411962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223290+0000","last_change":"2024-09-12T02:59:06.058963+0000","last_active":"2024-09-12T02:59:20.223290+0000","last_peered":"2024-09-12T02:59:20.223290+0000","last_clean":"2024-09-12T02:59:20.223290+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:20.223290+0000","last_undegraded":"2024-09-12T02:59:20.223290+0000","last_fullsized":"2024-09-12T02:59:20.223290+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651357+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:59:20.651357+0000","last_peered":"2024-09-12T02:59:20.651357+0000","last_clean":"2024-09-12T02:59:20.651357+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:20.651357+0000","last_undegraded":"2024-09-12T02:59:20.651357+0000","last_fullsized":"2024-09-12T02:59:20.651357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572449+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:59:20.572449+0000","last_peered":"2024-09-12T02:59:20.572449+0000","last_clean":"2024-09-12T02:59:20.572449+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:20.572449+0000","last_undegraded":"2024-09-12T02:59:20.572449+0000","last_fullsized":"2024-09-12T02:59:20.572449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223073+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:59:20.223073+0000","last_peered":"2024-09-12T02:59:20.223073+0000","last_clean":"2024-09-12T02:59:20.223073+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:20.223073+0000","last_undegraded":"2024-09-12T02:59:20.223073+0000","last_fullsized":"2024-09-12T02:59:20.223073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555282+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:59:20.555282+0000","last_peered":"2024-09-12T02:59:20.555282+0000","last_clean":"2024-09-12T02:59:20.555282+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:20.555282+0000","last_undegraded":"2024-09-12T02:59:20.555282+0000","last_fullsized":"2024-09-12T02:59:20.555282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220179+0000","last_change":"2024-09-12T02:59:08.061938+0000","last_active":"2024-09-12T02:59:20.220179+0000","last_peered":"2024-09-12T02:59:20.220179+0000","last_clean":"2024-09-12T02:59:20.220179+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:20.220179+0000","last_undegraded":"2024-09-12T02:59:20.220179+0000","last_fullsized":"2024-09-12T02:59:20.220179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.137585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221866+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:59:20.221866+0000","last_peered":"2024-09-12T02:59:20.221866+0000","last_clean":"2024-09-12T02:59:20.221866+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:20.221866+0000","last_undegraded":"2024-09-12T02:59:20.221866+0000","last_fullsized":"2024-09-12T02:59:20.221866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555522+0000","last_change":"2024-09-12T02:59:08.063392+0000","last_active":"2024-09-12T02:59:20.555522+0000","last_peered":"2024-09-12T02:59:20.555522+0000","last_clean":"2024-09-12T02:59:20.555522+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:20.555522+0000","last_undegraded":"2024-09-12T02:59:20.555522+0000","last_fullsized":"2024-09-12T02:59:20.555522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:39.814573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219716+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:59:20.219716+0000","last_peered":"2024-09-12T02:59:20.219716+0000","last_clean":"2024-09-12T02:59:20.219716+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:20.219716+0000","last_undegraded":"2024-09-12T02:59:20.219716+0000","last_fullsized":"2024-09-12T02:59:20.219716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221264+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:59:20.221264+0000","last_peered":"2024-09-12T02:59:20.221264+0000","last_clean":"2024-09-12T02:59:20.221264+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:20.221264+0000","last_undegraded":"2024-09-12T02:59:20.221264+0000","last_fullsized":"2024-09-12T02:59:20.221264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222869+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:59:20.222869+0000","last_peered":"2024-09-12T02:59:20.222869+0000","last_clean":"2024-09-12T02:59:20.222869+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:20.222869+0000","last_undegraded":"2024-09-12T02:59:20.222869+0000","last_fullsized":"2024-09-12T02:59:20.222869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571430+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:59:20.571430+0000","last_peered":"2024-09-12T02:59:20.571430+0000","last_clean":"2024-09-12T02:59:20.571430+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:20.571430+0000","last_undegraded":"2024-09-12T02:59:20.571430+0000","last_fullsized":"2024-09-12T02:59:20.571430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224226+0000","last_change":"2024-09-12T02:59:08.080501+0000","last_active":"2024-09-12T02:59:20.224226+0000","last_peered":"2024-09-12T02:59:20.224226+0000","last_clean":"2024-09-12T02:59:20.224226+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:20.224226+0000","last_undegraded":"2024-09-12T02:59:20.224226+0000","last_fullsized":"2024-09-12T02:59:20.224226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:19.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094222+0000","last_change":"2024-09-12T02:59:08.061926+0000","last_active":"2024-09-12T02:59:21.094222+0000","last_peered":"2024-09-12T02:59:21.094222+0000","last_clean":"2024-09-12T02:59:21.094222+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:21.094222+0000","last_undegraded":"2024-09-12T02:59:21.094222+0000","last_fullsized":"2024-09-12T02:59:21.094222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652743+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:59:20.652743+0000","last_peered":"2024-09-12T02:59:20.652743+0000","last_clean":"2024-09-12T02:59:20.652743+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:20.652743+0000","last_undegraded":"2024-09-12T02:59:20.652743+0000","last_fullsized":"2024-09-12T02:59:20.652743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222216+0000","last_change":"2024-09-12T02:59:06.042311+0000","last_active":"2024-09-12T02:59:20.222216+0000","last_peered":"2024-09-12T02:59:20.222216+0000","last_clean":"2024-09-12T02:59:20.222216+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:20.222216+0000","last_undegraded":"2024-09-12T02:59:20.222216+0000","last_fullsized":"2024-09-12T02:59:20.222216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.556036+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:59:20.556036+0000","last_peered":"2024-09-12T02:59:20.556036+0000","last_clean":"2024-09-12T02:59:20.556036+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:20.556036+0000","last_undegraded":"2024-09-12T02:59:20.556036+0000","last_fullsized":"2024-09-12T02:59:20.556036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'10","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220976+0000","last_change":"2024-09-12T02:59:08.080132+0000","last_active":"2024-09-12T02:59:20.220976+0000","last_peered":"2024-09-12T02:59:20.220976+0000","last_clean":"2024-09-12T02:59:20.220976+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:20.220976+0000","last_undegraded":"2024-09-12T02:59:20.220976+0000","last_fullsized":"2024-09-12T02:59:20.220976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:33.297534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554880+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:59:20.554880+0000","last_peered":"2024-09-12T02:59:20.554880+0000","last_clean":"2024-09-12T02:59:20.554880+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:59:20.554880+0000","last_undegraded":"2024-09-12T02:59:20.554880+0000","last_fullsized":"2024-09-12T02:59:20.554880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220394+0000","last_change":"2024-09-12T02:59:08.052379+0000","last_active":"2024-09-12T02:59:20.220394+0000","last_peered":"2024-09-12T02:59:20.220394+0000","last_clean":"2024-09-12T02:59:20.220394+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:20.220394+0000","last_undegraded":"2024-09-12T02:59:20.220394+0000","last_fullsized":"2024-09-12T02:59:20.220394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.582966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572839+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:59:20.572839+0000","last_peered":"2024-09-12T02:59:20.572839+0000","last_clean":"2024-09-12T02:59:20.572839+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:20.572839+0000","last_undegraded":"2024-09-12T02:59:20.572839+0000","last_fullsized":"2024-09-12T02:59:20.572839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094850+0000","last_change":"2024-09-12T02:59:06.034354+0000","last_active":"2024-09-12T02:59:21.094850+0000","last_peered":"2024-09-12T02:59:21.094850+0000","last_clean":"2024-09-12T02:59:21.094850+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:21.094850+0000","last_undegraded":"2024-09-12T02:59:21.094850+0000","last_fullsized":"2024-09-12T02:59:21.094850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:05.155351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226589+0000","last_change":"2024-09-12T02:59:06.034822+0000","last_active":"2024-09-12T02:59:20.226589+0000","last_peered":"2024-09-12T02:59:20.226589+0000","last_clean":"2024-09-12T02:59:20.226589+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:20.226589+0000","last_undegraded":"2024-09-12T02:59:20.226589+0000","last_fullsized":"2024-09-12T02:59:20.226589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:00.839140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220548+0000","last_change":"2024-09-12T02:59:08.054413+0000","last_active":"2024-09-12T02:59:20.220548+0000","last_peered":"2024-09-12T02:59:20.220548+0000","last_clean":"2024-09-12T02:59:20.220548+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:20.220548+0000","last_undegraded":"2024-09-12T02:59:20.220548+0000","last_fullsized":"2024-09-12T02:59:20.220548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:21.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220362+0000","last_change":"2024-09-12T02:59:08.063077+0000","last_active":"2024-09-12T02:59:20.220362+0000","last_peered":"2024-09-12T02:59:20.220362+0000","last_clean":"2024-09-12T02:59:20.220362+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:20.220362+0000","last_undegraded":"2024-09-12T02:59:20.220362+0000","last_fullsized":"2024-09-12T02:59:20.220362+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224154+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:59:20.224154+0000","last_peered":"2024-09-12T02:59:20.224154+0000","last_clean":"2024-09-12T02:59:20.224154+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:20.224154+0000","last_undegraded":"2024-09-12T02:59:20.224154+0000","last_fullsized":"2024-09-12T02:59:20.224154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224740+0000","last_change":"2024-09-12T02:59:06.046884+0000","last_active":"2024-09-12T02:59:20.224740+0000","last_peered":"2024-09-12T02:59:20.224740+0000","last_clean":"2024-09-12T02:59:20.224740+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:20.224740+0000","last_undegraded":"2024-09-12T02:59:20.224740+0000","last_fullsized":"2024-09-12T02:59:20.224740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:52.145202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227571+0000","last_change":"2024-09-12T02:59:06.062554+0000","last_active":"2024-09-12T02:59:20.227571+0000","last_peered":"2024-09-12T02:59:20.227571+0000","last_clean":"2024-09-12T02:59:20.227571+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:20.227571+0000","last_undegraded":"2024-09-12T02:59:20.227571+0000","last_fullsized":"2024-09-12T02:59:20.227571+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:27.156770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220124+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:59:20.220124+0000","last_peered":"2024-09-12T02:59:20.220124+0000","last_clean":"2024-09-12T02:59:20.220124+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:20.220124+0000","last_undegraded":"2024-09-12T02:59:20.220124+0000","last_fullsized":"2024-09-12T02:59:20.220124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"60'2","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893199+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:59:20.893199+0000","last_peered":"2024-09-12T02:59:20.893199+0000","last_clean":"2024-09-12T02:59:20.893199+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:20.893199+0000","last_undegraded":"2024-09-12T02:59:20.893199+0000","last_fullsized":"2024-09-12T02:59:20.893199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220885+0000","last_change":"2024-09-12T02:59:08.057364+0000","last_active":"2024-09-12T02:59:20.220885+0000","last_peered":"2024-09-12T02:59:20.220885+0000","last_clean":"2024-09-12T02:59:20.220885+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:20.220885+0000","last_undegraded":"2024-09-12T02:59:20.220885+0000","last_fullsized":"2024-09-12T02:59:20.220885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.092701+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:59:21.092701+0000","last_peered":"2024-09-12T02:59:21.092701+0000","last_clean":"2024-09-12T02:59:21.092701+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:21.092701+0000","last_undegraded":"2024-09-12T02:59:21.092701+0000","last_fullsized":"2024-09-12T02:59:21.092701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571447+0000","last_change":"2024-09-12T02:59:08.070124+0000","last_active":"2024-09-12T02:59:20.571447+0000","last_peered":"2024-09-12T02:59:20.571447+0000","last_clean":"2024-09-12T02:59:20.571447+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:20.571447+0000","last_undegraded":"2024-09-12T02:59:20.571447+0000","last_fullsized":"2024-09-12T02:59:20.571447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:14.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093938+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:59:21.093938+0000","last_peered":"2024-09-12T02:59:21.093938+0000","last_clean":"2024-09-12T02:59:21.093938+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:21.093938+0000","last_undegraded":"2024-09-12T02:59:21.093938+0000","last_fullsized":"2024-09-12T02:59:21.093938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555055+0000","last_change":"2024-09-12T02:59:06.063289+0000","last_active":"2024-09-12T02:59:20.555055+0000","last_peered":"2024-09-12T02:59:20.555055+0000","last_clean":"2024-09-12T02:59:20.555055+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:20.555055+0000","last_undegraded":"2024-09-12T02:59:20.555055+0000","last_fullsized":"2024-09-12T02:59:20.555055+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225192+0000","last_change":"2024-09-12T02:59:06.038764+0000","last_active":"2024-09-12T02:59:20.225192+0000","last_peered":"2024-09-12T02:59:20.225192+0000","last_clean":"2024-09-12T02:59:20.225192+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:20.225192+0000","last_undegraded":"2024-09-12T02:59:20.225192+0000","last_fullsized":"2024-09-12T02:59:20.225192+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.748521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":283,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571685+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:59:20.571685+0000","last_peered":"2024-09-12T02:59:20.571685+0000","last_clean":"2024-09-12T02:59:20.571685+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:20.571685+0000","last_undegraded":"2024-09-12T02:59:20.571685+0000","last_fullsized":"2024-09-12T02:59:20.571685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651983+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:59:20.651983+0000","last_peered":"2024-09-12T02:59:20.651983+0000","last_clean":"2024-09-12T02:59:20.651983+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:20.651983+0000","last_undegraded":"2024-09-12T02:59:20.651983+0000","last_fullsized":"2024-09-12T02:59:20.651983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220781+0000","last_change":"2024-09-12T02:59:06.041259+0000","last_active":"2024-09-12T02:59:20.220781+0000","last_peered":"2024-09-12T02:59:20.220781+0000","last_clean":"2024-09-12T02:59:20.220781+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:20.220781+0000","last_undegraded":"2024-09-12T02:59:20.220781+0000","last_fullsized":"2024-09-12T02:59:20.220781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:50.481819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893814+0000","last_change":"2024-09-12T02:59:06.053023+0000","last_active":"2024-09-12T02:59:20.893814+0000","last_peered":"2024-09-12T02:59:20.893814+0000","last_clean":"2024-09-12T02:59:20.893814+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:20.893814+0000","last_undegraded":"2024-09-12T02:59:20.893814+0000","last_fullsized":"2024-09-12T02:59:20.893814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:23.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651340+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:59:20.651340+0000","last_peered":"2024-09-12T02:59:20.651340+0000","last_clean":"2024-09-12T02:59:20.651340+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:20.651340+0000","last_undegraded":"2024-09-12T02:59:20.651340+0000","last_fullsized":"2024-09-12T02:59:20.651340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227193+0000","last_change":"2024-09-12T02:59:06.048181+0000","last_active":"2024-09-12T02:59:20.227193+0000","last_peered":"2024-09-12T02:59:20.227193+0000","last_clean":"2024-09-12T02:59:20.227193+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:20.227193+0000","last_undegraded":"2024-09-12T02:59:20.227193+0000","last_fullsized":"2024-09-12T02:59:20.227193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:18.582473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219594+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:59:20.219594+0000","last_peered":"2024-09-12T02:59:20.219594+0000","last_clean":"2024-09-12T02:59:20.219594+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:20.219594+0000","last_undegraded":"2024-09-12T02:59:20.219594+0000","last_fullsized":"2024-09-12T02:59:20.219594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095006+0000","last_change":"2024-09-12T02:59:06.034598+0000","last_active":"2024-09-12T02:59:21.095006+0000","last_peered":"2024-09-12T02:59:21.095006+0000","last_clean":"2024-09-12T02:59:21.095006+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:21.095006+0000","last_undegraded":"2024-09-12T02:59:21.095006+0000","last_fullsized":"2024-09-12T02:59:21.095006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:16.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573065+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:59:20.573065+0000","last_peered":"2024-09-12T02:59:20.573065+0000","last_clean":"2024-09-12T02:59:20.573065+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:20.573065+0000","last_undegraded":"2024-09-12T02:59:20.573065+0000","last_fullsized":"2024-09-12T02:59:20.573065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893238+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:59:20.893238+0000","last_peered":"2024-09-12T02:59:20.893238+0000","last_clean":"2024-09-12T02:59:20.893238+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:20.893238+0000","last_undegraded":"2024-09-12T02:59:20.893238+0000","last_fullsized":"2024-09-12T02:59:20.893238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222460+0000","last_change":"2024-09-12T02:59:06.062947+0000","last_active":"2024-09-12T02:59:20.222460+0000","last_peered":"2024-09-12T02:59:20.222460+0000","last_clean":"2024-09-12T02:59:20.222460+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:20.222460+0000","last_undegraded":"2024-09-12T02:59:20.222460+0000","last_fullsized":"2024-09-12T02:59:20.222460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:19.386600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573025+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:59:20.573025+0000","last_peered":"2024-09-12T02:59:20.573025+0000","last_clean":"2024-09-12T02:59:20.573025+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:20.573025+0000","last_undegraded":"2024-09-12T02:59:20.573025+0000","last_fullsized":"2024-09-12T02:59:20.573025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224723+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:59:20.224723+0000","last_peered":"2024-09-12T02:59:20.224723+0000","last_clean":"2024-09-12T02:59:20.224723+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:20.224723+0000","last_undegraded":"2024-09-12T02:59:20.224723+0000","last_fullsized":"2024-09-12T02:59:20.224723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221617+0000","last_change":"2024-09-12T02:59:08.073044+0000","last_active":"2024-09-12T02:59:20.221617+0000","last_peered":"2024-09-12T02:59:20.221617+0000","last_clean":"2024-09-12T02:59:20.221617+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:20.221617+0000","last_undegraded":"2024-09-12T02:59:20.221617+0000","last_fullsized":"2024-09-12T02:59:20.221617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571812+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:59:20.571812+0000","last_peered":"2024-09-12T02:59:20.571812+0000","last_clean":"2024-09-12T02:59:20.571812+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:20.571812+0000","last_undegraded":"2024-09-12T02:59:20.571812+0000","last_fullsized":"2024-09-12T02:59:20.571812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893455+0000","last_change":"2024-09-12T02:59:08.079372+0000","last_active":"2024-09-12T02:59:20.893455+0000","last_peered":"2024-09-12T02:59:20.893455+0000","last_clean":"2024-09-12T02:59:20.893455+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:20.893455+0000","last_undegraded":"2024-09-12T02:59:20.893455+0000","last_fullsized":"2024-09-12T02:59:20.893455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:04.951763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093850+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:59:21.093850+0000","last_peered":"2024-09-12T02:59:21.093850+0000","last_clean":"2024-09-12T02:59:21.093850+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:21.093850+0000","last_undegraded":"2024-09-12T02:59:21.093850+0000","last_fullsized":"2024-09-12T02:59:21.093850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651401+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:59:20.651401+0000","last_peered":"2024-09-12T02:59:20.651401+0000","last_clean":"2024-09-12T02:59:20.651401+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:20.651401+0000","last_undegraded":"2024-09-12T02:59:20.651401+0000","last_fullsized":"2024-09-12T02:59:20.651401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651642+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:59:20.651642+0000","last_peered":"2024-09-12T02:59:20.651642+0000","last_clean":"2024-09-12T02:59:20.651642+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:20.651642+0000","last_undegraded":"2024-09-12T02:59:20.651642+0000","last_fullsized":"2024-09-12T02:59:20.651642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555842+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:59:20.555842+0000","last_peered":"2024-09-12T02:59:20.555842+0000","last_clean":"2024-09-12T02:59:20.555842+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:20.555842+0000","last_undegraded":"2024-09-12T02:59:20.555842+0000","last_fullsized":"2024-09-12T02:59:20.555842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572178+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:59:20.572178+0000","last_peered":"2024-09-12T02:59:20.572178+0000","last_clean":"2024-09-12T02:59:20.572178+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:20.572178+0000","last_undegraded":"2024-09-12T02:59:20.572178+0000","last_fullsized":"2024-09-12T02:59:20.572178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221668+0000","last_change":"2024-09-12T02:59:06.050751+0000","last_active":"2024-09-12T02:59:20.221668+0000","last_peered":"2024-09-12T02:59:20.221668+0000","last_clean":"2024-09-12T02:59:20.221668+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:20.221668+0000","last_undegraded":"2024-09-12T02:59:20.221668+0000","last_fullsized":"2024-09-12T02:59:20.221668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.271840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555505+0000","last_change":"2024-09-12T02:59:08.061102+0000","last_active":"2024-09-12T02:59:20.555505+0000","last_peered":"2024-09-12T02:59:20.555505+0000","last_clean":"2024-09-12T02:59:20.555505+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:20.555505+0000","last_undegraded":"2024-09-12T02:59:20.555505+0000","last_fullsized":"2024-09-12T02:59:20.555505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:58.125545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093457+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:59:21.093457+0000","last_peered":"2024-09-12T02:59:21.093457+0000","last_clean":"2024-09-12T02:59:21.093457+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:21.093457+0000","last_undegraded":"2024-09-12T02:59:21.093457+0000","last_fullsized":"2024-09-12T02:59:21.093457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095077+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:59:21.095077+0000","last_peered":"2024-09-12T02:59:21.095077+0000","last_clean":"2024-09-12T02:59:21.095077+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:21.095077+0000","last_undegraded":"2024-09-12T02:59:21.095077+0000","last_fullsized":"2024-09-12T02:59:21.095077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227503+0000","last_change":"2024-09-12T02:59:06.046162+0000","last_active":"2024-09-12T02:59:20.227503+0000","last_peered":"2024-09-12T02:59:20.227503+0000","last_clean":"2024-09-12T02:59:20.227503+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:20.227503+0000","last_undegraded":"2024-09-12T02:59:20.227503+0000","last_fullsized":"2024-09-12T02:59:20.227503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.056594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572297+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:59:20.572297+0000","last_peered":"2024-09-12T02:59:20.572297+0000","last_clean":"2024-09-12T02:59:20.572297+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:20.572297+0000","last_undegraded":"2024-09-12T02:59:20.572297+0000","last_fullsized":"2024-09-12T02:59:20.572297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"62'23","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.650946+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:59:20.650946+0000","last_peered":"2024-09-12T02:59:20.650946+0000","last_clean":"2024-09-12T02:59:20.650946+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:20.650946+0000","last_undegraded":"2024-09-12T02:59:20.650946+0000","last_fullsized":"2024-09-12T02:59:20.650946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37601,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220586+0000","last_change":"2024-09-12T02:59:08.086853+0000","last_active":"2024-09-12T02:59:20.220586+0000","last_peered":"2024-09-12T02:59:20.220586+0000","last_clean":"2024-09-12T02:59:20.220586+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:20.220586+0000","last_undegraded":"2024-09-12T02:59:20.220586+0000","last_fullsized":"2024-09-12T02:59:20.220586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222774+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:59:20.222774+0000","last_peered":"2024-09-12T02:59:20.222774+0000","last_clean":"2024-09-12T02:59:20.222774+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:20.222774+0000","last_undegraded":"2024-09-12T02:59:20.222774+0000","last_fullsized":"2024-09-12T02:59:20.222774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"60'5","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220978+0000","last_change":"2024-09-12T02:59:08.072309+0000","last_active":"2024-09-12T02:59:20.220978+0000","last_peered":"2024-09-12T02:59:20.220978+0000","last_clean":"2024-09-12T02:59:20.220978+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:20.220978+0000","last_undegraded":"2024-09-12T02:59:20.220978+0000","last_fullsized":"2024-09-12T02:59:20.220978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223587+0000","last_change":"2024-09-12T02:59:08.080949+0000","last_active":"2024-09-12T02:59:20.223587+0000","last_peered":"2024-09-12T02:59:20.223587+0000","last_clean":"2024-09-12T02:59:20.223587+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:20.223587+0000","last_undegraded":"2024-09-12T02:59:20.223587+0000","last_fullsized":"2024-09-12T02:59:20.223587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:41.284531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093410+0000","last_change":"2024-09-12T02:59:06.040772+0000","last_active":"2024-09-12T02:59:21.093410+0000","last_peered":"2024-09-12T02:59:21.093410+0000","last_clean":"2024-09-12T02:59:21.093410+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:21.093410+0000","last_undegraded":"2024-09-12T02:59:21.093410+0000","last_fullsized":"2024-09-12T02:59:21.093410+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:31.077375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225642+0000","last_change":"2024-09-12T02:59:06.033384+0000","last_active":"2024-09-12T02:59:20.225642+0000","last_peered":"2024-09-12T02:59:20.225642+0000","last_clean":"2024-09-12T02:59:20.225642+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:20.225642+0000","last_undegraded":"2024-09-12T02:59:20.225642+0000","last_fullsized":"2024-09-12T02:59:20.225642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:41.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555370+0000","last_change":"2024-09-12T02:59:08.074397+0000","last_active":"2024-09-12T02:59:20.555370+0000","last_peered":"2024-09-12T02:59:20.555370+0000","last_clean":"2024-09-12T02:59:20.555370+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:20.555370+0000","last_undegraded":"2024-09-12T02:59:20.555370+0000","last_fullsized":"2024-09-12T02:59:20.555370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:11.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225923+0000","last_change":"2024-09-12T02:59:06.035397+0000","last_active":"2024-09-12T02:59:20.225923+0000","last_peered":"2024-09-12T02:59:20.225923+0000","last_clean":"2024-09-12T02:59:20.225923+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:20.225923+0000","last_undegraded":"2024-09-12T02:59:20.225923+0000","last_fullsized":"2024-09-12T02:59:20.225923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:13.552932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652530+0000","last_change":"2024-09-12T02:59:06.055518+0000","last_active":"2024-09-12T02:59:20.652530+0000","last_peered":"2024-09-12T02:59:20.652530+0000","last_clean":"2024-09-12T02:59:20.652530+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:20.652530+0000","last_undegraded":"2024-09-12T02:59:20.652530+0000","last_fullsized":"2024-09-12T02:59:20.652530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:09.456324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555259+0000","last_change":"2024-09-12T02:59:06.038606+0000","last_active":"2024-09-12T02:59:20.555259+0000","last_peered":"2024-09-12T02:59:20.555259+0000","last_clean":"2024-09-12T02:59:20.555259+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:20.555259+0000","last_undegraded":"2024-09-12T02:59:20.555259+0000","last_fullsized":"2024-09-12T02:59:20.555259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.456399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093743+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:59:21.093743+0000","last_peered":"2024-09-12T02:59:21.093743+0000","last_clean":"2024-09-12T02:59:21.093743+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:21.093743+0000","last_undegraded":"2024-09-12T02:59:21.093743+0000","last_fullsized":"2024-09-12T02:59:21.093743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220149+0000","last_change":"2024-09-12T02:59:08.058453+0000","last_active":"2024-09-12T02:59:20.220149+0000","last_peered":"2024-09-12T02:59:20.220149+0000","last_clean":"2024-09-12T02:59:20.220149+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:20.220149+0000","last_undegraded":"2024-09-12T02:59:20.220149+0000","last_fullsized":"2024-09-12T02:59:20.220149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221549+0000","last_change":"2024-09-12T02:59:06.065547+0000","last_active":"2024-09-12T02:59:20.221549+0000","last_peered":"2024-09-12T02:59:20.221549+0000","last_clean":"2024-09-12T02:59:20.221549+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:20.221549+0000","last_undegraded":"2024-09-12T02:59:20.221549+0000","last_fullsized":"2024-09-12T02:59:20.221549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.274480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652330+0000","last_change":"2024-09-12T02:59:06.057027+0000","last_active":"2024-09-12T02:59:20.652330+0000","last_peered":"2024-09-12T02:59:20.652330+0000","last_clean":"2024-09-12T02:59:20.652330+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:20.652330+0000","last_undegraded":"2024-09-12T02:59:20.652330+0000","last_fullsized":"2024-09-12T02:59:20.652330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:00.045309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555400+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:59:20.555400+0000","last_peered":"2024-09-12T02:59:20.555400+0000","last_clean":"2024-09-12T02:59:20.555400+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:20.555400+0000","last_undegraded":"2024-09-12T02:59:20.555400+0000","last_fullsized":"2024-09-12T02:59:20.555400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554671+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:59:20.554671+0000","last_peered":"2024-09-12T02:59:20.554671+0000","last_clean":"2024-09-12T02:59:20.554671+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:20.554671+0000","last_undegraded":"2024-09-12T02:59:20.554671+0000","last_fullsized":"2024-09-12T02:59:20.554671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651664+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:59:20.651664+0000","last_peered":"2024-09-12T02:59:20.651664+0000","last_clean":"2024-09-12T02:59:20.651664+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:20.651664+0000","last_undegraded":"2024-09-12T02:59:20.651664+0000","last_fullsized":"2024-09-12T02:59:20.651664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094328+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:59:21.094328+0000","last_peered":"2024-09-12T02:59:21.094328+0000","last_clean":"2024-09-12T02:59:21.094328+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:21.094328+0000","last_undegraded":"2024-09-12T02:59:21.094328+0000","last_fullsized":"2024-09-12T02:59:21.094328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893710+0000","last_change":"2024-09-12T02:59:06.049017+0000","last_active":"2024-09-12T02:59:20.893710+0000","last_peered":"2024-09-12T02:59:20.893710+0000","last_clean":"2024-09-12T02:59:20.893710+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:20.893710+0000","last_undegraded":"2024-09-12T02:59:20.893710+0000","last_fullsized":"2024-09-12T02:59:20.893710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.513391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554672+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:59:20.554672+0000","last_peered":"2024-09-12T02:59:20.554672+0000","last_clean":"2024-09-12T02:59:20.554672+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:20.554672+0000","last_undegraded":"2024-09-12T02:59:20.554672+0000","last_fullsized":"2024-09-12T02:59:20.554672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223808+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:59:20.223808+0000","last_peered":"2024-09-12T02:59:20.223808+0000","last_clean":"2024-09-12T02:59:20.223808+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:20.223808+0000","last_undegraded":"2024-09-12T02:59:20.223808+0000","last_fullsized":"2024-09-12T02:59:20.223808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555699+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:59:20.555699+0000","last_peered":"2024-09-12T02:59:20.555699+0000","last_clean":"2024-09-12T02:59:20.555699+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:20.555699+0000","last_undegraded":"2024-09-12T02:59:20.555699+0000","last_fullsized":"2024-09-12T02:59:20.555699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651209+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:59:20.651209+0000","last_peered":"2024-09-12T02:59:20.651209+0000","last_clean":"2024-09-12T02:59:20.651209+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:20.651209+0000","last_undegraded":"2024-09-12T02:59:20.651209+0000","last_fullsized":"2024-09-12T02:59:20.651209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893469+0000","last_change":"2024-09-12T02:59:06.035202+0000","last_active":"2024-09-12T02:59:20.893469+0000","last_peered":"2024-09-12T02:59:20.893469+0000","last_clean":"2024-09-12T02:59:20.893469+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:20.893469+0000","last_undegraded":"2024-09-12T02:59:20.893469+0000","last_fullsized":"2024-09-12T02:59:20.893469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:38.826721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224631+0000","last_change":"2024-09-12T02:59:06.039795+0000","last_active":"2024-09-12T02:59:20.224631+0000","last_peered":"2024-09-12T02:59:20.224631+0000","last_clean":"2024-09-12T02:59:20.224631+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:20.224631+0000","last_undegraded":"2024-09-12T02:59:20.224631+0000","last_fullsized":"2024-09-12T02:59:20.224631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094428+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:59:21.094428+0000","last_peered":"2024-09-12T02:59:21.094428+0000","last_clean":"2024-09-12T02:59:21.094428+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:21.094428+0000","last_undegraded":"2024-09-12T02:59:21.094428+0000","last_fullsized":"2024-09-12T02:59:21.094428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555831+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:59:20.555831+0000","last_peered":"2024-09-12T02:59:20.555831+0000","last_clean":"2024-09-12T02:59:20.555831+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:20.555831+0000","last_undegraded":"2024-09-12T02:59:20.555831+0000","last_fullsized":"2024-09-12T02:59:20.555831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220580+0000","last_change":"2024-09-12T02:59:08.055950+0000","last_active":"2024-09-12T02:59:20.220580+0000","last_peered":"2024-09-12T02:59:20.220580+0000","last_clean":"2024-09-12T02:59:20.220580+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:20.220580+0000","last_undegraded":"2024-09-12T02:59:20.220580+0000","last_fullsized":"2024-09-12T02:59:20.220580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.808972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652436+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:59:20.652436+0000","last_peered":"2024-09-12T02:59:20.652436+0000","last_clean":"2024-09-12T02:59:20.652436+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:20.652436+0000","last_undegraded":"2024-09-12T02:59:20.652436+0000","last_fullsized":"2024-09-12T02:59:20.652436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555996+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:59:20.555996+0000","last_peered":"2024-09-12T02:59:20.555996+0000","last_clean":"2024-09-12T02:59:20.555996+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:20.555996+0000","last_undegraded":"2024-09-12T02:59:20.555996+0000","last_fullsized":"2024-09-12T02:59:20.555996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221900+0000","last_change":"2024-09-12T02:59:06.064508+0000","last_active":"2024-09-12T02:59:20.221900+0000","last_peered":"2024-09-12T02:59:20.221900+0000","last_clean":"2024-09-12T02:59:20.221900+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:20.221900+0000","last_undegraded":"2024-09-12T02:59:20.221900+0000","last_fullsized":"2024-09-12T02:59:20.221900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:09.089943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554994+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:59:20.554994+0000","last_peered":"2024-09-12T02:59:20.554994+0000","last_clean":"2024-09-12T02:59:20.554994+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:20.554994+0000","last_undegraded":"2024-09-12T02:59:20.554994+0000","last_fullsized":"2024-09-12T02:59:20.554994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224351+0000","last_change":"2024-09-12T02:59:06.039130+0000","last_active":"2024-09-12T02:59:20.224351+0000","last_peered":"2024-09-12T02:59:20.224351+0000","last_clean":"2024-09-12T02:59:20.224351+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:20.224351+0000","last_undegraded":"2024-09-12T02:59:20.224351+0000","last_fullsized":"2024-09-12T02:59:20.224351+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:47.700652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094518+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:59:21.094518+0000","last_peered":"2024-09-12T02:59:21.094518+0000","last_clean":"2024-09-12T02:59:21.094518+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:21.094518+0000","last_undegraded":"2024-09-12T02:59:21.094518+0000","last_fullsized":"2024-09-12T02:59:21.094518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652175+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:59:20.652175+0000","last_peered":"2024-09-12T02:59:20.652175+0000","last_clean":"2024-09-12T02:59:20.652175+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:20.652175+0000","last_undegraded":"2024-09-12T02:59:20.652175+0000","last_fullsized":"2024-09-12T02:59:20.652175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572669+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:59:20.572669+0000","last_peered":"2024-09-12T02:59:20.572669+0000","last_clean":"2024-09-12T02:59:20.572669+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:20.572669+0000","last_undegraded":"2024-09-12T02:59:20.572669+0000","last_fullsized":"2024-09-12T02:59:20.572669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893383+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:59:20.893383+0000","last_peered":"2024-09-12T02:59:20.893383+0000","last_clean":"2024-09-12T02:59:20.893383+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:20.893383+0000","last_undegraded":"2024-09-12T02:59:20.893383+0000","last_fullsized":"2024-09-12T02:59:20.893383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226422+0000","last_change":"2024-09-12T02:59:06.052737+0000","last_active":"2024-09-12T02:59:20.226422+0000","last_peered":"2024-09-12T02:59:20.226422+0000","last_clean":"2024-09-12T02:59:20.226422+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:20.226422+0000","last_undegraded":"2024-09-12T02:59:20.226422+0000","last_fullsized":"2024-09-12T02:59:20.226422+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:35.122045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222235+0000","last_change":"2024-09-12T02:59:06.033376+0000","last_active":"2024-09-12T02:59:20.222235+0000","last_peered":"2024-09-12T02:59:20.222235+0000","last_clean":"2024-09-12T02:59:20.222235+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:20.222235+0000","last_undegraded":"2024-09-12T02:59:20.222235+0000","last_fullsized":"2024-09-12T02:59:20.222235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:58.904459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220371+0000","last_change":"2024-09-12T02:59:08.058142+0000","last_active":"2024-09-12T02:59:20.220371+0000","last_peered":"2024-09-12T02:59:20.220371+0000","last_clean":"2024-09-12T02:59:20.220371+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:20.220371+0000","last_undegraded":"2024-09-12T02:59:20.220371+0000","last_fullsized":"2024-09-12T02:59:20.220371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:34.922114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"60'1","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093570+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:59:21.093570+0000","last_peered":"2024-09-12T02:59:21.093570+0000","last_clean":"2024-09-12T02:59:21.093570+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:21.093570+0000","last_undegraded":"2024-09-12T02:59:21.093570+0000","last_fullsized":"2024-09-12T02:59:21.093570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555233+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:59:20.555233+0000","last_peered":"2024-09-12T02:59:20.555233+0000","last_clean":"2024-09-12T02:59:20.555233+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:20.555233+0000","last_undegraded":"2024-09-12T02:59:20.555233+0000","last_fullsized":"2024-09-12T02:59:20.555233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222303+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:59:20.222303+0000","last_peered":"2024-09-12T02:59:20.222303+0000","last_clean":"2024-09-12T02:59:20.222303+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:20.222303+0000","last_undegraded":"2024-09-12T02:59:20.222303+0000","last_fullsized":"2024-09-12T02:59:20.222303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652209+0000","last_change":"2024-09-12T02:59:06.053463+0000","last_active":"2024-09-12T02:59:20.652209+0000","last_peered":"2024-09-12T02:59:20.652209+0000","last_clean":"2024-09-12T02:59:20.652209+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:20.652209+0000","last_undegraded":"2024-09-12T02:59:20.652209+0000","last_fullsized":"2024-09-12T02:59:20.652209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:12.272345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652306+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:59:20.652306+0000","last_peered":"2024-09-12T02:59:20.652306+0000","last_clean":"2024-09-12T02:59:20.652306+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:20.652306+0000","last_undegraded":"2024-09-12T02:59:20.652306+0000","last_fullsized":"2024-09-12T02:59:20.652306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572981+0000","last_change":"2024-09-12T02:59:06.058593+0000","last_active":"2024-09-12T02:59:20.572981+0000","last_peered":"2024-09-12T02:59:20.572981+0000","last_clean":"2024-09-12T02:59:20.572981+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:20.572981+0000","last_undegraded":"2024-09-12T02:59:20.572981+0000","last_fullsized":"2024-09-12T02:59:20.572981+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.306038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555202+0000","last_change":"2024-09-12T02:59:06.066878+0000","last_active":"2024-09-12T02:59:20.555202+0000","last_peered":"2024-09-12T02:59:20.555202+0000","last_clean":"2024-09-12T02:59:20.555202+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:20.555202+0000","last_undegraded":"2024-09-12T02:59:20.555202+0000","last_fullsized":"2024-09-12T02:59:20.555202+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.621838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571689+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:59:20.571689+0000","last_peered":"2024-09-12T02:59:20.571689+0000","last_clean":"2024-09-12T02:59:20.571689+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:20.571689+0000","last_undegraded":"2024-09-12T02:59:20.571689+0000","last_fullsized":"2024-09-12T02:59:20.571689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225014+0000","last_change":"2024-09-12T02:59:06.052855+0000","last_active":"2024-09-12T02:59:20.225014+0000","last_peered":"2024-09-12T02:59:20.225014+0000","last_clean":"2024-09-12T02:59:20.225014+0000","last_became_active":"2024-09-12T02:59:06.051893+0000","last_became_peered":"2024-09-12T02:59:06.051893+0000","last_unstale":"2024-09-12T02:59:20.225014+0000","last_undegraded":"2024-09-12T02:59:20.225014+0000","last_fullsized":"2024-09-12T02:59:20.225014+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:59.682086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571964+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:59:20.571964+0000","last_peered":"2024-09-12T02:59:20.571964+0000","last_clean":"2024-09-12T02:59:20.571964+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:20.571964+0000","last_undegraded":"2024-09-12T02:59:20.571964+0000","last_fullsized":"2024-09-12T02:59:20.571964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226513+0000","last_change":"2024-09-12T02:59:06.050998+0000","last_active":"2024-09-12T02:59:20.226513+0000","last_peered":"2024-09-12T02:59:20.226513+0000","last_clean":"2024-09-12T02:59:20.226513+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:20.226513+0000","last_undegraded":"2024-09-12T02:59:20.226513+0000","last_fullsized":"2024-09-12T02:59:20.226513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:41.882534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094247+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:59:21.094247+0000","last_peered":"2024-09-12T02:59:21.094247+0000","last_clean":"2024-09-12T02:59:21.094247+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:21.094247+0000","last_undegraded":"2024-09-12T02:59:21.094247+0000","last_fullsized":"2024-09-12T02:59:21.094247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221167+0000","last_change":"2024-09-12T02:59:08.055576+0000","last_active":"2024-09-12T02:59:20.221167+0000","last_peered":"2024-09-12T02:59:20.221167+0000","last_clean":"2024-09-12T02:59:20.221167+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:20.221167+0000","last_undegraded":"2024-09-12T02:59:20.221167+0000","last_fullsized":"2024-09-12T02:59:20.221167+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:55.285218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572731+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:59:20.572731+0000","last_peered":"2024-09-12T02:59:20.572731+0000","last_clean":"2024-09-12T02:59:20.572731+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:20.572731+0000","last_undegraded":"2024-09-12T02:59:20.572731+0000","last_fullsized":"2024-09-12T02:59:20.572731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38710,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":502175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":913408,"data_stored":471499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509475,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1527808,"data_stored":1069119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28512,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343328,"statfs":{"total":96636764160,"available":96607567872,"internally_reserved":0,"allocated":1519616,"data_stored":1069063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":515714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906949,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29020,"kb_used_data":904,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342820,"statfs":{"total":96636764160,"available":96607047680,"internally_reserved":0,"allocated":925696,"data_stored":478203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":933888,"data_stored":478239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":478273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:59:24.567 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T02:59:24.568 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T02:59:24.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc6000640 1 Processor -- start 2024-09-12T02:59:24.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc6000640 1 -- start start 2024-09-12T02:59:24.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc6000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8fc01515f0 0x7f8fc00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc6000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8fc00c1e90 0x7f8fc00c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc6000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fc00c1520 con 0x7f8fc01519d0 2024-09-12T02:59:24.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc6000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc00c84a0 con 0x7f8fc01515f0 2024-09-12T02:59:24.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc6000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc0073810 con 0x7f8fc00c1e90 2024-09-12T02:59:24.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc4c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8fc01515f0 0x7f8fc00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc4c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8fc01515f0 0x7f8fc00c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42382/0 (socket says 172.21.15.63:42382) 2024-09-12T02:59:24.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fc4c00640 1 -- 172.21.15.63:0/17785031 learned_addr learned my addr 172.21.15.63:0/17785031 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:24.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.748+0000 7f8fbfe00640 1 --1- 172.21.15.63:0/17785031 >> v1:172.21.15.63:6789/0 conn(0x7f8fc01519d0 0x7f8fc00717e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57582/0 (socket says 172.21.15.63:57582) 2024-09-12T02:59:24.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fc5600640 1 --2- 172.21.15.63:0/17785031 >> v2:172.21.15.119:3300/0 conn(0x7f8fc00c1e90 0x7f8fc00c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fc4c00640 1 -- 172.21.15.63:0/17785031 >> v2:172.21.15.119:3300/0 conn(0x7f8fc00c1e90 msgr2=0x7f8fc00c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:24.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fc4c00640 1 --2- 172.21.15.63:0/17785031 >> v2:172.21.15.119:3300/0 conn(0x7f8fc00c1e90 0x7f8fc00c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fc4c00640 1 -- 172.21.15.63:0/17785031 >> v1:172.21.15.63:6789/0 conn(0x7f8fc01519d0 legacy=0x7f8fc00717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fc4c00640 1 -- 172.21.15.63:0/17785031 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc0073af0 con 0x7f8fc01515f0 2024-09-12T02:59:24.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fc4c00640 1 --2- 172.21.15.63:0/17785031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 0x7f8fc00c7f60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0070390 tx=0x7f8fb001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd56ca5f64a8d1a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:24.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fbf400640 1 -- 172.21.15.63:0/17785031 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00a5590 con 0x7f8fc01515f0 2024-09-12T02:59:24.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fbf400640 1 -- 172.21.15.63:0/17785031 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb00a5730 con 0x7f8fc01515f0 2024-09-12T02:59:24.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fbf400640 1 -- 172.21.15.63:0/17785031 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00a5b00 con 0x7f8fc01515f0 2024-09-12T02:59:24.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fc6000640 1 -- 172.21.15.63:0/17785031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 msgr2=0x7f8fc00c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.752+0000 7f8fc6000640 1 --2- 172.21.15.63:0/17785031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 0x7f8fc00c7f60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0070390 tx=0x7f8fb001c8d0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 -- 172.21.15.63:0/17785031 shutdown_connections 2024-09-12T02:59:24.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 --2- 172.21.15.63:0/17785031 >> v2:172.21.15.119:3300/0 conn(0x7f8fc00c1e90 0x7f8fc00c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 --2- 172.21.15.63:0/17785031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 0x7f8fc00c7f60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 -- 172.21.15.63:0/17785031 >> 172.21.15.63:0/17785031 conn(0x7f8fc006f3a0 msgr2=0x7f8fc006f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:24.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 -- 172.21.15.63:0/17785031 shutdown_connections 2024-09-12T02:59:24.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 -- 172.21.15.63:0/17785031 wait complete. 2024-09-12T02:59:24.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 Processor -- start 2024-09-12T02:59:24.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 -- start start 2024-09-12T02:59:24.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00c1e90 0x7f8fc01539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 0x7f8fc01f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc0075150 0x7f8fc0143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc0072070 con 0x7f8fc01515f0 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc0071ef0 con 0x7f8fc00c1e90 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc6000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc0164510 con 0x7f8fc0075150 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fbfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 0x7f8fc01f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fbfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 0x7f8fc01f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42394/0 (socket says 172.21.15.63:42394) 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fbfe00640 1 -- 172.21.15.63:0/3318660501 learned_addr learned my addr 172.21.15.63:0/3318660501 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc4c00640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00c1e90 0x7f8fc01539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fc5600640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc0075150 0x7f8fc0143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fbfe00640 1 -- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc0075150 msgr2=0x7f8fc0143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fbfe00640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc0075150 0x7f8fc0143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fbfe00640 1 -- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00c1e90 msgr2=0x7f8fc01539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fbfe00640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00c1e90 0x7f8fc01539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fbfe00640 1 -- 172.21.15.63:0/3318660501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc0153ef0 con 0x7f8fc01515f0 2024-09-12T02:59:24.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.756+0000 7f8fbfe00640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 0x7f8fc01f6d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00c450 tx=0x7f8fac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:24.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fbcc00640 1 -- 172.21.15.63:0/3318660501 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac018070 con 0x7f8fc01515f0 2024-09-12T02:59:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fbcc00640 1 -- 172.21.15.63:0/3318660501 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fac007480 con 0x7f8fc01515f0 2024-09-12T02:59:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc0152350 con 0x7f8fc01515f0 2024-09-12T02:59:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fbcc00640 1 -- 172.21.15.63:0/3318660501 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac0047f0 con 0x7f8fc01515f0 2024-09-12T02:59:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc0145300 con 0x7f8fc01515f0 2024-09-12T02:59:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc00c8810 con 0x7f8fc01515f0 2024-09-12T02:59:24.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fbcc00640 1 -- 172.21.15.63:0/3318660501 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8fac01b070 con 0x7f8fc01515f0 2024-09-12T02:59:24.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fbcc00640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8fa00678f0 0x7f8fa0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:24.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fbcc00640 1 -- 172.21.15.63:0/3318660501 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f8fac085370 con 0x7f8fc01515f0 2024-09-12T02:59:24.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.760+0000 7f8fc4c00640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8fa00678f0 0x7f8fa0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:24.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.764+0000 7f8fc4c00640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8fa00678f0 0x7f8fa0069db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00ae000 tx=0x7f8fb00a7070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:24.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.764+0000 7f8fbcc00640 1 -- 172.21.15.63:0/3318660501 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8fc0153ef0 con 0x7f8fc01515f0 2024-09-12T02:59:24.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.932+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"} v 0) -- 0x7f8fc00c7800 con 0x7f8fc01515f0 2024-09-12T02:59:24.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fbcc00640 1 -- 172.21.15.63:0/3318660501 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr_debug_aggressive_pg_num_changes"}]=0 v11) ==== 118+0+0 (secure 0 0 0) 0x7f8fac055a20 con 0x7f8fc01515f0 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8fa00678f0 msgr2=0x7f8fa0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8fa00678f0 0x7f8fa0069db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00ae000 tx=0x7f8fb00a7070 comp rx=0 tx=0).stop 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 msgr2=0x7f8fc01f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 0x7f8fc01f6d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00c450 tx=0x7f8fac00c910 comp rx=0 tx=0).stop 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 shutdown_connections 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f8fa00678f0 0x7f8fa0069db0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc0075150 0x7f8fc0143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8fc01515f0 0x7f8fc01f6d80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 --2- 172.21.15.63:0/3318660501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00c1e90 0x7f8fc01539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 >> 172.21.15.63:0/3318660501 conn(0x7f8fc006f3a0 msgr2=0x7f8fc01540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 shutdown_connections 2024-09-12T02:59:24.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:24.936+0000 7f8fc6000640 1 -- 172.21.15.63:0/3318660501 wait complete. 2024-09-12T02:59:24.960 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:59:24.971 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:59:24.971 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:59:24.971 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:59:24.980 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-12T02:59:24.980 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:59:25.031 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T02:59:25.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f5235600640 1 Processor -- start 2024-09-12T02:59:25.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f5235600640 1 -- start start 2024-09-12T02:59:25.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f5235600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52300c88f0 0x7f523006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:25.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f5235600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52300c6790 con 0x7f52300c6340 2024-09-12T02:59:25.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f5235600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52300c7060 con 0x7f5230152550 2024-09-12T02:59:25.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f5235600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f52300c6e10 con 0x7f52300c88f0 2024-09-12T02:59:25.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522f400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f52300c6340 0x7f52300c81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57590/0 (socket says 172.21.15.63:57590) 2024-09-12T02:59:25.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522f400640 1 -- 172.21.15.63:0/3100373414 learned_addr learned my addr 172.21.15.63:0/3100373414 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:25.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f5234c00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52300c88f0 0x7f523006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:25.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780094682 0 0) 0x7f521c001120 con 0x7f52300c6340 2024-09-12T02:59:25.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5214003530 con 0x7f52300c6340 2024-09-12T02:59:25.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4199893083 0 0) 0x7f5214003530 con 0x7f52300c6340 2024-09-12T02:59:25.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52300c88f0 msgr2=0x7f523006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:25.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52300c88f0 0x7f523006ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:25.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 >> v1:172.21.15.119:6789/0 conn(0x7f5230152550 legacy=0x7f5230158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:25.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52300c7340 con 0x7f52300c6340 2024-09-12T02:59:25.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f521c001850 con 0x7f52300c6340 2024-09-12T02:59:25.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 >> v1:172.21.15.63:6789/0 conn(0x7f52300c6340 legacy=0x7f52300c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:25.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f5214003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:25.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52140043c0 0x7f5214004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:25.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5214005090 0x7f521400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:25.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f52300c6e10 con 0x7f52140039f0 2024-09-12T02:59:25.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f521400bf10 con 0x7f52140043c0 2024-09-12T02:59:25.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f521400c090 con 0x7f5214005090 2024-09-12T02:59:25.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.212+0000 7f522fe00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f5214003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:25.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f5234c00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5214005090 0x7f521400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:25.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522f400640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52140043c0 0x7f5214004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:25.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522fe00640 1 -- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5214005090 msgr2=0x7f521400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:25.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522fe00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5214005090 0x7f521400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:25.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522fe00640 1 -- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52140043c0 msgr2=0x7f5214004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:25.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522fe00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52140043c0 0x7f5214004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:25.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522fe00640 1 -- 172.21.15.63:0/3100373414 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5214003530 con 0x7f52140039f0 2024-09-12T02:59:25.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522fe00640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f5214003df0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5220001860 tx=0x7f522001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67da87b8d8cae94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:25.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52200b5070 con 0x7f52140039f0 2024-09-12T02:59:25.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52200a88b0 con 0x7f52140039f0 2024-09-12T02:59:25.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f522ea00640 1 -- 172.21.15.63:0/3100373414 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220001460 con 0x7f52140039f0 2024-09-12T02:59:25.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f5235600640 1 -- 172.21.15.63:0/3100373414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 msgr2=0x7f5214003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:25.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f5235600640 1 --2- 172.21.15.63:0/3100373414 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f5214003df0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5220001860 tx=0x7f522001ec90 comp rx=0 tx=0).stop 2024-09-12T02:59:25.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.216+0000 7f5234c00640 1 -- 172.21.15.63:0/3100373414 reap_dead start 2024-09-12T02:59:25.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 -- 172.21.15.63:0/3100373414 shutdown_connections 2024-09-12T02:59:25.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 -- 172.21.15.63:0/3100373414 >> 172.21.15.63:0/3100373414 conn(0x7f52300cc410 msgr2=0x7f52300cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:25.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 -- 172.21.15.63:0/3100373414 shutdown_connections 2024-09-12T02:59:25.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 -- 172.21.15.63:0/3100373414 wait complete. 2024-09-12T02:59:25.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 Processor -- start 2024-09-12T02:59:25.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 -- start start 2024-09-12T02:59:25.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f52301539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:25.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52301554e0 0x7f5230153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:25.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52300720c0 0x7f52301482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:25.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f52300c7900 con 0x7f52140039f0 2024-09-12T02:59:25.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f52300c7c70 con 0x7f52300720c0 2024-09-12T02:59:25.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5230152930 con 0x7f52301554e0 2024-09-12T02:59:25.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f52301539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f52301539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42410/0 (socket says 172.21.15.63:42410) 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522fe00640 1 -- 172.21.15.63:0/163864405 learned_addr learned my addr 172.21.15.63:0/163864405 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5234c00640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52300720c0 0x7f52301482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522f400640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52301554e0 0x7f5230153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522fe00640 1 -- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52301554e0 msgr2=0x7f5230153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522fe00640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52301554e0 0x7f5230153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522fe00640 1 -- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52300720c0 msgr2=0x7f52301482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522fe00640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52300720c0 0x7f52301482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522fe00640 1 -- 172.21.15.63:0/163864405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52301f0220 con 0x7f52140039f0 2024-09-12T02:59:25.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f522fe00640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f52301539d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f52200b3040 tx=0x7f5214005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5227e00640 1 -- 172.21.15.63:0/163864405 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52200be070 con 0x7f52140039f0 2024-09-12T02:59:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5227e00640 1 -- 172.21.15.63:0/163864405 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5220005070 con 0x7f52140039f0 2024-09-12T02:59:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5227e00640 1 -- 172.21.15.63:0/163864405 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52200b5040 con 0x7f52140039f0 2024-09-12T02:59:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.220+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52301f04e0 con 0x7f52140039f0 2024-09-12T02:59:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.224+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52301f0aa0 con 0x7f52140039f0 2024-09-12T02:59:25.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.224+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52300cd090 con 0x7f52140039f0 2024-09-12T02:59:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.224+0000 7f5227e00640 1 -- 172.21.15.63:0/163864405 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52200b8070 con 0x7f52140039f0 2024-09-12T02:59:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.224+0000 7f5227e00640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52100678c0 0x7f5210069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.224+0000 7f5227e00640 1 -- 172.21.15.63:0/163864405 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f5220123170 con 0x7f52140039f0 2024-09-12T02:59:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.224+0000 7f522f400640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52100678c0 0x7f5210069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:25.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.228+0000 7f522f400640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52100678c0 0x7f5210069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f523015c9f0 tx=0x7f521c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:25.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.228+0000 7f5227e00640 1 -- 172.21.15.63:0/163864405 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f52200c8020 con 0x7f52140039f0 2024-09-12T02:59:25.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.408+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5230150e40 con 0x7f52140039f0 2024-09-12T02:59:25.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.408+0000 7f5227e00640 1 -- 172.21.15.63:0/163864405 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v79) ==== 80+0+0 (secure 0 0 0) 0x7f52200189a0 con 0x7f52140039f0 2024-09-12T02:59:25.412 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-12T02:59:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52100678c0 msgr2=0x7f5210069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52100678c0 0x7f5210069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f523015c9f0 tx=0x7f521c009040 comp rx=0 tx=0).stop 2024-09-12T02:59:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 msgr2=0x7f52301539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f52301539d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f52200b3040 tx=0x7f5214005840 comp rx=0 tx=0).stop 2024-09-12T02:59:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 shutdown_connections 2024-09-12T02:59:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52300720c0 0x7f52301482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52100678c0 0x7f5210069d80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52301554e0 0x7f5230153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 --2- 172.21.15.63:0/163864405 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52140039f0 0x7f52301539d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:25.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 >> 172.21.15.63:0/163864405 conn(0x7f52300cc410 msgr2=0x7f5230158900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:25.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 shutdown_connections 2024-09-12T02:59:25.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:25.412+0000 7f5235600640 1 -- 172.21.15.63:0/163864405 wait complete. 2024-09-12T02:59:25.435 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:59:25.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:59:25.435 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T02:59:25.492 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T02:59:25.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:59:25.492 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T02:59:25.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:59:25.508 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-12T02:59:25.563 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T02:59:25.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:59:25.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T02:59:25.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:59:25.628 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-12T02:59:26.220 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T02:59:26.230 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T02:59:26.230 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:59:26.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd10fa00640 1 Processor -- start 2024-09-12T02:59:26.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd10fa00640 1 -- start start 2024-09-12T02:59:26.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd10fa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd1081527e0 0x7fd1080c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd10fa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd1080c7a00 0x7fd1080c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd10fa00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd108159520 con 0x7fd1080c61e0 2024-09-12T02:59:26.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd10fa00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd1081589a0 con 0x7fd1080c7a00 2024-09-12T02:59:26.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd10fa00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fd108158c80 con 0x7fd1081527e0 2024-09-12T02:59:26.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd0ffe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd1080c7a00 0x7fd1080c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd0ffe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd1080c7a00 0x7fd1080c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42424/0 (socket says 172.21.15.63:42424) 2024-09-12T02:59:26.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd0ffe00640 1 -- 172.21.15.63:0/3227238090 learned_addr learned my addr 172.21.15.63:0/3227238090 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:26.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd10d000640 1 --2- 172.21.15.63:0/3227238090 >> v2:172.21.15.119:3300/0 conn(0x7fd1081527e0 0x7fd1080c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd0ffe00640 1 -- 172.21.15.63:0/3227238090 >> v2:172.21.15.119:3300/0 conn(0x7fd1081527e0 msgr2=0x7fd1080c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:26.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd0ffe00640 1 --2- 172.21.15.63:0/3227238090 >> v2:172.21.15.119:3300/0 conn(0x7fd1081527e0 0x7fd1080c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd0ffe00640 1 -- 172.21.15.63:0/3227238090 >> v1:172.21.15.63:6789/0 conn(0x7fd1080c61e0 legacy=0x7fd1080cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.368+0000 7fd0ffe00640 1 -- 172.21.15.63:0/3227238090 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd108158f60 con 0x7fd1080c7a00 2024-09-12T02:59:26.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd0ffe00640 1 --2- 172.21.15.63:0/3227238090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c7a00 0x7fd1080c6eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd108069960 tx=0x7fd0f001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2418cfff21c33fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:26.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd107e00640 1 -- 172.21.15.63:0/3227238090 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00aa650 con 0x7fd1080c7a00 2024-09-12T02:59:26.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd107e00640 1 -- 172.21.15.63:0/3227238090 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f00af070 con 0x7fd1080c7a00 2024-09-12T02:59:26.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd107e00640 1 -- 172.21.15.63:0/3227238090 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00aaa10 con 0x7fd1080c7a00 2024-09-12T02:59:26.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd10fa00640 1 -- 172.21.15.63:0/3227238090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c7a00 msgr2=0x7fd1080c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd10fa00640 1 --2- 172.21.15.63:0/3227238090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c7a00 0x7fd1080c6eb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd108069960 tx=0x7fd0f001c4f0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd10fa00640 1 -- 172.21.15.63:0/3227238090 shutdown_connections 2024-09-12T02:59:26.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd10fa00640 1 --2- 172.21.15.63:0/3227238090 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c7a00 0x7fd1080c6eb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd10fa00640 1 --2- 172.21.15.63:0/3227238090 >> v2:172.21.15.119:3300/0 conn(0x7fd1081527e0 0x7fd1080c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd10fa00640 1 -- 172.21.15.63:0/3227238090 >> 172.21.15.63:0/3227238090 conn(0x7fd10806f3d0 msgr2=0x7fd10806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:26.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd10fa00640 1 -- 172.21.15.63:0/3227238090 shutdown_connections 2024-09-12T02:59:26.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.372+0000 7fd10fa00640 1 -- 172.21.15.63:0/3227238090 wait complete. 2024-09-12T02:59:26.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10fa00640 1 Processor -- start 2024-09-12T02:59:26.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10fa00640 1 -- start start 2024-09-12T02:59:26.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10fa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c61e0 0x7fd10814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10fa00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1080c7a00 0x7fd1080c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10fa00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1081527e0 0x7fd10814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10fa00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd1081586e0 con 0x7fd1080c61e0 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10fa00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd108158560 con 0x7fd1081527e0 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10fa00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fd108165700 con 0x7fd1080c7a00 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c61e0 0x7fd10814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c61e0 0x7fd10814dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42432/0 (socket says 172.21.15.63:42432) 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10d000640 1 -- 172.21.15.63:0/3136300674 learned_addr learned my addr 172.21.15.63:0/3136300674 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd0ffe00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1080c7a00 0x7fd1080c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10da00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1081527e0 0x7fd10814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10d000640 1 -- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1080c7a00 msgr2=0x7fd1080c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10d000640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1080c7a00 0x7fd1080c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10d000640 1 -- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1081527e0 msgr2=0x7fd10814b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10d000640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1081527e0 0x7fd10814b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10d000640 1 -- 172.21.15.63:0/3136300674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10814cba0 con 0x7fd1080c61e0 2024-09-12T02:59:26.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10da00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1081527e0 0x7fd10814b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:26.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.376+0000 7fd10d000640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c61e0 0x7fd10814dac0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800e8a0 tx=0x7fd0f800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:26.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd105600640 1 -- 172.21.15.63:0/3136300674 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8017070 con 0x7fd1080c61e0 2024-09-12T02:59:26.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd105600640 1 -- 172.21.15.63:0/3136300674 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f800c8e0 con 0x7fd1080c61e0 2024-09-12T02:59:26.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd105600640 1 -- 172.21.15.63:0/3136300674 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800cc90 con 0x7fd1080c61e0 2024-09-12T02:59:26.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1080cb090 con 0x7fd1080c61e0 2024-09-12T02:59:26.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1080cbac0 con 0x7fd1080c61e0 2024-09-12T02:59:26.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1080cc550 con 0x7fd1080c61e0 2024-09-12T02:59:26.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd105600640 1 -- 172.21.15.63:0/3136300674 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0f801a070 con 0x7fd1080c61e0 2024-09-12T02:59:26.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd105600640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e40678c0 0x7fd0e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd105600640 1 -- 172.21.15.63:0/3136300674 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fd0f8086390 con 0x7fd1080c61e0 2024-09-12T02:59:26.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.380+0000 7fd0ffe00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e40678c0 0x7fd0e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.384+0000 7fd0ffe00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e40678c0 0x7fd0e4069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00ae000 tx=0x7fd0f00a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:26.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.384+0000 7fd105600640 1 -- 172.21.15.63:0/3136300674 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd0f8056a50 con 0x7fd1080c61e0 2024-09-12T02:59:26.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.552+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd1080c8010 con 0x7fd0e40678c0 2024-09-12T02:59:26.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.576+0000 7fd105600640 1 -- 172.21.15.63:0/3136300674 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332672 (secure 0 0 0) 0x7fd1080c8010 con 0x7fd0e40678c0 2024-09-12T02:59:26.584 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:26.586 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:59:26.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e40678c0 msgr2=0x7fd0e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e40678c0 0x7fd0e4069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00ae000 tx=0x7fd0f00a7000 comp rx=0 tx=0).stop 2024-09-12T02:59:26.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c61e0 msgr2=0x7fd10814dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c61e0 0x7fd10814dac0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800e8a0 tx=0x7fd0f800eca0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 shutdown_connections 2024-09-12T02:59:26.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1081527e0 0x7fd10814b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fd0e40678c0 0x7fd0e4069d80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1080c7a00 0x7fd1080c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 --2- 172.21.15.63:0/3136300674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1080c61e0 0x7fd10814dac0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 >> 172.21.15.63:0/3136300674 conn(0x7fd10806f3d0 msgr2=0x7fd108156890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:26.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 shutdown_connections 2024-09-12T02:59:26.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.580+0000 7fd10fa00640 1 -- 172.21.15.63:0/3136300674 wait complete. 2024-09-12T02:59:26.605 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-12T02:59:25.798754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629078,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":244,"num_write_kb":2486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234152,"kb_used_data":8504,"kb_used_omap":15,"kb_used_meta":225456,"kb_avail":754740568,"statfs":{"total":773094113280,"available":772854341632,"internally_reserved":0,"allocated":8708096,"data_stored":5083060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":230867630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.608140"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093498+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:59:21.093498+0000","last_peered":"2024-09-12T02:59:21.093498+0000","last_clean":"2024-09-12T02:59:21.093498+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:21.093498+0000","last_undegraded":"2024-09-12T02:59:21.093498+0000","last_fullsized":"2024-09-12T02:59:21.093498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555874+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:59:20.555874+0000","last_peered":"2024-09-12T02:59:20.555874+0000","last_clean":"2024-09-12T02:59:20.555874+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:20.555874+0000","last_undegraded":"2024-09-12T02:59:20.555874+0000","last_fullsized":"2024-09-12T02:59:20.555874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554951+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:59:20.554951+0000","last_peered":"2024-09-12T02:59:20.554951+0000","last_clean":"2024-09-12T02:59:20.554951+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:20.554951+0000","last_undegraded":"2024-09-12T02:59:20.554951+0000","last_fullsized":"2024-09-12T02:59:20.554951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555984+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:59:20.555984+0000","last_peered":"2024-09-12T02:59:20.555984+0000","last_clean":"2024-09-12T02:59:20.555984+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:20.555984+0000","last_undegraded":"2024-09-12T02:59:20.555984+0000","last_fullsized":"2024-09-12T02:59:20.555984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093267+0000","last_change":"2024-09-12T02:59:06.040714+0000","last_active":"2024-09-12T02:59:21.093267+0000","last_peered":"2024-09-12T02:59:21.093267+0000","last_clean":"2024-09-12T02:59:21.093267+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:21.093267+0000","last_undegraded":"2024-09-12T02:59:21.093267+0000","last_fullsized":"2024-09-12T02:59:21.093267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:54.289352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":141,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221118+0000","last_change":"2024-09-12T02:59:08.071320+0000","last_active":"2024-09-12T02:59:20.221118+0000","last_peered":"2024-09-12T02:59:20.221118+0000","last_clean":"2024-09-12T02:59:20.221118+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:20.221118+0000","last_undegraded":"2024-09-12T02:59:20.221118+0000","last_fullsized":"2024-09-12T02:59:20.221118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:38.378285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572534+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:59:20.572534+0000","last_peered":"2024-09-12T02:59:20.572534+0000","last_clean":"2024-09-12T02:59:20.572534+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:20.572534+0000","last_undegraded":"2024-09-12T02:59:20.572534+0000","last_fullsized":"2024-09-12T02:59:20.572534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226154+0000","last_change":"2024-09-12T02:59:06.046085+0000","last_active":"2024-09-12T02:59:20.226154+0000","last_peered":"2024-09-12T02:59:20.226154+0000","last_clean":"2024-09-12T02:59:20.226154+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:20.226154+0000","last_undegraded":"2024-09-12T02:59:20.226154+0000","last_fullsized":"2024-09-12T02:59:20.226154+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:35.684141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223813+0000","last_change":"2024-09-12T02:59:08.073058+0000","last_active":"2024-09-12T02:59:20.223813+0000","last_peered":"2024-09-12T02:59:20.223813+0000","last_clean":"2024-09-12T02:59:20.223813+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:20.223813+0000","last_undegraded":"2024-09-12T02:59:20.223813+0000","last_fullsized":"2024-09-12T02:59:20.223813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.609541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572259+0000","last_change":"2024-09-12T02:59:06.053365+0000","last_active":"2024-09-12T02:59:20.572259+0000","last_peered":"2024-09-12T02:59:20.572259+0000","last_clean":"2024-09-12T02:59:20.572259+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:20.572259+0000","last_undegraded":"2024-09-12T02:59:20.572259+0000","last_fullsized":"2024-09-12T02:59:20.572259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227143+0000","last_change":"2024-09-12T02:59:06.040820+0000","last_active":"2024-09-12T02:59:20.227143+0000","last_peered":"2024-09-12T02:59:20.227143+0000","last_clean":"2024-09-12T02:59:20.227143+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:20.227143+0000","last_undegraded":"2024-09-12T02:59:20.227143+0000","last_fullsized":"2024-09-12T02:59:20.227143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:41.411962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223290+0000","last_change":"2024-09-12T02:59:06.058963+0000","last_active":"2024-09-12T02:59:20.223290+0000","last_peered":"2024-09-12T02:59:20.223290+0000","last_clean":"2024-09-12T02:59:20.223290+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:20.223290+0000","last_undegraded":"2024-09-12T02:59:20.223290+0000","last_fullsized":"2024-09-12T02:59:20.223290+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651357+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:59:20.651357+0000","last_peered":"2024-09-12T02:59:20.651357+0000","last_clean":"2024-09-12T02:59:20.651357+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:20.651357+0000","last_undegraded":"2024-09-12T02:59:20.651357+0000","last_fullsized":"2024-09-12T02:59:20.651357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572449+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:59:20.572449+0000","last_peered":"2024-09-12T02:59:20.572449+0000","last_clean":"2024-09-12T02:59:20.572449+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:20.572449+0000","last_undegraded":"2024-09-12T02:59:20.572449+0000","last_fullsized":"2024-09-12T02:59:20.572449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223073+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:59:20.223073+0000","last_peered":"2024-09-12T02:59:20.223073+0000","last_clean":"2024-09-12T02:59:20.223073+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:20.223073+0000","last_undegraded":"2024-09-12T02:59:20.223073+0000","last_fullsized":"2024-09-12T02:59:20.223073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555282+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:59:20.555282+0000","last_peered":"2024-09-12T02:59:20.555282+0000","last_clean":"2024-09-12T02:59:20.555282+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:20.555282+0000","last_undegraded":"2024-09-12T02:59:20.555282+0000","last_fullsized":"2024-09-12T02:59:20.555282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220179+0000","last_change":"2024-09-12T02:59:08.061938+0000","last_active":"2024-09-12T02:59:20.220179+0000","last_peered":"2024-09-12T02:59:20.220179+0000","last_clean":"2024-09-12T02:59:20.220179+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:20.220179+0000","last_undegraded":"2024-09-12T02:59:20.220179+0000","last_fullsized":"2024-09-12T02:59:20.220179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.137585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221866+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:59:20.221866+0000","last_peered":"2024-09-12T02:59:20.221866+0000","last_clean":"2024-09-12T02:59:20.221866+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:20.221866+0000","last_undegraded":"2024-09-12T02:59:20.221866+0000","last_fullsized":"2024-09-12T02:59:20.221866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555522+0000","last_change":"2024-09-12T02:59:08.063392+0000","last_active":"2024-09-12T02:59:20.555522+0000","last_peered":"2024-09-12T02:59:20.555522+0000","last_clean":"2024-09-12T02:59:20.555522+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:20.555522+0000","last_undegraded":"2024-09-12T02:59:20.555522+0000","last_fullsized":"2024-09-12T02:59:20.555522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:39.814573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219716+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:59:20.219716+0000","last_peered":"2024-09-12T02:59:20.219716+0000","last_clean":"2024-09-12T02:59:20.219716+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:20.219716+0000","last_undegraded":"2024-09-12T02:59:20.219716+0000","last_fullsized":"2024-09-12T02:59:20.219716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221264+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:59:20.221264+0000","last_peered":"2024-09-12T02:59:20.221264+0000","last_clean":"2024-09-12T02:59:20.221264+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:20.221264+0000","last_undegraded":"2024-09-12T02:59:20.221264+0000","last_fullsized":"2024-09-12T02:59:20.221264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222869+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:59:20.222869+0000","last_peered":"2024-09-12T02:59:20.222869+0000","last_clean":"2024-09-12T02:59:20.222869+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:20.222869+0000","last_undegraded":"2024-09-12T02:59:20.222869+0000","last_fullsized":"2024-09-12T02:59:20.222869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571430+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:59:20.571430+0000","last_peered":"2024-09-12T02:59:20.571430+0000","last_clean":"2024-09-12T02:59:20.571430+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:20.571430+0000","last_undegraded":"2024-09-12T02:59:20.571430+0000","last_fullsized":"2024-09-12T02:59:20.571430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224226+0000","last_change":"2024-09-12T02:59:08.080501+0000","last_active":"2024-09-12T02:59:20.224226+0000","last_peered":"2024-09-12T02:59:20.224226+0000","last_clean":"2024-09-12T02:59:20.224226+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:20.224226+0000","last_undegraded":"2024-09-12T02:59:20.224226+0000","last_fullsized":"2024-09-12T02:59:20.224226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:19.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094222+0000","last_change":"2024-09-12T02:59:08.061926+0000","last_active":"2024-09-12T02:59:21.094222+0000","last_peered":"2024-09-12T02:59:21.094222+0000","last_clean":"2024-09-12T02:59:21.094222+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:21.094222+0000","last_undegraded":"2024-09-12T02:59:21.094222+0000","last_fullsized":"2024-09-12T02:59:21.094222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652743+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:59:20.652743+0000","last_peered":"2024-09-12T02:59:20.652743+0000","last_clean":"2024-09-12T02:59:20.652743+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:20.652743+0000","last_undegraded":"2024-09-12T02:59:20.652743+0000","last_fullsized":"2024-09-12T02:59:20.652743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222216+0000","last_change":"2024-09-12T02:59:06.042311+0000","last_active":"2024-09-12T02:59:20.222216+0000","last_peered":"2024-09-12T02:59:20.222216+0000","last_clean":"2024-09-12T02:59:20.222216+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:20.222216+0000","last_undegraded":"2024-09-12T02:59:20.222216+0000","last_fullsized":"2024-09-12T02:59:20.222216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.556036+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:59:20.556036+0000","last_peered":"2024-09-12T02:59:20.556036+0000","last_clean":"2024-09-12T02:59:20.556036+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:20.556036+0000","last_undegraded":"2024-09-12T02:59:20.556036+0000","last_fullsized":"2024-09-12T02:59:20.556036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'10","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220976+0000","last_change":"2024-09-12T02:59:08.080132+0000","last_active":"2024-09-12T02:59:20.220976+0000","last_peered":"2024-09-12T02:59:20.220976+0000","last_clean":"2024-09-12T02:59:20.220976+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:20.220976+0000","last_undegraded":"2024-09-12T02:59:20.220976+0000","last_fullsized":"2024-09-12T02:59:20.220976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:33.297534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554880+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:59:20.554880+0000","last_peered":"2024-09-12T02:59:20.554880+0000","last_clean":"2024-09-12T02:59:20.554880+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:59:20.554880+0000","last_undegraded":"2024-09-12T02:59:20.554880+0000","last_fullsized":"2024-09-12T02:59:20.554880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220394+0000","last_change":"2024-09-12T02:59:08.052379+0000","last_active":"2024-09-12T02:59:20.220394+0000","last_peered":"2024-09-12T02:59:20.220394+0000","last_clean":"2024-09-12T02:59:20.220394+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:20.220394+0000","last_undegraded":"2024-09-12T02:59:20.220394+0000","last_fullsized":"2024-09-12T02:59:20.220394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.582966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572839+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:59:20.572839+0000","last_peered":"2024-09-12T02:59:20.572839+0000","last_clean":"2024-09-12T02:59:20.572839+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:20.572839+0000","last_undegraded":"2024-09-12T02:59:20.572839+0000","last_fullsized":"2024-09-12T02:59:20.572839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094850+0000","last_change":"2024-09-12T02:59:06.034354+0000","last_active":"2024-09-12T02:59:21.094850+0000","last_peered":"2024-09-12T02:59:21.094850+0000","last_clean":"2024-09-12T02:59:21.094850+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:21.094850+0000","last_undegraded":"2024-09-12T02:59:21.094850+0000","last_fullsized":"2024-09-12T02:59:21.094850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:05.155351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226589+0000","last_change":"2024-09-12T02:59:06.034822+0000","last_active":"2024-09-12T02:59:20.226589+0000","last_peered":"2024-09-12T02:59:20.226589+0000","last_clean":"2024-09-12T02:59:20.226589+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:20.226589+0000","last_undegraded":"2024-09-12T02:59:20.226589+0000","last_fullsized":"2024-09-12T02:59:20.226589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:00.839140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220548+0000","last_change":"2024-09-12T02:59:08.054413+0000","last_active":"2024-09-12T02:59:20.220548+0000","last_peered":"2024-09-12T02:59:20.220548+0000","last_clean":"2024-09-12T02:59:20.220548+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:20.220548+0000","last_undegraded":"2024-09-12T02:59:20.220548+0000","last_fullsized":"2024-09-12T02:59:20.220548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:21.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220362+0000","last_change":"2024-09-12T02:59:08.063077+0000","last_active":"2024-09-12T02:59:20.220362+0000","last_peered":"2024-09-12T02:59:20.220362+0000","last_clean":"2024-09-12T02:59:20.220362+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:20.220362+0000","last_undegraded":"2024-09-12T02:59:20.220362+0000","last_fullsized":"2024-09-12T02:59:20.220362+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224154+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:59:20.224154+0000","last_peered":"2024-09-12T02:59:20.224154+0000","last_clean":"2024-09-12T02:59:20.224154+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:20.224154+0000","last_undegraded":"2024-09-12T02:59:20.224154+0000","last_fullsized":"2024-09-12T02:59:20.224154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224740+0000","last_change":"2024-09-12T02:59:06.046884+0000","last_active":"2024-09-12T02:59:20.224740+0000","last_peered":"2024-09-12T02:59:20.224740+0000","last_clean":"2024-09-12T02:59:20.224740+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:20.224740+0000","last_undegraded":"2024-09-12T02:59:20.224740+0000","last_fullsized":"2024-09-12T02:59:20.224740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:52.145202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227571+0000","last_change":"2024-09-12T02:59:06.062554+0000","last_active":"2024-09-12T02:59:20.227571+0000","last_peered":"2024-09-12T02:59:20.227571+0000","last_clean":"2024-09-12T02:59:20.227571+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:20.227571+0000","last_undegraded":"2024-09-12T02:59:20.227571+0000","last_fullsized":"2024-09-12T02:59:20.227571+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:27.156770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220124+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:59:20.220124+0000","last_peered":"2024-09-12T02:59:20.220124+0000","last_clean":"2024-09-12T02:59:20.220124+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:20.220124+0000","last_undegraded":"2024-09-12T02:59:20.220124+0000","last_fullsized":"2024-09-12T02:59:20.220124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"60'2","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893199+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:59:20.893199+0000","last_peered":"2024-09-12T02:59:20.893199+0000","last_clean":"2024-09-12T02:59:20.893199+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:20.893199+0000","last_undegraded":"2024-09-12T02:59:20.893199+0000","last_fullsized":"2024-09-12T02:59:20.893199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220885+0000","last_change":"2024-09-12T02:59:08.057364+0000","last_active":"2024-09-12T02:59:20.220885+0000","last_peered":"2024-09-12T02:59:20.220885+0000","last_clean":"2024-09-12T02:59:20.220885+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:20.220885+0000","last_undegraded":"2024-09-12T02:59:20.220885+0000","last_fullsized":"2024-09-12T02:59:20.220885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.092701+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:59:21.092701+0000","last_peered":"2024-09-12T02:59:21.092701+0000","last_clean":"2024-09-12T02:59:21.092701+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:21.092701+0000","last_undegraded":"2024-09-12T02:59:21.092701+0000","last_fullsized":"2024-09-12T02:59:21.092701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571447+0000","last_change":"2024-09-12T02:59:08.070124+0000","last_active":"2024-09-12T02:59:20.571447+0000","last_peered":"2024-09-12T02:59:20.571447+0000","last_clean":"2024-09-12T02:59:20.571447+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:20.571447+0000","last_undegraded":"2024-09-12T02:59:20.571447+0000","last_fullsized":"2024-09-12T02:59:20.571447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:14.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093938+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:59:21.093938+0000","last_peered":"2024-09-12T02:59:21.093938+0000","last_clean":"2024-09-12T02:59:21.093938+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:21.093938+0000","last_undegraded":"2024-09-12T02:59:21.093938+0000","last_fullsized":"2024-09-12T02:59:21.093938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555055+0000","last_change":"2024-09-12T02:59:06.063289+0000","last_active":"2024-09-12T02:59:20.555055+0000","last_peered":"2024-09-12T02:59:20.555055+0000","last_clean":"2024-09-12T02:59:20.555055+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:20.555055+0000","last_undegraded":"2024-09-12T02:59:20.555055+0000","last_fullsized":"2024-09-12T02:59:20.555055+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225192+0000","last_change":"2024-09-12T02:59:06.038764+0000","last_active":"2024-09-12T02:59:20.225192+0000","last_peered":"2024-09-12T02:59:20.225192+0000","last_clean":"2024-09-12T02:59:20.225192+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:20.225192+0000","last_undegraded":"2024-09-12T02:59:20.225192+0000","last_fullsized":"2024-09-12T02:59:20.225192+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.748521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":283,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571685+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:59:20.571685+0000","last_peered":"2024-09-12T02:59:20.571685+0000","last_clean":"2024-09-12T02:59:20.571685+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:20.571685+0000","last_undegraded":"2024-09-12T02:59:20.571685+0000","last_fullsized":"2024-09-12T02:59:20.571685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651983+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:59:20.651983+0000","last_peered":"2024-09-12T02:59:20.651983+0000","last_clean":"2024-09-12T02:59:20.651983+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:20.651983+0000","last_undegraded":"2024-09-12T02:59:20.651983+0000","last_fullsized":"2024-09-12T02:59:20.651983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220781+0000","last_change":"2024-09-12T02:59:06.041259+0000","last_active":"2024-09-12T02:59:20.220781+0000","last_peered":"2024-09-12T02:59:20.220781+0000","last_clean":"2024-09-12T02:59:20.220781+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:20.220781+0000","last_undegraded":"2024-09-12T02:59:20.220781+0000","last_fullsized":"2024-09-12T02:59:20.220781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:50.481819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893814+0000","last_change":"2024-09-12T02:59:06.053023+0000","last_active":"2024-09-12T02:59:20.893814+0000","last_peered":"2024-09-12T02:59:20.893814+0000","last_clean":"2024-09-12T02:59:20.893814+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:20.893814+0000","last_undegraded":"2024-09-12T02:59:20.893814+0000","last_fullsized":"2024-09-12T02:59:20.893814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:23.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651340+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:59:20.651340+0000","last_peered":"2024-09-12T02:59:20.651340+0000","last_clean":"2024-09-12T02:59:20.651340+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:20.651340+0000","last_undegraded":"2024-09-12T02:59:20.651340+0000","last_fullsized":"2024-09-12T02:59:20.651340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227193+0000","last_change":"2024-09-12T02:59:06.048181+0000","last_active":"2024-09-12T02:59:20.227193+0000","last_peered":"2024-09-12T02:59:20.227193+0000","last_clean":"2024-09-12T02:59:20.227193+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:20.227193+0000","last_undegraded":"2024-09-12T02:59:20.227193+0000","last_fullsized":"2024-09-12T02:59:20.227193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:18.582473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219594+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:59:20.219594+0000","last_peered":"2024-09-12T02:59:20.219594+0000","last_clean":"2024-09-12T02:59:20.219594+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:20.219594+0000","last_undegraded":"2024-09-12T02:59:20.219594+0000","last_fullsized":"2024-09-12T02:59:20.219594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095006+0000","last_change":"2024-09-12T02:59:06.034598+0000","last_active":"2024-09-12T02:59:21.095006+0000","last_peered":"2024-09-12T02:59:21.095006+0000","last_clean":"2024-09-12T02:59:21.095006+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:21.095006+0000","last_undegraded":"2024-09-12T02:59:21.095006+0000","last_fullsized":"2024-09-12T02:59:21.095006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:16.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573065+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:59:20.573065+0000","last_peered":"2024-09-12T02:59:20.573065+0000","last_clean":"2024-09-12T02:59:20.573065+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:20.573065+0000","last_undegraded":"2024-09-12T02:59:20.573065+0000","last_fullsized":"2024-09-12T02:59:20.573065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893238+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:59:20.893238+0000","last_peered":"2024-09-12T02:59:20.893238+0000","last_clean":"2024-09-12T02:59:20.893238+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:20.893238+0000","last_undegraded":"2024-09-12T02:59:20.893238+0000","last_fullsized":"2024-09-12T02:59:20.893238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222460+0000","last_change":"2024-09-12T02:59:06.062947+0000","last_active":"2024-09-12T02:59:20.222460+0000","last_peered":"2024-09-12T02:59:20.222460+0000","last_clean":"2024-09-12T02:59:20.222460+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:20.222460+0000","last_undegraded":"2024-09-12T02:59:20.222460+0000","last_fullsized":"2024-09-12T02:59:20.222460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:19.386600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573025+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:59:20.573025+0000","last_peered":"2024-09-12T02:59:20.573025+0000","last_clean":"2024-09-12T02:59:20.573025+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:20.573025+0000","last_undegraded":"2024-09-12T02:59:20.573025+0000","last_fullsized":"2024-09-12T02:59:20.573025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224723+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:59:20.224723+0000","last_peered":"2024-09-12T02:59:20.224723+0000","last_clean":"2024-09-12T02:59:20.224723+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:20.224723+0000","last_undegraded":"2024-09-12T02:59:20.224723+0000","last_fullsized":"2024-09-12T02:59:20.224723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221617+0000","last_change":"2024-09-12T02:59:08.073044+0000","last_active":"2024-09-12T02:59:20.221617+0000","last_peered":"2024-09-12T02:59:20.221617+0000","last_clean":"2024-09-12T02:59:20.221617+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:20.221617+0000","last_undegraded":"2024-09-12T02:59:20.221617+0000","last_fullsized":"2024-09-12T02:59:20.221617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571812+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:59:20.571812+0000","last_peered":"2024-09-12T02:59:20.571812+0000","last_clean":"2024-09-12T02:59:20.571812+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:20.571812+0000","last_undegraded":"2024-09-12T02:59:20.571812+0000","last_fullsized":"2024-09-12T02:59:20.571812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893455+0000","last_change":"2024-09-12T02:59:08.079372+0000","last_active":"2024-09-12T02:59:20.893455+0000","last_peered":"2024-09-12T02:59:20.893455+0000","last_clean":"2024-09-12T02:59:20.893455+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:20.893455+0000","last_undegraded":"2024-09-12T02:59:20.893455+0000","last_fullsized":"2024-09-12T02:59:20.893455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:04.951763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093850+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:59:21.093850+0000","last_peered":"2024-09-12T02:59:21.093850+0000","last_clean":"2024-09-12T02:59:21.093850+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:21.093850+0000","last_undegraded":"2024-09-12T02:59:21.093850+0000","last_fullsized":"2024-09-12T02:59:21.093850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651401+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:59:20.651401+0000","last_peered":"2024-09-12T02:59:20.651401+0000","last_clean":"2024-09-12T02:59:20.651401+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:20.651401+0000","last_undegraded":"2024-09-12T02:59:20.651401+0000","last_fullsized":"2024-09-12T02:59:20.651401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651642+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:59:20.651642+0000","last_peered":"2024-09-12T02:59:20.651642+0000","last_clean":"2024-09-12T02:59:20.651642+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:20.651642+0000","last_undegraded":"2024-09-12T02:59:20.651642+0000","last_fullsized":"2024-09-12T02:59:20.651642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555842+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:59:20.555842+0000","last_peered":"2024-09-12T02:59:20.555842+0000","last_clean":"2024-09-12T02:59:20.555842+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:20.555842+0000","last_undegraded":"2024-09-12T02:59:20.555842+0000","last_fullsized":"2024-09-12T02:59:20.555842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572178+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:59:20.572178+0000","last_peered":"2024-09-12T02:59:20.572178+0000","last_clean":"2024-09-12T02:59:20.572178+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:20.572178+0000","last_undegraded":"2024-09-12T02:59:20.572178+0000","last_fullsized":"2024-09-12T02:59:20.572178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221668+0000","last_change":"2024-09-12T02:59:06.050751+0000","last_active":"2024-09-12T02:59:20.221668+0000","last_peered":"2024-09-12T02:59:20.221668+0000","last_clean":"2024-09-12T02:59:20.221668+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:20.221668+0000","last_undegraded":"2024-09-12T02:59:20.221668+0000","last_fullsized":"2024-09-12T02:59:20.221668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.271840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555505+0000","last_change":"2024-09-12T02:59:08.061102+0000","last_active":"2024-09-12T02:59:20.555505+0000","last_peered":"2024-09-12T02:59:20.555505+0000","last_clean":"2024-09-12T02:59:20.555505+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:20.555505+0000","last_undegraded":"2024-09-12T02:59:20.555505+0000","last_fullsized":"2024-09-12T02:59:20.555505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:58.125545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093505+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:59:21.093505+0000","last_peered":"2024-09-12T02:59:21.093505+0000","last_clean":"2024-09-12T02:59:21.093505+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:21.093505+0000","last_undegraded":"2024-09-12T02:59:21.093505+0000","last_fullsized":"2024-09-12T02:59:21.093505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095128+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:59:21.095128+0000","last_peered":"2024-09-12T02:59:21.095128+0000","last_clean":"2024-09-12T02:59:21.095128+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:21.095128+0000","last_undegraded":"2024-09-12T02:59:21.095128+0000","last_fullsized":"2024-09-12T02:59:21.095128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227503+0000","last_change":"2024-09-12T02:59:06.046162+0000","last_active":"2024-09-12T02:59:20.227503+0000","last_peered":"2024-09-12T02:59:20.227503+0000","last_clean":"2024-09-12T02:59:20.227503+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:20.227503+0000","last_undegraded":"2024-09-12T02:59:20.227503+0000","last_fullsized":"2024-09-12T02:59:20.227503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.056594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572297+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:59:20.572297+0000","last_peered":"2024-09-12T02:59:20.572297+0000","last_clean":"2024-09-12T02:59:20.572297+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:20.572297+0000","last_undegraded":"2024-09-12T02:59:20.572297+0000","last_fullsized":"2024-09-12T02:59:20.572297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"62'23","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.650946+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:59:20.650946+0000","last_peered":"2024-09-12T02:59:20.650946+0000","last_clean":"2024-09-12T02:59:20.650946+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:20.650946+0000","last_undegraded":"2024-09-12T02:59:20.650946+0000","last_fullsized":"2024-09-12T02:59:20.650946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37601,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220586+0000","last_change":"2024-09-12T02:59:08.086853+0000","last_active":"2024-09-12T02:59:20.220586+0000","last_peered":"2024-09-12T02:59:20.220586+0000","last_clean":"2024-09-12T02:59:20.220586+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:20.220586+0000","last_undegraded":"2024-09-12T02:59:20.220586+0000","last_fullsized":"2024-09-12T02:59:20.220586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222774+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:59:20.222774+0000","last_peered":"2024-09-12T02:59:20.222774+0000","last_clean":"2024-09-12T02:59:20.222774+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:20.222774+0000","last_undegraded":"2024-09-12T02:59:20.222774+0000","last_fullsized":"2024-09-12T02:59:20.222774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"60'5","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220978+0000","last_change":"2024-09-12T02:59:08.072309+0000","last_active":"2024-09-12T02:59:20.220978+0000","last_peered":"2024-09-12T02:59:20.220978+0000","last_clean":"2024-09-12T02:59:20.220978+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:20.220978+0000","last_undegraded":"2024-09-12T02:59:20.220978+0000","last_fullsized":"2024-09-12T02:59:20.220978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223587+0000","last_change":"2024-09-12T02:59:08.080949+0000","last_active":"2024-09-12T02:59:20.223587+0000","last_peered":"2024-09-12T02:59:20.223587+0000","last_clean":"2024-09-12T02:59:20.223587+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:20.223587+0000","last_undegraded":"2024-09-12T02:59:20.223587+0000","last_fullsized":"2024-09-12T02:59:20.223587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:41.284531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093410+0000","last_change":"2024-09-12T02:59:06.040772+0000","last_active":"2024-09-12T02:59:21.093410+0000","last_peered":"2024-09-12T02:59:21.093410+0000","last_clean":"2024-09-12T02:59:21.093410+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:21.093410+0000","last_undegraded":"2024-09-12T02:59:21.093410+0000","last_fullsized":"2024-09-12T02:59:21.093410+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:31.077375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225642+0000","last_change":"2024-09-12T02:59:06.033384+0000","last_active":"2024-09-12T02:59:20.225642+0000","last_peered":"2024-09-12T02:59:20.225642+0000","last_clean":"2024-09-12T02:59:20.225642+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:20.225642+0000","last_undegraded":"2024-09-12T02:59:20.225642+0000","last_fullsized":"2024-09-12T02:59:20.225642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:41.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555370+0000","last_change":"2024-09-12T02:59:08.074397+0000","last_active":"2024-09-12T02:59:20.555370+0000","last_peered":"2024-09-12T02:59:20.555370+0000","last_clean":"2024-09-12T02:59:20.555370+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:20.555370+0000","last_undegraded":"2024-09-12T02:59:20.555370+0000","last_fullsized":"2024-09-12T02:59:20.555370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:11.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225923+0000","last_change":"2024-09-12T02:59:06.035397+0000","last_active":"2024-09-12T02:59:20.225923+0000","last_peered":"2024-09-12T02:59:20.225923+0000","last_clean":"2024-09-12T02:59:20.225923+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:20.225923+0000","last_undegraded":"2024-09-12T02:59:20.225923+0000","last_fullsized":"2024-09-12T02:59:20.225923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:13.552932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652530+0000","last_change":"2024-09-12T02:59:06.055518+0000","last_active":"2024-09-12T02:59:20.652530+0000","last_peered":"2024-09-12T02:59:20.652530+0000","last_clean":"2024-09-12T02:59:20.652530+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:20.652530+0000","last_undegraded":"2024-09-12T02:59:20.652530+0000","last_fullsized":"2024-09-12T02:59:20.652530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:09.456324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555259+0000","last_change":"2024-09-12T02:59:06.038606+0000","last_active":"2024-09-12T02:59:20.555259+0000","last_peered":"2024-09-12T02:59:20.555259+0000","last_clean":"2024-09-12T02:59:20.555259+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:20.555259+0000","last_undegraded":"2024-09-12T02:59:20.555259+0000","last_fullsized":"2024-09-12T02:59:20.555259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.456399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093743+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:59:21.093743+0000","last_peered":"2024-09-12T02:59:21.093743+0000","last_clean":"2024-09-12T02:59:21.093743+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:21.093743+0000","last_undegraded":"2024-09-12T02:59:21.093743+0000","last_fullsized":"2024-09-12T02:59:21.093743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220149+0000","last_change":"2024-09-12T02:59:08.058453+0000","last_active":"2024-09-12T02:59:20.220149+0000","last_peered":"2024-09-12T02:59:20.220149+0000","last_clean":"2024-09-12T02:59:20.220149+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:20.220149+0000","last_undegraded":"2024-09-12T02:59:20.220149+0000","last_fullsized":"2024-09-12T02:59:20.220149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221549+0000","last_change":"2024-09-12T02:59:06.065547+0000","last_active":"2024-09-12T02:59:20.221549+0000","last_peered":"2024-09-12T02:59:20.221549+0000","last_clean":"2024-09-12T02:59:20.221549+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:20.221549+0000","last_undegraded":"2024-09-12T02:59:20.221549+0000","last_fullsized":"2024-09-12T02:59:20.221549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.274480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652330+0000","last_change":"2024-09-12T02:59:06.057027+0000","last_active":"2024-09-12T02:59:20.652330+0000","last_peered":"2024-09-12T02:59:20.652330+0000","last_clean":"2024-09-12T02:59:20.652330+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:20.652330+0000","last_undegraded":"2024-09-12T02:59:20.652330+0000","last_fullsized":"2024-09-12T02:59:20.652330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:00.045309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555400+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:59:20.555400+0000","last_peered":"2024-09-12T02:59:20.555400+0000","last_clean":"2024-09-12T02:59:20.555400+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:20.555400+0000","last_undegraded":"2024-09-12T02:59:20.555400+0000","last_fullsized":"2024-09-12T02:59:20.555400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554671+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:59:20.554671+0000","last_peered":"2024-09-12T02:59:20.554671+0000","last_clean":"2024-09-12T02:59:20.554671+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:20.554671+0000","last_undegraded":"2024-09-12T02:59:20.554671+0000","last_fullsized":"2024-09-12T02:59:20.554671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651664+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:59:20.651664+0000","last_peered":"2024-09-12T02:59:20.651664+0000","last_clean":"2024-09-12T02:59:20.651664+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:20.651664+0000","last_undegraded":"2024-09-12T02:59:20.651664+0000","last_fullsized":"2024-09-12T02:59:20.651664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094328+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:59:21.094328+0000","last_peered":"2024-09-12T02:59:21.094328+0000","last_clean":"2024-09-12T02:59:21.094328+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:21.094328+0000","last_undegraded":"2024-09-12T02:59:21.094328+0000","last_fullsized":"2024-09-12T02:59:21.094328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893710+0000","last_change":"2024-09-12T02:59:06.049017+0000","last_active":"2024-09-12T02:59:20.893710+0000","last_peered":"2024-09-12T02:59:20.893710+0000","last_clean":"2024-09-12T02:59:20.893710+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:20.893710+0000","last_undegraded":"2024-09-12T02:59:20.893710+0000","last_fullsized":"2024-09-12T02:59:20.893710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.513391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554672+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:59:20.554672+0000","last_peered":"2024-09-12T02:59:20.554672+0000","last_clean":"2024-09-12T02:59:20.554672+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:20.554672+0000","last_undegraded":"2024-09-12T02:59:20.554672+0000","last_fullsized":"2024-09-12T02:59:20.554672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223808+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:59:20.223808+0000","last_peered":"2024-09-12T02:59:20.223808+0000","last_clean":"2024-09-12T02:59:20.223808+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:20.223808+0000","last_undegraded":"2024-09-12T02:59:20.223808+0000","last_fullsized":"2024-09-12T02:59:20.223808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555699+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:59:20.555699+0000","last_peered":"2024-09-12T02:59:20.555699+0000","last_clean":"2024-09-12T02:59:20.555699+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:20.555699+0000","last_undegraded":"2024-09-12T02:59:20.555699+0000","last_fullsized":"2024-09-12T02:59:20.555699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651209+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:59:20.651209+0000","last_peered":"2024-09-12T02:59:20.651209+0000","last_clean":"2024-09-12T02:59:20.651209+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:20.651209+0000","last_undegraded":"2024-09-12T02:59:20.651209+0000","last_fullsized":"2024-09-12T02:59:20.651209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893469+0000","last_change":"2024-09-12T02:59:06.035202+0000","last_active":"2024-09-12T02:59:20.893469+0000","last_peered":"2024-09-12T02:59:20.893469+0000","last_clean":"2024-09-12T02:59:20.893469+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:20.893469+0000","last_undegraded":"2024-09-12T02:59:20.893469+0000","last_fullsized":"2024-09-12T02:59:20.893469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:38.826721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224631+0000","last_change":"2024-09-12T02:59:06.039795+0000","last_active":"2024-09-12T02:59:20.224631+0000","last_peered":"2024-09-12T02:59:20.224631+0000","last_clean":"2024-09-12T02:59:20.224631+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:20.224631+0000","last_undegraded":"2024-09-12T02:59:20.224631+0000","last_fullsized":"2024-09-12T02:59:20.224631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094428+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:59:21.094428+0000","last_peered":"2024-09-12T02:59:21.094428+0000","last_clean":"2024-09-12T02:59:21.094428+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:21.094428+0000","last_undegraded":"2024-09-12T02:59:21.094428+0000","last_fullsized":"2024-09-12T02:59:21.094428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555831+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:59:20.555831+0000","last_peered":"2024-09-12T02:59:20.555831+0000","last_clean":"2024-09-12T02:59:20.555831+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:20.555831+0000","last_undegraded":"2024-09-12T02:59:20.555831+0000","last_fullsized":"2024-09-12T02:59:20.555831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220580+0000","last_change":"2024-09-12T02:59:08.055950+0000","last_active":"2024-09-12T02:59:20.220580+0000","last_peered":"2024-09-12T02:59:20.220580+0000","last_clean":"2024-09-12T02:59:20.220580+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:20.220580+0000","last_undegraded":"2024-09-12T02:59:20.220580+0000","last_fullsized":"2024-09-12T02:59:20.220580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.808972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652436+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:59:20.652436+0000","last_peered":"2024-09-12T02:59:20.652436+0000","last_clean":"2024-09-12T02:59:20.652436+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:20.652436+0000","last_undegraded":"2024-09-12T02:59:20.652436+0000","last_fullsized":"2024-09-12T02:59:20.652436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555996+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:59:20.555996+0000","last_peered":"2024-09-12T02:59:20.555996+0000","last_clean":"2024-09-12T02:59:20.555996+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:20.555996+0000","last_undegraded":"2024-09-12T02:59:20.555996+0000","last_fullsized":"2024-09-12T02:59:20.555996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221900+0000","last_change":"2024-09-12T02:59:06.064508+0000","last_active":"2024-09-12T02:59:20.221900+0000","last_peered":"2024-09-12T02:59:20.221900+0000","last_clean":"2024-09-12T02:59:20.221900+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:20.221900+0000","last_undegraded":"2024-09-12T02:59:20.221900+0000","last_fullsized":"2024-09-12T02:59:20.221900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:09.089943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554994+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:59:20.554994+0000","last_peered":"2024-09-12T02:59:20.554994+0000","last_clean":"2024-09-12T02:59:20.554994+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:20.554994+0000","last_undegraded":"2024-09-12T02:59:20.554994+0000","last_fullsized":"2024-09-12T02:59:20.554994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224351+0000","last_change":"2024-09-12T02:59:06.039130+0000","last_active":"2024-09-12T02:59:20.224351+0000","last_peered":"2024-09-12T02:59:20.224351+0000","last_clean":"2024-09-12T02:59:20.224351+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:20.224351+0000","last_undegraded":"2024-09-12T02:59:20.224351+0000","last_fullsized":"2024-09-12T02:59:20.224351+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:47.700652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094518+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:59:21.094518+0000","last_peered":"2024-09-12T02:59:21.094518+0000","last_clean":"2024-09-12T02:59:21.094518+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:21.094518+0000","last_undegraded":"2024-09-12T02:59:21.094518+0000","last_fullsized":"2024-09-12T02:59:21.094518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652175+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:59:20.652175+0000","last_peered":"2024-09-12T02:59:20.652175+0000","last_clean":"2024-09-12T02:59:20.652175+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:20.652175+0000","last_undegraded":"2024-09-12T02:59:20.652175+0000","last_fullsized":"2024-09-12T02:59:20.652175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572669+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:59:20.572669+0000","last_peered":"2024-09-12T02:59:20.572669+0000","last_clean":"2024-09-12T02:59:20.572669+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:20.572669+0000","last_undegraded":"2024-09-12T02:59:20.572669+0000","last_fullsized":"2024-09-12T02:59:20.572669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893383+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:59:20.893383+0000","last_peered":"2024-09-12T02:59:20.893383+0000","last_clean":"2024-09-12T02:59:20.893383+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:20.893383+0000","last_undegraded":"2024-09-12T02:59:20.893383+0000","last_fullsized":"2024-09-12T02:59:20.893383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226422+0000","last_change":"2024-09-12T02:59:06.052737+0000","last_active":"2024-09-12T02:59:20.226422+0000","last_peered":"2024-09-12T02:59:20.226422+0000","last_clean":"2024-09-12T02:59:20.226422+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:20.226422+0000","last_undegraded":"2024-09-12T02:59:20.226422+0000","last_fullsized":"2024-09-12T02:59:20.226422+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:35.122045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222235+0000","last_change":"2024-09-12T02:59:06.033376+0000","last_active":"2024-09-12T02:59:20.222235+0000","last_peered":"2024-09-12T02:59:20.222235+0000","last_clean":"2024-09-12T02:59:20.222235+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:20.222235+0000","last_undegraded":"2024-09-12T02:59:20.222235+0000","last_fullsized":"2024-09-12T02:59:20.222235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:58.904459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220371+0000","last_change":"2024-09-12T02:59:08.058142+0000","last_active":"2024-09-12T02:59:20.220371+0000","last_peered":"2024-09-12T02:59:20.220371+0000","last_clean":"2024-09-12T02:59:20.220371+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:20.220371+0000","last_undegraded":"2024-09-12T02:59:20.220371+0000","last_fullsized":"2024-09-12T02:59:20.220371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:34.922114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"60'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093613+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:59:21.093613+0000","last_peered":"2024-09-12T02:59:21.093613+0000","last_clean":"2024-09-12T02:59:21.093613+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:21.093613+0000","last_undegraded":"2024-09-12T02:59:21.093613+0000","last_fullsized":"2024-09-12T02:59:21.093613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555233+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:59:20.555233+0000","last_peered":"2024-09-12T02:59:20.555233+0000","last_clean":"2024-09-12T02:59:20.555233+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:20.555233+0000","last_undegraded":"2024-09-12T02:59:20.555233+0000","last_fullsized":"2024-09-12T02:59:20.555233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222303+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:59:20.222303+0000","last_peered":"2024-09-12T02:59:20.222303+0000","last_clean":"2024-09-12T02:59:20.222303+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:20.222303+0000","last_undegraded":"2024-09-12T02:59:20.222303+0000","last_fullsized":"2024-09-12T02:59:20.222303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652209+0000","last_change":"2024-09-12T02:59:06.053463+0000","last_active":"2024-09-12T02:59:20.652209+0000","last_peered":"2024-09-12T02:59:20.652209+0000","last_clean":"2024-09-12T02:59:20.652209+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:20.652209+0000","last_undegraded":"2024-09-12T02:59:20.652209+0000","last_fullsized":"2024-09-12T02:59:20.652209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:12.272345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652306+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:59:20.652306+0000","last_peered":"2024-09-12T02:59:20.652306+0000","last_clean":"2024-09-12T02:59:20.652306+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:20.652306+0000","last_undegraded":"2024-09-12T02:59:20.652306+0000","last_fullsized":"2024-09-12T02:59:20.652306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572981+0000","last_change":"2024-09-12T02:59:06.058593+0000","last_active":"2024-09-12T02:59:20.572981+0000","last_peered":"2024-09-12T02:59:20.572981+0000","last_clean":"2024-09-12T02:59:20.572981+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:20.572981+0000","last_undegraded":"2024-09-12T02:59:20.572981+0000","last_fullsized":"2024-09-12T02:59:20.572981+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.306038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555202+0000","last_change":"2024-09-12T02:59:06.066878+0000","last_active":"2024-09-12T02:59:20.555202+0000","last_peered":"2024-09-12T02:59:20.555202+0000","last_clean":"2024-09-12T02:59:20.555202+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:20.555202+0000","last_undegraded":"2024-09-12T02:59:20.555202+0000","last_fullsized":"2024-09-12T02:59:20.555202+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.621838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571689+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:59:20.571689+0000","last_peered":"2024-09-12T02:59:20.571689+0000","last_clean":"2024-09-12T02:59:20.571689+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:20.571689+0000","last_undegraded":"2024-09-12T02:59:20.571689+0000","last_fullsized":"2024-09-12T02:59:20.571689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225014+0000","last_change":"2024-09-12T02:59:06.052855+0000","last_active":"2024-09-12T02:59:20.225014+0000","last_peered":"2024-09-12T02:59:20.225014+0000","last_clean":"2024-09-12T02:59:20.225014+0000","last_became_active":"2024-09-12T02:59:06.051893+0000","last_became_peered":"2024-09-12T02:59:06.051893+0000","last_unstale":"2024-09-12T02:59:20.225014+0000","last_undegraded":"2024-09-12T02:59:20.225014+0000","last_fullsized":"2024-09-12T02:59:20.225014+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:59.682086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571964+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:59:20.571964+0000","last_peered":"2024-09-12T02:59:20.571964+0000","last_clean":"2024-09-12T02:59:20.571964+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:20.571964+0000","last_undegraded":"2024-09-12T02:59:20.571964+0000","last_fullsized":"2024-09-12T02:59:20.571964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226513+0000","last_change":"2024-09-12T02:59:06.050998+0000","last_active":"2024-09-12T02:59:20.226513+0000","last_peered":"2024-09-12T02:59:20.226513+0000","last_clean":"2024-09-12T02:59:20.226513+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:20.226513+0000","last_undegraded":"2024-09-12T02:59:20.226513+0000","last_fullsized":"2024-09-12T02:59:20.226513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:41.882534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094247+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:59:21.094247+0000","last_peered":"2024-09-12T02:59:21.094247+0000","last_clean":"2024-09-12T02:59:21.094247+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:21.094247+0000","last_undegraded":"2024-09-12T02:59:21.094247+0000","last_fullsized":"2024-09-12T02:59:21.094247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221167+0000","last_change":"2024-09-12T02:59:08.055576+0000","last_active":"2024-09-12T02:59:20.221167+0000","last_peered":"2024-09-12T02:59:20.221167+0000","last_clean":"2024-09-12T02:59:20.221167+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:20.221167+0000","last_undegraded":"2024-09-12T02:59:20.221167+0000","last_fullsized":"2024-09-12T02:59:20.221167+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:55.285218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572731+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:59:20.572731+0000","last_peered":"2024-09-12T02:59:20.572731+0000","last_clean":"2024-09-12T02:59:20.572731+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:20.572731+0000","last_undegraded":"2024-09-12T02:59:20.572731+0000","last_fullsized":"2024-09-12T02:59:20.572731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38710,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":516025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":925696,"data_stored":478424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1527808,"data_stored":1069119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28512,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343328,"statfs":{"total":96636764160,"available":96607567872,"internally_reserved":0,"allocated":1519616,"data_stored":1069063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":515714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906950,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29020,"kb_used_data":904,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342820,"statfs":{"total":96636764160,"available":96607047680,"internally_reserved":0,"allocated":925696,"data_stored":478203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":933888,"data_stored":478239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":478273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:59:26.610 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:59:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.780+0000 7f30f5c00640 1 Processor -- start 2024-09-12T02:59:26.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.780+0000 7f30f5c00640 1 -- start start 2024-09-12T02:59:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30f5c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f30f0074070 0x7f30f00c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30f5c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f00c2d50 con 0x7f30f0151a80 2024-09-12T02:59:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30f5c00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f01580c0 con 0x7f30f00c28c0 2024-09-12T02:59:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30f5c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f30f00c8500 con 0x7f30f0074070 2024-09-12T02:59:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30eea00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f30f0151a80 0x7f30f0072e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57610/0 (socket says 172.21.15.63:57610) 2024-09-12T02:59:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30eea00640 1 -- 172.21.15.63:0/88973269 learned_addr learned my addr 172.21.15.63:0/88973269 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:26.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30e6000640 1 --2- 172.21.15.63:0/88973269 >> v2:172.21.15.119:3300/0 conn(0x7f30f0074070 0x7f30f00c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848369247 0 0) 0x7f30f00c2d50 con 0x7f30f0151a80 2024-09-12T02:59:26.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30d4005740 con 0x7f30f0151a80 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 326214676 0 0) 0x7f30d4005740 con 0x7f30f0151a80 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 >> v2:172.21.15.119:3300/0 conn(0x7f30f0074070 msgr2=0x7f30f00c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 --2- 172.21.15.63:0/88973269 >> v2:172.21.15.119:3300/0 conn(0x7f30f0074070 0x7f30f00c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 >> v1:172.21.15.119:6789/0 conn(0x7f30f00c28c0 legacy=0x7f30f0161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f01583a0 con 0x7f30f0151a80 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f30e0001680 con 0x7f30f0151a80 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 >> v1:172.21.15.63:6789/0 conn(0x7f30f0151a80 legacy=0x7f30f0072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d4005bd0 0x7f30d4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30d4006a20 0x7f30d4006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30d40073e0 0x7f30d400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30f00c8500 con 0x7f30d40073e0 2024-09-12T02:59:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30d400e290 con 0x7f30d4005bd0 2024-09-12T02:59:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f30d400e490 con 0x7f30d4006a20 2024-09-12T02:59:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ef400640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30d40073e0 0x7f30d400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30eea00640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d4005bd0 0x7f30d4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30e6000640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30d4006a20 0x7f30d4006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ef400640 1 -- 172.21.15.63:0/88973269 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30d4006a20 msgr2=0x7f30d4006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:26.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ef400640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30d4006a20 0x7f30d4006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ef400640 1 -- 172.21.15.63:0/88973269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d4005bd0 msgr2=0x7f30d4005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:26.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ef400640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d4005bd0 0x7f30d4005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.784+0000 7f30ef400640 1 -- 172.21.15.63:0/88973269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d4005740 con 0x7f30d40073e0 2024-09-12T02:59:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30ef400640 1 -- 172.21.15.63:0/88973269 reap_dead start 2024-09-12T02:59:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30ef400640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30d40073e0 0x7f30d400dbe0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f30e8001e70 tx=0x7f30e801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545956ed99500645 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8001a90 con 0x7f30d40073e0 2024-09-12T02:59:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e8003bc0 con 0x7f30d40073e0 2024-09-12T02:59:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30ee000640 1 -- 172.21.15.63:0/88973269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8005020 con 0x7f30d40073e0 2024-09-12T02:59:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30f5c00640 1 -- 172.21.15.63:0/88973269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30d40073e0 msgr2=0x7f30d400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30f5c00640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30d40073e0 0x7f30d400dbe0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f30e8001e70 tx=0x7f30e801c780 comp rx=0 tx=0).stop 2024-09-12T02:59:26.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30f5c00640 1 -- 172.21.15.63:0/88973269 shutdown_connections 2024-09-12T02:59:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30f5c00640 1 --2- 172.21.15.63:0/88973269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30d40073e0 0x7f30d400dbe0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30f5c00640 1 -- 172.21.15.63:0/88973269 >> 172.21.15.63:0/88973269 conn(0x7f30f006f3d0 msgr2=0x7f30f006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30f5c00640 1 -- 172.21.15.63:0/88973269 shutdown_connections 2024-09-12T02:59:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.788+0000 7f30f5c00640 1 -- 172.21.15.63:0/88973269 wait complete. 2024-09-12T02:59:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 Processor -- start 2024-09-12T02:59:26.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 -- start start 2024-09-12T02:59:26.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d40073e0 0x7f30f0151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f01523e0 0x7f30f0154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30f014d090 0x7f30f0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30f00cc4c0 con 0x7f30f01523e0 2024-09-12T02:59:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f30f00cc1e0 con 0x7f30d40073e0 2024-09-12T02:59:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f30f00c7cf0 con 0x7f30f014d090 2024-09-12T02:59:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e6000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f01523e0 0x7f30f0154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e6000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f01523e0 0x7f30f0154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42446/0 (socket says 172.21.15.63:42446) 2024-09-12T02:59:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e6000640 1 -- 172.21.15.63:0/1646306440 learned_addr learned my addr 172.21.15.63:0/1646306440 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:26.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30eea00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d40073e0 0x7f30f0151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30ef400640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30f014d090 0x7f30f0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e6000640 1 -- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30f014d090 msgr2=0x7f30f0154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e6000640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30f014d090 0x7f30f0154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e6000640 1 -- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d40073e0 msgr2=0x7f30f0151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e6000640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d40073e0 0x7f30f0151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e6000640 1 -- 172.21.15.63:0/1646306440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f00c6190 con 0x7f30f01523e0 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30ef400640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30f014d090 0x7f30f0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30eea00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d40073e0 0x7f30f0151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e6000640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f01523e0 0x7f30f0154690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f30d8011590 tx=0x7f30d8011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e7400640 1 -- 172.21.15.63:0/1646306440 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8015870 con 0x7f30f01523e0 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e7400640 1 -- 172.21.15.63:0/1646306440 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d8015a10 con 0x7f30f01523e0 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30e7400640 1 -- 172.21.15.63:0/1646306440 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8015dc0 con 0x7f30f01523e0 2024-09-12T02:59:26.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f014d800 con 0x7f30f01523e0 2024-09-12T02:59:26.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f01ec010 con 0x7f30f01523e0 2024-09-12T02:59:26.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.792+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f01eca10 con 0x7f30f01523e0 2024-09-12T02:59:26.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.796+0000 7f30e7400640 1 -- 172.21.15.63:0/1646306440 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30d8013400 con 0x7f30f01523e0 2024-09-12T02:59:26.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.796+0000 7f30e7400640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30cc0678c0 0x7f30cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:26.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.796+0000 7f30e7400640 1 -- 172.21.15.63:0/1646306440 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f30d8086aa0 con 0x7f30f01523e0 2024-09-12T02:59:26.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.796+0000 7f30eea00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30cc0678c0 0x7f30cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:26.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.796+0000 7f30eea00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30cc0678c0 0x7f30cc069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f30e0007cc0 tx=0x7f30e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:26.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.800+0000 7f30e7400640 1 -- 172.21.15.63:0/1646306440 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f30d8019030 con 0x7f30f01523e0 2024-09-12T02:59:26.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.964+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30f006dae0 con 0x7f30cc0678c0 2024-09-12T02:59:26.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.988+0000 7f30e7400640 1 -- 172.21.15.63:0/1646306440 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332672 (secure 0 0 0) 0x7f30f006dae0 con 0x7f30cc0678c0 2024-09-12T02:59:26.993 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30cc0678c0 msgr2=0x7f30cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30cc0678c0 0x7f30cc069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f30e0007cc0 tx=0x7f30e0009040 comp rx=0 tx=0).stop 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f01523e0 msgr2=0x7f30f0154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f01523e0 0x7f30f0154690 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f30d8011590 tx=0x7f30d8011a50 comp rx=0 tx=0).stop 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 shutdown_connections 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f30cc0678c0 0x7f30cc069d80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30f014d090 0x7f30f0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30f01523e0 0x7f30f0154690 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 --2- 172.21.15.63:0/1646306440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30d40073e0 0x7f30f0151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 >> 172.21.15.63:0/1646306440 conn(0x7f30f006f3d0 msgr2=0x7f30f0072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:27.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 shutdown_connections 2024-09-12T02:59:27.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:26.992+0000 7f30f5c00640 1 -- 172.21.15.63:0/1646306440 wait complete. 2024-09-12T02:59:27.015 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-12T02:59:25.798754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629078,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":244,"num_write_kb":2486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234152,"kb_used_data":8504,"kb_used_omap":15,"kb_used_meta":225456,"kb_avail":754740568,"statfs":{"total":773094113280,"available":772854341632,"internally_reserved":0,"allocated":8708096,"data_stored":5083060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":230867630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.608140"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093498+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:59:21.093498+0000","last_peered":"2024-09-12T02:59:21.093498+0000","last_clean":"2024-09-12T02:59:21.093498+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:21.093498+0000","last_undegraded":"2024-09-12T02:59:21.093498+0000","last_fullsized":"2024-09-12T02:59:21.093498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555874+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:59:20.555874+0000","last_peered":"2024-09-12T02:59:20.555874+0000","last_clean":"2024-09-12T02:59:20.555874+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:20.555874+0000","last_undegraded":"2024-09-12T02:59:20.555874+0000","last_fullsized":"2024-09-12T02:59:20.555874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554951+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:59:20.554951+0000","last_peered":"2024-09-12T02:59:20.554951+0000","last_clean":"2024-09-12T02:59:20.554951+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:20.554951+0000","last_undegraded":"2024-09-12T02:59:20.554951+0000","last_fullsized":"2024-09-12T02:59:20.554951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555984+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:59:20.555984+0000","last_peered":"2024-09-12T02:59:20.555984+0000","last_clean":"2024-09-12T02:59:20.555984+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:20.555984+0000","last_undegraded":"2024-09-12T02:59:20.555984+0000","last_fullsized":"2024-09-12T02:59:20.555984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093267+0000","last_change":"2024-09-12T02:59:06.040714+0000","last_active":"2024-09-12T02:59:21.093267+0000","last_peered":"2024-09-12T02:59:21.093267+0000","last_clean":"2024-09-12T02:59:21.093267+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:21.093267+0000","last_undegraded":"2024-09-12T02:59:21.093267+0000","last_fullsized":"2024-09-12T02:59:21.093267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:54.289352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":141,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221118+0000","last_change":"2024-09-12T02:59:08.071320+0000","last_active":"2024-09-12T02:59:20.221118+0000","last_peered":"2024-09-12T02:59:20.221118+0000","last_clean":"2024-09-12T02:59:20.221118+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:20.221118+0000","last_undegraded":"2024-09-12T02:59:20.221118+0000","last_fullsized":"2024-09-12T02:59:20.221118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:38.378285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572534+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:59:20.572534+0000","last_peered":"2024-09-12T02:59:20.572534+0000","last_clean":"2024-09-12T02:59:20.572534+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:20.572534+0000","last_undegraded":"2024-09-12T02:59:20.572534+0000","last_fullsized":"2024-09-12T02:59:20.572534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226154+0000","last_change":"2024-09-12T02:59:06.046085+0000","last_active":"2024-09-12T02:59:20.226154+0000","last_peered":"2024-09-12T02:59:20.226154+0000","last_clean":"2024-09-12T02:59:20.226154+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:20.226154+0000","last_undegraded":"2024-09-12T02:59:20.226154+0000","last_fullsized":"2024-09-12T02:59:20.226154+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:35.684141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223813+0000","last_change":"2024-09-12T02:59:08.073058+0000","last_active":"2024-09-12T02:59:20.223813+0000","last_peered":"2024-09-12T02:59:20.223813+0000","last_clean":"2024-09-12T02:59:20.223813+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:20.223813+0000","last_undegraded":"2024-09-12T02:59:20.223813+0000","last_fullsized":"2024-09-12T02:59:20.223813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.609541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572259+0000","last_change":"2024-09-12T02:59:06.053365+0000","last_active":"2024-09-12T02:59:20.572259+0000","last_peered":"2024-09-12T02:59:20.572259+0000","last_clean":"2024-09-12T02:59:20.572259+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:20.572259+0000","last_undegraded":"2024-09-12T02:59:20.572259+0000","last_fullsized":"2024-09-12T02:59:20.572259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227143+0000","last_change":"2024-09-12T02:59:06.040820+0000","last_active":"2024-09-12T02:59:20.227143+0000","last_peered":"2024-09-12T02:59:20.227143+0000","last_clean":"2024-09-12T02:59:20.227143+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:20.227143+0000","last_undegraded":"2024-09-12T02:59:20.227143+0000","last_fullsized":"2024-09-12T02:59:20.227143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:41.411962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223290+0000","last_change":"2024-09-12T02:59:06.058963+0000","last_active":"2024-09-12T02:59:20.223290+0000","last_peered":"2024-09-12T02:59:20.223290+0000","last_clean":"2024-09-12T02:59:20.223290+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:20.223290+0000","last_undegraded":"2024-09-12T02:59:20.223290+0000","last_fullsized":"2024-09-12T02:59:20.223290+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651357+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:59:20.651357+0000","last_peered":"2024-09-12T02:59:20.651357+0000","last_clean":"2024-09-12T02:59:20.651357+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:20.651357+0000","last_undegraded":"2024-09-12T02:59:20.651357+0000","last_fullsized":"2024-09-12T02:59:20.651357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572449+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:59:20.572449+0000","last_peered":"2024-09-12T02:59:20.572449+0000","last_clean":"2024-09-12T02:59:20.572449+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:20.572449+0000","last_undegraded":"2024-09-12T02:59:20.572449+0000","last_fullsized":"2024-09-12T02:59:20.572449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223073+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:59:20.223073+0000","last_peered":"2024-09-12T02:59:20.223073+0000","last_clean":"2024-09-12T02:59:20.223073+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:20.223073+0000","last_undegraded":"2024-09-12T02:59:20.223073+0000","last_fullsized":"2024-09-12T02:59:20.223073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555282+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:59:20.555282+0000","last_peered":"2024-09-12T02:59:20.555282+0000","last_clean":"2024-09-12T02:59:20.555282+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:20.555282+0000","last_undegraded":"2024-09-12T02:59:20.555282+0000","last_fullsized":"2024-09-12T02:59:20.555282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220179+0000","last_change":"2024-09-12T02:59:08.061938+0000","last_active":"2024-09-12T02:59:20.220179+0000","last_peered":"2024-09-12T02:59:20.220179+0000","last_clean":"2024-09-12T02:59:20.220179+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:20.220179+0000","last_undegraded":"2024-09-12T02:59:20.220179+0000","last_fullsized":"2024-09-12T02:59:20.220179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.137585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221866+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:59:20.221866+0000","last_peered":"2024-09-12T02:59:20.221866+0000","last_clean":"2024-09-12T02:59:20.221866+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:20.221866+0000","last_undegraded":"2024-09-12T02:59:20.221866+0000","last_fullsized":"2024-09-12T02:59:20.221866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555522+0000","last_change":"2024-09-12T02:59:08.063392+0000","last_active":"2024-09-12T02:59:20.555522+0000","last_peered":"2024-09-12T02:59:20.555522+0000","last_clean":"2024-09-12T02:59:20.555522+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:20.555522+0000","last_undegraded":"2024-09-12T02:59:20.555522+0000","last_fullsized":"2024-09-12T02:59:20.555522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:39.814573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219716+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:59:20.219716+0000","last_peered":"2024-09-12T02:59:20.219716+0000","last_clean":"2024-09-12T02:59:20.219716+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:20.219716+0000","last_undegraded":"2024-09-12T02:59:20.219716+0000","last_fullsized":"2024-09-12T02:59:20.219716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221264+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:59:20.221264+0000","last_peered":"2024-09-12T02:59:20.221264+0000","last_clean":"2024-09-12T02:59:20.221264+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:20.221264+0000","last_undegraded":"2024-09-12T02:59:20.221264+0000","last_fullsized":"2024-09-12T02:59:20.221264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222869+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:59:20.222869+0000","last_peered":"2024-09-12T02:59:20.222869+0000","last_clean":"2024-09-12T02:59:20.222869+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:20.222869+0000","last_undegraded":"2024-09-12T02:59:20.222869+0000","last_fullsized":"2024-09-12T02:59:20.222869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571430+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:59:20.571430+0000","last_peered":"2024-09-12T02:59:20.571430+0000","last_clean":"2024-09-12T02:59:20.571430+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:20.571430+0000","last_undegraded":"2024-09-12T02:59:20.571430+0000","last_fullsized":"2024-09-12T02:59:20.571430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224226+0000","last_change":"2024-09-12T02:59:08.080501+0000","last_active":"2024-09-12T02:59:20.224226+0000","last_peered":"2024-09-12T02:59:20.224226+0000","last_clean":"2024-09-12T02:59:20.224226+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:20.224226+0000","last_undegraded":"2024-09-12T02:59:20.224226+0000","last_fullsized":"2024-09-12T02:59:20.224226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:19.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094222+0000","last_change":"2024-09-12T02:59:08.061926+0000","last_active":"2024-09-12T02:59:21.094222+0000","last_peered":"2024-09-12T02:59:21.094222+0000","last_clean":"2024-09-12T02:59:21.094222+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:21.094222+0000","last_undegraded":"2024-09-12T02:59:21.094222+0000","last_fullsized":"2024-09-12T02:59:21.094222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652743+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:59:20.652743+0000","last_peered":"2024-09-12T02:59:20.652743+0000","last_clean":"2024-09-12T02:59:20.652743+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:20.652743+0000","last_undegraded":"2024-09-12T02:59:20.652743+0000","last_fullsized":"2024-09-12T02:59:20.652743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222216+0000","last_change":"2024-09-12T02:59:06.042311+0000","last_active":"2024-09-12T02:59:20.222216+0000","last_peered":"2024-09-12T02:59:20.222216+0000","last_clean":"2024-09-12T02:59:20.222216+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:20.222216+0000","last_undegraded":"2024-09-12T02:59:20.222216+0000","last_fullsized":"2024-09-12T02:59:20.222216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.556036+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:59:20.556036+0000","last_peered":"2024-09-12T02:59:20.556036+0000","last_clean":"2024-09-12T02:59:20.556036+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:20.556036+0000","last_undegraded":"2024-09-12T02:59:20.556036+0000","last_fullsized":"2024-09-12T02:59:20.556036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'10","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220976+0000","last_change":"2024-09-12T02:59:08.080132+0000","last_active":"2024-09-12T02:59:20.220976+0000","last_peered":"2024-09-12T02:59:20.220976+0000","last_clean":"2024-09-12T02:59:20.220976+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:20.220976+0000","last_undegraded":"2024-09-12T02:59:20.220976+0000","last_fullsized":"2024-09-12T02:59:20.220976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:33.297534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554880+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:59:20.554880+0000","last_peered":"2024-09-12T02:59:20.554880+0000","last_clean":"2024-09-12T02:59:20.554880+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:59:20.554880+0000","last_undegraded":"2024-09-12T02:59:20.554880+0000","last_fullsized":"2024-09-12T02:59:20.554880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220394+0000","last_change":"2024-09-12T02:59:08.052379+0000","last_active":"2024-09-12T02:59:20.220394+0000","last_peered":"2024-09-12T02:59:20.220394+0000","last_clean":"2024-09-12T02:59:20.220394+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:20.220394+0000","last_undegraded":"2024-09-12T02:59:20.220394+0000","last_fullsized":"2024-09-12T02:59:20.220394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.582966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572839+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:59:20.572839+0000","last_peered":"2024-09-12T02:59:20.572839+0000","last_clean":"2024-09-12T02:59:20.572839+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:20.572839+0000","last_undegraded":"2024-09-12T02:59:20.572839+0000","last_fullsized":"2024-09-12T02:59:20.572839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094850+0000","last_change":"2024-09-12T02:59:06.034354+0000","last_active":"2024-09-12T02:59:21.094850+0000","last_peered":"2024-09-12T02:59:21.094850+0000","last_clean":"2024-09-12T02:59:21.094850+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:21.094850+0000","last_undegraded":"2024-09-12T02:59:21.094850+0000","last_fullsized":"2024-09-12T02:59:21.094850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:05.155351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226589+0000","last_change":"2024-09-12T02:59:06.034822+0000","last_active":"2024-09-12T02:59:20.226589+0000","last_peered":"2024-09-12T02:59:20.226589+0000","last_clean":"2024-09-12T02:59:20.226589+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:20.226589+0000","last_undegraded":"2024-09-12T02:59:20.226589+0000","last_fullsized":"2024-09-12T02:59:20.226589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:00.839140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220548+0000","last_change":"2024-09-12T02:59:08.054413+0000","last_active":"2024-09-12T02:59:20.220548+0000","last_peered":"2024-09-12T02:59:20.220548+0000","last_clean":"2024-09-12T02:59:20.220548+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:20.220548+0000","last_undegraded":"2024-09-12T02:59:20.220548+0000","last_fullsized":"2024-09-12T02:59:20.220548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:21.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220362+0000","last_change":"2024-09-12T02:59:08.063077+0000","last_active":"2024-09-12T02:59:20.220362+0000","last_peered":"2024-09-12T02:59:20.220362+0000","last_clean":"2024-09-12T02:59:20.220362+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:20.220362+0000","last_undegraded":"2024-09-12T02:59:20.220362+0000","last_fullsized":"2024-09-12T02:59:20.220362+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224154+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:59:20.224154+0000","last_peered":"2024-09-12T02:59:20.224154+0000","last_clean":"2024-09-12T02:59:20.224154+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:20.224154+0000","last_undegraded":"2024-09-12T02:59:20.224154+0000","last_fullsized":"2024-09-12T02:59:20.224154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224740+0000","last_change":"2024-09-12T02:59:06.046884+0000","last_active":"2024-09-12T02:59:20.224740+0000","last_peered":"2024-09-12T02:59:20.224740+0000","last_clean":"2024-09-12T02:59:20.224740+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:20.224740+0000","last_undegraded":"2024-09-12T02:59:20.224740+0000","last_fullsized":"2024-09-12T02:59:20.224740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:52.145202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227571+0000","last_change":"2024-09-12T02:59:06.062554+0000","last_active":"2024-09-12T02:59:20.227571+0000","last_peered":"2024-09-12T02:59:20.227571+0000","last_clean":"2024-09-12T02:59:20.227571+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:20.227571+0000","last_undegraded":"2024-09-12T02:59:20.227571+0000","last_fullsized":"2024-09-12T02:59:20.227571+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:27.156770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220124+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:59:20.220124+0000","last_peered":"2024-09-12T02:59:20.220124+0000","last_clean":"2024-09-12T02:59:20.220124+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:20.220124+0000","last_undegraded":"2024-09-12T02:59:20.220124+0000","last_fullsized":"2024-09-12T02:59:20.220124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"60'2","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893199+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:59:20.893199+0000","last_peered":"2024-09-12T02:59:20.893199+0000","last_clean":"2024-09-12T02:59:20.893199+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:20.893199+0000","last_undegraded":"2024-09-12T02:59:20.893199+0000","last_fullsized":"2024-09-12T02:59:20.893199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220885+0000","last_change":"2024-09-12T02:59:08.057364+0000","last_active":"2024-09-12T02:59:20.220885+0000","last_peered":"2024-09-12T02:59:20.220885+0000","last_clean":"2024-09-12T02:59:20.220885+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:20.220885+0000","last_undegraded":"2024-09-12T02:59:20.220885+0000","last_fullsized":"2024-09-12T02:59:20.220885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.092701+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:59:21.092701+0000","last_peered":"2024-09-12T02:59:21.092701+0000","last_clean":"2024-09-12T02:59:21.092701+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:21.092701+0000","last_undegraded":"2024-09-12T02:59:21.092701+0000","last_fullsized":"2024-09-12T02:59:21.092701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571447+0000","last_change":"2024-09-12T02:59:08.070124+0000","last_active":"2024-09-12T02:59:20.571447+0000","last_peered":"2024-09-12T02:59:20.571447+0000","last_clean":"2024-09-12T02:59:20.571447+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:20.571447+0000","last_undegraded":"2024-09-12T02:59:20.571447+0000","last_fullsized":"2024-09-12T02:59:20.571447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:14.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093938+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:59:21.093938+0000","last_peered":"2024-09-12T02:59:21.093938+0000","last_clean":"2024-09-12T02:59:21.093938+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:21.093938+0000","last_undegraded":"2024-09-12T02:59:21.093938+0000","last_fullsized":"2024-09-12T02:59:21.093938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555055+0000","last_change":"2024-09-12T02:59:06.063289+0000","last_active":"2024-09-12T02:59:20.555055+0000","last_peered":"2024-09-12T02:59:20.555055+0000","last_clean":"2024-09-12T02:59:20.555055+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:20.555055+0000","last_undegraded":"2024-09-12T02:59:20.555055+0000","last_fullsized":"2024-09-12T02:59:20.555055+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225192+0000","last_change":"2024-09-12T02:59:06.038764+0000","last_active":"2024-09-12T02:59:20.225192+0000","last_peered":"2024-09-12T02:59:20.225192+0000","last_clean":"2024-09-12T02:59:20.225192+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:20.225192+0000","last_undegraded":"2024-09-12T02:59:20.225192+0000","last_fullsized":"2024-09-12T02:59:20.225192+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.748521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":283,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571685+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:59:20.571685+0000","last_peered":"2024-09-12T02:59:20.571685+0000","last_clean":"2024-09-12T02:59:20.571685+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:20.571685+0000","last_undegraded":"2024-09-12T02:59:20.571685+0000","last_fullsized":"2024-09-12T02:59:20.571685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651983+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:59:20.651983+0000","last_peered":"2024-09-12T02:59:20.651983+0000","last_clean":"2024-09-12T02:59:20.651983+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:20.651983+0000","last_undegraded":"2024-09-12T02:59:20.651983+0000","last_fullsized":"2024-09-12T02:59:20.651983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220781+0000","last_change":"2024-09-12T02:59:06.041259+0000","last_active":"2024-09-12T02:59:20.220781+0000","last_peered":"2024-09-12T02:59:20.220781+0000","last_clean":"2024-09-12T02:59:20.220781+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:20.220781+0000","last_undegraded":"2024-09-12T02:59:20.220781+0000","last_fullsized":"2024-09-12T02:59:20.220781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:50.481819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893814+0000","last_change":"2024-09-12T02:59:06.053023+0000","last_active":"2024-09-12T02:59:20.893814+0000","last_peered":"2024-09-12T02:59:20.893814+0000","last_clean":"2024-09-12T02:59:20.893814+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:20.893814+0000","last_undegraded":"2024-09-12T02:59:20.893814+0000","last_fullsized":"2024-09-12T02:59:20.893814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:23.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651340+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:59:20.651340+0000","last_peered":"2024-09-12T02:59:20.651340+0000","last_clean":"2024-09-12T02:59:20.651340+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:20.651340+0000","last_undegraded":"2024-09-12T02:59:20.651340+0000","last_fullsized":"2024-09-12T02:59:20.651340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227193+0000","last_change":"2024-09-12T02:59:06.048181+0000","last_active":"2024-09-12T02:59:20.227193+0000","last_peered":"2024-09-12T02:59:20.227193+0000","last_clean":"2024-09-12T02:59:20.227193+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:20.227193+0000","last_undegraded":"2024-09-12T02:59:20.227193+0000","last_fullsized":"2024-09-12T02:59:20.227193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:18.582473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219594+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:59:20.219594+0000","last_peered":"2024-09-12T02:59:20.219594+0000","last_clean":"2024-09-12T02:59:20.219594+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:20.219594+0000","last_undegraded":"2024-09-12T02:59:20.219594+0000","last_fullsized":"2024-09-12T02:59:20.219594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095006+0000","last_change":"2024-09-12T02:59:06.034598+0000","last_active":"2024-09-12T02:59:21.095006+0000","last_peered":"2024-09-12T02:59:21.095006+0000","last_clean":"2024-09-12T02:59:21.095006+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:21.095006+0000","last_undegraded":"2024-09-12T02:59:21.095006+0000","last_fullsized":"2024-09-12T02:59:21.095006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:16.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573065+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:59:20.573065+0000","last_peered":"2024-09-12T02:59:20.573065+0000","last_clean":"2024-09-12T02:59:20.573065+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:20.573065+0000","last_undegraded":"2024-09-12T02:59:20.573065+0000","last_fullsized":"2024-09-12T02:59:20.573065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893238+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:59:20.893238+0000","last_peered":"2024-09-12T02:59:20.893238+0000","last_clean":"2024-09-12T02:59:20.893238+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:20.893238+0000","last_undegraded":"2024-09-12T02:59:20.893238+0000","last_fullsized":"2024-09-12T02:59:20.893238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222460+0000","last_change":"2024-09-12T02:59:06.062947+0000","last_active":"2024-09-12T02:59:20.222460+0000","last_peered":"2024-09-12T02:59:20.222460+0000","last_clean":"2024-09-12T02:59:20.222460+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:20.222460+0000","last_undegraded":"2024-09-12T02:59:20.222460+0000","last_fullsized":"2024-09-12T02:59:20.222460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:19.386600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573025+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:59:20.573025+0000","last_peered":"2024-09-12T02:59:20.573025+0000","last_clean":"2024-09-12T02:59:20.573025+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:20.573025+0000","last_undegraded":"2024-09-12T02:59:20.573025+0000","last_fullsized":"2024-09-12T02:59:20.573025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224723+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:59:20.224723+0000","last_peered":"2024-09-12T02:59:20.224723+0000","last_clean":"2024-09-12T02:59:20.224723+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:20.224723+0000","last_undegraded":"2024-09-12T02:59:20.224723+0000","last_fullsized":"2024-09-12T02:59:20.224723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221617+0000","last_change":"2024-09-12T02:59:08.073044+0000","last_active":"2024-09-12T02:59:20.221617+0000","last_peered":"2024-09-12T02:59:20.221617+0000","last_clean":"2024-09-12T02:59:20.221617+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:20.221617+0000","last_undegraded":"2024-09-12T02:59:20.221617+0000","last_fullsized":"2024-09-12T02:59:20.221617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571812+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:59:20.571812+0000","last_peered":"2024-09-12T02:59:20.571812+0000","last_clean":"2024-09-12T02:59:20.571812+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:20.571812+0000","last_undegraded":"2024-09-12T02:59:20.571812+0000","last_fullsized":"2024-09-12T02:59:20.571812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893455+0000","last_change":"2024-09-12T02:59:08.079372+0000","last_active":"2024-09-12T02:59:20.893455+0000","last_peered":"2024-09-12T02:59:20.893455+0000","last_clean":"2024-09-12T02:59:20.893455+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:20.893455+0000","last_undegraded":"2024-09-12T02:59:20.893455+0000","last_fullsized":"2024-09-12T02:59:20.893455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:04.951763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093850+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:59:21.093850+0000","last_peered":"2024-09-12T02:59:21.093850+0000","last_clean":"2024-09-12T02:59:21.093850+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:21.093850+0000","last_undegraded":"2024-09-12T02:59:21.093850+0000","last_fullsized":"2024-09-12T02:59:21.093850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651401+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:59:20.651401+0000","last_peered":"2024-09-12T02:59:20.651401+0000","last_clean":"2024-09-12T02:59:20.651401+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:20.651401+0000","last_undegraded":"2024-09-12T02:59:20.651401+0000","last_fullsized":"2024-09-12T02:59:20.651401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651642+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:59:20.651642+0000","last_peered":"2024-09-12T02:59:20.651642+0000","last_clean":"2024-09-12T02:59:20.651642+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:20.651642+0000","last_undegraded":"2024-09-12T02:59:20.651642+0000","last_fullsized":"2024-09-12T02:59:20.651642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555842+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:59:20.555842+0000","last_peered":"2024-09-12T02:59:20.555842+0000","last_clean":"2024-09-12T02:59:20.555842+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:20.555842+0000","last_undegraded":"2024-09-12T02:59:20.555842+0000","last_fullsized":"2024-09-12T02:59:20.555842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572178+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:59:20.572178+0000","last_peered":"2024-09-12T02:59:20.572178+0000","last_clean":"2024-09-12T02:59:20.572178+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:20.572178+0000","last_undegraded":"2024-09-12T02:59:20.572178+0000","last_fullsized":"2024-09-12T02:59:20.572178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221668+0000","last_change":"2024-09-12T02:59:06.050751+0000","last_active":"2024-09-12T02:59:20.221668+0000","last_peered":"2024-09-12T02:59:20.221668+0000","last_clean":"2024-09-12T02:59:20.221668+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:20.221668+0000","last_undegraded":"2024-09-12T02:59:20.221668+0000","last_fullsized":"2024-09-12T02:59:20.221668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.271840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555505+0000","last_change":"2024-09-12T02:59:08.061102+0000","last_active":"2024-09-12T02:59:20.555505+0000","last_peered":"2024-09-12T02:59:20.555505+0000","last_clean":"2024-09-12T02:59:20.555505+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:20.555505+0000","last_undegraded":"2024-09-12T02:59:20.555505+0000","last_fullsized":"2024-09-12T02:59:20.555505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:58.125545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093505+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:59:21.093505+0000","last_peered":"2024-09-12T02:59:21.093505+0000","last_clean":"2024-09-12T02:59:21.093505+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:21.093505+0000","last_undegraded":"2024-09-12T02:59:21.093505+0000","last_fullsized":"2024-09-12T02:59:21.093505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095128+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:59:21.095128+0000","last_peered":"2024-09-12T02:59:21.095128+0000","last_clean":"2024-09-12T02:59:21.095128+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:21.095128+0000","last_undegraded":"2024-09-12T02:59:21.095128+0000","last_fullsized":"2024-09-12T02:59:21.095128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227503+0000","last_change":"2024-09-12T02:59:06.046162+0000","last_active":"2024-09-12T02:59:20.227503+0000","last_peered":"2024-09-12T02:59:20.227503+0000","last_clean":"2024-09-12T02:59:20.227503+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:20.227503+0000","last_undegraded":"2024-09-12T02:59:20.227503+0000","last_fullsized":"2024-09-12T02:59:20.227503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.056594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572297+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:59:20.572297+0000","last_peered":"2024-09-12T02:59:20.572297+0000","last_clean":"2024-09-12T02:59:20.572297+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:20.572297+0000","last_undegraded":"2024-09-12T02:59:20.572297+0000","last_fullsized":"2024-09-12T02:59:20.572297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"62'23","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.650946+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:59:20.650946+0000","last_peered":"2024-09-12T02:59:20.650946+0000","last_clean":"2024-09-12T02:59:20.650946+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:20.650946+0000","last_undegraded":"2024-09-12T02:59:20.650946+0000","last_fullsized":"2024-09-12T02:59:20.650946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37601,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220586+0000","last_change":"2024-09-12T02:59:08.086853+0000","last_active":"2024-09-12T02:59:20.220586+0000","last_peered":"2024-09-12T02:59:20.220586+0000","last_clean":"2024-09-12T02:59:20.220586+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:20.220586+0000","last_undegraded":"2024-09-12T02:59:20.220586+0000","last_fullsized":"2024-09-12T02:59:20.220586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222774+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:59:20.222774+0000","last_peered":"2024-09-12T02:59:20.222774+0000","last_clean":"2024-09-12T02:59:20.222774+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:20.222774+0000","last_undegraded":"2024-09-12T02:59:20.222774+0000","last_fullsized":"2024-09-12T02:59:20.222774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"60'5","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220978+0000","last_change":"2024-09-12T02:59:08.072309+0000","last_active":"2024-09-12T02:59:20.220978+0000","last_peered":"2024-09-12T02:59:20.220978+0000","last_clean":"2024-09-12T02:59:20.220978+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:20.220978+0000","last_undegraded":"2024-09-12T02:59:20.220978+0000","last_fullsized":"2024-09-12T02:59:20.220978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223587+0000","last_change":"2024-09-12T02:59:08.080949+0000","last_active":"2024-09-12T02:59:20.223587+0000","last_peered":"2024-09-12T02:59:20.223587+0000","last_clean":"2024-09-12T02:59:20.223587+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:20.223587+0000","last_undegraded":"2024-09-12T02:59:20.223587+0000","last_fullsized":"2024-09-12T02:59:20.223587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:41.284531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093410+0000","last_change":"2024-09-12T02:59:06.040772+0000","last_active":"2024-09-12T02:59:21.093410+0000","last_peered":"2024-09-12T02:59:21.093410+0000","last_clean":"2024-09-12T02:59:21.093410+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:21.093410+0000","last_undegraded":"2024-09-12T02:59:21.093410+0000","last_fullsized":"2024-09-12T02:59:21.093410+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:31.077375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225642+0000","last_change":"2024-09-12T02:59:06.033384+0000","last_active":"2024-09-12T02:59:20.225642+0000","last_peered":"2024-09-12T02:59:20.225642+0000","last_clean":"2024-09-12T02:59:20.225642+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:20.225642+0000","last_undegraded":"2024-09-12T02:59:20.225642+0000","last_fullsized":"2024-09-12T02:59:20.225642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:41.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555370+0000","last_change":"2024-09-12T02:59:08.074397+0000","last_active":"2024-09-12T02:59:20.555370+0000","last_peered":"2024-09-12T02:59:20.555370+0000","last_clean":"2024-09-12T02:59:20.555370+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:20.555370+0000","last_undegraded":"2024-09-12T02:59:20.555370+0000","last_fullsized":"2024-09-12T02:59:20.555370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:11.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225923+0000","last_change":"2024-09-12T02:59:06.035397+0000","last_active":"2024-09-12T02:59:20.225923+0000","last_peered":"2024-09-12T02:59:20.225923+0000","last_clean":"2024-09-12T02:59:20.225923+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:20.225923+0000","last_undegraded":"2024-09-12T02:59:20.225923+0000","last_fullsized":"2024-09-12T02:59:20.225923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:13.552932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652530+0000","last_change":"2024-09-12T02:59:06.055518+0000","last_active":"2024-09-12T02:59:20.652530+0000","last_peered":"2024-09-12T02:59:20.652530+0000","last_clean":"2024-09-12T02:59:20.652530+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:20.652530+0000","last_undegraded":"2024-09-12T02:59:20.652530+0000","last_fullsized":"2024-09-12T02:59:20.652530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:09.456324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555259+0000","last_change":"2024-09-12T02:59:06.038606+0000","last_active":"2024-09-12T02:59:20.555259+0000","last_peered":"2024-09-12T02:59:20.555259+0000","last_clean":"2024-09-12T02:59:20.555259+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:20.555259+0000","last_undegraded":"2024-09-12T02:59:20.555259+0000","last_fullsized":"2024-09-12T02:59:20.555259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.456399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093743+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:59:21.093743+0000","last_peered":"2024-09-12T02:59:21.093743+0000","last_clean":"2024-09-12T02:59:21.093743+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:21.093743+0000","last_undegraded":"2024-09-12T02:59:21.093743+0000","last_fullsized":"2024-09-12T02:59:21.093743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220149+0000","last_change":"2024-09-12T02:59:08.058453+0000","last_active":"2024-09-12T02:59:20.220149+0000","last_peered":"2024-09-12T02:59:20.220149+0000","last_clean":"2024-09-12T02:59:20.220149+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:20.220149+0000","last_undegraded":"2024-09-12T02:59:20.220149+0000","last_fullsized":"2024-09-12T02:59:20.220149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221549+0000","last_change":"2024-09-12T02:59:06.065547+0000","last_active":"2024-09-12T02:59:20.221549+0000","last_peered":"2024-09-12T02:59:20.221549+0000","last_clean":"2024-09-12T02:59:20.221549+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:20.221549+0000","last_undegraded":"2024-09-12T02:59:20.221549+0000","last_fullsized":"2024-09-12T02:59:20.221549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.274480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652330+0000","last_change":"2024-09-12T02:59:06.057027+0000","last_active":"2024-09-12T02:59:20.652330+0000","last_peered":"2024-09-12T02:59:20.652330+0000","last_clean":"2024-09-12T02:59:20.652330+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:20.652330+0000","last_undegraded":"2024-09-12T02:59:20.652330+0000","last_fullsized":"2024-09-12T02:59:20.652330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:00.045309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555400+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:59:20.555400+0000","last_peered":"2024-09-12T02:59:20.555400+0000","last_clean":"2024-09-12T02:59:20.555400+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:20.555400+0000","last_undegraded":"2024-09-12T02:59:20.555400+0000","last_fullsized":"2024-09-12T02:59:20.555400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554671+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:59:20.554671+0000","last_peered":"2024-09-12T02:59:20.554671+0000","last_clean":"2024-09-12T02:59:20.554671+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:20.554671+0000","last_undegraded":"2024-09-12T02:59:20.554671+0000","last_fullsized":"2024-09-12T02:59:20.554671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651664+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:59:20.651664+0000","last_peered":"2024-09-12T02:59:20.651664+0000","last_clean":"2024-09-12T02:59:20.651664+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:20.651664+0000","last_undegraded":"2024-09-12T02:59:20.651664+0000","last_fullsized":"2024-09-12T02:59:20.651664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094328+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:59:21.094328+0000","last_peered":"2024-09-12T02:59:21.094328+0000","last_clean":"2024-09-12T02:59:21.094328+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:21.094328+0000","last_undegraded":"2024-09-12T02:59:21.094328+0000","last_fullsized":"2024-09-12T02:59:21.094328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893710+0000","last_change":"2024-09-12T02:59:06.049017+0000","last_active":"2024-09-12T02:59:20.893710+0000","last_peered":"2024-09-12T02:59:20.893710+0000","last_clean":"2024-09-12T02:59:20.893710+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:20.893710+0000","last_undegraded":"2024-09-12T02:59:20.893710+0000","last_fullsized":"2024-09-12T02:59:20.893710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.513391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554672+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:59:20.554672+0000","last_peered":"2024-09-12T02:59:20.554672+0000","last_clean":"2024-09-12T02:59:20.554672+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:20.554672+0000","last_undegraded":"2024-09-12T02:59:20.554672+0000","last_fullsized":"2024-09-12T02:59:20.554672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223808+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:59:20.223808+0000","last_peered":"2024-09-12T02:59:20.223808+0000","last_clean":"2024-09-12T02:59:20.223808+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:20.223808+0000","last_undegraded":"2024-09-12T02:59:20.223808+0000","last_fullsized":"2024-09-12T02:59:20.223808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555699+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:59:20.555699+0000","last_peered":"2024-09-12T02:59:20.555699+0000","last_clean":"2024-09-12T02:59:20.555699+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:20.555699+0000","last_undegraded":"2024-09-12T02:59:20.555699+0000","last_fullsized":"2024-09-12T02:59:20.555699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651209+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:59:20.651209+0000","last_peered":"2024-09-12T02:59:20.651209+0000","last_clean":"2024-09-12T02:59:20.651209+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:20.651209+0000","last_undegraded":"2024-09-12T02:59:20.651209+0000","last_fullsized":"2024-09-12T02:59:20.651209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893469+0000","last_change":"2024-09-12T02:59:06.035202+0000","last_active":"2024-09-12T02:59:20.893469+0000","last_peered":"2024-09-12T02:59:20.893469+0000","last_clean":"2024-09-12T02:59:20.893469+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:20.893469+0000","last_undegraded":"2024-09-12T02:59:20.893469+0000","last_fullsized":"2024-09-12T02:59:20.893469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:38.826721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224631+0000","last_change":"2024-09-12T02:59:06.039795+0000","last_active":"2024-09-12T02:59:20.224631+0000","last_peered":"2024-09-12T02:59:20.224631+0000","last_clean":"2024-09-12T02:59:20.224631+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:20.224631+0000","last_undegraded":"2024-09-12T02:59:20.224631+0000","last_fullsized":"2024-09-12T02:59:20.224631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094428+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:59:21.094428+0000","last_peered":"2024-09-12T02:59:21.094428+0000","last_clean":"2024-09-12T02:59:21.094428+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:21.094428+0000","last_undegraded":"2024-09-12T02:59:21.094428+0000","last_fullsized":"2024-09-12T02:59:21.094428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555831+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:59:20.555831+0000","last_peered":"2024-09-12T02:59:20.555831+0000","last_clean":"2024-09-12T02:59:20.555831+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:20.555831+0000","last_undegraded":"2024-09-12T02:59:20.555831+0000","last_fullsized":"2024-09-12T02:59:20.555831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220580+0000","last_change":"2024-09-12T02:59:08.055950+0000","last_active":"2024-09-12T02:59:20.220580+0000","last_peered":"2024-09-12T02:59:20.220580+0000","last_clean":"2024-09-12T02:59:20.220580+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:20.220580+0000","last_undegraded":"2024-09-12T02:59:20.220580+0000","last_fullsized":"2024-09-12T02:59:20.220580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.808972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652436+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:59:20.652436+0000","last_peered":"2024-09-12T02:59:20.652436+0000","last_clean":"2024-09-12T02:59:20.652436+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:20.652436+0000","last_undegraded":"2024-09-12T02:59:20.652436+0000","last_fullsized":"2024-09-12T02:59:20.652436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555996+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:59:20.555996+0000","last_peered":"2024-09-12T02:59:20.555996+0000","last_clean":"2024-09-12T02:59:20.555996+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:20.555996+0000","last_undegraded":"2024-09-12T02:59:20.555996+0000","last_fullsized":"2024-09-12T02:59:20.555996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221900+0000","last_change":"2024-09-12T02:59:06.064508+0000","last_active":"2024-09-12T02:59:20.221900+0000","last_peered":"2024-09-12T02:59:20.221900+0000","last_clean":"2024-09-12T02:59:20.221900+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:20.221900+0000","last_undegraded":"2024-09-12T02:59:20.221900+0000","last_fullsized":"2024-09-12T02:59:20.221900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:09.089943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554994+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:59:20.554994+0000","last_peered":"2024-09-12T02:59:20.554994+0000","last_clean":"2024-09-12T02:59:20.554994+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:20.554994+0000","last_undegraded":"2024-09-12T02:59:20.554994+0000","last_fullsized":"2024-09-12T02:59:20.554994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224351+0000","last_change":"2024-09-12T02:59:06.039130+0000","last_active":"2024-09-12T02:59:20.224351+0000","last_peered":"2024-09-12T02:59:20.224351+0000","last_clean":"2024-09-12T02:59:20.224351+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:20.224351+0000","last_undegraded":"2024-09-12T02:59:20.224351+0000","last_fullsized":"2024-09-12T02:59:20.224351+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:47.700652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094518+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:59:21.094518+0000","last_peered":"2024-09-12T02:59:21.094518+0000","last_clean":"2024-09-12T02:59:21.094518+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:21.094518+0000","last_undegraded":"2024-09-12T02:59:21.094518+0000","last_fullsized":"2024-09-12T02:59:21.094518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652175+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:59:20.652175+0000","last_peered":"2024-09-12T02:59:20.652175+0000","last_clean":"2024-09-12T02:59:20.652175+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:20.652175+0000","last_undegraded":"2024-09-12T02:59:20.652175+0000","last_fullsized":"2024-09-12T02:59:20.652175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572669+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:59:20.572669+0000","last_peered":"2024-09-12T02:59:20.572669+0000","last_clean":"2024-09-12T02:59:20.572669+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:20.572669+0000","last_undegraded":"2024-09-12T02:59:20.572669+0000","last_fullsized":"2024-09-12T02:59:20.572669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893383+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:59:20.893383+0000","last_peered":"2024-09-12T02:59:20.893383+0000","last_clean":"2024-09-12T02:59:20.893383+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:20.893383+0000","last_undegraded":"2024-09-12T02:59:20.893383+0000","last_fullsized":"2024-09-12T02:59:20.893383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226422+0000","last_change":"2024-09-12T02:59:06.052737+0000","last_active":"2024-09-12T02:59:20.226422+0000","last_peered":"2024-09-12T02:59:20.226422+0000","last_clean":"2024-09-12T02:59:20.226422+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:20.226422+0000","last_undegraded":"2024-09-12T02:59:20.226422+0000","last_fullsized":"2024-09-12T02:59:20.226422+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:35.122045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222235+0000","last_change":"2024-09-12T02:59:06.033376+0000","last_active":"2024-09-12T02:59:20.222235+0000","last_peered":"2024-09-12T02:59:20.222235+0000","last_clean":"2024-09-12T02:59:20.222235+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:20.222235+0000","last_undegraded":"2024-09-12T02:59:20.222235+0000","last_fullsized":"2024-09-12T02:59:20.222235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:58.904459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220371+0000","last_change":"2024-09-12T02:59:08.058142+0000","last_active":"2024-09-12T02:59:20.220371+0000","last_peered":"2024-09-12T02:59:20.220371+0000","last_clean":"2024-09-12T02:59:20.220371+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:20.220371+0000","last_undegraded":"2024-09-12T02:59:20.220371+0000","last_fullsized":"2024-09-12T02:59:20.220371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:34.922114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"60'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093613+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:59:21.093613+0000","last_peered":"2024-09-12T02:59:21.093613+0000","last_clean":"2024-09-12T02:59:21.093613+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:21.093613+0000","last_undegraded":"2024-09-12T02:59:21.093613+0000","last_fullsized":"2024-09-12T02:59:21.093613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555233+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:59:20.555233+0000","last_peered":"2024-09-12T02:59:20.555233+0000","last_clean":"2024-09-12T02:59:20.555233+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:20.555233+0000","last_undegraded":"2024-09-12T02:59:20.555233+0000","last_fullsized":"2024-09-12T02:59:20.555233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222303+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:59:20.222303+0000","last_peered":"2024-09-12T02:59:20.222303+0000","last_clean":"2024-09-12T02:59:20.222303+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:20.222303+0000","last_undegraded":"2024-09-12T02:59:20.222303+0000","last_fullsized":"2024-09-12T02:59:20.222303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652209+0000","last_change":"2024-09-12T02:59:06.053463+0000","last_active":"2024-09-12T02:59:20.652209+0000","last_peered":"2024-09-12T02:59:20.652209+0000","last_clean":"2024-09-12T02:59:20.652209+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:20.652209+0000","last_undegraded":"2024-09-12T02:59:20.652209+0000","last_fullsized":"2024-09-12T02:59:20.652209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:12.272345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652306+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:59:20.652306+0000","last_peered":"2024-09-12T02:59:20.652306+0000","last_clean":"2024-09-12T02:59:20.652306+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:20.652306+0000","last_undegraded":"2024-09-12T02:59:20.652306+0000","last_fullsized":"2024-09-12T02:59:20.652306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572981+0000","last_change":"2024-09-12T02:59:06.058593+0000","last_active":"2024-09-12T02:59:20.572981+0000","last_peered":"2024-09-12T02:59:20.572981+0000","last_clean":"2024-09-12T02:59:20.572981+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:20.572981+0000","last_undegraded":"2024-09-12T02:59:20.572981+0000","last_fullsized":"2024-09-12T02:59:20.572981+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.306038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555202+0000","last_change":"2024-09-12T02:59:06.066878+0000","last_active":"2024-09-12T02:59:20.555202+0000","last_peered":"2024-09-12T02:59:20.555202+0000","last_clean":"2024-09-12T02:59:20.555202+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:20.555202+0000","last_undegraded":"2024-09-12T02:59:20.555202+0000","last_fullsized":"2024-09-12T02:59:20.555202+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.621838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571689+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:59:20.571689+0000","last_peered":"2024-09-12T02:59:20.571689+0000","last_clean":"2024-09-12T02:59:20.571689+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:20.571689+0000","last_undegraded":"2024-09-12T02:59:20.571689+0000","last_fullsized":"2024-09-12T02:59:20.571689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225014+0000","last_change":"2024-09-12T02:59:06.052855+0000","last_active":"2024-09-12T02:59:20.225014+0000","last_peered":"2024-09-12T02:59:20.225014+0000","last_clean":"2024-09-12T02:59:20.225014+0000","last_became_active":"2024-09-12T02:59:06.051893+0000","last_became_peered":"2024-09-12T02:59:06.051893+0000","last_unstale":"2024-09-12T02:59:20.225014+0000","last_undegraded":"2024-09-12T02:59:20.225014+0000","last_fullsized":"2024-09-12T02:59:20.225014+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:59.682086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571964+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:59:20.571964+0000","last_peered":"2024-09-12T02:59:20.571964+0000","last_clean":"2024-09-12T02:59:20.571964+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:20.571964+0000","last_undegraded":"2024-09-12T02:59:20.571964+0000","last_fullsized":"2024-09-12T02:59:20.571964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226513+0000","last_change":"2024-09-12T02:59:06.050998+0000","last_active":"2024-09-12T02:59:20.226513+0000","last_peered":"2024-09-12T02:59:20.226513+0000","last_clean":"2024-09-12T02:59:20.226513+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:20.226513+0000","last_undegraded":"2024-09-12T02:59:20.226513+0000","last_fullsized":"2024-09-12T02:59:20.226513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:41.882534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094247+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:59:21.094247+0000","last_peered":"2024-09-12T02:59:21.094247+0000","last_clean":"2024-09-12T02:59:21.094247+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:21.094247+0000","last_undegraded":"2024-09-12T02:59:21.094247+0000","last_fullsized":"2024-09-12T02:59:21.094247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221167+0000","last_change":"2024-09-12T02:59:08.055576+0000","last_active":"2024-09-12T02:59:20.221167+0000","last_peered":"2024-09-12T02:59:20.221167+0000","last_clean":"2024-09-12T02:59:20.221167+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:20.221167+0000","last_undegraded":"2024-09-12T02:59:20.221167+0000","last_fullsized":"2024-09-12T02:59:20.221167+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:55.285218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572731+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:59:20.572731+0000","last_peered":"2024-09-12T02:59:20.572731+0000","last_clean":"2024-09-12T02:59:20.572731+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:20.572731+0000","last_undegraded":"2024-09-12T02:59:20.572731+0000","last_fullsized":"2024-09-12T02:59:20.572731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38710,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":516025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":925696,"data_stored":478424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1527808,"data_stored":1069119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28512,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343328,"statfs":{"total":96636764160,"available":96607567872,"internally_reserved":0,"allocated":1519616,"data_stored":1069063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":515714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906950,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29020,"kb_used_data":904,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342820,"statfs":{"total":96636764160,"available":96607047680,"internally_reserved":0,"allocated":925696,"data_stored":478203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":933888,"data_stored":478239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":478273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:59:27.020 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T02:59:27.021 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:59:27.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7ff4a00640 1 Processor -- start 2024-09-12T02:59:27.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7ff4a00640 1 -- start start 2024-09-12T02:59:27.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7ff4a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff01527e0 0x7f7ff00c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7ff4a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ff00c61e0 0x7f7ff00c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7ff4a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff0159520 con 0x7f7ff00c7a00 2024-09-12T02:59:27.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7ff4a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7ff01589a0 con 0x7f7ff00c61e0 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7ff4a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff0158c80 con 0x7f7ff01527e0 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7fee800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ff00c61e0 0x7f7ff00c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7fede00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff01527e0 0x7f7ff00c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7fee800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ff00c61e0 0x7f7ff00c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:34866/0 (socket says 172.21.15.63:34866) 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7fede00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff01527e0 0x7f7ff00c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:51978/0 (socket says 172.21.15.63:51978) 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7fee800640 1 -- 172.21.15.63:0/2424469264 learned_addr learned my addr 172.21.15.63:0/2424469264 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.208+0000 7f7fe5400640 1 --1- 172.21.15.63:0/2424469264 >> v1:172.21.15.119:6789/0 conn(0x7f7ff00c7a00 0x7f7ff00cc550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:60796/0 (socket says 172.21.15.63:60796) 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7fee800640 1 -- 172.21.15.63:0/2424469264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff01527e0 msgr2=0x7f7ff00c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7fee800640 1 --2- 172.21.15.63:0/2424469264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff01527e0 0x7f7ff00c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7fee800640 1 -- 172.21.15.63:0/2424469264 >> v1:172.21.15.119:6789/0 conn(0x7f7ff00c7a00 legacy=0x7f7ff00cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7fee800640 1 -- 172.21.15.63:0/2424469264 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff0158f60 con 0x7f7ff00c61e0 2024-09-12T02:59:27.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7fee800640 1 --2- 172.21.15.63:0/2424469264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff00c61e0 0x7f7ff00c6eb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009e50 tx=0x7f7fe801ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ff25d2521ba344c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:27.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7fed400640 1 -- 172.21.15.63:0/2424469264 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80a58d0 con 0x7f7ff00c61e0 2024-09-12T02:59:27.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7fed400640 1 -- 172.21.15.63:0/2424469264 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe80a5a70 con 0x7f7ff00c61e0 2024-09-12T02:59:27.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7fed400640 1 -- 172.21.15.63:0/2424469264 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80a5e40 con 0x7f7ff00c61e0 2024-09-12T02:59:27.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7ff4a00640 1 -- 172.21.15.63:0/2424469264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff00c61e0 msgr2=0x7f7ff00c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7ff4a00640 1 --2- 172.21.15.63:0/2424469264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff00c61e0 0x7f7ff00c6eb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009e50 tx=0x7f7fe801ca00 comp rx=0 tx=0).stop 2024-09-12T02:59:27.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7ff4a00640 1 -- 172.21.15.63:0/2424469264 shutdown_connections 2024-09-12T02:59:27.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7ff4a00640 1 --2- 172.21.15.63:0/2424469264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff00c61e0 0x7f7ff00c6eb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7ff4a00640 1 --2- 172.21.15.63:0/2424469264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff01527e0 0x7f7ff00c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.212+0000 7f7ff4a00640 1 -- 172.21.15.63:0/2424469264 >> 172.21.15.63:0/2424469264 conn(0x7f7ff006f3d0 msgr2=0x7f7ff006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:27.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 -- 172.21.15.63:0/2424469264 shutdown_connections 2024-09-12T02:59:27.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 -- 172.21.15.63:0/2424469264 wait complete. 2024-09-12T02:59:27.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 Processor -- start 2024-09-12T02:59:27.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 -- start start 2024-09-12T02:59:27.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ff00c61e0 0x7f7ff00c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff00c7a00 0x7f7ff01f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff01527e0 0x7f7ff00c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff01586e0 con 0x7f7ff00c61e0 2024-09-12T02:59:27.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff0158560 con 0x7f7ff01527e0 2024-09-12T02:59:27.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7ff4a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7ff0165700 con 0x7f7ff00c7a00 2024-09-12T02:59:27.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fede00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ff00c61e0 0x7f7ff00c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fede00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ff00c61e0 0x7f7ff00c51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42454/0 (socket says 172.21.15.63:42454) 2024-09-12T02:59:27.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fede00640 1 -- 172.21.15.63:0/1946609544 learned_addr learned my addr 172.21.15.63:0/1946609544 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:27.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fe5400640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff00c7a00 0x7f7ff01f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fee800640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff01527e0 0x7f7ff00c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fede00640 1 -- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff00c7a00 msgr2=0x7f7ff01f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fede00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff00c7a00 0x7f7ff01f77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fede00640 1 -- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff01527e0 msgr2=0x7f7ff00c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fede00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff01527e0 0x7f7ff00c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fede00640 1 -- 172.21.15.63:0/1946609544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff00c3980 con 0x7f7ff00c61e0 2024-09-12T02:59:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fee800640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff01527e0 0x7f7ff00c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fede00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ff00c61e0 0x7f7ff00c51c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e870 tx=0x7f7fe000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fe6a00640 1 -- 172.21.15.63:0/1946609544 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0017070 con 0x7f7ff00c61e0 2024-09-12T02:59:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fe6a00640 1 -- 172.21.15.63:0/1946609544 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe000c940 con 0x7f7ff00c61e0 2024-09-12T02:59:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.216+0000 7f7fe6a00640 1 -- 172.21.15.63:0/1946609544 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000ccf0 con 0x7f7ff00c61e0 2024-09-12T02:59:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.220+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff00c3c60 con 0x7f7ff00c61e0 2024-09-12T02:59:27.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.220+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff00c4220 con 0x7f7ff00c61e0 2024-09-12T02:59:27.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.220+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff00cc550 con 0x7f7ff00c61e0 2024-09-12T02:59:27.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.220+0000 7f7fe6a00640 1 -- 172.21.15.63:0/1946609544 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7fe001a070 con 0x7f7ff00c61e0 2024-09-12T02:59:27.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.220+0000 7f7fe6a00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7fcc0678c0 0x7f7fcc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.220+0000 7f7fe6a00640 1 -- 172.21.15.63:0/1946609544 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f7fe00862f0 con 0x7f7ff00c61e0 2024-09-12T02:59:27.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.220+0000 7f7fe5400640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7fcc0678c0 0x7f7fcc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.224+0000 7f7fe5400640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7fcc0678c0 0x7f7fcc069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ff014ec80 tx=0x7f7fd8007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:27.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.224+0000 7f7fe6a00640 1 -- 172.21.15.63:0/1946609544 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7fe0056350 con 0x7f7ff00c61e0 2024-09-12T02:59:27.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.388+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ff0161db0 con 0x7f7fcc0678c0 2024-09-12T02:59:27.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7fe6a00640 1 -- 172.21.15.63:0/1946609544 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332672 (secure 0 0 0) 0x7f7ff0161db0 con 0x7f7fcc0678c0 2024-09-12T02:59:27.420 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:27.422 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:59:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7fcc0678c0 msgr2=0x7f7fcc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7fcc0678c0 0x7f7fcc069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ff014ec80 tx=0x7f7fd8007e90 comp rx=0 tx=0).stop 2024-09-12T02:59:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ff00c61e0 msgr2=0x7f7ff00c51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ff00c61e0 0x7f7ff00c51c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e870 tx=0x7f7fe000ec70 comp rx=0 tx=0).stop 2024-09-12T02:59:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 shutdown_connections 2024-09-12T02:59:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ff01527e0 0x7f7ff00c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7fcc0678c0 0x7f7fcc069d80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ff00c7a00 0x7f7ff01f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 --2- 172.21.15.63:0/1946609544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ff00c61e0 0x7f7ff00c51c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 >> 172.21.15.63:0/1946609544 conn(0x7f7ff006f3d0 msgr2=0x7f7ff006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 shutdown_connections 2024-09-12T02:59:27.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.416+0000 7f7ff4a00640 1 -- 172.21.15.63:0/1946609544 wait complete. 2024-09-12T02:59:27.440 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-12T02:59:25.798754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629078,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":244,"num_write_kb":2486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234152,"kb_used_data":8504,"kb_used_omap":15,"kb_used_meta":225456,"kb_avail":754740568,"statfs":{"total":773094113280,"available":772854341632,"internally_reserved":0,"allocated":8708096,"data_stored":5083060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":230867630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.608140"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093498+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:59:21.093498+0000","last_peered":"2024-09-12T02:59:21.093498+0000","last_clean":"2024-09-12T02:59:21.093498+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:21.093498+0000","last_undegraded":"2024-09-12T02:59:21.093498+0000","last_fullsized":"2024-09-12T02:59:21.093498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555874+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:59:20.555874+0000","last_peered":"2024-09-12T02:59:20.555874+0000","last_clean":"2024-09-12T02:59:20.555874+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:20.555874+0000","last_undegraded":"2024-09-12T02:59:20.555874+0000","last_fullsized":"2024-09-12T02:59:20.555874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554951+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:59:20.554951+0000","last_peered":"2024-09-12T02:59:20.554951+0000","last_clean":"2024-09-12T02:59:20.554951+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:20.554951+0000","last_undegraded":"2024-09-12T02:59:20.554951+0000","last_fullsized":"2024-09-12T02:59:20.554951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555984+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:59:20.555984+0000","last_peered":"2024-09-12T02:59:20.555984+0000","last_clean":"2024-09-12T02:59:20.555984+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:20.555984+0000","last_undegraded":"2024-09-12T02:59:20.555984+0000","last_fullsized":"2024-09-12T02:59:20.555984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093267+0000","last_change":"2024-09-12T02:59:06.040714+0000","last_active":"2024-09-12T02:59:21.093267+0000","last_peered":"2024-09-12T02:59:21.093267+0000","last_clean":"2024-09-12T02:59:21.093267+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:21.093267+0000","last_undegraded":"2024-09-12T02:59:21.093267+0000","last_fullsized":"2024-09-12T02:59:21.093267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:54.289352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":141,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221118+0000","last_change":"2024-09-12T02:59:08.071320+0000","last_active":"2024-09-12T02:59:20.221118+0000","last_peered":"2024-09-12T02:59:20.221118+0000","last_clean":"2024-09-12T02:59:20.221118+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:20.221118+0000","last_undegraded":"2024-09-12T02:59:20.221118+0000","last_fullsized":"2024-09-12T02:59:20.221118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:38.378285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572534+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:59:20.572534+0000","last_peered":"2024-09-12T02:59:20.572534+0000","last_clean":"2024-09-12T02:59:20.572534+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:20.572534+0000","last_undegraded":"2024-09-12T02:59:20.572534+0000","last_fullsized":"2024-09-12T02:59:20.572534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226154+0000","last_change":"2024-09-12T02:59:06.046085+0000","last_active":"2024-09-12T02:59:20.226154+0000","last_peered":"2024-09-12T02:59:20.226154+0000","last_clean":"2024-09-12T02:59:20.226154+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:20.226154+0000","last_undegraded":"2024-09-12T02:59:20.226154+0000","last_fullsized":"2024-09-12T02:59:20.226154+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:35.684141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223813+0000","last_change":"2024-09-12T02:59:08.073058+0000","last_active":"2024-09-12T02:59:20.223813+0000","last_peered":"2024-09-12T02:59:20.223813+0000","last_clean":"2024-09-12T02:59:20.223813+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:20.223813+0000","last_undegraded":"2024-09-12T02:59:20.223813+0000","last_fullsized":"2024-09-12T02:59:20.223813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.609541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572259+0000","last_change":"2024-09-12T02:59:06.053365+0000","last_active":"2024-09-12T02:59:20.572259+0000","last_peered":"2024-09-12T02:59:20.572259+0000","last_clean":"2024-09-12T02:59:20.572259+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:20.572259+0000","last_undegraded":"2024-09-12T02:59:20.572259+0000","last_fullsized":"2024-09-12T02:59:20.572259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227143+0000","last_change":"2024-09-12T02:59:06.040820+0000","last_active":"2024-09-12T02:59:20.227143+0000","last_peered":"2024-09-12T02:59:20.227143+0000","last_clean":"2024-09-12T02:59:20.227143+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:20.227143+0000","last_undegraded":"2024-09-12T02:59:20.227143+0000","last_fullsized":"2024-09-12T02:59:20.227143+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:41.411962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223290+0000","last_change":"2024-09-12T02:59:06.058963+0000","last_active":"2024-09-12T02:59:20.223290+0000","last_peered":"2024-09-12T02:59:20.223290+0000","last_clean":"2024-09-12T02:59:20.223290+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:20.223290+0000","last_undegraded":"2024-09-12T02:59:20.223290+0000","last_fullsized":"2024-09-12T02:59:20.223290+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651357+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:59:20.651357+0000","last_peered":"2024-09-12T02:59:20.651357+0000","last_clean":"2024-09-12T02:59:20.651357+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:20.651357+0000","last_undegraded":"2024-09-12T02:59:20.651357+0000","last_fullsized":"2024-09-12T02:59:20.651357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572449+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:59:20.572449+0000","last_peered":"2024-09-12T02:59:20.572449+0000","last_clean":"2024-09-12T02:59:20.572449+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:20.572449+0000","last_undegraded":"2024-09-12T02:59:20.572449+0000","last_fullsized":"2024-09-12T02:59:20.572449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223073+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:59:20.223073+0000","last_peered":"2024-09-12T02:59:20.223073+0000","last_clean":"2024-09-12T02:59:20.223073+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:20.223073+0000","last_undegraded":"2024-09-12T02:59:20.223073+0000","last_fullsized":"2024-09-12T02:59:20.223073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555282+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:59:20.555282+0000","last_peered":"2024-09-12T02:59:20.555282+0000","last_clean":"2024-09-12T02:59:20.555282+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:20.555282+0000","last_undegraded":"2024-09-12T02:59:20.555282+0000","last_fullsized":"2024-09-12T02:59:20.555282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220179+0000","last_change":"2024-09-12T02:59:08.061938+0000","last_active":"2024-09-12T02:59:20.220179+0000","last_peered":"2024-09-12T02:59:20.220179+0000","last_clean":"2024-09-12T02:59:20.220179+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:20.220179+0000","last_undegraded":"2024-09-12T02:59:20.220179+0000","last_fullsized":"2024-09-12T02:59:20.220179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.137585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221866+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:59:20.221866+0000","last_peered":"2024-09-12T02:59:20.221866+0000","last_clean":"2024-09-12T02:59:20.221866+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:20.221866+0000","last_undegraded":"2024-09-12T02:59:20.221866+0000","last_fullsized":"2024-09-12T02:59:20.221866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555522+0000","last_change":"2024-09-12T02:59:08.063392+0000","last_active":"2024-09-12T02:59:20.555522+0000","last_peered":"2024-09-12T02:59:20.555522+0000","last_clean":"2024-09-12T02:59:20.555522+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:20.555522+0000","last_undegraded":"2024-09-12T02:59:20.555522+0000","last_fullsized":"2024-09-12T02:59:20.555522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:39.814573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219716+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:59:20.219716+0000","last_peered":"2024-09-12T02:59:20.219716+0000","last_clean":"2024-09-12T02:59:20.219716+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:20.219716+0000","last_undegraded":"2024-09-12T02:59:20.219716+0000","last_fullsized":"2024-09-12T02:59:20.219716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221264+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:59:20.221264+0000","last_peered":"2024-09-12T02:59:20.221264+0000","last_clean":"2024-09-12T02:59:20.221264+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:20.221264+0000","last_undegraded":"2024-09-12T02:59:20.221264+0000","last_fullsized":"2024-09-12T02:59:20.221264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222869+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:59:20.222869+0000","last_peered":"2024-09-12T02:59:20.222869+0000","last_clean":"2024-09-12T02:59:20.222869+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:20.222869+0000","last_undegraded":"2024-09-12T02:59:20.222869+0000","last_fullsized":"2024-09-12T02:59:20.222869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571430+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:59:20.571430+0000","last_peered":"2024-09-12T02:59:20.571430+0000","last_clean":"2024-09-12T02:59:20.571430+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:20.571430+0000","last_undegraded":"2024-09-12T02:59:20.571430+0000","last_fullsized":"2024-09-12T02:59:20.571430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224226+0000","last_change":"2024-09-12T02:59:08.080501+0000","last_active":"2024-09-12T02:59:20.224226+0000","last_peered":"2024-09-12T02:59:20.224226+0000","last_clean":"2024-09-12T02:59:20.224226+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:20.224226+0000","last_undegraded":"2024-09-12T02:59:20.224226+0000","last_fullsized":"2024-09-12T02:59:20.224226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:19.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094222+0000","last_change":"2024-09-12T02:59:08.061926+0000","last_active":"2024-09-12T02:59:21.094222+0000","last_peered":"2024-09-12T02:59:21.094222+0000","last_clean":"2024-09-12T02:59:21.094222+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:21.094222+0000","last_undegraded":"2024-09-12T02:59:21.094222+0000","last_fullsized":"2024-09-12T02:59:21.094222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652743+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:59:20.652743+0000","last_peered":"2024-09-12T02:59:20.652743+0000","last_clean":"2024-09-12T02:59:20.652743+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:20.652743+0000","last_undegraded":"2024-09-12T02:59:20.652743+0000","last_fullsized":"2024-09-12T02:59:20.652743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222216+0000","last_change":"2024-09-12T02:59:06.042311+0000","last_active":"2024-09-12T02:59:20.222216+0000","last_peered":"2024-09-12T02:59:20.222216+0000","last_clean":"2024-09-12T02:59:20.222216+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:20.222216+0000","last_undegraded":"2024-09-12T02:59:20.222216+0000","last_fullsized":"2024-09-12T02:59:20.222216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.556036+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:59:20.556036+0000","last_peered":"2024-09-12T02:59:20.556036+0000","last_clean":"2024-09-12T02:59:20.556036+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:20.556036+0000","last_undegraded":"2024-09-12T02:59:20.556036+0000","last_fullsized":"2024-09-12T02:59:20.556036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"62'10","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220976+0000","last_change":"2024-09-12T02:59:08.080132+0000","last_active":"2024-09-12T02:59:20.220976+0000","last_peered":"2024-09-12T02:59:20.220976+0000","last_clean":"2024-09-12T02:59:20.220976+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:20.220976+0000","last_undegraded":"2024-09-12T02:59:20.220976+0000","last_fullsized":"2024-09-12T02:59:20.220976+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:33.297534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554880+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:59:20.554880+0000","last_peered":"2024-09-12T02:59:20.554880+0000","last_clean":"2024-09-12T02:59:20.554880+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:59:20.554880+0000","last_undegraded":"2024-09-12T02:59:20.554880+0000","last_fullsized":"2024-09-12T02:59:20.554880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220394+0000","last_change":"2024-09-12T02:59:08.052379+0000","last_active":"2024-09-12T02:59:20.220394+0000","last_peered":"2024-09-12T02:59:20.220394+0000","last_clean":"2024-09-12T02:59:20.220394+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:20.220394+0000","last_undegraded":"2024-09-12T02:59:20.220394+0000","last_fullsized":"2024-09-12T02:59:20.220394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.582966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572839+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:59:20.572839+0000","last_peered":"2024-09-12T02:59:20.572839+0000","last_clean":"2024-09-12T02:59:20.572839+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:20.572839+0000","last_undegraded":"2024-09-12T02:59:20.572839+0000","last_fullsized":"2024-09-12T02:59:20.572839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094850+0000","last_change":"2024-09-12T02:59:06.034354+0000","last_active":"2024-09-12T02:59:21.094850+0000","last_peered":"2024-09-12T02:59:21.094850+0000","last_clean":"2024-09-12T02:59:21.094850+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:21.094850+0000","last_undegraded":"2024-09-12T02:59:21.094850+0000","last_fullsized":"2024-09-12T02:59:21.094850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:05.155351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226589+0000","last_change":"2024-09-12T02:59:06.034822+0000","last_active":"2024-09-12T02:59:20.226589+0000","last_peered":"2024-09-12T02:59:20.226589+0000","last_clean":"2024-09-12T02:59:20.226589+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:20.226589+0000","last_undegraded":"2024-09-12T02:59:20.226589+0000","last_fullsized":"2024-09-12T02:59:20.226589+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:00.839140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220548+0000","last_change":"2024-09-12T02:59:08.054413+0000","last_active":"2024-09-12T02:59:20.220548+0000","last_peered":"2024-09-12T02:59:20.220548+0000","last_clean":"2024-09-12T02:59:20.220548+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:20.220548+0000","last_undegraded":"2024-09-12T02:59:20.220548+0000","last_fullsized":"2024-09-12T02:59:20.220548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:21.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220362+0000","last_change":"2024-09-12T02:59:08.063077+0000","last_active":"2024-09-12T02:59:20.220362+0000","last_peered":"2024-09-12T02:59:20.220362+0000","last_clean":"2024-09-12T02:59:20.220362+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:20.220362+0000","last_undegraded":"2024-09-12T02:59:20.220362+0000","last_fullsized":"2024-09-12T02:59:20.220362+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224154+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:59:20.224154+0000","last_peered":"2024-09-12T02:59:20.224154+0000","last_clean":"2024-09-12T02:59:20.224154+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:20.224154+0000","last_undegraded":"2024-09-12T02:59:20.224154+0000","last_fullsized":"2024-09-12T02:59:20.224154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224740+0000","last_change":"2024-09-12T02:59:06.046884+0000","last_active":"2024-09-12T02:59:20.224740+0000","last_peered":"2024-09-12T02:59:20.224740+0000","last_clean":"2024-09-12T02:59:20.224740+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:20.224740+0000","last_undegraded":"2024-09-12T02:59:20.224740+0000","last_fullsized":"2024-09-12T02:59:20.224740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:52.145202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227571+0000","last_change":"2024-09-12T02:59:06.062554+0000","last_active":"2024-09-12T02:59:20.227571+0000","last_peered":"2024-09-12T02:59:20.227571+0000","last_clean":"2024-09-12T02:59:20.227571+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:20.227571+0000","last_undegraded":"2024-09-12T02:59:20.227571+0000","last_fullsized":"2024-09-12T02:59:20.227571+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:27.156770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220124+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:59:20.220124+0000","last_peered":"2024-09-12T02:59:20.220124+0000","last_clean":"2024-09-12T02:59:20.220124+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:20.220124+0000","last_undegraded":"2024-09-12T02:59:20.220124+0000","last_fullsized":"2024-09-12T02:59:20.220124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"60'2","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893199+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:59:20.893199+0000","last_peered":"2024-09-12T02:59:20.893199+0000","last_clean":"2024-09-12T02:59:20.893199+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:20.893199+0000","last_undegraded":"2024-09-12T02:59:20.893199+0000","last_fullsized":"2024-09-12T02:59:20.893199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220885+0000","last_change":"2024-09-12T02:59:08.057364+0000","last_active":"2024-09-12T02:59:20.220885+0000","last_peered":"2024-09-12T02:59:20.220885+0000","last_clean":"2024-09-12T02:59:20.220885+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:20.220885+0000","last_undegraded":"2024-09-12T02:59:20.220885+0000","last_fullsized":"2024-09-12T02:59:20.220885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.092701+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:59:21.092701+0000","last_peered":"2024-09-12T02:59:21.092701+0000","last_clean":"2024-09-12T02:59:21.092701+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:21.092701+0000","last_undegraded":"2024-09-12T02:59:21.092701+0000","last_fullsized":"2024-09-12T02:59:21.092701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571447+0000","last_change":"2024-09-12T02:59:08.070124+0000","last_active":"2024-09-12T02:59:20.571447+0000","last_peered":"2024-09-12T02:59:20.571447+0000","last_clean":"2024-09-12T02:59:20.571447+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:20.571447+0000","last_undegraded":"2024-09-12T02:59:20.571447+0000","last_fullsized":"2024-09-12T02:59:20.571447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:14.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093938+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:59:21.093938+0000","last_peered":"2024-09-12T02:59:21.093938+0000","last_clean":"2024-09-12T02:59:21.093938+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:21.093938+0000","last_undegraded":"2024-09-12T02:59:21.093938+0000","last_fullsized":"2024-09-12T02:59:21.093938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555055+0000","last_change":"2024-09-12T02:59:06.063289+0000","last_active":"2024-09-12T02:59:20.555055+0000","last_peered":"2024-09-12T02:59:20.555055+0000","last_clean":"2024-09-12T02:59:20.555055+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:20.555055+0000","last_undegraded":"2024-09-12T02:59:20.555055+0000","last_fullsized":"2024-09-12T02:59:20.555055+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225192+0000","last_change":"2024-09-12T02:59:06.038764+0000","last_active":"2024-09-12T02:59:20.225192+0000","last_peered":"2024-09-12T02:59:20.225192+0000","last_clean":"2024-09-12T02:59:20.225192+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:20.225192+0000","last_undegraded":"2024-09-12T02:59:20.225192+0000","last_fullsized":"2024-09-12T02:59:20.225192+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.748521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":283,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571685+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:59:20.571685+0000","last_peered":"2024-09-12T02:59:20.571685+0000","last_clean":"2024-09-12T02:59:20.571685+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:20.571685+0000","last_undegraded":"2024-09-12T02:59:20.571685+0000","last_fullsized":"2024-09-12T02:59:20.571685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651983+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:59:20.651983+0000","last_peered":"2024-09-12T02:59:20.651983+0000","last_clean":"2024-09-12T02:59:20.651983+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:20.651983+0000","last_undegraded":"2024-09-12T02:59:20.651983+0000","last_fullsized":"2024-09-12T02:59:20.651983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220781+0000","last_change":"2024-09-12T02:59:06.041259+0000","last_active":"2024-09-12T02:59:20.220781+0000","last_peered":"2024-09-12T02:59:20.220781+0000","last_clean":"2024-09-12T02:59:20.220781+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:20.220781+0000","last_undegraded":"2024-09-12T02:59:20.220781+0000","last_fullsized":"2024-09-12T02:59:20.220781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:50.481819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893814+0000","last_change":"2024-09-12T02:59:06.053023+0000","last_active":"2024-09-12T02:59:20.893814+0000","last_peered":"2024-09-12T02:59:20.893814+0000","last_clean":"2024-09-12T02:59:20.893814+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:20.893814+0000","last_undegraded":"2024-09-12T02:59:20.893814+0000","last_fullsized":"2024-09-12T02:59:20.893814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:23.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651340+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:59:20.651340+0000","last_peered":"2024-09-12T02:59:20.651340+0000","last_clean":"2024-09-12T02:59:20.651340+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:20.651340+0000","last_undegraded":"2024-09-12T02:59:20.651340+0000","last_fullsized":"2024-09-12T02:59:20.651340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227193+0000","last_change":"2024-09-12T02:59:06.048181+0000","last_active":"2024-09-12T02:59:20.227193+0000","last_peered":"2024-09-12T02:59:20.227193+0000","last_clean":"2024-09-12T02:59:20.227193+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:20.227193+0000","last_undegraded":"2024-09-12T02:59:20.227193+0000","last_fullsized":"2024-09-12T02:59:20.227193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:18.582473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219594+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:59:20.219594+0000","last_peered":"2024-09-12T02:59:20.219594+0000","last_clean":"2024-09-12T02:59:20.219594+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:20.219594+0000","last_undegraded":"2024-09-12T02:59:20.219594+0000","last_fullsized":"2024-09-12T02:59:20.219594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095006+0000","last_change":"2024-09-12T02:59:06.034598+0000","last_active":"2024-09-12T02:59:21.095006+0000","last_peered":"2024-09-12T02:59:21.095006+0000","last_clean":"2024-09-12T02:59:21.095006+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:21.095006+0000","last_undegraded":"2024-09-12T02:59:21.095006+0000","last_fullsized":"2024-09-12T02:59:21.095006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:16.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573065+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:59:20.573065+0000","last_peered":"2024-09-12T02:59:20.573065+0000","last_clean":"2024-09-12T02:59:20.573065+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:20.573065+0000","last_undegraded":"2024-09-12T02:59:20.573065+0000","last_fullsized":"2024-09-12T02:59:20.573065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893238+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:59:20.893238+0000","last_peered":"2024-09-12T02:59:20.893238+0000","last_clean":"2024-09-12T02:59:20.893238+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:20.893238+0000","last_undegraded":"2024-09-12T02:59:20.893238+0000","last_fullsized":"2024-09-12T02:59:20.893238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222460+0000","last_change":"2024-09-12T02:59:06.062947+0000","last_active":"2024-09-12T02:59:20.222460+0000","last_peered":"2024-09-12T02:59:20.222460+0000","last_clean":"2024-09-12T02:59:20.222460+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:20.222460+0000","last_undegraded":"2024-09-12T02:59:20.222460+0000","last_fullsized":"2024-09-12T02:59:20.222460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:19.386600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.573025+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:59:20.573025+0000","last_peered":"2024-09-12T02:59:20.573025+0000","last_clean":"2024-09-12T02:59:20.573025+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:20.573025+0000","last_undegraded":"2024-09-12T02:59:20.573025+0000","last_fullsized":"2024-09-12T02:59:20.573025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224723+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:59:20.224723+0000","last_peered":"2024-09-12T02:59:20.224723+0000","last_clean":"2024-09-12T02:59:20.224723+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:20.224723+0000","last_undegraded":"2024-09-12T02:59:20.224723+0000","last_fullsized":"2024-09-12T02:59:20.224723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221617+0000","last_change":"2024-09-12T02:59:08.073044+0000","last_active":"2024-09-12T02:59:20.221617+0000","last_peered":"2024-09-12T02:59:20.221617+0000","last_clean":"2024-09-12T02:59:20.221617+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:20.221617+0000","last_undegraded":"2024-09-12T02:59:20.221617+0000","last_fullsized":"2024-09-12T02:59:20.221617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571812+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:59:20.571812+0000","last_peered":"2024-09-12T02:59:20.571812+0000","last_clean":"2024-09-12T02:59:20.571812+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:20.571812+0000","last_undegraded":"2024-09-12T02:59:20.571812+0000","last_fullsized":"2024-09-12T02:59:20.571812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893455+0000","last_change":"2024-09-12T02:59:08.079372+0000","last_active":"2024-09-12T02:59:20.893455+0000","last_peered":"2024-09-12T02:59:20.893455+0000","last_clean":"2024-09-12T02:59:20.893455+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:20.893455+0000","last_undegraded":"2024-09-12T02:59:20.893455+0000","last_fullsized":"2024-09-12T02:59:20.893455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:04.951763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093850+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:59:21.093850+0000","last_peered":"2024-09-12T02:59:21.093850+0000","last_clean":"2024-09-12T02:59:21.093850+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:21.093850+0000","last_undegraded":"2024-09-12T02:59:21.093850+0000","last_fullsized":"2024-09-12T02:59:21.093850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651401+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:59:20.651401+0000","last_peered":"2024-09-12T02:59:20.651401+0000","last_clean":"2024-09-12T02:59:20.651401+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:20.651401+0000","last_undegraded":"2024-09-12T02:59:20.651401+0000","last_fullsized":"2024-09-12T02:59:20.651401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651642+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:59:20.651642+0000","last_peered":"2024-09-12T02:59:20.651642+0000","last_clean":"2024-09-12T02:59:20.651642+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:20.651642+0000","last_undegraded":"2024-09-12T02:59:20.651642+0000","last_fullsized":"2024-09-12T02:59:20.651642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555842+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:59:20.555842+0000","last_peered":"2024-09-12T02:59:20.555842+0000","last_clean":"2024-09-12T02:59:20.555842+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:20.555842+0000","last_undegraded":"2024-09-12T02:59:20.555842+0000","last_fullsized":"2024-09-12T02:59:20.555842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572178+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:59:20.572178+0000","last_peered":"2024-09-12T02:59:20.572178+0000","last_clean":"2024-09-12T02:59:20.572178+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:20.572178+0000","last_undegraded":"2024-09-12T02:59:20.572178+0000","last_fullsized":"2024-09-12T02:59:20.572178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221668+0000","last_change":"2024-09-12T02:59:06.050751+0000","last_active":"2024-09-12T02:59:20.221668+0000","last_peered":"2024-09-12T02:59:20.221668+0000","last_clean":"2024-09-12T02:59:20.221668+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:20.221668+0000","last_undegraded":"2024-09-12T02:59:20.221668+0000","last_fullsized":"2024-09-12T02:59:20.221668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.271840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555505+0000","last_change":"2024-09-12T02:59:08.061102+0000","last_active":"2024-09-12T02:59:20.555505+0000","last_peered":"2024-09-12T02:59:20.555505+0000","last_clean":"2024-09-12T02:59:20.555505+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:20.555505+0000","last_undegraded":"2024-09-12T02:59:20.555505+0000","last_fullsized":"2024-09-12T02:59:20.555505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:58.125545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093505+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:59:21.093505+0000","last_peered":"2024-09-12T02:59:21.093505+0000","last_clean":"2024-09-12T02:59:21.093505+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:21.093505+0000","last_undegraded":"2024-09-12T02:59:21.093505+0000","last_fullsized":"2024-09-12T02:59:21.093505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095128+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:59:21.095128+0000","last_peered":"2024-09-12T02:59:21.095128+0000","last_clean":"2024-09-12T02:59:21.095128+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:21.095128+0000","last_undegraded":"2024-09-12T02:59:21.095128+0000","last_fullsized":"2024-09-12T02:59:21.095128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227503+0000","last_change":"2024-09-12T02:59:06.046162+0000","last_active":"2024-09-12T02:59:20.227503+0000","last_peered":"2024-09-12T02:59:20.227503+0000","last_clean":"2024-09-12T02:59:20.227503+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:20.227503+0000","last_undegraded":"2024-09-12T02:59:20.227503+0000","last_fullsized":"2024-09-12T02:59:20.227503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.056594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572297+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:59:20.572297+0000","last_peered":"2024-09-12T02:59:20.572297+0000","last_clean":"2024-09-12T02:59:20.572297+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:20.572297+0000","last_undegraded":"2024-09-12T02:59:20.572297+0000","last_fullsized":"2024-09-12T02:59:20.572297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"62'23","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.650946+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:59:20.650946+0000","last_peered":"2024-09-12T02:59:20.650946+0000","last_clean":"2024-09-12T02:59:20.650946+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:20.650946+0000","last_undegraded":"2024-09-12T02:59:20.650946+0000","last_fullsized":"2024-09-12T02:59:20.650946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37601,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220586+0000","last_change":"2024-09-12T02:59:08.086853+0000","last_active":"2024-09-12T02:59:20.220586+0000","last_peered":"2024-09-12T02:59:20.220586+0000","last_clean":"2024-09-12T02:59:20.220586+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:20.220586+0000","last_undegraded":"2024-09-12T02:59:20.220586+0000","last_fullsized":"2024-09-12T02:59:20.220586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222774+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:59:20.222774+0000","last_peered":"2024-09-12T02:59:20.222774+0000","last_clean":"2024-09-12T02:59:20.222774+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:20.222774+0000","last_undegraded":"2024-09-12T02:59:20.222774+0000","last_fullsized":"2024-09-12T02:59:20.222774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"60'5","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220978+0000","last_change":"2024-09-12T02:59:08.072309+0000","last_active":"2024-09-12T02:59:20.220978+0000","last_peered":"2024-09-12T02:59:20.220978+0000","last_clean":"2024-09-12T02:59:20.220978+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:20.220978+0000","last_undegraded":"2024-09-12T02:59:20.220978+0000","last_fullsized":"2024-09-12T02:59:20.220978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223587+0000","last_change":"2024-09-12T02:59:08.080949+0000","last_active":"2024-09-12T02:59:20.223587+0000","last_peered":"2024-09-12T02:59:20.223587+0000","last_clean":"2024-09-12T02:59:20.223587+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:20.223587+0000","last_undegraded":"2024-09-12T02:59:20.223587+0000","last_fullsized":"2024-09-12T02:59:20.223587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:41.284531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093410+0000","last_change":"2024-09-12T02:59:06.040772+0000","last_active":"2024-09-12T02:59:21.093410+0000","last_peered":"2024-09-12T02:59:21.093410+0000","last_clean":"2024-09-12T02:59:21.093410+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:21.093410+0000","last_undegraded":"2024-09-12T02:59:21.093410+0000","last_fullsized":"2024-09-12T02:59:21.093410+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:31.077375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225642+0000","last_change":"2024-09-12T02:59:06.033384+0000","last_active":"2024-09-12T02:59:20.225642+0000","last_peered":"2024-09-12T02:59:20.225642+0000","last_clean":"2024-09-12T02:59:20.225642+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:20.225642+0000","last_undegraded":"2024-09-12T02:59:20.225642+0000","last_fullsized":"2024-09-12T02:59:20.225642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:41.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555370+0000","last_change":"2024-09-12T02:59:08.074397+0000","last_active":"2024-09-12T02:59:20.555370+0000","last_peered":"2024-09-12T02:59:20.555370+0000","last_clean":"2024-09-12T02:59:20.555370+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:20.555370+0000","last_undegraded":"2024-09-12T02:59:20.555370+0000","last_fullsized":"2024-09-12T02:59:20.555370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:11.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225923+0000","last_change":"2024-09-12T02:59:06.035397+0000","last_active":"2024-09-12T02:59:20.225923+0000","last_peered":"2024-09-12T02:59:20.225923+0000","last_clean":"2024-09-12T02:59:20.225923+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:20.225923+0000","last_undegraded":"2024-09-12T02:59:20.225923+0000","last_fullsized":"2024-09-12T02:59:20.225923+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:13.552932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652530+0000","last_change":"2024-09-12T02:59:06.055518+0000","last_active":"2024-09-12T02:59:20.652530+0000","last_peered":"2024-09-12T02:59:20.652530+0000","last_clean":"2024-09-12T02:59:20.652530+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:20.652530+0000","last_undegraded":"2024-09-12T02:59:20.652530+0000","last_fullsized":"2024-09-12T02:59:20.652530+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:09.456324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555259+0000","last_change":"2024-09-12T02:59:06.038606+0000","last_active":"2024-09-12T02:59:20.555259+0000","last_peered":"2024-09-12T02:59:20.555259+0000","last_clean":"2024-09-12T02:59:20.555259+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:20.555259+0000","last_undegraded":"2024-09-12T02:59:20.555259+0000","last_fullsized":"2024-09-12T02:59:20.555259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.456399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093743+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:59:21.093743+0000","last_peered":"2024-09-12T02:59:21.093743+0000","last_clean":"2024-09-12T02:59:21.093743+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:21.093743+0000","last_undegraded":"2024-09-12T02:59:21.093743+0000","last_fullsized":"2024-09-12T02:59:21.093743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220149+0000","last_change":"2024-09-12T02:59:08.058453+0000","last_active":"2024-09-12T02:59:20.220149+0000","last_peered":"2024-09-12T02:59:20.220149+0000","last_clean":"2024-09-12T02:59:20.220149+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:20.220149+0000","last_undegraded":"2024-09-12T02:59:20.220149+0000","last_fullsized":"2024-09-12T02:59:20.220149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221549+0000","last_change":"2024-09-12T02:59:06.065547+0000","last_active":"2024-09-12T02:59:20.221549+0000","last_peered":"2024-09-12T02:59:20.221549+0000","last_clean":"2024-09-12T02:59:20.221549+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:20.221549+0000","last_undegraded":"2024-09-12T02:59:20.221549+0000","last_fullsized":"2024-09-12T02:59:20.221549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.274480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652330+0000","last_change":"2024-09-12T02:59:06.057027+0000","last_active":"2024-09-12T02:59:20.652330+0000","last_peered":"2024-09-12T02:59:20.652330+0000","last_clean":"2024-09-12T02:59:20.652330+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:20.652330+0000","last_undegraded":"2024-09-12T02:59:20.652330+0000","last_fullsized":"2024-09-12T02:59:20.652330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:00.045309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555400+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:59:20.555400+0000","last_peered":"2024-09-12T02:59:20.555400+0000","last_clean":"2024-09-12T02:59:20.555400+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:20.555400+0000","last_undegraded":"2024-09-12T02:59:20.555400+0000","last_fullsized":"2024-09-12T02:59:20.555400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554671+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:59:20.554671+0000","last_peered":"2024-09-12T02:59:20.554671+0000","last_clean":"2024-09-12T02:59:20.554671+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:20.554671+0000","last_undegraded":"2024-09-12T02:59:20.554671+0000","last_fullsized":"2024-09-12T02:59:20.554671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651664+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:59:20.651664+0000","last_peered":"2024-09-12T02:59:20.651664+0000","last_clean":"2024-09-12T02:59:20.651664+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:20.651664+0000","last_undegraded":"2024-09-12T02:59:20.651664+0000","last_fullsized":"2024-09-12T02:59:20.651664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094328+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:59:21.094328+0000","last_peered":"2024-09-12T02:59:21.094328+0000","last_clean":"2024-09-12T02:59:21.094328+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:21.094328+0000","last_undegraded":"2024-09-12T02:59:21.094328+0000","last_fullsized":"2024-09-12T02:59:21.094328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893710+0000","last_change":"2024-09-12T02:59:06.049017+0000","last_active":"2024-09-12T02:59:20.893710+0000","last_peered":"2024-09-12T02:59:20.893710+0000","last_clean":"2024-09-12T02:59:20.893710+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:20.893710+0000","last_undegraded":"2024-09-12T02:59:20.893710+0000","last_fullsized":"2024-09-12T02:59:20.893710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.513391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554672+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:59:20.554672+0000","last_peered":"2024-09-12T02:59:20.554672+0000","last_clean":"2024-09-12T02:59:20.554672+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:20.554672+0000","last_undegraded":"2024-09-12T02:59:20.554672+0000","last_fullsized":"2024-09-12T02:59:20.554672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223808+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:59:20.223808+0000","last_peered":"2024-09-12T02:59:20.223808+0000","last_clean":"2024-09-12T02:59:20.223808+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:20.223808+0000","last_undegraded":"2024-09-12T02:59:20.223808+0000","last_fullsized":"2024-09-12T02:59:20.223808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555699+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:59:20.555699+0000","last_peered":"2024-09-12T02:59:20.555699+0000","last_clean":"2024-09-12T02:59:20.555699+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:20.555699+0000","last_undegraded":"2024-09-12T02:59:20.555699+0000","last_fullsized":"2024-09-12T02:59:20.555699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651209+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:59:20.651209+0000","last_peered":"2024-09-12T02:59:20.651209+0000","last_clean":"2024-09-12T02:59:20.651209+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:20.651209+0000","last_undegraded":"2024-09-12T02:59:20.651209+0000","last_fullsized":"2024-09-12T02:59:20.651209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893469+0000","last_change":"2024-09-12T02:59:06.035202+0000","last_active":"2024-09-12T02:59:20.893469+0000","last_peered":"2024-09-12T02:59:20.893469+0000","last_clean":"2024-09-12T02:59:20.893469+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:20.893469+0000","last_undegraded":"2024-09-12T02:59:20.893469+0000","last_fullsized":"2024-09-12T02:59:20.893469+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:38.826721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224631+0000","last_change":"2024-09-12T02:59:06.039795+0000","last_active":"2024-09-12T02:59:20.224631+0000","last_peered":"2024-09-12T02:59:20.224631+0000","last_clean":"2024-09-12T02:59:20.224631+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:20.224631+0000","last_undegraded":"2024-09-12T02:59:20.224631+0000","last_fullsized":"2024-09-12T02:59:20.224631+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094428+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:59:21.094428+0000","last_peered":"2024-09-12T02:59:21.094428+0000","last_clean":"2024-09-12T02:59:21.094428+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:21.094428+0000","last_undegraded":"2024-09-12T02:59:21.094428+0000","last_fullsized":"2024-09-12T02:59:21.094428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555831+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:59:20.555831+0000","last_peered":"2024-09-12T02:59:20.555831+0000","last_clean":"2024-09-12T02:59:20.555831+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:20.555831+0000","last_undegraded":"2024-09-12T02:59:20.555831+0000","last_fullsized":"2024-09-12T02:59:20.555831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220580+0000","last_change":"2024-09-12T02:59:08.055950+0000","last_active":"2024-09-12T02:59:20.220580+0000","last_peered":"2024-09-12T02:59:20.220580+0000","last_clean":"2024-09-12T02:59:20.220580+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:20.220580+0000","last_undegraded":"2024-09-12T02:59:20.220580+0000","last_fullsized":"2024-09-12T02:59:20.220580+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.808972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652436+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:59:20.652436+0000","last_peered":"2024-09-12T02:59:20.652436+0000","last_clean":"2024-09-12T02:59:20.652436+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:20.652436+0000","last_undegraded":"2024-09-12T02:59:20.652436+0000","last_fullsized":"2024-09-12T02:59:20.652436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555996+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:59:20.555996+0000","last_peered":"2024-09-12T02:59:20.555996+0000","last_clean":"2024-09-12T02:59:20.555996+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:20.555996+0000","last_undegraded":"2024-09-12T02:59:20.555996+0000","last_fullsized":"2024-09-12T02:59:20.555996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221900+0000","last_change":"2024-09-12T02:59:06.064508+0000","last_active":"2024-09-12T02:59:20.221900+0000","last_peered":"2024-09-12T02:59:20.221900+0000","last_clean":"2024-09-12T02:59:20.221900+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:20.221900+0000","last_undegraded":"2024-09-12T02:59:20.221900+0000","last_fullsized":"2024-09-12T02:59:20.221900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:09.089943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554994+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:59:20.554994+0000","last_peered":"2024-09-12T02:59:20.554994+0000","last_clean":"2024-09-12T02:59:20.554994+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:20.554994+0000","last_undegraded":"2024-09-12T02:59:20.554994+0000","last_fullsized":"2024-09-12T02:59:20.554994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224351+0000","last_change":"2024-09-12T02:59:06.039130+0000","last_active":"2024-09-12T02:59:20.224351+0000","last_peered":"2024-09-12T02:59:20.224351+0000","last_clean":"2024-09-12T02:59:20.224351+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:20.224351+0000","last_undegraded":"2024-09-12T02:59:20.224351+0000","last_fullsized":"2024-09-12T02:59:20.224351+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:47.700652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094518+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:59:21.094518+0000","last_peered":"2024-09-12T02:59:21.094518+0000","last_clean":"2024-09-12T02:59:21.094518+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:21.094518+0000","last_undegraded":"2024-09-12T02:59:21.094518+0000","last_fullsized":"2024-09-12T02:59:21.094518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652175+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:59:20.652175+0000","last_peered":"2024-09-12T02:59:20.652175+0000","last_clean":"2024-09-12T02:59:20.652175+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:20.652175+0000","last_undegraded":"2024-09-12T02:59:20.652175+0000","last_fullsized":"2024-09-12T02:59:20.652175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572669+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:59:20.572669+0000","last_peered":"2024-09-12T02:59:20.572669+0000","last_clean":"2024-09-12T02:59:20.572669+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:20.572669+0000","last_undegraded":"2024-09-12T02:59:20.572669+0000","last_fullsized":"2024-09-12T02:59:20.572669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893383+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:59:20.893383+0000","last_peered":"2024-09-12T02:59:20.893383+0000","last_clean":"2024-09-12T02:59:20.893383+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:20.893383+0000","last_undegraded":"2024-09-12T02:59:20.893383+0000","last_fullsized":"2024-09-12T02:59:20.893383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226422+0000","last_change":"2024-09-12T02:59:06.052737+0000","last_active":"2024-09-12T02:59:20.226422+0000","last_peered":"2024-09-12T02:59:20.226422+0000","last_clean":"2024-09-12T02:59:20.226422+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:20.226422+0000","last_undegraded":"2024-09-12T02:59:20.226422+0000","last_fullsized":"2024-09-12T02:59:20.226422+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:35.122045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222235+0000","last_change":"2024-09-12T02:59:06.033376+0000","last_active":"2024-09-12T02:59:20.222235+0000","last_peered":"2024-09-12T02:59:20.222235+0000","last_clean":"2024-09-12T02:59:20.222235+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:20.222235+0000","last_undegraded":"2024-09-12T02:59:20.222235+0000","last_fullsized":"2024-09-12T02:59:20.222235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:58.904459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220371+0000","last_change":"2024-09-12T02:59:08.058142+0000","last_active":"2024-09-12T02:59:20.220371+0000","last_peered":"2024-09-12T02:59:20.220371+0000","last_clean":"2024-09-12T02:59:20.220371+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:20.220371+0000","last_undegraded":"2024-09-12T02:59:20.220371+0000","last_fullsized":"2024-09-12T02:59:20.220371+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:34.922114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"60'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093613+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:59:21.093613+0000","last_peered":"2024-09-12T02:59:21.093613+0000","last_clean":"2024-09-12T02:59:21.093613+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:21.093613+0000","last_undegraded":"2024-09-12T02:59:21.093613+0000","last_fullsized":"2024-09-12T02:59:21.093613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":123,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555233+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:59:20.555233+0000","last_peered":"2024-09-12T02:59:20.555233+0000","last_clean":"2024-09-12T02:59:20.555233+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:20.555233+0000","last_undegraded":"2024-09-12T02:59:20.555233+0000","last_fullsized":"2024-09-12T02:59:20.555233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222303+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:59:20.222303+0000","last_peered":"2024-09-12T02:59:20.222303+0000","last_clean":"2024-09-12T02:59:20.222303+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:20.222303+0000","last_undegraded":"2024-09-12T02:59:20.222303+0000","last_fullsized":"2024-09-12T02:59:20.222303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652209+0000","last_change":"2024-09-12T02:59:06.053463+0000","last_active":"2024-09-12T02:59:20.652209+0000","last_peered":"2024-09-12T02:59:20.652209+0000","last_clean":"2024-09-12T02:59:20.652209+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:20.652209+0000","last_undegraded":"2024-09-12T02:59:20.652209+0000","last_fullsized":"2024-09-12T02:59:20.652209+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:12.272345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652306+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:59:20.652306+0000","last_peered":"2024-09-12T02:59:20.652306+0000","last_clean":"2024-09-12T02:59:20.652306+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:20.652306+0000","last_undegraded":"2024-09-12T02:59:20.652306+0000","last_fullsized":"2024-09-12T02:59:20.652306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572981+0000","last_change":"2024-09-12T02:59:06.058593+0000","last_active":"2024-09-12T02:59:20.572981+0000","last_peered":"2024-09-12T02:59:20.572981+0000","last_clean":"2024-09-12T02:59:20.572981+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:20.572981+0000","last_undegraded":"2024-09-12T02:59:20.572981+0000","last_fullsized":"2024-09-12T02:59:20.572981+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.306038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555202+0000","last_change":"2024-09-12T02:59:06.066878+0000","last_active":"2024-09-12T02:59:20.555202+0000","last_peered":"2024-09-12T02:59:20.555202+0000","last_clean":"2024-09-12T02:59:20.555202+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:20.555202+0000","last_undegraded":"2024-09-12T02:59:20.555202+0000","last_fullsized":"2024-09-12T02:59:20.555202+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.621838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571689+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:59:20.571689+0000","last_peered":"2024-09-12T02:59:20.571689+0000","last_clean":"2024-09-12T02:59:20.571689+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:20.571689+0000","last_undegraded":"2024-09-12T02:59:20.571689+0000","last_fullsized":"2024-09-12T02:59:20.571689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225014+0000","last_change":"2024-09-12T02:59:06.052855+0000","last_active":"2024-09-12T02:59:20.225014+0000","last_peered":"2024-09-12T02:59:20.225014+0000","last_clean":"2024-09-12T02:59:20.225014+0000","last_became_active":"2024-09-12T02:59:06.051893+0000","last_became_peered":"2024-09-12T02:59:06.051893+0000","last_unstale":"2024-09-12T02:59:20.225014+0000","last_undegraded":"2024-09-12T02:59:20.225014+0000","last_fullsized":"2024-09-12T02:59:20.225014+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:59.682086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571964+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:59:20.571964+0000","last_peered":"2024-09-12T02:59:20.571964+0000","last_clean":"2024-09-12T02:59:20.571964+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:20.571964+0000","last_undegraded":"2024-09-12T02:59:20.571964+0000","last_fullsized":"2024-09-12T02:59:20.571964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.226513+0000","last_change":"2024-09-12T02:59:06.050998+0000","last_active":"2024-09-12T02:59:20.226513+0000","last_peered":"2024-09-12T02:59:20.226513+0000","last_clean":"2024-09-12T02:59:20.226513+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:20.226513+0000","last_undegraded":"2024-09-12T02:59:20.226513+0000","last_fullsized":"2024-09-12T02:59:20.226513+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:41.882534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094247+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:59:21.094247+0000","last_peered":"2024-09-12T02:59:21.094247+0000","last_clean":"2024-09-12T02:59:21.094247+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:21.094247+0000","last_undegraded":"2024-09-12T02:59:21.094247+0000","last_fullsized":"2024-09-12T02:59:21.094247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221167+0000","last_change":"2024-09-12T02:59:08.055576+0000","last_active":"2024-09-12T02:59:20.221167+0000","last_peered":"2024-09-12T02:59:20.221167+0000","last_clean":"2024-09-12T02:59:20.221167+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:20.221167+0000","last_undegraded":"2024-09-12T02:59:20.221167+0000","last_fullsized":"2024-09-12T02:59:20.221167+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:55.285218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":125,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572731+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:59:20.572731+0000","last_peered":"2024-09-12T02:59:20.572731+0000","last_clean":"2024-09-12T02:59:20.572731+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:20.572731+0000","last_undegraded":"2024-09-12T02:59:20.572731+0000","last_fullsized":"2024-09-12T02:59:20.572731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38710,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":83,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509474,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":516025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":925696,"data_stored":478424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509476,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1527808,"data_stored":1069119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542180,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28512,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343328,"statfs":{"total":96636764160,"available":96607567872,"internally_reserved":0,"allocated":1519616,"data_stored":1069063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":515714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906950,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29020,"kb_used_data":904,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342820,"statfs":{"total":96636764160,"available":96607047680,"internally_reserved":0,"allocated":925696,"data_stored":478203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":933888,"data_stored":478239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":478273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":37912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:59:27.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:59:27.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cfe800640 1 Processor -- start 2024-09-12T02:59:27.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cfe800640 1 -- start start 2024-09-12T02:59:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cfe800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf8151730 0x7f2cf80c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cfe800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2cf8151b10 0x7f2cf815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cfe800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf80c84b0 con 0x7f2cf815b730 2024-09-12T02:59:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cfe800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2cf80c8260 con 0x7f2cf8151b10 2024-09-12T02:59:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cfe800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf815ad60 con 0x7f2cf8151730 2024-09-12T02:59:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cf7e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2cf815b730 0x7f2cf80cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57614/0 (socket says 172.21.15.63:57614) 2024-09-12T02:59:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cf7e00640 1 -- 172.21.15.63:0/898256624 learned_addr learned my addr 172.21.15.63:0/898256624 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cf7400640 1 --2- 172.21.15.63:0/898256624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf8151730 0x7f2cf80c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2ceea00640 1 --2- 172.21.15.63:0/898256624 >> v2:172.21.15.119:3300/0 conn(0x7f2cf8151b10 0x7f2cf815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cf6a00640 1 -- 172.21.15.63:0/898256624 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1636123933 0 0) 0x7f2cf80c84b0 con 0x7f2cf815b730 2024-09-12T02:59:27.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cf6a00640 1 -- 172.21.15.63:0/898256624 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cdc003530 con 0x7f2cf815b730 2024-09-12T02:59:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cf7400640 1 -- 172.21.15.63:0/898256624 >> v2:172.21.15.119:3300/0 conn(0x7f2cf8151b10 msgr2=0x7f2cf815b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cf7400640 1 --2- 172.21.15.63:0/898256624 >> v2:172.21.15.119:3300/0 conn(0x7f2cf8151b10 0x7f2cf815b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cf7400640 1 -- 172.21.15.63:0/898256624 >> v1:172.21.15.63:6789/0 conn(0x7f2cf815b730 legacy=0x7f2cf80cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.620+0000 7f2cf7400640 1 -- 172.21.15.63:0/898256624 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf80c8790 con 0x7f2cf8151730 2024-09-12T02:59:27.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cf7400640 1 --2- 172.21.15.63:0/898256624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf8151730 0x7f2cf80c61b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097c0 tx=0x7f2ce801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ec8e0ae511b9c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cf6a00640 1 -- 172.21.15.63:0/898256624 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80b5070 con 0x7f2cf8151730 2024-09-12T02:59:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cf6a00640 1 -- 172.21.15.63:0/898256624 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce80a8990 con 0x7f2cf8151730 2024-09-12T02:59:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cf6a00640 1 -- 172.21.15.63:0/898256624 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80a8d40 con 0x7f2cf8151730 2024-09-12T02:59:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cfe800640 1 -- 172.21.15.63:0/898256624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf8151730 msgr2=0x7f2cf80c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cfe800640 1 --2- 172.21.15.63:0/898256624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf8151730 0x7f2cf80c61b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097c0 tx=0x7f2ce801ec90 comp rx=0 tx=0).stop 2024-09-12T02:59:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cfe800640 1 -- 172.21.15.63:0/898256624 shutdown_connections 2024-09-12T02:59:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cfe800640 1 --2- 172.21.15.63:0/898256624 >> v2:172.21.15.119:3300/0 conn(0x7f2cf8151b10 0x7f2cf815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cfe800640 1 --2- 172.21.15.63:0/898256624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf8151730 0x7f2cf80c61b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cfe800640 1 -- 172.21.15.63:0/898256624 >> 172.21.15.63:0/898256624 conn(0x7f2cf806be90 msgr2=0x7f2cf806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cfe800640 1 -- 172.21.15.63:0/898256624 shutdown_connections 2024-09-12T02:59:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.624+0000 7f2cfe800640 1 -- 172.21.15.63:0/898256624 wait complete. 2024-09-12T02:59:27.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 Processor -- start 2024-09-12T02:59:27.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 -- start start 2024-09-12T02:59:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2cf8151730 0x7f2cf8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cf8151b10 0x7f2cf814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf815b730 0x7f2cf81457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf80ccd40 con 0x7f2cf8151730 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf80c66f0 con 0x7f2cf8151b10 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf80ccec0 con 0x7f2cf815b730 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2cf8151730 0x7f2cf8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2cf8151730 0x7f2cf8159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42468/0 (socket says 172.21.15.63:42468) 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7400640 1 -- 172.21.15.63:0/3225747134 learned_addr learned my addr 172.21.15.63:0/3225747134 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7e00640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf815b730 0x7f2cf81457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2ceea00640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cf8151b10 0x7f2cf814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7400640 1 -- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf815b730 msgr2=0x7f2cf81457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7400640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf815b730 0x7f2cf81457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7400640 1 -- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cf8151b10 msgr2=0x7f2cf814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7400640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cf8151b10 0x7f2cf814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7400640 1 -- 172.21.15.63:0/3225747134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf814c400 con 0x7f2cf8151730 2024-09-12T02:59:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2ceea00640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cf8151b10 0x7f2cf814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cf7400640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2cf8151730 0x7f2cf8159f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80b3040 tx=0x7f2ce801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cefe00640 1 -- 172.21.15.63:0/3225747134 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80b5040 con 0x7f2cf8151730 2024-09-12T02:59:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cefe00640 1 -- 172.21.15.63:0/3225747134 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce80bf070 con 0x7f2cf8151730 2024-09-12T02:59:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cefe00640 1 -- 172.21.15.63:0/3225747134 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80044e0 con 0x7f2cf8151730 2024-09-12T02:59:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf81f0ab0 con 0x7f2cf8151730 2024-09-12T02:59:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.628+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf8150730 con 0x7f2cf8151730 2024-09-12T02:59:27.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.632+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf80c38a0 con 0x7f2cf8151730 2024-09-12T02:59:27.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.632+0000 7f2cefe00640 1 -- 172.21.15.63:0/3225747134 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ce8003620 con 0x7f2cf8151730 2024-09-12T02:59:27.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.632+0000 7f2cefe00640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2cd4067a60 0x7f2cd4069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:27.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.632+0000 7f2cefe00640 1 -- 172.21.15.63:0/3225747134 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f2ce8123480 con 0x7f2cf8151730 2024-09-12T02:59:27.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.632+0000 7f2ceea00640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2cd4067a60 0x7f2cd4069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:27.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.632+0000 7f2ceea00640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2cd4067a60 0x7f2cd4069f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8148e90 tx=0x7f2ce000d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:27.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.636+0000 7f2cefe00640 1 -- 172.21.15.63:0/3225747134 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2ce80187f0 con 0x7f2cf8151730 2024-09-12T02:59:27.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cf80c8d50 con 0x7f2cf8151730 2024-09-12T02:59:27.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cefe00640 1 -- 172.21.15.63:0/3225747134 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+18821 (secure 0 0 0) 0x7f2ce80f3ce0 con 0x7f2cf8151730 2024-09-12T02:59:27.808 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:27.808 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":79,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:59:20.214537+0000","last_up_change":"2024-09-12T02:59:04.984510+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":51,"up_from":64,"up_thru":64,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6825","nonce":2412795190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6827","nonce":2412795190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6831","nonce":2412795190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6829","nonce":2412795190}]},"public_addr":"172.21.15.119:6825/2412795190","cluster_addr":"172.21.15.119:6827/2412795190","heartbeat_back_addr":"172.21.15.119:6831/2412795190","heartbeat_front_addr":"172.21.15.119:6829/2412795190","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":52},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.4","osds":[5,7,4,6]}],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:59:27.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2cd4067a60 msgr2=0x7f2cd4069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2cd4067a60 0x7f2cd4069f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8148e90 tx=0x7f2ce000d040 comp rx=0 tx=0).stop 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2cf8151730 msgr2=0x7f2cf8159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2cf8151730 0x7f2cf8159f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80b3040 tx=0x7f2ce801ba30 comp rx=0 tx=0).stop 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 shutdown_connections 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2cd4067a60 0x7f2cd4069f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cf815b730 0x7f2cf81457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cf8151b10 0x7f2cf814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 --2- 172.21.15.63:0/3225747134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2cf8151730 0x7f2cf8159f80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 >> 172.21.15.63:0/3225747134 conn(0x7f2cf806be90 msgr2=0x7f2cf80c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 shutdown_connections 2024-09-12T02:59:27.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:27.804+0000 7f2cfe800640 1 -- 172.21.15.63:0/3225747134 wait complete. 2024-09-12T02:59:28.830 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T02:59:28.830 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:59:28.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab8e400640 1 Processor -- start 2024-09-12T02:59:28.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab8e400640 1 -- start start 2024-09-12T02:59:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab8e400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab88157db0 0x7fab881519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab8e400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fab8815b850 0x7fab880c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab8e400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab881584d0 con 0x7fab881515d0 2024-09-12T02:59:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab8e400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fab880c3bd0 con 0x7fab8815b850 2024-09-12T02:59:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab8e400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fab880c6d30 con 0x7fab88157db0 2024-09-12T02:59:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab87400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fab881515d0 0x7fab881576a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57616/0 (socket says 172.21.15.63:57616) 2024-09-12T02:59:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab87400640 1 -- 172.21.15.63:0/115936853 learned_addr learned my addr 172.21.15.63:0/115936853 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:28.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab87e00640 1 --2- 172.21.15.63:0/115936853 >> v2:172.21.15.63:3300/0 conn(0x7fab8815b850 0x7fab880c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:28.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab7ea00640 1 --2- 172.21.15.63:0/115936853 >> v2:172.21.15.119:3300/0 conn(0x7fab88157db0 0x7fab881519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:28.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.984+0000 7fab86a00640 1 -- 172.21.15.63:0/115936853 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099828489 0 0) 0x7fab78001120 con 0x7fab881515d0 2024-09-12T02:59:28.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab86a00640 1 -- 172.21.15.63:0/115936853 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab6c005740 con 0x7fab881515d0 2024-09-12T02:59:28.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab87e00640 1 -- 172.21.15.63:0/115936853 >> v2:172.21.15.119:3300/0 conn(0x7fab88157db0 msgr2=0x7fab881519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:28.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab87e00640 1 --2- 172.21.15.63:0/115936853 >> v2:172.21.15.119:3300/0 conn(0x7fab88157db0 0x7fab881519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:28.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab87e00640 1 -- 172.21.15.63:0/115936853 >> v1:172.21.15.63:6789/0 conn(0x7fab881515d0 legacy=0x7fab881576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:28.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab87e00640 1 -- 172.21.15.63:0/115936853 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab880c7010 con 0x7fab8815b850 2024-09-12T02:59:28.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab7ea00640 1 --2- 172.21.15.63:0/115936853 >> v2:172.21.15.119:3300/0 conn(0x7fab88157db0 0x7fab881519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:28.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab87e00640 1 --2- 172.21.15.63:0/115936853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab8815b850 0x7fab880c3690 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fab880713a0 tx=0x7fab8001f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8c98c486d2c200 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab86a00640 1 -- 172.21.15.63:0/115936853 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab800b4070 con 0x7fab8815b850 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab86a00640 1 -- 172.21.15.63:0/115936853 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab800af600 con 0x7fab8815b850 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab86a00640 1 -- 172.21.15.63:0/115936853 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab800af9b0 con 0x7fab8815b850 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab8e400640 1 -- 172.21.15.63:0/115936853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab8815b850 msgr2=0x7fab880c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab8e400640 1 --2- 172.21.15.63:0/115936853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab8815b850 0x7fab880c3690 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fab880713a0 tx=0x7fab8001f110 comp rx=0 tx=0).stop 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab8e400640 1 -- 172.21.15.63:0/115936853 shutdown_connections 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab8e400640 1 --2- 172.21.15.63:0/115936853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab8815b850 0x7fab880c3690 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab8e400640 1 --2- 172.21.15.63:0/115936853 >> v2:172.21.15.119:3300/0 conn(0x7fab88157db0 0x7fab881519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab8e400640 1 -- 172.21.15.63:0/115936853 >> 172.21.15.63:0/115936853 conn(0x7fab8806bcc0 msgr2=0x7fab8806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab8e400640 1 -- 172.21.15.63:0/115936853 shutdown_connections 2024-09-12T02:59:28.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.988+0000 7fab8e400640 1 -- 172.21.15.63:0/115936853 wait complete. 2024-09-12T02:59:28.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab8e400640 1 Processor -- start 2024-09-12T02:59:28.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab8e400640 1 -- start start 2024-09-12T02:59:29.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab8e400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab881515d0 0x7fab88154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab8e400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8815b850 0x7fab881505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab8e400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab88154ca0 0x7fab88159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab8e400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fab880c78b0 con 0x7fab88154ca0 2024-09-12T02:59:29.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab8e400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fab880c75d0 con 0x7fab8815b850 2024-09-12T02:59:29.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab8e400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fab880c8210 con 0x7fab881515d0 2024-09-12T02:59:29.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab88154ca0 0x7fab88159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab88154ca0 0x7fab88159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42486/0 (socket says 172.21.15.63:42486) 2024-09-12T02:59:29.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87e00640 1 -- 172.21.15.63:0/4211423051 learned_addr learned my addr 172.21.15.63:0/4211423051 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:29.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab7ea00640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8815b850 0x7fab881505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87400640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab881515d0 0x7fab88154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87e00640 1 -- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab881515d0 msgr2=0x7fab88154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87e00640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab881515d0 0x7fab88154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87e00640 1 -- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8815b850 msgr2=0x7fab881505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87e00640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8815b850 0x7fab881505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87e00640 1 -- 172.21.15.63:0/4211423051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab88154870 con 0x7fab88154ca0 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87400640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab881515d0 0x7fab88154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab7ea00640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab8815b850 0x7fab881505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab87e00640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab88154ca0 0x7fab88159df0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fab8001bd20 tx=0x7fab8001beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab7fe00640 1 -- 172.21.15.63:0/4211423051 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab800b4040 con 0x7fab88154ca0 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab7fe00640 1 -- 172.21.15.63:0/4211423051 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab800c1070 con 0x7fab88154ca0 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab7fe00640 1 -- 172.21.15.63:0/4211423051 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80009450 con 0x7fab88154ca0 2024-09-12T02:59:29.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.992+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab881f1000 con 0x7fab88154ca0 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab881576a0 con 0x7fab88154ca0 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab88151ce0 con 0x7fab88154ca0 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab7fe00640 1 -- 172.21.15.63:0/4211423051 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab800ba690 con 0x7fab88154ca0 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab7fe00640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fab640678c0 0x7fab64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab7fe00640 1 -- 172.21.15.63:0/4211423051 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fab801255c0 con 0x7fab88154ca0 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab7fe00640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fab64071260 0x7fab64073700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab7fe00640 1 -- 172.21.15.63:0/4211423051 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab800af600 con 0x7fab64071260 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab7fe00640 1 -- 172.21.15.63:0/4211423051 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fab80125970 con 0x7fab88154ca0 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab87400640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fab640678c0 0x7fab64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab7ea00640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fab64071260 0x7fab64073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:28.996+0000 7fab7ea00640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fab64071260 0x7fab64073700 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.000+0000 7fab87400640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fab640678c0 0x7fab64069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fab78005890 tx=0x7fab78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.000+0000 7fab7fe00640 1 -- 172.21.15.63:0/4211423051 <== osd.0 v2:172.21.15.63:6824/3662141659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab800af600 con 0x7fab64071260 2024-09-12T02:59:29.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 --> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fab880c3690 con 0x7fab64071260 2024-09-12T02:59:29.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab7fe00640 1 -- 172.21.15.63:0/4211423051 <== osd.0 v2:172.21.15.63:6824/3662141659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fab880c3690 con 0x7fab64071260 2024-09-12T02:59:29.017 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:59:29.017 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:59:29.017 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fab64071260 msgr2=0x7fab64073700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.63:6824/3662141659,v1:172.21.15.63:6825/3662141659] conn(0x7fab64071260 0x7fab64073700 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fab640678c0 msgr2=0x7fab64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fab640678c0 0x7fab64069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fab78005890 tx=0x7fab78009040 comp rx=0 tx=0).stop 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab88154ca0 msgr2=0x7fab88159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 --2- 172.21.15.63:0/4211423051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fab88154ca0 0x7fab88159df0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fab8001bd20 tx=0x7fab8001beb0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab87e00640 1 -- 172.21.15.63:0/4211423051 reap_dead start 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 shutdown_connections 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 >> 172.21.15.63:0/4211423051 conn(0x7fab8806bcc0 msgr2=0x7fab8815adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:29.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 shutdown_connections 2024-09-12T02:59:29.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.012+0000 7fab8e400640 1 -- 172.21.15.63:0/4211423051 wait complete. 2024-09-12T02:59:29.035 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T02:59:29.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.172+0000 7f52e7c00640 1 Processor -- start 2024-09-12T02:59:29.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.172+0000 7f52e7c00640 1 -- start start 2024-09-12T02:59:29.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e7c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f52e0152940 0x7f52e0158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e7c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e006c430 0x7f52e006ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e7c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e006bcc0 con 0x7f52e00c9600 2024-09-12T02:59:29.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e7c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f52e00c7bd0 con 0x7f52e0152940 2024-09-12T02:59:29.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e7c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f52e00c8060 con 0x7f52e006c430 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e5c00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f52e00c9600 0x7f52e0070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57622/0 (socket says 172.21.15.63:57622) 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e5c00640 1 -- 172.21.15.63:0/1462534162 learned_addr learned my addr 172.21.15.63:0/1462534162 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e5200640 1 --2- 172.21.15.63:0/1462534162 >> v2:172.21.15.119:3300/0 conn(0x7f52e0152940 0x7f52e0158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52d7e00640 1 --2- 172.21.15.63:0/1462534162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e006c430 0x7f52e006ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52dfe00640 1 -- 172.21.15.63:0/1462534162 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262713875 0 0) 0x7f52e006bcc0 con 0x7f52e00c9600 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52dfe00640 1 -- 172.21.15.63:0/1462534162 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c4003530 con 0x7f52e00c9600 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e5200640 1 -- 172.21.15.63:0/1462534162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e006c430 msgr2=0x7f52e006ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e5200640 1 --2- 172.21.15.63:0/1462534162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e006c430 0x7f52e006ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e5200640 1 -- 172.21.15.63:0/1462534162 >> v1:172.21.15.63:6789/0 conn(0x7f52e00c9600 legacy=0x7f52e0070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52dfe00640 1 -- 172.21.15.63:0/1462534162 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1234027677 0 0) 0x7f52c4003530 con 0x7f52e00c9600 2024-09-12T02:59:29.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.176+0000 7f52e5200640 1 -- 172.21.15.63:0/1462534162 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e006bf60 con 0x7f52e0152940 2024-09-12T02:59:29.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52e5200640 1 --2- 172.21.15.63:0/1462534162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52e0152940 0x7f52e0158730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52d00097c0 tx=0x7f52d001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf1eeb39518a098 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52dfe00640 1 -- 172.21.15.63:0/1462534162 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d00b5070 con 0x7f52e0152940 2024-09-12T02:59:29.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52dfe00640 1 -- 172.21.15.63:0/1462534162 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d00a8990 con 0x7f52e0152940 2024-09-12T02:59:29.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52dfe00640 1 -- 172.21.15.63:0/1462534162 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d00a8d40 con 0x7f52e0152940 2024-09-12T02:59:29.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52e7c00640 1 -- 172.21.15.63:0/1462534162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52e0152940 msgr2=0x7f52e0158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52e7c00640 1 --2- 172.21.15.63:0/1462534162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52e0152940 0x7f52e0158730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52d00097c0 tx=0x7f52d001ec90 comp rx=0 tx=0).stop 2024-09-12T02:59:29.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52e7c00640 1 -- 172.21.15.63:0/1462534162 shutdown_connections 2024-09-12T02:59:29.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52e7c00640 1 --2- 172.21.15.63:0/1462534162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e006c430 0x7f52e006ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52e7c00640 1 --2- 172.21.15.63:0/1462534162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52e0152940 0x7f52e0158730 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52e7c00640 1 -- 172.21.15.63:0/1462534162 >> 172.21.15.63:0/1462534162 conn(0x7f52e0072960 msgr2=0x7f52e0072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:29.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52e7c00640 1 -- 172.21.15.63:0/1462534162 shutdown_connections 2024-09-12T02:59:29.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.180+0000 7f52e7c00640 1 -- 172.21.15.63:0/1462534162 wait complete. 2024-09-12T02:59:29.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 Processor -- start 2024-09-12T02:59:29.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 -- start start 2024-09-12T02:59:29.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52e006c430 0x7f52e01415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e00c9600 0x7f52e0144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e0152940 0x7f52e014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f52e00c9170 con 0x7f52e0152940 2024-09-12T02:59:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f52e00cdc70 con 0x7f52e006c430 2024-09-12T02:59:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f52e00cdf50 con 0x7f52e00c9600 2024-09-12T02:59:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e0152940 0x7f52e014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e0152940 0x7f52e014bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42488/0 (socket says 172.21.15.63:42488) 2024-09-12T02:59:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5c00640 1 -- 172.21.15.63:0/4125802087 learned_addr learned my addr 172.21.15.63:0/4125802087 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5200640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52e006c430 0x7f52e01415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52d7e00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e00c9600 0x7f52e0144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5c00640 1 -- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e00c9600 msgr2=0x7f52e0144b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5c00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e00c9600 0x7f52e0144b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5c00640 1 -- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52e006c430 msgr2=0x7f52e01415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5c00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52e006c430 0x7f52e01415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5c00640 1 -- 172.21.15.63:0/4125802087 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e01f12b0 con 0x7f52e0152940 2024-09-12T02:59:29.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e5c00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e0152940 0x7f52e014bf40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f52d800cb20 tx=0x7f52d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52dd600640 1 -- 172.21.15.63:0/4125802087 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d800aca0 con 0x7f52e0152940 2024-09-12T02:59:29.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52dd600640 1 -- 172.21.15.63:0/4125802087 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d800ae40 con 0x7f52e0152940 2024-09-12T02:59:29.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e01f0fd0 con 0x7f52e0152940 2024-09-12T02:59:29.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52dd600640 1 -- 172.21.15.63:0/4125802087 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8012640 con 0x7f52e0152940 2024-09-12T02:59:29.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e01499c0 con 0x7f52e0152940 2024-09-12T02:59:29.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.184+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e00cd720 con 0x7f52e0152940 2024-09-12T02:59:29.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.188+0000 7f52dd600640 1 -- 172.21.15.63:0/4125802087 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f52d80127e0 con 0x7f52e0152940 2024-09-12T02:59:29.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.188+0000 7f52dd600640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52bc0678c0 0x7f52bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.188+0000 7f52dd600640 1 -- 172.21.15.63:0/4125802087 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f52d80866e0 con 0x7f52e0152940 2024-09-12T02:59:29.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.188+0000 7f52e5200640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52bc0678c0 0x7f52bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.188+0000 7f52e5200640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52bc0678c0 0x7f52bc069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f52d00b2000 tx=0x7f52d00aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.192+0000 7f52dd600640 1 -- 172.21.15.63:0/4125802087 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f52d8056740 con 0x7f52e0152940 2024-09-12T02:59:29.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f52e0151df0 con 0x7f52bc0678c0 2024-09-12T02:59:29.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52dd600640 1 -- 172.21.15.63:0/4125802087 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f52e0151df0 con 0x7f52bc0678c0 2024-09-12T02:59:29.364 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52bc0678c0 msgr2=0x7f52bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52bc0678c0 0x7f52bc069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f52d00b2000 tx=0x7f52d00aa070 comp rx=0 tx=0).stop 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e0152940 msgr2=0x7f52e014bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e0152940 0x7f52e014bf40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f52d800cb20 tx=0x7f52d800a060 comp rx=0 tx=0).stop 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 shutdown_connections 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52e0152940 0x7f52e014bf40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f52bc0678c0 0x7f52bc069d80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52e00c9600 0x7f52e0144b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 --2- 172.21.15.63:0/4125802087 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52e006c430 0x7f52e01415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 >> 172.21.15.63:0/4125802087 conn(0x7f52e0072960 msgr2=0x7f52e0150830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.360+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 shutdown_connections 2024-09-12T02:59:29.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.364+0000 7f52e7c00640 1 -- 172.21.15.63:0/4125802087 wait complete. 2024-09-12T02:59:29.386 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T02:59:29.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:59:29.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6ec200640 1 Processor -- start 2024-09-12T02:59:29.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6ec200640 1 -- start start 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6ec200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6e4154f00 0x7fe6e415b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6ec200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe6e4072490 0x7fe6e415e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6ec200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e415ded0 con 0x7fe6e4154b20 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6ec200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e415eeb0 con 0x7fe6e4072490 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6ec200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e40c7c00 con 0x7fe6e4154f00 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e9800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe6e4154b20 0x7fe6e40c6f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57632/0 (socket says 172.21.15.63:57632) 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e9800640 1 -- 172.21.15.63:0/3312790125 learned_addr learned my addr 172.21.15.63:0/3312790125 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e8e00640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6e4154f00 0x7fe6e415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6ea200640 1 --2- 172.21.15.63:0/3312790125 >> v2:172.21.15.119:3300/0 conn(0x7fe6e4072490 0x7fe6e415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713311339 0 0) 0x7fe6e415ded0 con 0x7fe6e4154b20 2024-09-12T02:59:29.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6cc003530 con 0x7fe6e4154b20 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2643692623 0 0) 0x7fe6cc003530 con 0x7fe6e4154b20 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6e4154f00 msgr2=0x7fe6e415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6e4154f00 0x7fe6e415b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 >> v2:172.21.15.119:3300/0 conn(0x7fe6e4072490 msgr2=0x7fe6e415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 --2- 172.21.15.63:0/3312790125 >> v2:172.21.15.119:3300/0 conn(0x7fe6e4072490 0x7fe6e415e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e40c7ee0 con 0x7fe6e4154b20 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7fe6d8001680 con 0x7fe6e4154b20 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 >> v1:172.21.15.63:6789/0 conn(0x7fe6e4154b20 legacy=0x7fe6e40c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc0039c0 0x7fe6cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6e4154f00 0x7fe6cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6cc004d50 0x7fe6cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e415eeb0 con 0x7fe6cc004d50 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e40c7c00 con 0x7fe6cc0039c0 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe6cc00b9d0 con 0x7fe6e4154f00 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6ea200640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6cc004d50 0x7fe6cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e8e00640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6e4154f00 0x7fe6cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.528+0000 7fe6e9800640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc0039c0 0x7fe6cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ea200640 1 -- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6e4154f00 msgr2=0x7fe6cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ea200640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6e4154f00 0x7fe6cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ea200640 1 -- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc0039c0 msgr2=0x7fe6cc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ea200640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc0039c0 0x7fe6cc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ea200640 1 -- 172.21.15.63:0/3312790125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6cc003530 con 0x7fe6cc004d50 2024-09-12T02:59:29.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6e9800640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6cc0039c0 0x7fe6cc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:29.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ea200640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6cc004d50 0x7fe6cc0051d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40718f0 tx=0x7fe6dc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e0db358f2e83aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0b2070 con 0x7fe6cc004d50 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0a5c70 con 0x7fe6cc004d50 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6e3e00640 1 -- 172.21.15.63:0/3312790125 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc009c10 con 0x7fe6cc004d50 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ec200640 1 -- 172.21.15.63:0/3312790125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6cc004d50 msgr2=0x7fe6cc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ec200640 1 --2- 172.21.15.63:0/3312790125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6cc004d50 0x7fe6cc0051d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40718f0 tx=0x7fe6dc01cc60 comp rx=0 tx=0).stop 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ea200640 1 -- 172.21.15.63:0/3312790125 reap_dead start 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ec200640 1 -- 172.21.15.63:0/3312790125 shutdown_connections 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ec200640 1 -- 172.21.15.63:0/3312790125 >> 172.21.15.63:0/3312790125 conn(0x7fe6e406bcc0 msgr2=0x7fe6e406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.532+0000 7fe6ec200640 1 -- 172.21.15.63:0/3312790125 shutdown_connections 2024-09-12T02:59:29.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 -- 172.21.15.63:0/3312790125 wait complete. 2024-09-12T02:59:29.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 Processor -- start 2024-09-12T02:59:29.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 -- start start 2024-09-12T02:59:29.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6cc004d50 0x7fe6e414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6e40cb290 0x7fe6e40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6e4151e70 0x7fe6e41522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e415e450 con 0x7fe6e4151e70 2024-09-12T02:59:29.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e415e170 con 0x7fe6e40cb290 2024-09-12T02:59:29.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e40c7630 con 0x7fe6cc004d50 2024-09-12T02:59:29.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ea200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6e4151e70 0x7fe6e41522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ea200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6e4151e70 0x7fe6e41522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42504/0 (socket says 172.21.15.63:42504) 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ea200640 1 -- 172.21.15.63:0/973864204 learned_addr learned my addr 172.21.15.63:0/973864204 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6e8e00640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6e40cb290 0x7fe6e40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6e9800640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6cc004d50 0x7fe6e414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ea200640 1 -- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6cc004d50 msgr2=0x7fe6e414c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ea200640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6cc004d50 0x7fe6e414c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ea200640 1 -- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6e40cb290 msgr2=0x7fe6e40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ea200640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6e40cb290 0x7fe6e40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ea200640 1 -- 172.21.15.63:0/973864204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e40cbc30 con 0x7fe6e4151e70 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ea200640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6e4151e70 0x7fe6e41522f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc01ca90 tx=0x7fe6dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6e1600640 1 -- 172.21.15.63:0/973864204 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0bc070 con 0x7fe6e4151e70 2024-09-12T02:59:29.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6e1600640 1 -- 172.21.15.63:0/973864204 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0adb50 con 0x7fe6e4151e70 2024-09-12T02:59:29.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.536+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e414b8b0 con 0x7fe6e4151e70 2024-09-12T02:59:29.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e1600640 1 -- 172.21.15.63:0/973864204 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0b2040 con 0x7fe6e4151e70 2024-09-12T02:59:29.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e4159be0 con 0x7fe6e4151e70 2024-09-12T02:59:29.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe6e40c62d0 con 0x7fe6e4151e70 2024-09-12T02:59:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e1600640 1 -- 172.21.15.63:0/973864204 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe6dc0bf070 con 0x7fe6e4151e70 2024-09-12T02:59:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e1600640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6c40678c0 0x7fe6c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e1600640 1 -- 172.21.15.63:0/973864204 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fe6dc120140 con 0x7fe6e4151e70 2024-09-12T02:59:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e1600640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6c4071250 0x7fe6c40736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e1600640 1 -- 172.21.15.63:0/973864204 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6dc0a5c70 con 0x7fe6c4071250 2024-09-12T02:59:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e1600640 1 -- 172.21.15.63:0/973864204 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fe6dc127050 con 0x7fe6e4151e70 2024-09-12T02:59:29.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e9800640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6c40678c0 0x7fe6c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e8e00640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6c4071250 0x7fe6c40736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e8e00640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6c4071250 0x7fe6c40736f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.540+0000 7fe6e9800640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6c40678c0 0x7fe6c4069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8000c10 tx=0x7fe6d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.544+0000 7fe6e1600640 1 -- 172.21.15.63:0/973864204 <== osd.1 v2:172.21.15.63:6800/866448188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6dc0a5c70 con 0x7fe6c4071250 2024-09-12T02:59:29.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 --> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe6e40c6a00 con 0x7fe6c4071250 2024-09-12T02:59:29.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6e1600640 1 -- 172.21.15.63:0/973864204 <== osd.1 v2:172.21.15.63:6800/866448188 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe6e40c6a00 con 0x7fe6c4071250 2024-09-12T02:59:29.561 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:59:29.561 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:59:29.561 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:59:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6c4071250 msgr2=0x7fe6c40736f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.63:6800/866448188,v1:172.21.15.63:6801/866448188] conn(0x7fe6c4071250 0x7fe6c40736f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6c40678c0 msgr2=0x7fe6c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fe6c40678c0 0x7fe6c4069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8000c10 tx=0x7fe6d8009040 comp rx=0 tx=0).stop 2024-09-12T02:59:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6e4151e70 msgr2=0x7fe6e41522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 --2- 172.21.15.63:0/973864204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe6e4151e70 0x7fe6e41522f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc01ca90 tx=0x7fe6dc009750 comp rx=0 tx=0).stop 2024-09-12T02:59:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ea200640 1 -- 172.21.15.63:0/973864204 reap_dead start 2024-09-12T02:59:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 shutdown_connections 2024-09-12T02:59:29.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 >> 172.21.15.63:0/973864204 conn(0x7fe6e406bcc0 msgr2=0x7fe6e406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:29.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 shutdown_connections 2024-09-12T02:59:29.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.556+0000 7fe6ec200640 1 -- 172.21.15.63:0/973864204 wait complete. 2024-09-12T02:59:29.580 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T02:59:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.716+0000 7f0ce7000640 1 Processor -- start 2024-09-12T02:59:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.716+0000 7f0ce7000640 1 -- start start 2024-09-12T02:59:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0ce7000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ce006dfb0 0x7f0ce00c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0ce7000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ce01515b0 con 0x7f0ce01511d0 2024-09-12T02:59:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0ce7000640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ce015a760 con 0x7f0ce006cec0 2024-09-12T02:59:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0ce7000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce015b2e0 con 0x7f0ce006dfb0 2024-09-12T02:59:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdfe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0ce01511d0 0x7f0ce00c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57636/0 (socket says 172.21.15.63:57636) 2024-09-12T02:59:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdfe00640 1 -- 172.21.15.63:0/2874005927 learned_addr learned my addr 172.21.15.63:0/2874005927 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdf400640 1 --2- 172.21.15.63:0/2874005927 >> v2:172.21.15.119:3300/0 conn(0x7f0ce006dfb0 0x7f0ce00c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3449791864 0 0) 0x7f0ce01515b0 con 0x7f0ce01511d0 2024-09-12T02:59:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cc4003530 con 0x7f0ce01511d0 2024-09-12T02:59:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4205714472 0 0) 0x7f0ce015a760 con 0x7f0ce006cec0 2024-09-12T02:59:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ce01515b0 con 0x7f0ce006cec0 2024-09-12T02:59:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 895563366 0 0) 0x7f0cc4003530 con 0x7f0ce01511d0 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 >> v2:172.21.15.119:3300/0 conn(0x7f0ce006dfb0 msgr2=0x7f0ce00c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 --2- 172.21.15.63:0/2874005927 >> v2:172.21.15.119:3300/0 conn(0x7f0ce006dfb0 0x7f0ce00c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 >> v1:172.21.15.119:6789/0 conn(0x7f0ce006cec0 legacy=0x7f0ce0161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce015aa40 con 0x7f0ce01511d0 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f0cd0001680 con 0x7f0ce01511d0 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 >> v1:172.21.15.63:6789/0 conn(0x7f0ce01511d0 legacy=0x7f0ce00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4003b50 0x7f0cc4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc4004810 0x7f0cc4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc40051d0 0x7f0cc400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce015b2e0 con 0x7f0cc4003b50 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc400c050 con 0x7f0cc40051d0 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc400c250 con 0x7f0cc4004810 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdfe00640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4003b50 0x7f0cc4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0ce5000640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc40051d0 0x7f0cc400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdf400640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc4004810 0x7f0cc4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdfe00640 1 -- 172.21.15.63:0/2874005927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc4004810 msgr2=0x7f0cc4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdfe00640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cc4004810 0x7f0cc4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdfe00640 1 -- 172.21.15.63:0/2874005927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc40051d0 msgr2=0x7f0cc400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdfe00640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc40051d0 0x7f0cc400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0ce5000640 1 -- 172.21.15.63:0/2874005927 reap_dead start 2024-09-12T02:59:29.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.720+0000 7f0cdfe00640 1 -- 172.21.15.63:0/2874005927 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc4003530 con 0x7f0cc4003b50 2024-09-12T02:59:29.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0cdfe00640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4003b50 0x7f0cc4003f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000c1c0 tx=0x7f0cd001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8b25aef484e44c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0007cf0 con 0x7f0cc4003b50 2024-09-12T02:59:29.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd00a9020 con 0x7f0cc4003b50 2024-09-12T02:59:29.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0cdea00640 1 -- 172.21.15.63:0/2874005927 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0005ae0 con 0x7f0cc4003b50 2024-09-12T02:59:29.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0ce7000640 1 -- 172.21.15.63:0/2874005927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4003b50 msgr2=0x7f0cc4003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0ce7000640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4003b50 0x7f0cc4003f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000c1c0 tx=0x7f0cd001cc20 comp rx=0 tx=0).stop 2024-09-12T02:59:29.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0ce7000640 1 -- 172.21.15.63:0/2874005927 shutdown_connections 2024-09-12T02:59:29.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0ce7000640 1 --2- 172.21.15.63:0/2874005927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc4003b50 0x7f0cc4003f50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0ce7000640 1 -- 172.21.15.63:0/2874005927 >> 172.21.15.63:0/2874005927 conn(0x7f0ce006f3d0 msgr2=0x7f0ce006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:29.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0ce7000640 1 -- 172.21.15.63:0/2874005927 shutdown_connections 2024-09-12T02:59:29.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.724+0000 7f0ce7000640 1 -- 172.21.15.63:0/2874005927 wait complete. 2024-09-12T02:59:29.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 Processor -- start 2024-09-12T02:59:29.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 -- start start 2024-09-12T02:59:29.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc4003b50 0x7f0ce0153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01f5300 0x7f0ce00cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ce00c3c60 0x7f0ce00c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce00c0f90 con 0x7f0ce01f5300 2024-09-12T02:59:29.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce015a400 con 0x7f0cc4003b50 2024-09-12T02:59:29.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce00c1110 con 0x7f0ce00c3c60 2024-09-12T02:59:29.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdf400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01f5300 0x7f0ce00cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdf400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01f5300 0x7f0ce00cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42524/0 (socket says 172.21.15.63:42524) 2024-09-12T02:59:29.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdf400640 1 -- 172.21.15.63:0/3041755049 learned_addr learned my addr 172.21.15.63:0/3041755049 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:29.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdfe00640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc4003b50 0x7f0ce0153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce5000640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ce00c3c60 0x7f0ce00c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdf400640 1 -- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ce00c3c60 msgr2=0x7f0ce00c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdf400640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ce00c3c60 0x7f0ce00c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdf400640 1 -- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc4003b50 msgr2=0x7f0ce0153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdf400640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc4003b50 0x7f0ce0153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdf400640 1 -- 172.21.15.63:0/3041755049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce01545d0 con 0x7f0ce01f5300 2024-09-12T02:59:29.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce5000640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ce00c3c60 0x7f0ce00c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:29.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cdf400640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01f5300 0x7f0ce00cb100 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc010a20 tx=0x7f0ccc010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cd7e00640 1 -- 172.21.15.63:0/3041755049 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc00b040 con 0x7f0ce01f5300 2024-09-12T02:59:29.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cd7e00640 1 -- 172.21.15.63:0/3041755049 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ccc00ecc0 con 0x7f0ce01f5300 2024-09-12T02:59:29.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0cd7e00640 1 -- 172.21.15.63:0/3041755049 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc012670 con 0x7f0ce01f5300 2024-09-12T02:59:29.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce01f1650 con 0x7f0ce01f5300 2024-09-12T02:59:29.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce01f1c10 con 0x7f0ce01f5300 2024-09-12T02:59:29.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.728+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce015a760 con 0x7f0ce01f5300 2024-09-12T02:59:29.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.732+0000 7f0cd7e00640 1 -- 172.21.15.63:0/3041755049 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ccc012810 con 0x7f0ce01f5300 2024-09-12T02:59:29.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.732+0000 7f0cd7e00640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0cc00678f0 0x7f0cc0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.732+0000 7f0cd7e00640 1 -- 172.21.15.63:0/3041755049 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f0ccc0869c0 con 0x7f0ce01f5300 2024-09-12T02:59:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.732+0000 7f0cdfe00640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0cc00678f0 0x7f0cc0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.732+0000 7f0cdfe00640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0cc00678f0 0x7f0cc0069db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00aa000 tx=0x7f0cd00b0040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.736+0000 7f0cd7e00640 1 -- 172.21.15.63:0/3041755049 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ccc057070 con 0x7f0ce01f5300 2024-09-12T02:59:29.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0ce00c8780 con 0x7f0cc00678f0 2024-09-12T02:59:29.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0cd7e00640 1 -- 172.21.15.63:0/3041755049 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0ce00c8780 con 0x7f0cc00678f0 2024-09-12T02:59:29.919 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T02:59:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0cc00678f0 msgr2=0x7f0cc0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0cc00678f0 0x7f0cc0069db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00aa000 tx=0x7f0cd00b0040 comp rx=0 tx=0).stop 2024-09-12T02:59:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01f5300 msgr2=0x7f0ce00cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01f5300 0x7f0ce00cb100 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc010a20 tx=0x7f0ccc010ee0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 shutdown_connections 2024-09-12T02:59:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f0cc00678f0 0x7f0cc0069db0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ce00c3c60 0x7f0ce00c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ce01f5300 0x7f0ce00cb100 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 --2- 172.21.15.63:0/3041755049 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cc4003b50 0x7f0ce0153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:29.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 >> 172.21.15.63:0/3041755049 conn(0x7f0ce006f3d0 msgr2=0x7f0ce0072c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:29.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 shutdown_connections 2024-09-12T02:59:29.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:29.916+0000 7f0ce7000640 1 -- 172.21.15.63:0/3041755049 wait complete. 2024-09-12T02:59:29.940 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T02:59:29.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:59:30.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.084+0000 7ff7f2600640 1 Processor -- start 2024-09-12T02:59:30.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.084+0000 7ff7f2600640 1 -- start start 2024-09-12T02:59:30.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7f2600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7ec0b0b00 0x7ff7ec06f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7f2600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7ec0c8c10 0x7ff7ec06fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7f2600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ec15ca10 con 0x7ff7ec1528a0 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7f2600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff7ec15be70 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7f2600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec15bb20 con 0x7ff7ec0c8c10 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7e3e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7ec0b0b00 0x7ff7ec06f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7f1200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff7ec1528a0 0x7ff7ec15c300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57652/0 (socket says 172.21.15.63:57652) 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7f1200640 1 -- 172.21.15.63:0/4058538759 learned_addr learned my addr 172.21.15.63:0/4058538759 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7f1c00640 1 --2- 172.21.15.63:0/4058538759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7ec0c8c10 0x7ff7ec06fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7e3e00640 1 -- 172.21.15.63:0/4058538759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7ec0c8c10 msgr2=0x7ff7ec06fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7e3e00640 1 --2- 172.21.15.63:0/4058538759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7ec0c8c10 0x7ff7ec06fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7e3e00640 1 -- 172.21.15.63:0/4058538759 >> v1:172.21.15.63:6789/0 conn(0x7ff7ec1528a0 legacy=0x7ff7ec15c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.088+0000 7ff7e3e00640 1 -- 172.21.15.63:0/4058538759 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec0c3650 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7e3e00640 1 --2- 172.21.15.63:0/4058538759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 0x7ff7ec06f680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40097c0 tx=0x7ff7d401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f7c2172df39b9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7ebe00640 1 -- 172.21.15.63:0/4058538759 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40b5070 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7ebe00640 1 -- 172.21.15.63:0/4058538759 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d40a8990 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7ebe00640 1 -- 172.21.15.63:0/4058538759 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d40a8d60 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 -- 172.21.15.63:0/4058538759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 msgr2=0x7ff7ec06f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 --2- 172.21.15.63:0/4058538759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 0x7ff7ec06f680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40097c0 tx=0x7ff7d401ec90 comp rx=0 tx=0).stop 2024-09-12T02:59:30.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 -- 172.21.15.63:0/4058538759 shutdown_connections 2024-09-12T02:59:30.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 --2- 172.21.15.63:0/4058538759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7ec0c8c10 0x7ff7ec06fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 --2- 172.21.15.63:0/4058538759 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 0x7ff7ec06f680 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 -- 172.21.15.63:0/4058538759 >> 172.21.15.63:0/4058538759 conn(0x7ff7ec06c2c0 msgr2=0x7ff7ec073930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:30.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 -- 172.21.15.63:0/4058538759 shutdown_connections 2024-09-12T02:59:30.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 -- 172.21.15.63:0/4058538759 wait complete. 2024-09-12T02:59:30.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 Processor -- start 2024-09-12T02:59:30.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.092+0000 7ff7f2600640 1 -- start start 2024-09-12T02:59:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f2600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 0x7ff7ec0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f2600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7ec0c8c10 0x7ff7ec1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f2600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec1528a0 0x7ff7ec14e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f2600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec152c80 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f2600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0c5310 con 0x7ff7ec1528a0 2024-09-12T02:59:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f2600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec0c4d30 con 0x7ff7ec0c8c10 2024-09-12T02:59:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 0x7ff7ec0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 0x7ff7ec0c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42552/0 (socket says 172.21.15.63:42552) 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1200640 1 -- 172.21.15.63:0/1171538576 learned_addr learned my addr 172.21.15.63:0/1171538576 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7e3e00640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7ec0c8c10 0x7ff7ec1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1c00640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec1528a0 0x7ff7ec14e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1200640 1 -- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7ec0c8c10 msgr2=0x7ff7ec1f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1200640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff7ec0c8c10 0x7ff7ec1f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1200640 1 -- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec1528a0 msgr2=0x7ff7ec14e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1200640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec1528a0 0x7ff7ec14e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1200640 1 -- 172.21.15.63:0/1171538576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec0c9680 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f1200640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 0x7ff7ec0c6b80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c420 tx=0x7ff7dc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7e9600640 1 -- 172.21.15.63:0/1171538576 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc017070 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7e9600640 1 -- 172.21.15.63:0/1171538576 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc005cf0 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7e9600640 1 -- 172.21.15.63:0/1171538576 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc0072f0 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec0c9940 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec0c9f00 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7ec1f1fb0 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.096+0000 7ff7e9600640 1 -- 172.21.15.63:0/1171538576 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7dc01a070 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7e9600640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7c80678c0 0x7ff7c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7e9600640 1 -- 172.21.15.63:0/1171538576 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7ff7dc085500 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7e9600640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff7c8071250 0x7ff7c80736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7e9600640 1 -- 172.21.15.63:0/1171538576 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7c8073dc0 con 0x7ff7c8071250 2024-09-12T02:59:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7e9600640 1 -- 172.21.15.63:0/1171538576 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7ff7dc08c050 con 0x7ff7ec0b0b00 2024-09-12T02:59:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7e3e00640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7c80678c0 0x7ff7c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7f1c00640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff7c8071250 0x7ff7c80736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7f1c00640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff7c8071250 0x7ff7c80736f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7e3e00640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7c80678c0 0x7ff7c8069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40b2000 tx=0x7ff7d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.100+0000 7ff7e9600640 1 -- 172.21.15.63:0/1171538576 <== osd.2 v2:172.21.15.63:6816/4130213561 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7c8073dc0 con 0x7ff7c8071250 2024-09-12T02:59:30.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.112+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 --> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff7ec0cf060 con 0x7ff7c8071250 2024-09-12T02:59:30.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.112+0000 7ff7e9600640 1 -- 172.21.15.63:0/1171538576 <== osd.2 v2:172.21.15.63:6816/4130213561 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff7ec0cf060 con 0x7ff7c8071250 2024-09-12T02:59:30.118 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:59:30.118 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:59:30.119 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:59:30.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff7c8071250 msgr2=0x7ff7c80736f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.63:6816/4130213561,v1:172.21.15.63:6817/4130213561] conn(0x7ff7c8071250 0x7ff7c80736f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7c80678c0 msgr2=0x7ff7c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7c80678c0 0x7ff7c8069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40b2000 tx=0x7ff7d4008040 comp rx=0 tx=0).stop 2024-09-12T02:59:30.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 msgr2=0x7ff7ec0c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 --2- 172.21.15.63:0/1171538576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7ec0b0b00 0x7ff7ec0c6b80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00c420 tx=0x7ff7dc00c8e0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f1c00640 1 -- 172.21.15.63:0/1171538576 reap_dead start 2024-09-12T02:59:30.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 shutdown_connections 2024-09-12T02:59:30.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 >> 172.21.15.63:0/1171538576 conn(0x7ff7ec06c2c0 msgr2=0x7ff7ec06f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:30.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 shutdown_connections 2024-09-12T02:59:30.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.116+0000 7ff7f2600640 1 -- 172.21.15.63:0/1171538576 wait complete. 2024-09-12T02:59:30.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T02:59:30.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec7d600640 1 Processor -- start 2024-09-12T02:59:30.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec7d600640 1 -- start start 2024-09-12T02:59:30.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec7d600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fec7806bd30 0x7fec780cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec7d600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fec780cdbc0 0x7fec7815e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec7d600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec7815aa60 con 0x7fec78154a80 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec7d600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fec780ce050 con 0x7fec780cdbc0 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec7d600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fec7815b880 con 0x7fec7806bd30 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec77400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fec780cdbc0 0x7fec7815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec77400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fec780cdbc0 0x7fec7815e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42568/0 (socket says 172.21.15.63:42568) 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec76a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fec78154a80 0x7fec7806ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57668/0 (socket says 172.21.15.63:57668) 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec77400640 1 -- 172.21.15.63:0/212163327 learned_addr learned my addr 172.21.15.63:0/212163327 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec76000640 1 --2- 172.21.15.63:0/212163327 >> v2:172.21.15.119:3300/0 conn(0x7fec7806bd30 0x7fec780cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec77400640 1 -- 172.21.15.63:0/212163327 >> v2:172.21.15.119:3300/0 conn(0x7fec7806bd30 msgr2=0x7fec780cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec77400640 1 --2- 172.21.15.63:0/212163327 >> v2:172.21.15.119:3300/0 conn(0x7fec7806bd30 0x7fec780cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec77400640 1 -- 172.21.15.63:0/212163327 >> v1:172.21.15.63:6789/0 conn(0x7fec78154a80 legacy=0x7fec7806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.276+0000 7fec77400640 1 -- 172.21.15.63:0/212163327 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7815ad00 con 0x7fec780cdbc0 2024-09-12T02:59:30.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec77400640 1 --2- 172.21.15.63:0/212163327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 0x7fec7815e220 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fec7806cda0 tx=0x7fec7001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d984d3625893f195 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec75600640 1 -- 172.21.15.63:0/212163327 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec700a5880 con 0x7fec780cdbc0 2024-09-12T02:59:30.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec75600640 1 -- 172.21.15.63:0/212163327 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec700a5a20 con 0x7fec780cdbc0 2024-09-12T02:59:30.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec75600640 1 -- 172.21.15.63:0/212163327 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec700a5df0 con 0x7fec780cdbc0 2024-09-12T02:59:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec7d600640 1 -- 172.21.15.63:0/212163327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 msgr2=0x7fec7815e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec7d600640 1 --2- 172.21.15.63:0/212163327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 0x7fec7815e220 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fec7806cda0 tx=0x7fec7001c9c0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec7d600640 1 -- 172.21.15.63:0/212163327 shutdown_connections 2024-09-12T02:59:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec7d600640 1 --2- 172.21.15.63:0/212163327 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 0x7fec7815e220 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec7d600640 1 --2- 172.21.15.63:0/212163327 >> v2:172.21.15.119:3300/0 conn(0x7fec7806bd30 0x7fec780cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec7d600640 1 -- 172.21.15.63:0/212163327 >> 172.21.15.63:0/212163327 conn(0x7fec78072960 msgr2=0x7fec78072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:30.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec7d600640 1 -- 172.21.15.63:0/212163327 shutdown_connections 2024-09-12T02:59:30.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec7d600640 1 -- 172.21.15.63:0/212163327 wait complete. 2024-09-12T02:59:30.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.280+0000 7fec7d600640 1 Processor -- start 2024-09-12T02:59:30.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 -- start start 2024-09-12T02:59:30.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7806bd30 0x7fec78146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 0x7fec781f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec78154a80 0x7fec781449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fec7806f2c0 con 0x7fec780cdbc0 2024-09-12T02:59:30.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fec7815eb70 con 0x7fec78154a80 2024-09-12T02:59:30.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fec7806f440 con 0x7fec7806bd30 2024-09-12T02:59:30.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 0x7fec781f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 0x7fec781f7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42576/0 (socket says 172.21.15.63:42576) 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76000640 1 -- 172.21.15.63:0/548375623 learned_addr learned my addr 172.21.15.63:0/548375623 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76a00640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7806bd30 0x7fec78146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec77400640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec78154a80 0x7fec781449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76000640 1 -- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7806bd30 msgr2=0x7fec78146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76000640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7806bd30 0x7fec78146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76000640 1 -- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec78154a80 msgr2=0x7fec781449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76000640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec78154a80 0x7fec781449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76000640 1 -- 172.21.15.63:0/548375623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec78148b30 con 0x7fec780cdbc0 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec76000640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 0x7fec781f7330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fec6400d5f0 tx=0x7fec6400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec6ea00640 1 -- 172.21.15.63:0/548375623 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec640125f0 con 0x7fec780cdbc0 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec6ea00640 1 -- 172.21.15.63:0/548375623 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec64019070 con 0x7fec780cdbc0 2024-09-12T02:59:30.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec6ea00640 1 -- 172.21.15.63:0/548375623 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec640129b0 con 0x7fec780cdbc0 2024-09-12T02:59:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec78150c30 con 0x7fec780cdbc0 2024-09-12T02:59:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec781490b0 con 0x7fec780cdbc0 2024-09-12T02:59:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.284+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec781492f0 con 0x7fec780cdbc0 2024-09-12T02:59:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.288+0000 7fec6ea00640 1 -- 172.21.15.63:0/548375623 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec64012b50 con 0x7fec780cdbc0 2024-09-12T02:59:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.288+0000 7fec6ea00640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fec580678f0 0x7fec58069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.288+0000 7fec6ea00640 1 -- 172.21.15.63:0/548375623 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7fec64086360 con 0x7fec780cdbc0 2024-09-12T02:59:30.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.288+0000 7fec76a00640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fec580678f0 0x7fec58069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.288+0000 7fec76a00640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fec580678f0 0x7fec58069db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fec68000f70 tx=0x7fec68007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.292+0000 7fec6ea00640 1 -- 172.21.15.63:0/548375623 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec781492f0 con 0x7fec780cdbc0 2024-09-12T02:59:30.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.456+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fec78154e60 con 0x7fec580678f0 2024-09-12T02:59:30.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.456+0000 7fec6ea00640 1 -- 172.21.15.63:0/548375623 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fec78154e60 con 0x7fec580678f0 2024-09-12T02:59:30.462 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T02:59:30.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fec580678f0 msgr2=0x7fec58069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fec580678f0 0x7fec58069db0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fec68000f70 tx=0x7fec68007e90 comp rx=0 tx=0).stop 2024-09-12T02:59:30.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 msgr2=0x7fec781f7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 0x7fec781f7330 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fec6400d5f0 tx=0x7fec6400dab0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 shutdown_connections 2024-09-12T02:59:30.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec78154a80 0x7fec781449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec780cdbc0 0x7fec781f7330 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fec580678f0 0x7fec58069db0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 --2- 172.21.15.63:0/548375623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec7806bd30 0x7fec78146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 >> 172.21.15.63:0/548375623 conn(0x7fec78072960 msgr2=0x7fec780c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:30.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 shutdown_connections 2024-09-12T02:59:30.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.460+0000 7fec7d600640 1 -- 172.21.15.63:0/548375623 wait complete. 2024-09-12T02:59:30.484 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T02:59:30.484 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:59:30.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.624+0000 7f6b31a00640 1 Processor -- start 2024-09-12T02:59:30.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.624+0000 7f6b31a00640 1 -- start start 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b31a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c0c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b31a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b2c0c6410 0x7f6b2c1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b31a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b2c0c5d10 con 0x7f6b2c152bf0 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b31a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f6b2c0c6b90 con 0x7f6b2c0c6410 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b31a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2c158e10 con 0x7f6b2c152810 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b2aa00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c0c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b2b400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6b2c0c6410 0x7f6b2c1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b2aa00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c0c3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:52122/0 (socket says 172.21.15.63:52122) 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b2aa00640 1 -- 172.21.15.63:0/3993620617 learned_addr learned my addr 172.21.15.63:0/3993620617 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:30.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b22000640 1 --1- 172.21.15.63:0/3993620617 >> v1:172.21.15.119:6789/0 conn(0x7f6b2c152bf0 0x7f6b2c06f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:60816/0 (socket says 172.21.15.63:60816) 2024-09-12T02:59:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b2b400640 1 -- 172.21.15.63:0/3993620617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 msgr2=0x7f6b2c0c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b2b400640 1 --2- 172.21.15.63:0/3993620617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c0c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b2b400640 1 -- 172.21.15.63:0/3993620617 >> v1:172.21.15.119:6789/0 conn(0x7f6b2c152bf0 legacy=0x7f6b2c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b2b400640 1 -- 172.21.15.63:0/3993620617 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c0c3a10 con 0x7f6b2c0c6410 2024-09-12T02:59:30.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.628+0000 7f6b2aa00640 1 --2- 172.21.15.63:0/3993620617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c0c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:59:30.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b2b400640 1 --2- 172.21.15.63:0/3993620617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b2c0c6410 0x7f6b2c1592a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009d90 tx=0x7f6b2401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a94ded74d10bfc07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b2a000640 1 -- 172.21.15.63:0/3993620617 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b240b4070 con 0x7f6b2c0c6410 2024-09-12T02:59:30.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b2a000640 1 -- 172.21.15.63:0/3993620617 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b240af600 con 0x7f6b2c0c6410 2024-09-12T02:59:30.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b2a000640 1 -- 172.21.15.63:0/3993620617 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b240af9d0 con 0x7f6b2c0c6410 2024-09-12T02:59:30.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 -- 172.21.15.63:0/3993620617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b2c0c6410 msgr2=0x7f6b2c1592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 --2- 172.21.15.63:0/3993620617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b2c0c6410 0x7f6b2c1592a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6b24009d90 tx=0x7f6b2401f150 comp rx=0 tx=0).stop 2024-09-12T02:59:30.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 -- 172.21.15.63:0/3993620617 shutdown_connections 2024-09-12T02:59:30.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 --2- 172.21.15.63:0/3993620617 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b2c0c6410 0x7f6b2c1592a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 --2- 172.21.15.63:0/3993620617 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c0c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 -- 172.21.15.63:0/3993620617 >> 172.21.15.63:0/3993620617 conn(0x7f6b2c06bcc0 msgr2=0x7f6b2c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:30.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 -- 172.21.15.63:0/3993620617 shutdown_connections 2024-09-12T02:59:30.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 -- 172.21.15.63:0/3993620617 wait complete. 2024-09-12T02:59:30.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 Processor -- start 2024-09-12T02:59:30.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.632+0000 7f6b31a00640 1 -- start start 2024-09-12T02:59:30.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b31a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b2c0c6410 0x7f6b2c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b31a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b31a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b2c152bf0 0x7f6b2c071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b31a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c158aa0 con 0x7f6b2c0c6410 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b31a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c0c70c0 con 0x7f6b2c152bf0 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b31a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2c158750 con 0x7f6b2c152810 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b2c0c6410 0x7f6b2c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b2c0c6410 0x7f6b2c15a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42586/0 (socket says 172.21.15.63:42586) 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2aa00640 1 -- 172.21.15.63:0/1645394307 learned_addr learned my addr 172.21.15.63:0/1645394307 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b22000640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2b400640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b2c152bf0 0x7f6b2c071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2aa00640 1 -- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 msgr2=0x7f6b2c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2aa00640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2aa00640 1 -- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b2c152bf0 msgr2=0x7f6b2c071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2aa00640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b2c152bf0 0x7f6b2c071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2aa00640 1 -- 172.21.15.63:0/1645394307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c1f06d0 con 0x7f6b2c0c6410 2024-09-12T02:59:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b22000640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6b2c152810 0x7f6b2c15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b2aa00640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b2c0c6410 0x7f6b2c15a550 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00ea00 tx=0x7f6b1c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b23400640 1 -- 172.21.15.63:0/1645394307 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c017070 con 0x7f6b2c0c6410 2024-09-12T02:59:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b23400640 1 -- 172.21.15.63:0/1645394307 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1c00ca60 con 0x7f6b2c0c6410 2024-09-12T02:59:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b23400640 1 -- 172.21.15.63:0/1645394307 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00ce10 con 0x7f6b2c0c6410 2024-09-12T02:59:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2c159790 con 0x7f6b2c0c6410 2024-09-12T02:59:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2c159d50 con 0x7f6b2c0c6410 2024-09-12T02:59:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b2c159540 con 0x7f6b2c0c6410 2024-09-12T02:59:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.636+0000 7f6b23400640 1 -- 172.21.15.63:0/1645394307 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b1c01a070 con 0x7f6b2c0c6410 2024-09-12T02:59:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b23400640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b080678c0 0x7f6b08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b23400640 1 -- 172.21.15.63:0/1645394307 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f6b1c0864f0 con 0x7f6b2c0c6410 2024-09-12T02:59:30.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b23400640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b08071250 0x7f6b080736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b23400640 1 -- 172.21.15.63:0/1645394307 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b08073dc0 con 0x7f6b08071250 2024-09-12T02:59:30.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b23400640 1 -- 172.21.15.63:0/1645394307 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f6b1c08d050 con 0x7f6b2c0c6410 2024-09-12T02:59:30.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b22000640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b080678c0 0x7f6b08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b2b400640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b08071250 0x7f6b080736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b22000640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b080678c0 0x7f6b08069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0c85b0 tx=0x7f6b14007d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b2b400640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b08071250 0x7f6b080736f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.640+0000 7f6b23400640 1 -- 172.21.15.63:0/1645394307 <== osd.3 v2:172.21.15.63:6808/2574114576 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b08073dc0 con 0x7f6b08071250 2024-09-12T02:59:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.652+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 --> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6b2c0c3690 con 0x7f6b08071250 2024-09-12T02:59:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.652+0000 7f6b23400640 1 -- 172.21.15.63:0/1645394307 <== osd.3 v2:172.21.15.63:6808/2574114576 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6b2c0c3690 con 0x7f6b08071250 2024-09-12T02:59:30.658 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:59:30.658 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:59:30.658 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:59:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.652+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b08071250 msgr2=0x7f6b080736f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.652+0000 7f6b31a00640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.63:6808/2574114576,v1:172.21.15.63:6809/2574114576] conn(0x7f6b08071250 0x7f6b080736f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.652+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b080678c0 msgr2=0x7f6b08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.652+0000 7f6b31a00640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f6b080678c0 0x7f6b08069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0c85b0 tx=0x7f6b14007d70 comp rx=0 tx=0).stop 2024-09-12T02:59:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.656+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b2c0c6410 msgr2=0x7f6b2c15a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.656+0000 7f6b31a00640 1 --2- 172.21.15.63:0/1645394307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b2c0c6410 0x7f6b2c15a550 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00ea00 tx=0x7f6b1c00eec0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.656+0000 7f6b2b400640 1 -- 172.21.15.63:0/1645394307 reap_dead start 2024-09-12T02:59:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.656+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 shutdown_connections 2024-09-12T02:59:30.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.656+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 >> 172.21.15.63:0/1645394307 conn(0x7f6b2c06bcc0 msgr2=0x7f6b2c157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:30.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.656+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 shutdown_connections 2024-09-12T02:59:30.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.656+0000 7f6b31a00640 1 -- 172.21.15.63:0/1645394307 wait complete. 2024-09-12T02:59:30.676 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T02:59:30.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e55000640 1 Processor -- start 2024-09-12T02:59:30.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e55000640 1 -- start start 2024-09-12T02:59:30.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e55000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 0x7f7e500ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e55000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e5006f1f0 0x7f7e500c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e55000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7e5015bcc0 0x7f7e50152440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e55000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7e500ca960 con 0x7f7e5015bcc0 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e55000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7e500c98a0 con 0x7f7e5006f1f0 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e55000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7e500cdf90 con 0x7f7e5006ee10 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e4e800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7e5015bcc0 0x7f7e50152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e4e800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7e5015bcc0 0x7f7e50152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42594/0 (socket says 172.21.15.63:42594) 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e4e800640 1 -- 172.21.15.63:0/1701338602 learned_addr learned my addr 172.21.15.63:0/1701338602 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e4de00640 1 --2- 172.21.15.63:0/1701338602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 0x7f7e500ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e45400640 1 --2- 172.21.15.63:0/1701338602 >> v2:172.21.15.119:3300/0 conn(0x7f7e5006f1f0 0x7f7e500c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e4e800640 1 -- 172.21.15.63:0/1701338602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 msgr2=0x7f7e500ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e4e800640 1 --2- 172.21.15.63:0/1701338602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 0x7f7e500ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e4e800640 1 -- 172.21.15.63:0/1701338602 >> v2:172.21.15.119:3300/0 conn(0x7f7e5006f1f0 msgr2=0x7f7e500c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e4e800640 1 --2- 172.21.15.63:0/1701338602 >> v2:172.21.15.119:3300/0 conn(0x7f7e5006f1f0 0x7f7e500c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.816+0000 7f7e4e800640 1 -- 172.21.15.63:0/1701338602 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e500c9cd0 con 0x7f7e5015bcc0 2024-09-12T02:59:30.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e4e800640 1 --2- 172.21.15.63:0/1701338602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 0x7f7e50152440 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7e500c6940 tx=0x7f7e4801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b559fcaa78510fff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e4d400640 1 -- 172.21.15.63:0/1701338602 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480b0070 con 0x7f7e5015bcc0 2024-09-12T02:59:30.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e4d400640 1 -- 172.21.15.63:0/1701338602 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e480ab600 con 0x7f7e5015bcc0 2024-09-12T02:59:30.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e4d400640 1 -- 172.21.15.63:0/1701338602 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480a4e60 con 0x7f7e5015bcc0 2024-09-12T02:59:30.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 -- 172.21.15.63:0/1701338602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 msgr2=0x7f7e50152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 --2- 172.21.15.63:0/1701338602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 0x7f7e50152440 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7e500c6940 tx=0x7f7e4801c520 comp rx=0 tx=0).stop 2024-09-12T02:59:30.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 -- 172.21.15.63:0/1701338602 shutdown_connections 2024-09-12T02:59:30.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 --2- 172.21.15.63:0/1701338602 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 0x7f7e50152440 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 --2- 172.21.15.63:0/1701338602 >> v2:172.21.15.119:3300/0 conn(0x7f7e5006f1f0 0x7f7e500c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 --2- 172.21.15.63:0/1701338602 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 0x7f7e500ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 -- 172.21.15.63:0/1701338602 >> 172.21.15.63:0/1701338602 conn(0x7f7e50072960 msgr2=0x7f7e50072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 -- 172.21.15.63:0/1701338602 shutdown_connections 2024-09-12T02:59:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 -- 172.21.15.63:0/1701338602 wait complete. 2024-09-12T02:59:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 Processor -- start 2024-09-12T02:59:30.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.820+0000 7f7e55000640 1 -- start start 2024-09-12T02:59:30.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e55000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 0x7f7e50142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e55000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e5006f1f0 0x7f7e50145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e55000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 0x7f7e500c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e55000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7e500c8160 con 0x7f7e5015bcc0 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e55000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7e500c7fe0 con 0x7f7e5006f1f0 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e55000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7e50070d30 con 0x7f7e5006ee10 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 0x7f7e500c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 0x7f7e500c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42600/0 (socket says 172.21.15.63:42600) 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4e800640 1 -- 172.21.15.63:0/2706347877 learned_addr learned my addr 172.21.15.63:0/2706347877 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e45400640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e5006f1f0 0x7f7e50145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4de00640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 0x7f7e50142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4e800640 1 -- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 msgr2=0x7f7e50142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4e800640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 0x7f7e50142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4e800640 1 -- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e5006f1f0 msgr2=0x7f7e50145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4e800640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e5006f1f0 0x7f7e50145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:30.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4e800640 1 -- 172.21.15.63:0/2706347877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e500c7450 con 0x7f7e5015bcc0 2024-09-12T02:59:30.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e4e800640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 0x7f7e500c5750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7e4801cdc0 tx=0x7f7e480192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e46a00640 1 -- 172.21.15.63:0/2706347877 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480ba070 con 0x7f7e5015bcc0 2024-09-12T02:59:30.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e46a00640 1 -- 172.21.15.63:0/2706347877 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e480a4e60 con 0x7f7e5015bcc0 2024-09-12T02:59:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e501409a0 con 0x7f7e5015bcc0 2024-09-12T02:59:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e46a00640 1 -- 172.21.15.63:0/2706347877 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480b0040 con 0x7f7e5015bcc0 2024-09-12T02:59:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e50140c40 con 0x7f7e5015bcc0 2024-09-12T02:59:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e500711b0 con 0x7f7e5015bcc0 2024-09-12T02:59:30.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.824+0000 7f7e46a00640 1 -- 172.21.15.63:0/2706347877 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e480bd070 con 0x7f7e5015bcc0 2024-09-12T02:59:30.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.828+0000 7f7e46a00640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7e2c0678c0 0x7f7e2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:30.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.828+0000 7f7e46a00640 1 -- 172.21.15.63:0/2706347877 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f7e4811f1f0 con 0x7f7e5015bcc0 2024-09-12T02:59:30.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.828+0000 7f7e4de00640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7e2c0678c0 0x7f7e2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:30.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.828+0000 7f7e4de00640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7e2c0678c0 0x7f7e2c069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e400074a0 tx=0x7f7e4000d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:30.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:30.832+0000 7f7e46a00640 1 -- 172.21.15.63:0/2706347877 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7e48016110 con 0x7f7e5015bcc0 2024-09-12T02:59:31.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.000+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f7e501473f0 con 0x7f7e2c0678c0 2024-09-12T02:59:31.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e46a00640 1 -- 172.21.15.63:0/2706347877 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7e501473f0 con 0x7f7e2c0678c0 2024-09-12T02:59:31.006 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7e2c0678c0 msgr2=0x7f7e2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7e2c0678c0 0x7f7e2c069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e400074a0 tx=0x7f7e4000d040 comp rx=0 tx=0).stop 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 msgr2=0x7f7e500c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 0x7f7e500c5750 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7e4801cdc0 tx=0x7f7e480192c0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 shutdown_connections 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7e5015bcc0 0x7f7e500c5750 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e5006f1f0 0x7f7e50145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7e2c0678c0 0x7f7e2c069d80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 --2- 172.21.15.63:0/2706347877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e5006ee10 0x7f7e50142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 >> 172.21.15.63:0/2706347877 conn(0x7f7e50072960 msgr2=0x7f7e50072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 shutdown_connections 2024-09-12T02:59:31.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.004+0000 7f7e55000640 1 -- 172.21.15.63:0/2706347877 wait complete. 2024-09-12T02:59:31.028 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T02:59:31.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:59:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.168+0000 7feef9a00640 1 Processor -- start 2024-09-12T02:59:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.168+0000 7feef9a00640 1 -- start start 2024-09-12T02:59:31.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef9a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feef4154b20 0x7feef415b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef9a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feef4072490 0x7feef415e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef9a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feef415ded0 con 0x7feef4154f00 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef9a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7feef415eeb0 con 0x7feef4072490 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef9a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7feef40c7c00 con 0x7feef4154b20 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feeea000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7feef4154f00 0x7feef40c6f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57676/0 (socket says 172.21.15.63:57676) 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feeea000640 1 -- 172.21.15.63:0/3653268195 learned_addr learned my addr 172.21.15.63:0/3653268195 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef3400640 1 --2- 172.21.15.63:0/3653268195 >> v2:172.21.15.119:3300/0 conn(0x7feef4072490 0x7feef415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef2a00640 1 --2- 172.21.15.63:0/3653268195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feef4154b20 0x7feef415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef2000640 1 -- 172.21.15.63:0/3653268195 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118076847 0 0) 0x7feef415ded0 con 0x7feef4154f00 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef2000640 1 -- 172.21.15.63:0/3653268195 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feed8003530 con 0x7feef4154f00 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef3400640 1 -- 172.21.15.63:0/3653268195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feef4154b20 msgr2=0x7feef415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef3400640 1 --2- 172.21.15.63:0/3653268195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feef4154b20 0x7feef415b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef3400640 1 -- 172.21.15.63:0/3653268195 >> v1:172.21.15.63:6789/0 conn(0x7feef4154f00 legacy=0x7feef40c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef2000640 1 -- 172.21.15.63:0/3653268195 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4008423772 0 0) 0x7feed8003530 con 0x7feef4154f00 2024-09-12T02:59:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.172+0000 7feef3400640 1 -- 172.21.15.63:0/3653268195 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef40c7ee0 con 0x7feef4072490 2024-09-12T02:59:31.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef3400640 1 --2- 172.21.15.63:0/3653268195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feef4072490 0x7feef415e970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feeec009d90 tx=0x7feeec01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=129de148abeb8d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef2000640 1 -- 172.21.15.63:0/3653268195 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec0b4070 con 0x7feef4072490 2024-09-12T02:59:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef2000640 1 -- 172.21.15.63:0/3653268195 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec0af600 con 0x7feef4072490 2024-09-12T02:59:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef2000640 1 -- 172.21.15.63:0/3653268195 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec0af9b0 con 0x7feef4072490 2024-09-12T02:59:31.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 -- 172.21.15.63:0/3653268195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feef4072490 msgr2=0x7feef415e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 --2- 172.21.15.63:0/3653268195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feef4072490 0x7feef415e970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feeec009d90 tx=0x7feeec01f150 comp rx=0 tx=0).stop 2024-09-12T02:59:31.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 -- 172.21.15.63:0/3653268195 shutdown_connections 2024-09-12T02:59:31.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 --2- 172.21.15.63:0/3653268195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feef4072490 0x7feef415e970 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 --2- 172.21.15.63:0/3653268195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feef4154b20 0x7feef415b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 -- 172.21.15.63:0/3653268195 >> 172.21.15.63:0/3653268195 conn(0x7feef406bcc0 msgr2=0x7feef406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 -- 172.21.15.63:0/3653268195 shutdown_connections 2024-09-12T02:59:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 -- 172.21.15.63:0/3653268195 wait complete. 2024-09-12T02:59:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 Processor -- start 2024-09-12T02:59:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.176+0000 7feef9a00640 1 -- start start 2024-09-12T02:59:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef9a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feef4072490 0x7feef40cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef9a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feef4154b20 0x7feef41520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef9a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feef4154f00 0x7feef41f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef9a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7feef415e450 con 0x7feef4154b20 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef9a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feef415e170 con 0x7feef4154f00 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef9a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7feef40c7630 con 0x7feef4072490 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeea000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feef4154b20 0x7feef41520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeea000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feef4154b20 0x7feef41520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42614/0 (socket says 172.21.15.63:42614) 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeea000640 1 -- 172.21.15.63:0/555350483 learned_addr learned my addr 172.21.15.63:0/555350483 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef2a00640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feef4072490 0x7feef40cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef3400640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feef4154f00 0x7feef41f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeea000640 1 -- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feef4072490 msgr2=0x7feef40cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeea000640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feef4072490 0x7feef40cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeea000640 1 -- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feef4154f00 msgr2=0x7feef41f32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeea000640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feef4154f00 0x7feef41f32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeea000640 1 -- 172.21.15.63:0/555350483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef40c5560 con 0x7feef4154b20 2024-09-12T02:59:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeea000640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feef4154b20 0x7feef41520b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feedc00c410 tx=0x7feedc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeeb400640 1 -- 172.21.15.63:0/555350483 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc017070 con 0x7feef4154b20 2024-09-12T02:59:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeeb400640 1 -- 172.21.15.63:0/555350483 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feedc005cf0 con 0x7feef4154b20 2024-09-12T02:59:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef40cbf20 con 0x7feef4154b20 2024-09-12T02:59:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feeeb400640 1 -- 172.21.15.63:0/555350483 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc0072f0 con 0x7feef4154b20 2024-09-12T02:59:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef415a300 con 0x7feef4154b20 2024-09-12T02:59:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.180+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feef40c62d0 con 0x7feef4154b20 2024-09-12T02:59:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feeeb400640 1 -- 172.21.15.63:0/555350483 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feedc01a070 con 0x7feef4154b20 2024-09-12T02:59:31.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feeeb400640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feed00678c0 0x7feed0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feeeb400640 1 -- 172.21.15.63:0/555350483 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7feedc0854a0 con 0x7feef4154b20 2024-09-12T02:59:31.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feeeb400640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feed0071260 0x7feed0073700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feeeb400640 1 -- 172.21.15.63:0/555350483 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feedc014ec0 con 0x7feed0071260 2024-09-12T02:59:31.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feeeb400640 1 -- 172.21.15.63:0/555350483 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7feedc08c050 con 0x7feef4154b20 2024-09-12T02:59:31.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feef2a00640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feed00678c0 0x7feed0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feef3400640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feed0071260 0x7feed0073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feef2a00640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feed00678c0 0x7feed0069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feee4009b60 tx=0x7feee4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.184+0000 7feef3400640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feed0071260 0x7feed0073700 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.188+0000 7feeeb400640 1 -- 172.21.15.63:0/555350483 <== osd.4 v2:172.21.15.119:6808/946317737 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feedc014ec0 con 0x7feed0071260 2024-09-12T02:59:31.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 --> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feef40c6980 con 0x7feed0071260 2024-09-12T02:59:31.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feeeb400640 1 -- 172.21.15.63:0/555350483 <== osd.4 v2:172.21.15.119:6808/946317737 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feef40c6980 con 0x7feed0071260 2024-09-12T02:59:31.204 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:59:31.204 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:59:31.204 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:59:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feed0071260 msgr2=0x7feed0073700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6808/946317737,v1:172.21.15.119:6809/946317737] conn(0x7feed0071260 0x7feed0073700 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feed00678c0 msgr2=0x7feed0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7feed00678c0 0x7feed0069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7feee4009b60 tx=0x7feee4009190 comp rx=0 tx=0).stop 2024-09-12T02:59:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feef4154b20 msgr2=0x7feef41520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 --2- 172.21.15.63:0/555350483 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feef4154b20 0x7feef41520b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feedc00c410 tx=0x7feedc00c8d0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef3400640 1 -- 172.21.15.63:0/555350483 reap_dead start 2024-09-12T02:59:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 shutdown_connections 2024-09-12T02:59:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 >> 172.21.15.63:0/555350483 conn(0x7feef406bcc0 msgr2=0x7feef4152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 shutdown_connections 2024-09-12T02:59:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.200+0000 7feef9a00640 1 -- 172.21.15.63:0/555350483 wait complete. 2024-09-12T02:59:31.222 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T02:59:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e3200640 1 Processor -- start 2024-09-12T02:59:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e3200640 1 -- start start 2024-09-12T02:59:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e3200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40740b0 0x7f06e4157580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e3200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e406fb90 con 0x7f06e40c8f60 2024-09-12T02:59:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e3200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e4157c10 con 0x7f06e40c8b80 2024-09-12T02:59:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e3200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f06e41584b0 con 0x7f06e40740b0 2024-09-12T02:59:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e2800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f06e40c8f60 0x7f06e41513b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57684/0 (socket says 172.21.15.63:57684) 2024-09-12T02:59:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e2800640 1 -- 172.21.15.63:0/3527589745 learned_addr learned my addr 172.21.15.63:0/3527589745 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:31.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06d9400640 1 --2- 172.21.15.63:0/3527589745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40740b0 0x7f06e4157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e1400640 1 -- 172.21.15.63:0/3527589745 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910103392 0 0) 0x7f06e406fb90 con 0x7f06e40c8f60 2024-09-12T02:59:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.360+0000 7f06e1400640 1 -- 172.21.15.63:0/3527589745 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06c8003530 con 0x7f06e40c8f60 2024-09-12T02:59:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.364+0000 7f06e1400640 1 -- 172.21.15.63:0/3527589745 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151560574 0 0) 0x7f06e4157c10 con 0x7f06e40c8b80 2024-09-12T02:59:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.364+0000 7f06e1400640 1 -- 172.21.15.63:0/3527589745 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06e406fb90 con 0x7f06e40c8b80 2024-09-12T02:59:31.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.364+0000 7f06d9400640 1 -- 172.21.15.63:0/3527589745 >> v1:172.21.15.119:6789/0 conn(0x7f06e40c8b80 legacy=0x7f06e40c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.364+0000 7f06d9400640 1 -- 172.21.15.63:0/3527589745 >> v1:172.21.15.63:6789/0 conn(0x7f06e40c8f60 legacy=0x7f06e41513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.364+0000 7f06d9400640 1 -- 172.21.15.63:0/3527589745 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e4157ef0 con 0x7f06e40740b0 2024-09-12T02:59:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.364+0000 7f06d9400640 1 --2- 172.21.15.63:0/3527589745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40740b0 0x7f06e4157580 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009820 tx=0x7f06cc01ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f1bdcfa20242c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.364+0000 7f06e1400640 1 -- 172.21.15.63:0/3527589745 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0b5070 con 0x7f06e40740b0 2024-09-12T02:59:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.364+0000 7f06e1400640 1 -- 172.21.15.63:0/3527589745 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc0a89b0 con 0x7f06e40740b0 2024-09-12T02:59:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.364+0000 7f06e1400640 1 -- 172.21.15.63:0/3527589745 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0a8d60 con 0x7f06e40740b0 2024-09-12T02:59:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 -- 172.21.15.63:0/3527589745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40740b0 msgr2=0x7f06e4157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 --2- 172.21.15.63:0/3527589745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40740b0 0x7f06e4157580 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009820 tx=0x7f06cc01ecb0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 -- 172.21.15.63:0/3527589745 shutdown_connections 2024-09-12T02:59:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 --2- 172.21.15.63:0/3527589745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40740b0 0x7f06e4157580 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 -- 172.21.15.63:0/3527589745 >> 172.21.15.63:0/3527589745 conn(0x7f06e406d900 msgr2=0x7f06e406f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 -- 172.21.15.63:0/3527589745 shutdown_connections 2024-09-12T02:59:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 -- 172.21.15.63:0/3527589745 wait complete. 2024-09-12T02:59:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 Processor -- start 2024-09-12T02:59:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 -- start start 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06e40740b0 0x7f06e414c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40c8b80 0x7f06e414f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06e40c8f60 0x7f06e40c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40c1310 con 0x7f06e40740b0 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40c1030 con 0x7f06e40c8f60 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e3200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f06e40c21a0 con 0x7f06e40c8b80 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06e40740b0 0x7f06e414c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e1e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06e40740b0 0x7f06e414c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42626/0 (socket says 172.21.15.63:42626) 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e1e00640 1 -- 172.21.15.63:0/3812548499 learned_addr learned my addr 172.21.15.63:0/3812548499 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:31.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06d9400640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40c8b80 0x7f06e414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e2800640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06e40c8f60 0x7f06e40c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e1e00640 1 -- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40c8b80 msgr2=0x7f06e414f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e1e00640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40c8b80 0x7f06e414f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e1e00640 1 -- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06e40c8f60 msgr2=0x7f06e40c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e1e00640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06e40c8f60 0x7f06e40c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e1e00640 1 -- 172.21.15.63:0/3812548499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e414cad0 con 0x7f06e40740b0 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.368+0000 7f06e1e00640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06e40740b0 0x7f06e414c590 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c4c0 tx=0x7f06d400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06daa00640 1 -- 172.21.15.63:0/3812548499 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d40052d0 con 0x7f06e40740b0 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06daa00640 1 -- 172.21.15.63:0/3812548499 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d4005470 con 0x7f06e40740b0 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06daa00640 1 -- 172.21.15.63:0/3812548499 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4012870 con 0x7f06e40740b0 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e4152b50 con 0x7f06e40740b0 2024-09-12T02:59:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e4153c30 con 0x7f06e40740b0 2024-09-12T02:59:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e406fdc0 con 0x7f06e40740b0 2024-09-12T02:59:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06daa00640 1 -- 172.21.15.63:0/3812548499 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f06d4012a10 con 0x7f06e40740b0 2024-09-12T02:59:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06daa00640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06c00678f0 0x7f06c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06daa00640 1 -- 172.21.15.63:0/3812548499 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f06d4085e70 con 0x7f06e40740b0 2024-09-12T02:59:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.372+0000 7f06d9400640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06c00678f0 0x7f06c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.376+0000 7f06d9400640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06c00678f0 0x7f06c0069db0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b2000 tx=0x7f06cc0aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.376+0000 7f06daa00640 1 -- 172.21.15.63:0/3812548499 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f06d4056490 con 0x7f06e40740b0 2024-09-12T02:59:31.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.544+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f06e4073c80 con 0x7f06c00678f0 2024-09-12T02:59:31.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06daa00640 1 -- 172.21.15.63:0/3812548499 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f06e4073c80 con 0x7f06c00678f0 2024-09-12T02:59:31.551 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T02:59:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06c00678f0 msgr2=0x7f06c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06c00678f0 0x7f06c0069db0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b2000 tx=0x7f06cc0aa070 comp rx=0 tx=0).stop 2024-09-12T02:59:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06e40740b0 msgr2=0x7f06e414c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06e40740b0 0x7f06e414c590 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c4c0 tx=0x7f06d400c980 comp rx=0 tx=0).stop 2024-09-12T02:59:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 shutdown_connections 2024-09-12T02:59:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06e40c8f60 0x7f06e40c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f06c00678f0 0x7f06c0069db0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06e40c8b80 0x7f06e414f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 --2- 172.21.15.63:0/3812548499 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06e40740b0 0x7f06e414c590 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 >> 172.21.15.63:0/3812548499 conn(0x7f06e406d900 msgr2=0x7f06e406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 shutdown_connections 2024-09-12T02:59:31.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.548+0000 7f06e3200640 1 -- 172.21.15.63:0/3812548499 wait complete. 2024-09-12T02:59:31.572 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T02:59:31.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:59:31.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3d600640 1 Processor -- start 2024-09-12T02:59:31.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3d600640 1 -- start start 2024-09-12T02:59:31.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3d600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a38151680 0x7f7a3806ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3d600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a38151a60 0x7f7a380c2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3d600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 0x7f7a380c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3d600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7a38073e70 con 0x7f7a38151680 2024-09-12T02:59:31.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3d600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f7a38071b00 con 0x7f7a38151a60 2024-09-12T02:59:31.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3d600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7a38071de0 con 0x7f7a3806d340 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a37e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a38151680 0x7f7a3806ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a37e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7a38151680 0x7f7a3806ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42640/0 (socket says 172.21.15.63:42640) 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a37e00640 1 -- 172.21.15.63:0/423506215 learned_addr learned my addr 172.21.15.63:0/423506215 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a37400640 1 --2- 172.21.15.63:0/423506215 >> v2:172.21.15.119:3300/0 conn(0x7f7a38151a60 0x7f7a380c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3cc00640 1 --2- 172.21.15.63:0/423506215 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 0x7f7a380c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a37e00640 1 -- 172.21.15.63:0/423506215 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 msgr2=0x7f7a380c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a37e00640 1 --2- 172.21.15.63:0/423506215 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 0x7f7a380c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a37e00640 1 -- 172.21.15.63:0/423506215 >> v2:172.21.15.119:3300/0 conn(0x7f7a38151a60 msgr2=0x7f7a380c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a37e00640 1 --2- 172.21.15.63:0/423506215 >> v2:172.21.15.119:3300/0 conn(0x7f7a38151a60 0x7f7a380c2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a37e00640 1 -- 172.21.15.63:0/423506215 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a380720c0 con 0x7f7a38151680 2024-09-12T02:59:31.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.716+0000 7f7a3cc00640 1 --2- 172.21.15.63:0/423506215 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 0x7f7a380c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:31.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a37e00640 1 --2- 172.21.15.63:0/423506215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 0x7f7a3806ce00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7a38158600 tx=0x7f7a2801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6aab7bb2961dddb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a36a00640 1 -- 172.21.15.63:0/423506215 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280b5070 con 0x7f7a38151680 2024-09-12T02:59:31.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a36a00640 1 -- 172.21.15.63:0/423506215 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a280a89d0 con 0x7f7a38151680 2024-09-12T02:59:31.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a36a00640 1 -- 172.21.15.63:0/423506215 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a280a8da0 con 0x7f7a38151680 2024-09-12T02:59:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 -- 172.21.15.63:0/423506215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 msgr2=0x7f7a3806ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 --2- 172.21.15.63:0/423506215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 0x7f7a3806ce00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7a38158600 tx=0x7f7a2801ed10 comp rx=0 tx=0).stop 2024-09-12T02:59:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 -- 172.21.15.63:0/423506215 shutdown_connections 2024-09-12T02:59:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 --2- 172.21.15.63:0/423506215 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 0x7f7a380c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 --2- 172.21.15.63:0/423506215 >> v2:172.21.15.119:3300/0 conn(0x7f7a38151a60 0x7f7a380c2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 --2- 172.21.15.63:0/423506215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 0x7f7a3806ce00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 -- 172.21.15.63:0/423506215 >> 172.21.15.63:0/423506215 conn(0x7f7a380c8ae0 msgr2=0x7f7a380c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:31.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 -- 172.21.15.63:0/423506215 shutdown_connections 2024-09-12T02:59:31.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 -- 172.21.15.63:0/423506215 wait complete. 2024-09-12T02:59:31.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 Processor -- start 2024-09-12T02:59:31.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.720+0000 7f7a3d600640 1 -- start start 2024-09-12T02:59:31.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3d600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 0x7f7a38157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3d600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 0x7f7a381f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3d600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a38151a60 0x7f7a3815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3d600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38071790 con 0x7f7a38151680 2024-09-12T02:59:31.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3d600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7a38073b00 con 0x7f7a38151a60 2024-09-12T02:59:31.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3d600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7a380c1d80 con 0x7f7a3806d340 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 0x7f7a381f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 0x7f7a381f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42642/0 (socket says 172.21.15.63:42642) 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37400640 1 -- 172.21.15.63:0/555441074 learned_addr learned my addr 172.21.15.63:0/555441074 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37e00640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 0x7f7a38157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3cc00640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a38151a60 0x7f7a3815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37400640 1 -- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 msgr2=0x7f7a38157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37400640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a3806d340 0x7f7a38157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37400640 1 -- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a38151a60 msgr2=0x7f7a3815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37400640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a38151a60 0x7f7a3815a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37400640 1 -- 172.21.15.63:0/555441074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a38072400 con 0x7f7a38151680 2024-09-12T02:59:31.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a37400640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 0x7f7a381f1d00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d5f0 tx=0x7f7a2400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a2fe00640 1 -- 172.21.15.63:0/555441074 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240125f0 con 0x7f7a38151680 2024-09-12T02:59:31.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a2fe00640 1 -- 172.21.15.63:0/555441074 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a24019070 con 0x7f7a38151680 2024-09-12T02:59:31.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3814e700 con 0x7f7a38151680 2024-09-12T02:59:31.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a2fe00640 1 -- 172.21.15.63:0/555441074 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240129b0 con 0x7f7a38151680 2024-09-12T02:59:31.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3814def0 con 0x7f7a38151680 2024-09-12T02:59:31.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a3814e9a0 con 0x7f7a38151680 2024-09-12T02:59:31.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.724+0000 7f7a2fe00640 1 -- 172.21.15.63:0/555441074 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a24012b50 con 0x7f7a38151680 2024-09-12T02:59:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a2fe00640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a180678c0 0x7f7a18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a2fe00640 1 -- 172.21.15.63:0/555441074 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f7a24086ec0 con 0x7f7a38151680 2024-09-12T02:59:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a2fe00640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7a18071250 0x7f7a180736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a2fe00640 1 -- 172.21.15.63:0/555441074 --> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a24001d40 con 0x7f7a18071250 2024-09-12T02:59:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a2fe00640 1 -- 172.21.15.63:0/555441074 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f7a24087270 con 0x7f7a38151680 2024-09-12T02:59:31.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a37e00640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a180678c0 0x7f7a18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a3cc00640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7a18071250 0x7f7a180736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a3cc00640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7a18071250 0x7f7a180736f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a37e00640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a180678c0 0x7f7a18069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7a280b2000 tx=0x7f7a28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.728+0000 7f7a2fe00640 1 -- 172.21.15.63:0/555441074 <== osd.5 v2:172.21.15.119:6824/2412795190 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a24001d40 con 0x7f7a18071250 2024-09-12T02:59:31.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 --> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7a381588a0 con 0x7f7a18071250 2024-09-12T02:59:31.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a2fe00640 1 -- 172.21.15.63:0/555441074 <== osd.5 v2:172.21.15.119:6824/2412795190 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f7a381588a0 con 0x7f7a18071250 2024-09-12T02:59:31.748 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:59:31.748 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-12T02:59:31.748 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:59:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7a18071250 msgr2=0x7f7a180736f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6824/2412795190,v1:172.21.15.119:6825/2412795190] conn(0x7f7a18071250 0x7f7a180736f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a180678c0 msgr2=0x7f7a18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7a180678c0 0x7f7a18069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7a280b2000 tx=0x7f7a28009040 comp rx=0 tx=0).stop 2024-09-12T02:59:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 msgr2=0x7f7a381f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 --2- 172.21.15.63:0/555441074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a38151680 0x7f7a381f1d00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d5f0 tx=0x7f7a2400dab0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3cc00640 1 -- 172.21.15.63:0/555441074 reap_dead start 2024-09-12T02:59:31.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 shutdown_connections 2024-09-12T02:59:31.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 >> 172.21.15.63:0/555441074 conn(0x7f7a380c8ae0 msgr2=0x7f7a380c9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:31.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 shutdown_connections 2024-09-12T02:59:31.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.744+0000 7f7a3d600640 1 -- 172.21.15.63:0/555441074 wait complete. 2024-09-12T02:59:31.766 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T02:59:31.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.908+0000 7ff751000640 1 Processor -- start 2024-09-12T02:59:31.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.908+0000 7ff751000640 1 -- start start 2024-09-12T02:59:31.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.908+0000 7ff751000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce2d0 0x7ff74c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.908+0000 7ff751000640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff74c15b0d0 0x7ff74c157a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.908+0000 7ff751000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74c15a940 con 0x7ff74c0ce6b0 2024-09-12T02:59:31.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.908+0000 7ff751000640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff74c0c90f0 con 0x7ff74c15b0d0 2024-09-12T02:59:31.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.908+0000 7ff751000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c0c93d0 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.908+0000 7ff742a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff74c0ce6b0 0x7ff74c06fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57694/0 (socket says 172.21.15.63:57694) 2024-09-12T02:59:31.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.908+0000 7ff742a00640 1 -- 172.21.15.63:0/487658329 learned_addr learned my addr 172.21.15.63:0/487658329 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:31.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74be00640 1 --2- 172.21.15.63:0/487658329 >> v2:172.21.15.119:3300/0 conn(0x7ff74c15b0d0 0x7ff74c157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74b400640 1 --2- 172.21.15.63:0/487658329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce2d0 0x7ff74c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74aa00640 1 -- 172.21.15.63:0/487658329 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347766566 0 0) 0x7ff74c15a940 con 0x7ff74c0ce6b0 2024-09-12T02:59:31.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74aa00640 1 -- 172.21.15.63:0/487658329 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff730003530 con 0x7ff74c0ce6b0 2024-09-12T02:59:31.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74b400640 1 -- 172.21.15.63:0/487658329 >> v2:172.21.15.119:3300/0 conn(0x7ff74c15b0d0 msgr2=0x7ff74c157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:31.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74b400640 1 --2- 172.21.15.63:0/487658329 >> v2:172.21.15.119:3300/0 conn(0x7ff74c15b0d0 0x7ff74c157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74b400640 1 -- 172.21.15.63:0/487658329 >> v1:172.21.15.63:6789/0 conn(0x7ff74c0ce6b0 legacy=0x7ff74c06fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74b400640 1 -- 172.21.15.63:0/487658329 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c15abb0 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74b400640 1 --2- 172.21.15.63:0/487658329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce2d0 0x7ff74c06cdd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0097c0 tx=0x7ff73c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abc3472593dd7eb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74aa00640 1 -- 172.21.15.63:0/487658329 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0aa620 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74aa00640 1 -- 172.21.15.63:0/487658329 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73c0af070 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.912+0000 7ff74aa00640 1 -- 172.21.15.63:0/487658329 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0aa9c0 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 -- 172.21.15.63:0/487658329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce2d0 msgr2=0x7ff74c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 --2- 172.21.15.63:0/487658329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce2d0 0x7ff74c06cdd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0097c0 tx=0x7ff73c01c460 comp rx=0 tx=0).stop 2024-09-12T02:59:31.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 -- 172.21.15.63:0/487658329 shutdown_connections 2024-09-12T02:59:31.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 --2- 172.21.15.63:0/487658329 >> v2:172.21.15.119:3300/0 conn(0x7ff74c15b0d0 0x7ff74c157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 --2- 172.21.15.63:0/487658329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce2d0 0x7ff74c06cdd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 -- 172.21.15.63:0/487658329 >> 172.21.15.63:0/487658329 conn(0x7ff74c074040 msgr2=0x7ff74c067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:31.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 -- 172.21.15.63:0/487658329 shutdown_connections 2024-09-12T02:59:31.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 -- 172.21.15.63:0/487658329 wait complete. 2024-09-12T02:59:31.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 Processor -- start 2024-09-12T02:59:31.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 -- start start 2024-09-12T02:59:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c0ce2d0 0x7ff74c0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce6b0 0x7ff74c0c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c15b0d0 0x7ff74c1595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c0c9fd0 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c1583b0 con 0x7ff74c15b0d0 2024-09-12T02:59:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff751000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c0ca150 con 0x7ff74c0ce6b0 2024-09-12T02:59:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c0ce2d0 0x7ff74c0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c0ce2d0 0x7ff74c0ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42644/0 (socket says 172.21.15.63:42644) 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74b400640 1 -- 172.21.15.63:0/534902313 learned_addr learned my addr 172.21.15.63:0/534902313 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff742a00640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce6b0 0x7ff74c0c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74be00640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c15b0d0 0x7ff74c1595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74b400640 1 -- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce6b0 msgr2=0x7ff74c0c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74b400640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce6b0 0x7ff74c0c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74b400640 1 -- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c15b0d0 msgr2=0x7ff74c1595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74b400640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c15b0d0 0x7ff74c1595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74b400640 1 -- 172.21.15.63:0/534902313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c0cd840 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff74be00640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c15b0d0 0x7ff74c1595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.916+0000 7ff742a00640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce6b0 0x7ff74c0c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:59:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff74b400640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c0ce2d0 0x7ff74c0ca560 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0ac040 tx=0x7ff73c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff743e00640 1 -- 172.21.15.63:0/534902313 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c003820 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff743e00640 1 -- 172.21.15.63:0/534902313 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73c0039c0 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74c0c8240 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff743e00640 1 -- 172.21.15.63:0/534902313 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c003d90 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74c0cd120 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff74c0cda10 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff743e00640 1 -- 172.21.15.63:0/534902313 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff73c0c2060 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff743e00640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7280678c0 0x7ff728069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff743e00640 1 -- 172.21.15.63:0/534902313 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7ff73c11fc50 con 0x7ff74c0ce2d0 2024-09-12T02:59:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.920+0000 7ff742a00640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7280678c0 0x7ff728069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.924+0000 7ff742a00640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7280678c0 0x7ff728069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0cd560 tx=0x7ff734009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:31.924+0000 7ff743e00640 1 -- 172.21.15.63:0/534902313 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff73c016050 con 0x7ff74c0ce2d0 2024-09-12T02:59:32.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.092+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ff74c06cdd0 con 0x7ff7280678c0 2024-09-12T02:59:32.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff743e00640 1 -- 172.21.15.63:0/534902313 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff74c06cdd0 con 0x7ff7280678c0 2024-09-12T02:59:32.099 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T02:59:32.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7280678c0 msgr2=0x7ff728069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7280678c0 0x7ff728069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff74c0cd560 tx=0x7ff734009040 comp rx=0 tx=0).stop 2024-09-12T02:59:32.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c0ce2d0 msgr2=0x7ff74c0ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c0ce2d0 0x7ff74c0ca560 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff73c0ac040 tx=0x7ff73c019200 comp rx=0 tx=0).stop 2024-09-12T02:59:32.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 shutdown_connections 2024-09-12T02:59:32.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff74c15b0d0 0x7ff74c1595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff7280678c0 0x7ff728069d80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff74c0ce6b0 0x7ff74c0c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 --2- 172.21.15.63:0/534902313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff74c0ce2d0 0x7ff74c0ca560 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 >> 172.21.15.63:0/534902313 conn(0x7ff74c074040 msgr2=0x7ff74c155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:32.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 shutdown_connections 2024-09-12T02:59:32.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.096+0000 7ff751000640 1 -- 172.21.15.63:0/534902313 wait complete. 2024-09-12T02:59:32.120 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T02:59:32.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:59:32.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.260+0000 7f1dc9000640 1 Processor -- start 2024-09-12T02:59:32.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.260+0000 7f1dc9000640 1 -- start start 2024-09-12T02:59:32.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.260+0000 7f1dc9000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dc41515d0 0x7f1dc41519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.260+0000 7f1dc9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1dc4157db0 0x7f1dc40c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.260+0000 7f1dc9000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc41584d0 con 0x7f1dc415b850 2024-09-12T02:59:32.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.260+0000 7f1dc9000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc40c3bd0 con 0x7f1dc4157db0 2024-09-12T02:59:32.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.260+0000 7f1dc9000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc40c6d30 con 0x7f1dc41515d0 2024-09-12T02:59:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.260+0000 7f1dc2800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1dc4157db0 0x7f1dc40c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc2800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1dc4157db0 0x7f1dc40c3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42654/0 (socket says 172.21.15.63:42654) 2024-09-12T02:59:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc2800640 1 -- 172.21.15.63:0/2870629882 learned_addr learned my addr 172.21.15.63:0/2870629882 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1db9400640 1 --1- 172.21.15.63:0/2870629882 >> v1:172.21.15.63:6789/0 conn(0x7f1dc415b850 0x7f1dc41576a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57708/0 (socket says 172.21.15.63:57708) 2024-09-12T02:59:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc1e00640 1 --2- 172.21.15.63:0/2870629882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dc41515d0 0x7f1dc41519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc2800640 1 -- 172.21.15.63:0/2870629882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dc41515d0 msgr2=0x7f1dc41519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc2800640 1 --2- 172.21.15.63:0/2870629882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dc41515d0 0x7f1dc41519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc2800640 1 -- 172.21.15.63:0/2870629882 >> v1:172.21.15.63:6789/0 conn(0x7f1dc415b850 legacy=0x7f1dc41576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc2800640 1 -- 172.21.15.63:0/2870629882 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc40c7010 con 0x7f1dc4157db0 2024-09-12T02:59:32.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc1400640 1 -- 172.21.15.63:0/2870629882 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124044177 0 0) 0x7f1dac001120 con 0x7f1dc415b850 2024-09-12T02:59:32.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc2800640 1 --2- 172.21.15.63:0/2870629882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc4157db0 0x7f1dc40c3690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009e50 tx=0x7f1dbc01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19bf32d048704f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc1400640 1 -- 172.21.15.63:0/2870629882 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0b4070 con 0x7f1dc4157db0 2024-09-12T02:59:32.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc1400640 1 -- 172.21.15.63:0/2870629882 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dbc0af400 con 0x7f1dc4157db0 2024-09-12T02:59:32.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc1400640 1 -- 172.21.15.63:0/2870629882 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc0af7d0 con 0x7f1dc4157db0 2024-09-12T02:59:32.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc9000640 1 -- 172.21.15.63:0/2870629882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc4157db0 msgr2=0x7f1dc40c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.264+0000 7f1dc9000640 1 --2- 172.21.15.63:0/2870629882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc4157db0 0x7f1dc40c3690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc009e50 tx=0x7f1dbc01f210 comp rx=0 tx=0).stop 2024-09-12T02:59:32.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 -- 172.21.15.63:0/2870629882 shutdown_connections 2024-09-12T02:59:32.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 --2- 172.21.15.63:0/2870629882 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc4157db0 0x7f1dc40c3690 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 --2- 172.21.15.63:0/2870629882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dc41515d0 0x7f1dc41519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 -- 172.21.15.63:0/2870629882 >> 172.21.15.63:0/2870629882 conn(0x7f1dc406bcc0 msgr2=0x7f1dc406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 -- 172.21.15.63:0/2870629882 shutdown_connections 2024-09-12T02:59:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 -- 172.21.15.63:0/2870629882 wait complete. 2024-09-12T02:59:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 Processor -- start 2024-09-12T02:59:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 -- start start 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc41515d0 0x7f1dc4152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc415b850 0x7f1dc4148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dc414bfc0 0x7f1dc414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc40c78b0 con 0x7f1dc415b850 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc40c75d0 con 0x7f1dc41515d0 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc40c8210 con 0x7f1dc414bfc0 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1db9400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc415b850 0x7f1dc4148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1db9400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc415b850 0x7f1dc4148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42662/0 (socket says 172.21.15.63:42662) 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1db9400640 1 -- 172.21.15.63:0/3917088230 learned_addr learned my addr 172.21.15.63:0/3917088230 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc1e00640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc41515d0 0x7f1dc4152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc2800640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dc414bfc0 0x7f1dc414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1db9400640 1 -- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dc414bfc0 msgr2=0x7f1dc414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1db9400640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1dc414bfc0 0x7f1dc414a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1db9400640 1 -- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc41515d0 msgr2=0x7f1dc4152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1db9400640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1dc41515d0 0x7f1dc4152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1db9400640 1 -- 172.21.15.63:0/3917088230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc414b840 con 0x7f1dc415b850 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1db9400640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc415b850 0x7f1dc4148540 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00c7b0 tx=0x7f1dac00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dbaa00640 1 -- 172.21.15.63:0/3917088230 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac018070 con 0x7f1dc415b850 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dbaa00640 1 -- 172.21.15.63:0/3917088230 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac0072f0 con 0x7f1dc415b850 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dbaa00640 1 -- 172.21.15.63:0/3917088230 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0047f0 con 0x7f1dc415b850 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.268+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc414bb20 con 0x7f1dc415b850 2024-09-12T02:59:32.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc4151e10 con 0x7f1dc415b850 2024-09-12T02:59:32.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1dc40c3690 con 0x7f1dc415b850 2024-09-12T02:59:32.276 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dbaa00640 1 -- 172.21.15.63:0/3917088230 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1dac01b070 con 0x7f1dc415b850 2024-09-12T02:59:32.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dbaa00640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1da00678c0 0x7f1da0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dbaa00640 1 -- 172.21.15.63:0/3917088230 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f1dac0855b0 con 0x7f1dc415b850 2024-09-12T02:59:32.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dbaa00640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1da0071260 0x7f1da0073700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dbaa00640 1 -- 172.21.15.63:0/3917088230 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dac01ee50 con 0x7f1da0071260 2024-09-12T02:59:32.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dbaa00640 1 -- 172.21.15.63:0/3917088230 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f1dac08c050 con 0x7f1dc415b850 2024-09-12T02:59:32.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dc1e00640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1da00678c0 0x7f1da0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dc2800640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1da0071260 0x7f1da0073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.272+0000 7f1dc1e00640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1da00678c0 0x7f1da0069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009a50 tx=0x7f1db4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.276+0000 7f1dc2800640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1da0071260 0x7f1da0073700 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.276+0000 7f1dbaa00640 1 -- 172.21.15.63:0/3917088230 <== osd.6 v2:172.21.15.119:6816/2029574290 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1dac01ee50 con 0x7f1da0071260 2024-09-12T02:59:32.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.288+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 --> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1dc40c32e0 con 0x7f1da0071260 2024-09-12T02:59:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.288+0000 7f1dbaa00640 1 -- 172.21.15.63:0/3917088230 <== osd.6 v2:172.21.15.119:6816/2029574290 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1dc40c32e0 con 0x7f1da0071260 2024-09-12T02:59:32.294 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:59:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:59:32.294 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1da0071260 msgr2=0x7f1da0073700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6816/2029574290,v1:172.21.15.119:6817/2029574290] conn(0x7f1da0071260 0x7f1da0073700 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1da00678c0 msgr2=0x7f1da0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f1da00678c0 0x7f1da0069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009a50 tx=0x7f1db4008040 comp rx=0 tx=0).stop 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc415b850 msgr2=0x7f1dc4148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 --2- 172.21.15.63:0/3917088230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1dc415b850 0x7f1dc4148540 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00c7b0 tx=0x7f1dac00cc70 comp rx=0 tx=0).stop 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc2800640 1 -- 172.21.15.63:0/3917088230 reap_dead start 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 shutdown_connections 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 >> 172.21.15.63:0/3917088230 conn(0x7f1dc406bcc0 msgr2=0x7f1dc406fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 shutdown_connections 2024-09-12T02:59:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.292+0000 7f1dc9000640 1 -- 172.21.15.63:0/3917088230 wait complete. 2024-09-12T02:59:32.313 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T02:59:32.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f0096a00640 1 Processor -- start 2024-09-12T02:59:32.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f0096a00640 1 -- start start 2024-09-12T02:59:32.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f0096a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0090157db0 0x7f0090162e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f0096a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00900c6a10 con 0x7f0090151ad0 2024-09-12T02:59:32.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f0096a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00900c6cf0 con 0x7f00900c9700 2024-09-12T02:59:32.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f0096a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f00900c7a10 con 0x7f0090157db0 2024-09-12T02:59:32.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0090151ad0 0x7f0090072f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57722/0 (socket says 172.21.15.63:57722) 2024-09-12T02:59:32.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008fe00640 1 -- 172.21.15.63:0/526322960 learned_addr learned my addr 172.21.15.63:0/526322960 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:32.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f0094a00640 1 --2- 172.21.15.63:0/526322960 >> v2:172.21.15.119:3300/0 conn(0x7f0090157db0 0x7f0090162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 509445168 0 0) 0x7f00900c6a10 con 0x7f0090151ad0 2024-09-12T02:59:32.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0074003530 con 0x7f0090151ad0 2024-09-12T02:59:32.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3520693261 0 0) 0x7f0074003530 con 0x7f0090151ad0 2024-09-12T02:59:32.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 >> v2:172.21.15.119:3300/0 conn(0x7f0090157db0 msgr2=0x7f0090162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:32.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 --2- 172.21.15.63:0/526322960 >> v2:172.21.15.119:3300/0 conn(0x7f0090157db0 0x7f0090162e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 >> v1:172.21.15.119:6789/0 conn(0x7f00900c9700 legacy=0x7f00901576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00900c6fd0 con 0x7f0090151ad0 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f0080001680 con 0x7f0090151ad0 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 >> v1:172.21.15.63:6789/0 conn(0x7f0090151ad0 legacy=0x7f0090072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f0074003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0074004810 0x7f0074004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00740051d0 0x7f007400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f00900c7a10 con 0x7f00740039c0 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f007400c070 con 0x7f00740051d0 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f007400c270 con 0x7f0074004810 2024-09-12T02:59:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008fe00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f0074003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f0094a00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00740051d0 0x7f007400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008f400640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0074004810 0x7f0074004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008fe00640 1 -- 172.21.15.63:0/526322960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0074004810 msgr2=0x7f0074004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008fe00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0074004810 0x7f0074004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008fe00640 1 -- 172.21.15.63:0/526322960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00740051d0 msgr2=0x7f007400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008fe00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00740051d0 0x7f007400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f008fe00640 1 -- 172.21.15.63:0/526322960 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0074003530 con 0x7f00740039c0 2024-09-12T02:59:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.452+0000 7f0094a00640 1 -- 172.21.15.63:0/526322960 reap_dead start 2024-09-12T02:59:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f008fe00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f0074003de0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f008000c210 tx=0x7f008001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41832ecd11179f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080007d40 con 0x7f00740039c0 2024-09-12T02:59:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00800a9070 con 0x7f00740039c0 2024-09-12T02:59:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f008ea00640 1 -- 172.21.15.63:0/526322960 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080005d80 con 0x7f00740039c0 2024-09-12T02:59:32.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f0096a00640 1 -- 172.21.15.63:0/526322960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 msgr2=0x7f0074003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f0096a00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f0074003de0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f008000c210 tx=0x7f008001cc60 comp rx=0 tx=0).stop 2024-09-12T02:59:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f0096a00640 1 -- 172.21.15.63:0/526322960 shutdown_connections 2024-09-12T02:59:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f0096a00640 1 --2- 172.21.15.63:0/526322960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f0074003de0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f0096a00640 1 -- 172.21.15.63:0/526322960 >> 172.21.15.63:0/526322960 conn(0x7f009006f3d0 msgr2=0x7f009006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f0096a00640 1 -- 172.21.15.63:0/526322960 shutdown_connections 2024-09-12T02:59:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.456+0000 7f0096a00640 1 -- 172.21.15.63:0/526322960 wait complete. 2024-09-12T02:59:32.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 Processor -- start 2024-09-12T02:59:32.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 -- start start 2024-09-12T02:59:32.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f009015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f009006da30 0x7f00901f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00901f4250 0x7f0090143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0090157ab0 con 0x7f00740039c0 2024-09-12T02:59:32.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f00900c7c60 con 0x7f00901f4250 2024-09-12T02:59:32.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f0090157c30 con 0x7f009006da30 2024-09-12T02:59:32.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f009015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f009015b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42686/0 (socket says 172.21.15.63:42686) 2024-09-12T02:59:32.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008fe00640 1 -- 172.21.15.63:0/2605735974 learned_addr learned my addr 172.21.15.63:0/2605735974 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:32.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0094a00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00901f4250 0x7f0090143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008f400640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f009006da30 0x7f00901f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008fe00640 1 -- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f009006da30 msgr2=0x7f00901f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008fe00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f009006da30 0x7f00901f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008fe00640 1 -- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00901f4250 msgr2=0x7f0090143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008fe00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00901f4250 0x7f0090143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008fe00640 1 -- 172.21.15.63:0/2605735974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00901f46d0 con 0x7f00740039c0 2024-09-12T02:59:32.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f008fe00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f009015b440 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0080001980 tx=0x7f0074005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0087e00640 1 -- 172.21.15.63:0/2605735974 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080007180 con 0x7f00740039c0 2024-09-12T02:59:32.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0087e00640 1 -- 172.21.15.63:0/2605735974 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0080007320 con 0x7f00740039c0 2024-09-12T02:59:32.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0087e00640 1 -- 172.21.15.63:0/2605735974 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00800076d0 con 0x7f00740039c0 2024-09-12T02:59:32.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00901f6fb0 con 0x7f00740039c0 2024-09-12T02:59:32.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.460+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00901f7250 con 0x7f00740039c0 2024-09-12T02:59:32.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.464+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0090074130 con 0x7f00740039c0 2024-09-12T02:59:32.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.464+0000 7f0087e00640 1 -- 172.21.15.63:0/2605735974 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00800a57f0 con 0x7f00740039c0 2024-09-12T02:59:32.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.464+0000 7f0087e00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f00700678c0 0x7f0070069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.464+0000 7f0087e00640 1 -- 172.21.15.63:0/2605735974 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f008011f9b0 con 0x7f00740039c0 2024-09-12T02:59:32.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.464+0000 7f008f400640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f00700678c0 0x7f0070069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.464+0000 7f008f400640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f00700678c0 0x7f0070069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f00901f49f0 tx=0x7f007c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.468+0000 7f0087e00640 1 -- 172.21.15.63:0/2605735974 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00901f46d0 con 0x7f00740039c0 2024-09-12T02:59:32.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f009014f500 con 0x7f00700678c0 2024-09-12T02:59:32.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0087e00640 1 -- 172.21.15.63:0/2605735974 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f009014f500 con 0x7f00700678c0 2024-09-12T02:59:32.639 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f00700678c0 msgr2=0x7f0070069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f00700678c0 0x7f0070069d80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f00901f49f0 tx=0x7f007c009040 comp rx=0 tx=0).stop 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 msgr2=0x7f009015b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f009015b440 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0080001980 tx=0x7f0074005840 comp rx=0 tx=0).stop 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 shutdown_connections 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00901f4250 0x7f0090143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f00700678c0 0x7f0070069d80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f009006da30 0x7f00901f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 --2- 172.21.15.63:0/2605735974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00740039c0 0x7f009015b440 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 >> 172.21.15.63:0/2605735974 conn(0x7f009006f3d0 msgr2=0x7f0090147a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:32.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 shutdown_connections 2024-09-12T02:59:32.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.636+0000 7f0096a00640 1 -- 172.21.15.63:0/2605735974 wait complete. 2024-09-12T02:59:32.661 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T02:59:32.661 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T02:59:32.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77fb400640 1 Processor -- start 2024-09-12T02:59:32.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77fb400640 1 -- start start 2024-09-12T02:59:32.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77fb400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f77f4152810 0x7f77f40c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77fb400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f40c5d10 con 0x7f77f4152bf0 2024-09-12T02:59:32.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77fb400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f40c3a10 con 0x7f77f40c6410 2024-09-12T02:59:32.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77fb400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f77f40c6b90 con 0x7f77f4152810 2024-09-12T02:59:32.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77f8a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f77f4152810 0x7f77f40c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77f3e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f77f4152bf0 0x7f77f406f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57730/0 (socket says 172.21.15.63:57730) 2024-09-12T02:59:32.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77f3e00640 1 -- 172.21.15.63:0/1445716395 learned_addr learned my addr 172.21.15.63:0/1445716395 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:32.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77f8a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f77f4152810 0x7f77f40c3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42696/0 (socket says 172.21.15.63:42696) 2024-09-12T02:59:32.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77f8a00640 1 -- 172.21.15.63:0/1445716395 >> v1:172.21.15.119:6789/0 conn(0x7f77f40c6410 legacy=0x7f77f406fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77f8a00640 1 -- 172.21.15.63:0/1445716395 >> v1:172.21.15.63:6789/0 conn(0x7f77f4152bf0 legacy=0x7f77f406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77f8a00640 1 -- 172.21.15.63:0/1445716395 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f40c6de0 con 0x7f77f4152810 2024-09-12T02:59:32.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.804+0000 7f77f3400640 1 -- 172.21.15.63:0/1445716395 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3389944189 0 0) 0x7f77f40c5d10 con 0x7f77f4152bf0 2024-09-12T02:59:32.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77f8a00640 1 --2- 172.21.15.63:0/1445716395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 0x7f77f40c3e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f77e80097c0 tx=0x7f77e801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923b01a676e90f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77f3400640 1 -- 172.21.15.63:0/1445716395 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80b5070 con 0x7f77f4152810 2024-09-12T02:59:32.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77f3400640 1 -- 172.21.15.63:0/1445716395 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e80a8990 con 0x7f77f4152810 2024-09-12T02:59:32.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77f3400640 1 -- 172.21.15.63:0/1445716395 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80a8d60 con 0x7f77f4152810 2024-09-12T02:59:32.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77fb400640 1 -- 172.21.15.63:0/1445716395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 msgr2=0x7f77f40c3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77fb400640 1 --2- 172.21.15.63:0/1445716395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 0x7f77f40c3e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f77e80097c0 tx=0x7f77e801ec90 comp rx=0 tx=0).stop 2024-09-12T02:59:32.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77fb400640 1 -- 172.21.15.63:0/1445716395 shutdown_connections 2024-09-12T02:59:32.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77fb400640 1 --2- 172.21.15.63:0/1445716395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 0x7f77f40c3e30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77fb400640 1 -- 172.21.15.63:0/1445716395 >> 172.21.15.63:0/1445716395 conn(0x7f77f406bcc0 msgr2=0x7f77f406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:32.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77fb400640 1 -- 172.21.15.63:0/1445716395 shutdown_connections 2024-09-12T02:59:32.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.808+0000 7f77fb400640 1 -- 172.21.15.63:0/1445716395 wait complete. 2024-09-12T02:59:32.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 Processor -- start 2024-09-12T02:59:32.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 -- start start 2024-09-12T02:59:32.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f40c6410 0x7f77f40c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 0x7f77f414b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f4152bf0 0x7f77f414a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4158aa0 con 0x7f77f4152810 2024-09-12T02:59:32.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4158e10 con 0x7f77f40c6410 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f77f4158750 con 0x7f77f4152bf0 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 0x7f77f414b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 0x7f77f414b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42700/0 (socket says 172.21.15.63:42700) 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f3e00640 1 -- 172.21.15.63:0/2789883638 learned_addr learned my addr 172.21.15.63:0/2789883638 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f8a00640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f40c6410 0x7f77f40c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f9400640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f4152bf0 0x7f77f414a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f3e00640 1 -- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f4152bf0 msgr2=0x7f77f414a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f3e00640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f4152bf0 0x7f77f414a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f3e00640 1 -- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f40c6410 msgr2=0x7f77f40c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f3e00640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77f40c6410 0x7f77f40c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f3e00640 1 -- 172.21.15.63:0/2789883638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f4155f20 con 0x7f77f4152810 2024-09-12T02:59:32.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f9400640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77f4152bf0 0x7f77f414a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:32.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f3e00640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 0x7f77f414b7a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f77e000c480 tx=0x7f77e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f0c00640 1 -- 172.21.15.63:0/2789883638 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0005cf0 con 0x7f77f4152810 2024-09-12T02:59:32.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f0c00640 1 -- 172.21.15.63:0/2789883638 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e0007070 con 0x7f77f4152810 2024-09-12T02:59:32.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77f0c00640 1 -- 172.21.15.63:0/2789883638 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e00074e0 con 0x7f77f4152810 2024-09-12T02:59:32.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f41f14b0 con 0x7f77f4152810 2024-09-12T02:59:32.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.812+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f4071fe0 con 0x7f77f4152810 2024-09-12T02:59:32.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77f40c3690 con 0x7f77f4152810 2024-09-12T02:59:32.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f0c00640 1 -- 172.21.15.63:0/2789883638 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77e001b400 con 0x7f77f4152810 2024-09-12T02:59:32.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f0c00640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 0x7f77d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f0c00640 1 -- 172.21.15.63:0/2789883638 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f77e0085d20 con 0x7f77f4152810 2024-09-12T02:59:32.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f0c00640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f77d4071280 0x7f77d4073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:32.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f0c00640 1 -- 172.21.15.63:0/2789883638 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77e0014e50 con 0x7f77d4071280 2024-09-12T02:59:32.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f0c00640 1 -- 172.21.15.63:0/2789883638 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f77e008b070 con 0x7f77f4152810 2024-09-12T02:59:32.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f8a00640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 0x7f77d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f9400640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f77d4071280 0x7f77d4073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:32.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f8a00640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 0x7f77d4069db0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f77e80b2000 tx=0x7f77e80aa070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.816+0000 7f77f9400640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f77d4071280 0x7f77d4073720 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:32.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.820+0000 7f77f0c00640 1 -- 172.21.15.63:0/2789883638 <== osd.7 v2:172.21.15.119:6800/3494373582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77e0014e50 con 0x7f77d4071280 2024-09-12T02:59:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.832+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 --> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f77f4156170 con 0x7f77d4071280 2024-09-12T02:59:32.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.832+0000 7f77f0c00640 1 -- 172.21.15.63:0/2789883638 <== osd.7 v2:172.21.15.119:6800/3494373582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f77f4156170 con 0x7f77d4071280 2024-09-12T02:59:32.838 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-12T02:59:32.838 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T02:59:32.838 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-12T02:59:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.832+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f77d4071280 msgr2=0x7f77d4073720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.832+0000 7f77fb400640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6800/3494373582,v1:172.21.15.119:6801/3494373582] conn(0x7f77d4071280 0x7f77d4073720 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.836+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 msgr2=0x7f77d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.836+0000 7f77fb400640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f77d40678f0 0x7f77d4069db0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f77e80b2000 tx=0x7f77e80aa070 comp rx=0 tx=0).stop 2024-09-12T02:59:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.836+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 msgr2=0x7f77f414b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.836+0000 7f77fb400640 1 --2- 172.21.15.63:0/2789883638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77f4152810 0x7f77f414b7a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f77e000c480 tx=0x7f77e000c940 comp rx=0 tx=0).stop 2024-09-12T02:59:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.836+0000 7f77f9400640 1 -- 172.21.15.63:0/2789883638 reap_dead start 2024-09-12T02:59:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.836+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 shutdown_connections 2024-09-12T02:59:32.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.836+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 >> 172.21.15.63:0/2789883638 conn(0x7f77f406bcc0 msgr2=0x7f77f40cc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.836+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 shutdown_connections 2024-09-12T02:59:32.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.836+0000 7f77fb400640 1 -- 172.21.15.63:0/2789883638 wait complete. 2024-09-12T02:59:32.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T02:59:33.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.996+0000 7f4305000640 1 Processor -- start 2024-09-12T02:59:33.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.996+0000 7f4305000640 1 -- start start 2024-09-12T02:59:33.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.996+0000 7f4305000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43001527e0 0x7f43000c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.996+0000 7f4305000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 0x7f43000ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.996+0000 7f4305000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43000c9720 con 0x7f43000c4ff0 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.996+0000 7f4305000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f4300070570 con 0x7f43001527e0 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:32.996+0000 7f4305000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f430006f6f0 con 0x7f43000ce080 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fde00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43001527e0 0x7f43000c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fde00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f43001527e0 0x7f43000c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42708/0 (socket says 172.21.15.63:42708) 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fd400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f43000c4ff0 0x7f430006fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57738/0 (socket says 172.21.15.63:57738) 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fde00640 1 -- 172.21.15.63:0/4086124433 learned_addr learned my addr 172.21.15.63:0/4086124433 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fe800640 1 --2- 172.21.15.63:0/4086124433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 0x7f43000ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fde00640 1 -- 172.21.15.63:0/4086124433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 msgr2=0x7f43000ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fde00640 1 --2- 172.21.15.63:0/4086124433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 0x7f43000ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fde00640 1 -- 172.21.15.63:0/4086124433 >> v1:172.21.15.63:6789/0 conn(0x7f43000c4ff0 legacy=0x7f430006fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fde00640 1 -- 172.21.15.63:0/4086124433 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43000c9a00 con 0x7f43001527e0 2024-09-12T02:59:33.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fde00640 1 --2- 172.21.15.63:0/4086124433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 0x7f43000c82a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009870 tx=0x7f42f001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f1fec4c3537f9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:33.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fca00640 1 -- 172.21.15.63:0/4086124433 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f00b5070 con 0x7f43001527e0 2024-09-12T02:59:33.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fca00640 1 -- 172.21.15.63:0/4086124433 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00a8a50 con 0x7f43001527e0 2024-09-12T02:59:33.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.000+0000 7f42fca00640 1 -- 172.21.15.63:0/4086124433 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f00a8e20 con 0x7f43001527e0 2024-09-12T02:59:33.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 -- 172.21.15.63:0/4086124433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 msgr2=0x7f43000c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 --2- 172.21.15.63:0/4086124433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 0x7f43000c82a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009870 tx=0x7f42f001ed50 comp rx=0 tx=0).stop 2024-09-12T02:59:33.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 -- 172.21.15.63:0/4086124433 shutdown_connections 2024-09-12T02:59:33.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 --2- 172.21.15.63:0/4086124433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 0x7f43000ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 --2- 172.21.15.63:0/4086124433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 0x7f43000c82a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 -- 172.21.15.63:0/4086124433 >> 172.21.15.63:0/4086124433 conn(0x7f4300067a00 msgr2=0x7f4300067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:33.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 -- 172.21.15.63:0/4086124433 shutdown_connections 2024-09-12T02:59:33.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 -- 172.21.15.63:0/4086124433 wait complete. 2024-09-12T02:59:33.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 Processor -- start 2024-09-12T02:59:33.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 -- start start 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43000c4ff0 0x7f43001e79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 0x7f4300151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 0x7f4300153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f43000c9fc0 con 0x7f43001527e0 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f430006f9d0 con 0x7f43000c4ff0 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f4305000640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f43000c93e0 con 0x7f43000ce080 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fe800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 0x7f4300153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fe800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 0x7f4300153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42722/0 (socket says 172.21.15.63:42722) 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fe800640 1 -- 172.21.15.63:0/2214778774 learned_addr learned my addr 172.21.15.63:0/2214778774 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:33.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fde00640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43000c4ff0 0x7f43001e79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fd400640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 0x7f4300151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fe800640 1 -- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 msgr2=0x7f4300151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fe800640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 0x7f4300151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fe800640 1 -- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43000c4ff0 msgr2=0x7f43001e79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fe800640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43000c4ff0 0x7f43001e79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fe800640 1 -- 172.21.15.63:0/2214778774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43000c3580 con 0x7f43001527e0 2024-09-12T02:59:33.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.004+0000 7f42fe800640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 0x7f4300153c50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009dd0 tx=0x7f42f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:33.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f42f6000640 1 -- 172.21.15.63:0/2214778774 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8018020 con 0x7f43001527e0 2024-09-12T02:59:33.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f42f6000640 1 -- 172.21.15.63:0/2214778774 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8014480 con 0x7f43001527e0 2024-09-12T02:59:33.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f42f6000640 1 -- 172.21.15.63:0/2214778774 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8014870 con 0x7f43001527e0 2024-09-12T02:59:33.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43001557c0 con 0x7f43001527e0 2024-09-12T02:59:33.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4300155a80 con 0x7f43001527e0 2024-09-12T02:59:33.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430015bb60 con 0x7f43001527e0 2024-09-12T02:59:33.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f42f6000640 1 -- 172.21.15.63:0/2214778774 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42f801b020 con 0x7f43001527e0 2024-09-12T02:59:33.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f42f6000640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f42e00678f0 0x7f42e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f42f6000640 1 -- 172.21.15.63:0/2214778774 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f42f80869f0 con 0x7f43001527e0 2024-09-12T02:59:33.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.008+0000 7f42fde00640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f42e00678f0 0x7f42e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.012+0000 7f42fde00640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f42e00678f0 0x7f42e0069db0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f42f00b2000 tx=0x7f42f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:33.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.012+0000 7f42f6000640 1 -- 172.21.15.63:0/2214778774 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42f8022070 con 0x7f43001527e0 2024-09-12T02:59:33.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.180+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f43001535d0 con 0x7f42e00678f0 2024-09-12T02:59:33.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f42f6000640 1 -- 172.21.15.63:0/2214778774 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f43001535d0 con 0x7f42e00678f0 2024-09-12T02:59:33.187 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T02:59:33.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f42e00678f0 msgr2=0x7f42e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f42e00678f0 0x7f42e0069db0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f42f00b2000 tx=0x7f42f0009040 comp rx=0 tx=0).stop 2024-09-12T02:59:33.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 msgr2=0x7f4300153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 0x7f4300153c50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009dd0 tx=0x7f42f800c490 comp rx=0 tx=0).stop 2024-09-12T02:59:33.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 shutdown_connections 2024-09-12T02:59:33.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f43001527e0 0x7f4300153c50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f42e00678f0 0x7f42e0069db0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43000ce080 0x7f4300151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 --2- 172.21.15.63:0/2214778774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43000c4ff0 0x7f43001e79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 >> 172.21.15.63:0/2214778774 conn(0x7f4300067a00 msgr2=0x7f43000cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:33.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 shutdown_connections 2024-09-12T02:59:33.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.184+0000 7f4305000640 1 -- 172.21.15.63:0/2214778774 wait complete. 2024-09-12T02:59:33.207 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:59:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.344+0000 7f514b400640 1 Processor -- start 2024-09-12T02:59:33.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.344+0000 7f514b400640 1 -- start start 2024-09-12T02:59:33.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f514b400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51440c7a00 0x7f51440cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f514b400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5144159520 con 0x7f51441527e0 2024-09-12T02:59:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f514b400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51441589a0 con 0x7f51440c61e0 2024-09-12T02:59:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f514b400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f5144158c80 con 0x7f51440c7a00 2024-09-12T02:59:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f5148a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f51441527e0 0x7f51440c6970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38606/0 (socket says 172.21.15.63:38606) 2024-09-12T02:59:33.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f5148a00640 1 -- 172.21.15.63:0/3283084853 learned_addr learned my addr 172.21.15.63:0/3283084853 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f5143e00640 1 --2- 172.21.15.63:0/3283084853 >> v2:172.21.15.119:3300/0 conn(0x7f51440c7a00 0x7f51440cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f5143400640 1 -- 172.21.15.63:0/3283084853 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225525549 0 0) 0x7f5144159520 con 0x7f51441527e0 2024-09-12T02:59:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f5143400640 1 -- 172.21.15.63:0/3283084853 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5128003530 con 0x7f51441527e0 2024-09-12T02:59:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f5143e00640 1 -- 172.21.15.63:0/3283084853 >> v1:172.21.15.119:6789/0 conn(0x7f51440c61e0 legacy=0x7f5144162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f5143e00640 1 -- 172.21.15.63:0/3283084853 >> v1:172.21.15.63:6789/0 conn(0x7f51441527e0 legacy=0x7f51440c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f5143400640 1 -- 172.21.15.63:0/3283084853 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2473049077 0 0) 0x7f5128003530 con 0x7f51441527e0 2024-09-12T02:59:33.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.348+0000 7f5143e00640 1 -- 172.21.15.63:0/3283084853 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5144158f60 con 0x7f51440c7a00 2024-09-12T02:59:33.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f5143e00640 1 --2- 172.21.15.63:0/3283084853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51440c7a00 0x7f51440cc550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51300097c0 tx=0x7f513001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeffe55c885962ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f5143400640 1 -- 172.21.15.63:0/3283084853 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51300b1070 con 0x7f51440c7a00 2024-09-12T02:59:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f5143400640 1 -- 172.21.15.63:0/3283084853 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51300ac440 con 0x7f51440c7a00 2024-09-12T02:59:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f5143400640 1 -- 172.21.15.63:0/3283084853 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134001680 con 0x7f51440c7a00 2024-09-12T02:59:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f514b400640 1 -- 172.21.15.63:0/3283084853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51440c7a00 msgr2=0x7f51440cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f514b400640 1 --2- 172.21.15.63:0/3283084853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51440c7a00 0x7f51440cc550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51300097c0 tx=0x7f513001c390 comp rx=0 tx=0).stop 2024-09-12T02:59:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f514b400640 1 -- 172.21.15.63:0/3283084853 shutdown_connections 2024-09-12T02:59:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f514b400640 1 --2- 172.21.15.63:0/3283084853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51440c7a00 0x7f51440cc550 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f514b400640 1 -- 172.21.15.63:0/3283084853 >> 172.21.15.63:0/3283084853 conn(0x7f514406f3d0 msgr2=0x7f514406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f514b400640 1 -- 172.21.15.63:0/3283084853 shutdown_connections 2024-09-12T02:59:33.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f514b400640 1 -- 172.21.15.63:0/3283084853 wait complete. 2024-09-12T02:59:33.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f514b400640 1 Processor -- start 2024-09-12T02:59:33.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.352+0000 7f514b400640 1 -- start start 2024-09-12T02:59:33.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f514b400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51440c61e0 0x7f514414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f514b400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51440c7a00 0x7f5144148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f514b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51441527e0 0x7f51440c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f514b400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f51440c7080 con 0x7f51441527e0 2024-09-12T02:59:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f514b400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f51440ccea0 con 0x7f51440c7a00 2024-09-12T02:59:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f514b400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f51440c7200 con 0x7f51440c61e0 2024-09-12T02:59:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5149400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51441527e0 0x7f51440c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5149400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51441527e0 0x7f51440c2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35052/0 (socket says 172.21.15.63:35052) 2024-09-12T02:59:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5149400640 1 -- 172.21.15.63:0/3984572258 learned_addr learned my addr 172.21.15.63:0/3984572258 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5143e00640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51440c7a00 0x7f5144148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5148a00640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51440c61e0 0x7f514414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5149400640 1 -- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51440c61e0 msgr2=0x7f514414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5149400640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51440c61e0 0x7f514414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5149400640 1 -- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51440c7a00 msgr2=0x7f5144148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5149400640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51440c7a00 0x7f5144148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5149400640 1 -- 172.21.15.63:0/3984572258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51440c8570 con 0x7f51441527e0 2024-09-12T02:59:33.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5149400640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51441527e0 0x7f51440c2580 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c760 tx=0x7f513c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:33.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5140c00640 1 -- 172.21.15.63:0/3984572258 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c016020 con 0x7f51441527e0 2024-09-12T02:59:33.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5140c00640 1 -- 172.21.15.63:0/3984572258 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513c006d60 con 0x7f51441527e0 2024-09-12T02:59:33.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5144149210 con 0x7f51441527e0 2024-09-12T02:59:33.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5140c00640 1 -- 172.21.15.63:0/3984572258 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c003bc0 con 0x7f51441527e0 2024-09-12T02:59:33.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51440b0e70 con 0x7f51441527e0 2024-09-12T02:59:33.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5144158560 con 0x7f51441527e0 2024-09-12T02:59:33.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.356+0000 7f5140c00640 1 -- 172.21.15.63:0/3984572258 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f513c0050d0 con 0x7f51441527e0 2024-09-12T02:59:33.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.360+0000 7f5140c00640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f51240678c0 0x7f5124069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:33.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.360+0000 7f5140c00640 1 -- 172.21.15.63:0/3984572258 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6717+0+0 (secure 0 0 0) 0x7f513c085b40 con 0x7f51441527e0 2024-09-12T02:59:33.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.360+0000 7f5148a00640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f51240678c0 0x7f5124069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:33.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.360+0000 7f5148a00640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f51240678c0 0x7f5124069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f51340011f0 tx=0x7f5134001700 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:33.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.364+0000 7f5140c00640 1 -- 172.21.15.63:0/3984572258 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f513c020020 con 0x7f51441527e0 2024-09-12T02:59:33.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.528+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51441642a0 con 0x7f51240678c0 2024-09-12T02:59:33.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.552+0000 7f5140c00640 1 -- 172.21.15.63:0/3984572258 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332897 (secure 0 0 0) 0x7f51441642a0 con 0x7f51240678c0 2024-09-12T02:59:33.559 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:33.562 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:59:33.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f51240678c0 msgr2=0x7f5124069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f51240678c0 0x7f5124069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f51340011f0 tx=0x7f5134001700 comp rx=0 tx=0).stop 2024-09-12T02:59:33.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51441527e0 msgr2=0x7f51440c2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:33.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51441527e0 0x7f51440c2580 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c760 tx=0x7f513c00cb60 comp rx=0 tx=0).stop 2024-09-12T02:59:33.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 shutdown_connections 2024-09-12T02:59:33.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51441527e0 0x7f51440c2580 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51440c7a00 0x7f5144148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f51240678c0 0x7f5124069d80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 --2- 172.21.15.63:0/3984572258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51440c61e0 0x7f514414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:33.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 >> 172.21.15.63:0/3984572258 conn(0x7f514406f3d0 msgr2=0x7f514406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:33.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 shutdown_connections 2024-09-12T02:59:33.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:33.556+0000 7f514b400640 1 -- 172.21.15.63:0/3984572258 wait complete. 2024-09-12T02:59:33.578 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-12T02:59:31.801444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":699,"ondisk_log_size":699,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234104,"kb_used_data":8504,"kb_used_omap":15,"kb_used_meta":225456,"kb_avail":754740616,"statfs":{"total":773094113280,"available":772854390784,"internally_reserved":0,"allocated":8708096,"data_stored":5083558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":230867630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.583688"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093498+0000","last_change":"2024-09-12T02:57:03.822494+0000","last_active":"2024-09-12T02:59:21.093498+0000","last_peered":"2024-09-12T02:59:21.093498+0000","last_clean":"2024-09-12T02:59:21.093498+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:21.093498+0000","last_undegraded":"2024-09-12T02:59:21.093498+0000","last_fullsized":"2024-09-12T02:59:21.093498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.535920+0000","last_change":"2024-09-12T02:57:04.857876+0000","last_active":"2024-09-12T02:59:25.535920+0000","last_peered":"2024-09-12T02:59:25.535920+0000","last_clean":"2024-09-12T02:59:25.535920+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:25.535920+0000","last_undegraded":"2024-09-12T02:59:25.535920+0000","last_fullsized":"2024-09-12T02:59:25.535920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.725737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554951+0000","last_change":"2024-09-12T02:57:09.035163+0000","last_active":"2024-09-12T02:59:20.554951+0000","last_peered":"2024-09-12T02:59:20.554951+0000","last_clean":"2024-09-12T02:59:20.554951+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:20.554951+0000","last_undegraded":"2024-09-12T02:59:20.554951+0000","last_fullsized":"2024-09-12T02:59:20.554951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:15.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555984+0000","last_change":"2024-09-12T02:57:03.798336+0000","last_active":"2024-09-12T02:59:20.555984+0000","last_peered":"2024-09-12T02:59:20.555984+0000","last_clean":"2024-09-12T02:59:20.555984+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:20.555984+0000","last_undegraded":"2024-09-12T02:59:20.555984+0000","last_fullsized":"2024-09-12T02:59:20.555984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.564461+0000","last_change":"2024-09-12T02:59:06.040714+0000","last_active":"2024-09-12T02:59:25.564461+0000","last_peered":"2024-09-12T02:59:25.564461+0000","last_clean":"2024-09-12T02:59:25.564461+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:25.564461+0000","last_undegraded":"2024-09-12T02:59:25.564461+0000","last_fullsized":"2024-09-12T02:59:25.564461+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:54.289352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":141,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221118+0000","last_change":"2024-09-12T02:59:08.071320+0000","last_active":"2024-09-12T02:59:20.221118+0000","last_peered":"2024-09-12T02:59:20.221118+0000","last_clean":"2024-09-12T02:59:20.221118+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:20.221118+0000","last_undegraded":"2024-09-12T02:59:20.221118+0000","last_fullsized":"2024-09-12T02:59:20.221118+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:38.378285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572534+0000","last_change":"2024-09-12T02:57:03.834073+0000","last_active":"2024-09-12T02:59:20.572534+0000","last_peered":"2024-09-12T02:59:20.572534+0000","last_clean":"2024-09-12T02:59:20.572534+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:20.572534+0000","last_undegraded":"2024-09-12T02:59:20.572534+0000","last_fullsized":"2024-09-12T02:59:20.572534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.261759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.564279+0000","last_change":"2024-09-12T02:59:06.046085+0000","last_active":"2024-09-12T02:59:25.564279+0000","last_peered":"2024-09-12T02:59:25.564279+0000","last_clean":"2024-09-12T02:59:25.564279+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:25.564279+0000","last_undegraded":"2024-09-12T02:59:25.564279+0000","last_fullsized":"2024-09-12T02:59:25.564279+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:35.684141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223813+0000","last_change":"2024-09-12T02:59:08.073058+0000","last_active":"2024-09-12T02:59:20.223813+0000","last_peered":"2024-09-12T02:59:20.223813+0000","last_clean":"2024-09-12T02:59:20.223813+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:20.223813+0000","last_undegraded":"2024-09-12T02:59:20.223813+0000","last_fullsized":"2024-09-12T02:59:20.223813+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.609541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572259+0000","last_change":"2024-09-12T02:59:06.053365+0000","last_active":"2024-09-12T02:59:20.572259+0000","last_peered":"2024-09-12T02:59:20.572259+0000","last_clean":"2024-09-12T02:59:20.572259+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:20.572259+0000","last_undegraded":"2024-09-12T02:59:20.572259+0000","last_fullsized":"2024-09-12T02:59:20.572259+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.562501+0000","last_change":"2024-09-12T02:59:06.040820+0000","last_active":"2024-09-12T02:59:25.562501+0000","last_peered":"2024-09-12T02:59:25.562501+0000","last_clean":"2024-09-12T02:59:25.562501+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:25.562501+0000","last_undegraded":"2024-09-12T02:59:25.562501+0000","last_fullsized":"2024-09-12T02:59:25.562501+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:41.411962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223290+0000","last_change":"2024-09-12T02:59:06.058963+0000","last_active":"2024-09-12T02:59:20.223290+0000","last_peered":"2024-09-12T02:59:20.223290+0000","last_clean":"2024-09-12T02:59:20.223290+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:20.223290+0000","last_undegraded":"2024-09-12T02:59:20.223290+0000","last_fullsized":"2024-09-12T02:59:20.223290+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.530957+0000","last_change":"2024-09-12T02:57:04.870829+0000","last_active":"2024-09-12T02:59:25.530957+0000","last_peered":"2024-09-12T02:59:25.530957+0000","last_clean":"2024-09-12T02:59:25.530957+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:25.530957+0000","last_undegraded":"2024-09-12T02:59:25.530957+0000","last_fullsized":"2024-09-12T02:59:25.530957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"60'3","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572449+0000","last_change":"2024-09-12T02:57:03.829382+0000","last_active":"2024-09-12T02:59:20.572449+0000","last_peered":"2024-09-12T02:59:20.572449+0000","last_clean":"2024-09-12T02:59:20.572449+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:20.572449+0000","last_undegraded":"2024-09-12T02:59:20.572449+0000","last_fullsized":"2024-09-12T02:59:20.572449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:10.947861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223073+0000","last_change":"2024-09-12T02:57:08.875315+0000","last_active":"2024-09-12T02:59:20.223073+0000","last_peered":"2024-09-12T02:59:20.223073+0000","last_clean":"2024-09-12T02:59:20.223073+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:20.223073+0000","last_undegraded":"2024-09-12T02:59:20.223073+0000","last_fullsized":"2024-09-12T02:59:20.223073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:29.539343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.509355+0000","last_change":"2024-09-12T02:57:04.844083+0000","last_active":"2024-09-12T02:59:25.509355+0000","last_peered":"2024-09-12T02:59:25.509355+0000","last_clean":"2024-09-12T02:59:25.509355+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:25.509355+0000","last_undegraded":"2024-09-12T02:59:25.509355+0000","last_fullsized":"2024-09-12T02:59:25.509355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220179+0000","last_change":"2024-09-12T02:59:08.061938+0000","last_active":"2024-09-12T02:59:20.220179+0000","last_peered":"2024-09-12T02:59:20.220179+0000","last_clean":"2024-09-12T02:59:20.220179+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:20.220179+0000","last_undegraded":"2024-09-12T02:59:20.220179+0000","last_fullsized":"2024-09-12T02:59:20.220179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:04.137585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221866+0000","last_change":"2024-09-12T02:57:08.881484+0000","last_active":"2024-09-12T02:59:20.221866+0000","last_peered":"2024-09-12T02:59:20.221866+0000","last_clean":"2024-09-12T02:59:20.221866+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:20.221866+0000","last_undegraded":"2024-09-12T02:59:20.221866+0000","last_fullsized":"2024-09-12T02:59:20.221866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:42.673316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.505845+0000","last_change":"2024-09-12T02:59:08.063392+0000","last_active":"2024-09-12T02:59:25.505845+0000","last_peered":"2024-09-12T02:59:25.505845+0000","last_clean":"2024-09-12T02:59:25.505845+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:25.505845+0000","last_undegraded":"2024-09-12T02:59:25.505845+0000","last_fullsized":"2024-09-12T02:59:25.505845+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:39.814573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219716+0000","last_change":"2024-09-12T02:57:03.819216+0000","last_active":"2024-09-12T02:59:20.219716+0000","last_peered":"2024-09-12T02:59:20.219716+0000","last_clean":"2024-09-12T02:59:20.219716+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:20.219716+0000","last_undegraded":"2024-09-12T02:59:20.219716+0000","last_fullsized":"2024-09-12T02:59:20.219716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.123286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221297+0000","last_change":"2024-09-12T02:57:09.034638+0000","last_active":"2024-09-12T02:59:20.221297+0000","last_peered":"2024-09-12T02:59:20.221297+0000","last_clean":"2024-09-12T02:59:20.221297+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:20.221297+0000","last_undegraded":"2024-09-12T02:59:20.221297+0000","last_fullsized":"2024-09-12T02:59:20.221297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:53.147332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.500230+0000","last_change":"2024-09-12T02:57:04.845286+0000","last_active":"2024-09-12T02:59:25.500230+0000","last_peered":"2024-09-12T02:59:25.500230+0000","last_clean":"2024-09-12T02:59:25.500230+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:25.500230+0000","last_undegraded":"2024-09-12T02:59:25.500230+0000","last_fullsized":"2024-09-12T02:59:25.500230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:28.849481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571430+0000","last_change":"2024-09-12T02:57:03.827988+0000","last_active":"2024-09-12T02:59:20.571430+0000","last_peered":"2024-09-12T02:59:20.571430+0000","last_clean":"2024-09-12T02:59:20.571430+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:20.571430+0000","last_undegraded":"2024-09-12T02:59:20.571430+0000","last_fullsized":"2024-09-12T02:59:20.571430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:31.323024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224226+0000","last_change":"2024-09-12T02:59:08.080501+0000","last_active":"2024-09-12T02:59:20.224226+0000","last_peered":"2024-09-12T02:59:20.224226+0000","last_clean":"2024-09-12T02:59:20.224226+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:20.224226+0000","last_undegraded":"2024-09-12T02:59:20.224226+0000","last_fullsized":"2024-09-12T02:59:20.224226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:19.159929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":142,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.502725+0000","last_change":"2024-09-12T02:59:08.061926+0000","last_active":"2024-09-12T02:59:25.502725+0000","last_peered":"2024-09-12T02:59:25.502725+0000","last_clean":"2024-09-12T02:59:25.502725+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:25.502725+0000","last_undegraded":"2024-09-12T02:59:25.502725+0000","last_fullsized":"2024-09-12T02:59:25.502725+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"60'3","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652743+0000","last_change":"2024-09-12T02:57:03.829818+0000","last_active":"2024-09-12T02:59:20.652743+0000","last_peered":"2024-09-12T02:59:20.652743+0000","last_clean":"2024-09-12T02:59:20.652743+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:20.652743+0000","last_undegraded":"2024-09-12T02:59:20.652743+0000","last_fullsized":"2024-09-12T02:59:20.652743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222216+0000","last_change":"2024-09-12T02:59:06.042311+0000","last_active":"2024-09-12T02:59:20.222216+0000","last_peered":"2024-09-12T02:59:20.222216+0000","last_clean":"2024-09-12T02:59:20.222216+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:20.222216+0000","last_undegraded":"2024-09-12T02:59:20.222216+0000","last_fullsized":"2024-09-12T02:59:20.222216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.548350+0000","last_change":"2024-09-12T02:57:04.850425+0000","last_active":"2024-09-12T02:59:25.548350+0000","last_peered":"2024-09-12T02:59:25.548350+0000","last_clean":"2024-09-12T02:59:25.548350+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:25.548350+0000","last_undegraded":"2024-09-12T02:59:25.548350+0000","last_fullsized":"2024-09-12T02:59:25.548350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:50.685848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221036+0000","last_change":"2024-09-12T02:59:08.080132+0000","last_active":"2024-09-12T02:59:20.221036+0000","last_peered":"2024-09-12T02:59:20.221036+0000","last_clean":"2024-09-12T02:59:20.221036+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:20.221036+0000","last_undegraded":"2024-09-12T02:59:20.221036+0000","last_fullsized":"2024-09-12T02:59:20.221036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:33.297534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554880+0000","last_change":"2024-09-12T02:57:09.030984+0000","last_active":"2024-09-12T02:59:20.554880+0000","last_peered":"2024-09-12T02:59:20.554880+0000","last_clean":"2024-09-12T02:59:20.554880+0000","last_became_active":"2024-09-12T02:57:09.029932+0000","last_became_peered":"2024-09-12T02:57:09.029932+0000","last_unstale":"2024-09-12T02:59:20.554880+0000","last_undegraded":"2024-09-12T02:59:20.554880+0000","last_fullsized":"2024-09-12T02:59:20.554880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:17.881889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.501133+0000","last_change":"2024-09-12T02:59:08.052379+0000","last_active":"2024-09-12T02:59:25.501133+0000","last_peered":"2024-09-12T02:59:25.501133+0000","last_clean":"2024-09-12T02:59:25.501133+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:25.501133+0000","last_undegraded":"2024-09-12T02:59:25.501133+0000","last_fullsized":"2024-09-12T02:59:25.501133+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:42.582966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.572839+0000","last_change":"2024-09-12T02:57:03.834859+0000","last_active":"2024-09-12T02:59:20.572839+0000","last_peered":"2024-09-12T02:59:20.572839+0000","last_clean":"2024-09-12T02:59:20.572839+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:20.572839+0000","last_undegraded":"2024-09-12T02:59:20.572839+0000","last_fullsized":"2024-09-12T02:59:20.572839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":138,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.094850+0000","last_change":"2024-09-12T02:59:06.034354+0000","last_active":"2024-09-12T02:59:21.094850+0000","last_peered":"2024-09-12T02:59:21.094850+0000","last_clean":"2024-09-12T02:59:21.094850+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:21.094850+0000","last_undegraded":"2024-09-12T02:59:21.094850+0000","last_fullsized":"2024-09-12T02:59:21.094850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:05.155351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.562188+0000","last_change":"2024-09-12T02:59:06.034822+0000","last_active":"2024-09-12T02:59:25.562188+0000","last_peered":"2024-09-12T02:59:25.562188+0000","last_clean":"2024-09-12T02:59:25.562188+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:25.562188+0000","last_undegraded":"2024-09-12T02:59:25.562188+0000","last_fullsized":"2024-09-12T02:59:25.562188+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:00.839140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220548+0000","last_change":"2024-09-12T02:59:08.054413+0000","last_active":"2024-09-12T02:59:20.220548+0000","last_peered":"2024-09-12T02:59:20.220548+0000","last_clean":"2024-09-12T02:59:20.220548+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:20.220548+0000","last_undegraded":"2024-09-12T02:59:20.220548+0000","last_fullsized":"2024-09-12T02:59:20.220548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:21.401840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220362+0000","last_change":"2024-09-12T02:59:08.063077+0000","last_active":"2024-09-12T02:59:20.220362+0000","last_peered":"2024-09-12T02:59:20.220362+0000","last_clean":"2024-09-12T02:59:20.220362+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:20.220362+0000","last_undegraded":"2024-09-12T02:59:20.220362+0000","last_fullsized":"2024-09-12T02:59:20.220362+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:52.579867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.517305+0000","last_change":"2024-09-12T02:57:04.855831+0000","last_active":"2024-09-12T02:59:25.517305+0000","last_peered":"2024-09-12T02:59:25.517305+0000","last_clean":"2024-09-12T02:59:25.517305+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:25.517305+0000","last_undegraded":"2024-09-12T02:59:25.517305+0000","last_fullsized":"2024-09-12T02:59:25.517305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.131789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224740+0000","last_change":"2024-09-12T02:59:06.046884+0000","last_active":"2024-09-12T02:59:20.224740+0000","last_peered":"2024-09-12T02:59:20.224740+0000","last_clean":"2024-09-12T02:59:20.224740+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:20.224740+0000","last_undegraded":"2024-09-12T02:59:20.224740+0000","last_fullsized":"2024-09-12T02:59:20.224740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:52.145202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227571+0000","last_change":"2024-09-12T02:59:06.062554+0000","last_active":"2024-09-12T02:59:20.227571+0000","last_peered":"2024-09-12T02:59:20.227571+0000","last_clean":"2024-09-12T02:59:20.227571+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:20.227571+0000","last_undegraded":"2024-09-12T02:59:20.227571+0000","last_fullsized":"2024-09-12T02:59:20.227571+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:27.156770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.501869+0000","last_change":"2024-09-12T02:57:04.838166+0000","last_active":"2024-09-12T02:59:25.501869+0000","last_peered":"2024-09-12T02:59:25.501869+0000","last_clean":"2024-09-12T02:59:25.501869+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:25.501869+0000","last_undegraded":"2024-09-12T02:59:25.501869+0000","last_fullsized":"2024-09-12T02:59:25.501869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:49.411999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"60'2","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893199+0000","last_change":"2024-09-12T02:57:03.800019+0000","last_active":"2024-09-12T02:59:20.893199+0000","last_peered":"2024-09-12T02:59:20.893199+0000","last_clean":"2024-09-12T02:59:20.893199+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:20.893199+0000","last_undegraded":"2024-09-12T02:59:20.893199+0000","last_fullsized":"2024-09-12T02:59:20.893199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220885+0000","last_change":"2024-09-12T02:59:08.057364+0000","last_active":"2024-09-12T02:59:20.220885+0000","last_peered":"2024-09-12T02:59:20.220885+0000","last_clean":"2024-09-12T02:59:20.220885+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:20.220885+0000","last_undegraded":"2024-09-12T02:59:20.220885+0000","last_fullsized":"2024-09-12T02:59:20.220885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.451435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.511965+0000","last_change":"2024-09-12T02:57:04.870629+0000","last_active":"2024-09-12T02:59:25.511965+0000","last_peered":"2024-09-12T02:59:25.511965+0000","last_clean":"2024-09-12T02:59:25.511965+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:25.511965+0000","last_undegraded":"2024-09-12T02:59:25.511965+0000","last_fullsized":"2024-09-12T02:59:25.511965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:11.185143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571447+0000","last_change":"2024-09-12T02:59:08.070124+0000","last_active":"2024-09-12T02:59:20.571447+0000","last_peered":"2024-09-12T02:59:20.571447+0000","last_clean":"2024-09-12T02:59:20.571447+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:20.571447+0000","last_undegraded":"2024-09-12T02:59:20.571447+0000","last_fullsized":"2024-09-12T02:59:20.571447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:14.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093938+0000","last_change":"2024-09-12T02:57:09.029506+0000","last_active":"2024-09-12T02:59:21.093938+0000","last_peered":"2024-09-12T02:59:21.093938+0000","last_clean":"2024-09-12T02:59:21.093938+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:21.093938+0000","last_undegraded":"2024-09-12T02:59:21.093938+0000","last_fullsized":"2024-09-12T02:59:21.093938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.151361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":139,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.558421+0000","last_change":"2024-09-12T02:59:06.063289+0000","last_active":"2024-09-12T02:59:25.558421+0000","last_peered":"2024-09-12T02:59:25.558421+0000","last_clean":"2024-09-12T02:59:25.558421+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:25.558421+0000","last_undegraded":"2024-09-12T02:59:25.558421+0000","last_fullsized":"2024-09-12T02:59:25.558421+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:20.383176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225192+0000","last_change":"2024-09-12T02:59:06.038764+0000","last_active":"2024-09-12T02:59:20.225192+0000","last_peered":"2024-09-12T02:59:20.225192+0000","last_clean":"2024-09-12T02:59:20.225192+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:20.225192+0000","last_undegraded":"2024-09-12T02:59:20.225192+0000","last_fullsized":"2024-09-12T02:59:20.225192+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:33.748521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":283,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.571685+0000","last_change":"2024-09-12T02:56:55.845926+0000","last_active":"2024-09-12T02:59:20.571685+0000","last_peered":"2024-09-12T02:59:20.571685+0000","last_clean":"2024-09-12T02:59:20.571685+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:20.571685+0000","last_undegraded":"2024-09-12T02:59:20.571685+0000","last_fullsized":"2024-09-12T02:59:20.571685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:56:54.718508+0000","last_clean_scrub_stamp":"2024-09-12T02:56:54.718508+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.161919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651983+0000","last_change":"2024-09-12T02:57:09.035612+0000","last_active":"2024-09-12T02:59:20.651983+0000","last_peered":"2024-09-12T02:59:20.651983+0000","last_clean":"2024-09-12T02:59:20.651983+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:20.651983+0000","last_undegraded":"2024-09-12T02:59:20.651983+0000","last_fullsized":"2024-09-12T02:59:20.651983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:43.858594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":124,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.519380+0000","last_change":"2024-09-12T02:59:06.041259+0000","last_active":"2024-09-12T02:59:25.519380+0000","last_peered":"2024-09-12T02:59:25.519380+0000","last_clean":"2024-09-12T02:59:25.519380+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:25.519380+0000","last_undegraded":"2024-09-12T02:59:25.519380+0000","last_fullsized":"2024-09-12T02:59:25.519380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:50.481819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893814+0000","last_change":"2024-09-12T02:59:06.053023+0000","last_active":"2024-09-12T02:59:20.893814+0000","last_peered":"2024-09-12T02:59:20.893814+0000","last_clean":"2024-09-12T02:59:20.893814+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:20.893814+0000","last_undegraded":"2024-09-12T02:59:20.893814+0000","last_fullsized":"2024-09-12T02:59:20.893814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:23.630626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651340+0000","last_change":"2024-09-12T02:57:09.026670+0000","last_active":"2024-09-12T02:59:20.651340+0000","last_peered":"2024-09-12T02:59:20.651340+0000","last_clean":"2024-09-12T02:59:20.651340+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:20.651340+0000","last_undegraded":"2024-09-12T02:59:20.651340+0000","last_fullsized":"2024-09-12T02:59:20.651340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.082830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.563012+0000","last_change":"2024-09-12T02:59:06.048181+0000","last_active":"2024-09-12T02:59:25.563012+0000","last_peered":"2024-09-12T02:59:25.563012+0000","last_clean":"2024-09-12T02:59:25.563012+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:25.563012+0000","last_undegraded":"2024-09-12T02:59:25.563012+0000","last_fullsized":"2024-09-12T02:59:25.563012+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:18.582473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":127,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.219594+0000","last_change":"2024-09-12T02:57:03.800392+0000","last_active":"2024-09-12T02:59:20.219594+0000","last_peered":"2024-09-12T02:59:20.219594+0000","last_clean":"2024-09-12T02:59:20.219594+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:20.219594+0000","last_undegraded":"2024-09-12T02:59:20.219594+0000","last_fullsized":"2024-09-12T02:59:20.219594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:23.239161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095006+0000","last_change":"2024-09-12T02:59:06.034598+0000","last_active":"2024-09-12T02:59:21.095006+0000","last_peered":"2024-09-12T02:59:21.095006+0000","last_clean":"2024-09-12T02:59:21.095006+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:21.095006+0000","last_undegraded":"2024-09-12T02:59:21.095006+0000","last_fullsized":"2024-09-12T02:59:21.095006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:16.580115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.558358+0000","last_change":"2024-09-12T02:57:04.875158+0000","last_active":"2024-09-12T02:59:25.558358+0000","last_peered":"2024-09-12T02:59:25.558358+0000","last_clean":"2024-09-12T02:59:25.558358+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:25.558358+0000","last_undegraded":"2024-09-12T02:59:25.558358+0000","last_fullsized":"2024-09-12T02:59:25.558358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:32.035107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893238+0000","last_change":"2024-09-12T02:57:03.793017+0000","last_active":"2024-09-12T02:59:20.893238+0000","last_peered":"2024-09-12T02:59:20.893238+0000","last_clean":"2024-09-12T02:59:20.893238+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:20.893238+0000","last_undegraded":"2024-09-12T02:59:20.893238+0000","last_fullsized":"2024-09-12T02:59:20.893238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:00.744104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.222460+0000","last_change":"2024-09-12T02:59:06.062947+0000","last_active":"2024-09-12T02:59:20.222460+0000","last_peered":"2024-09-12T02:59:20.222460+0000","last_clean":"2024-09-12T02:59:20.222460+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:20.222460+0000","last_undegraded":"2024-09-12T02:59:20.222460+0000","last_fullsized":"2024-09-12T02:59:20.222460+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:19.386600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.547290+0000","last_change":"2024-09-12T02:57:04.872730+0000","last_active":"2024-09-12T02:59:25.547290+0000","last_peered":"2024-09-12T02:59:25.547290+0000","last_clean":"2024-09-12T02:59:25.547290+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:25.547290+0000","last_undegraded":"2024-09-12T02:59:25.547290+0000","last_fullsized":"2024-09-12T02:59:25.547290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:21.160598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.224723+0000","last_change":"2024-09-12T02:57:03.798367+0000","last_active":"2024-09-12T02:59:20.224723+0000","last_peered":"2024-09-12T02:59:20.224723+0000","last_clean":"2024-09-12T02:59:20.224723+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:20.224723+0000","last_undegraded":"2024-09-12T02:59:20.224723+0000","last_fullsized":"2024-09-12T02:59:20.224723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:37.881468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221617+0000","last_change":"2024-09-12T02:59:08.073044+0000","last_active":"2024-09-12T02:59:20.221617+0000","last_peered":"2024-09-12T02:59:20.221617+0000","last_clean":"2024-09-12T02:59:20.221617+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:20.221617+0000","last_undegraded":"2024-09-12T02:59:20.221617+0000","last_fullsized":"2024-09-12T02:59:20.221617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.547512+0000","last_change":"2024-09-12T02:57:04.874388+0000","last_active":"2024-09-12T02:59:25.547512+0000","last_peered":"2024-09-12T02:59:25.547512+0000","last_clean":"2024-09-12T02:59:25.547512+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:25.547512+0000","last_undegraded":"2024-09-12T02:59:25.547512+0000","last_fullsized":"2024-09-12T02:59:25.547512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:14:38.601069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893455+0000","last_change":"2024-09-12T02:59:08.079372+0000","last_active":"2024-09-12T02:59:20.893455+0000","last_peered":"2024-09-12T02:59:20.893455+0000","last_clean":"2024-09-12T02:59:20.893455+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:20.893455+0000","last_undegraded":"2024-09-12T02:59:20.893455+0000","last_fullsized":"2024-09-12T02:59:20.893455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:04.951763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":119,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093850+0000","last_change":"2024-09-12T02:57:08.878499+0000","last_active":"2024-09-12T02:59:21.093850+0000","last_peered":"2024-09-12T02:59:21.093850+0000","last_clean":"2024-09-12T02:59:21.093850+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:21.093850+0000","last_undegraded":"2024-09-12T02:59:21.093850+0000","last_fullsized":"2024-09-12T02:59:21.093850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:35.601659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.526617+0000","last_change":"2024-09-12T02:57:04.850565+0000","last_active":"2024-09-12T02:59:25.526617+0000","last_peered":"2024-09-12T02:59:25.526617+0000","last_clean":"2024-09-12T02:59:25.526617+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:25.526617+0000","last_undegraded":"2024-09-12T02:59:25.526617+0000","last_fullsized":"2024-09-12T02:59:25.526617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651642+0000","last_change":"2024-09-12T02:57:03.810788+0000","last_active":"2024-09-12T02:59:20.651642+0000","last_peered":"2024-09-12T02:59:20.651642+0000","last_clean":"2024-09-12T02:59:20.651642+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:20.651642+0000","last_undegraded":"2024-09-12T02:59:20.651642+0000","last_fullsized":"2024-09-12T02:59:20.651642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:09.939582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555842+0000","last_change":"2024-09-12T02:57:09.025330+0000","last_active":"2024-09-12T02:59:20.555842+0000","last_peered":"2024-09-12T02:59:20.555842+0000","last_clean":"2024-09-12T02:59:20.555842+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:20.555842+0000","last_undegraded":"2024-09-12T02:59:20.555842+0000","last_fullsized":"2024-09-12T02:59:20.555842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:02.123129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.551239+0000","last_change":"2024-09-12T02:57:04.871915+0000","last_active":"2024-09-12T02:59:25.551239+0000","last_peered":"2024-09-12T02:59:25.551239+0000","last_clean":"2024-09-12T02:59:25.551239+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:25.551239+0000","last_undegraded":"2024-09-12T02:59:25.551239+0000","last_fullsized":"2024-09-12T02:59:25.551239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:44.565607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221668+0000","last_change":"2024-09-12T02:59:06.050751+0000","last_active":"2024-09-12T02:59:20.221668+0000","last_peered":"2024-09-12T02:59:20.221668+0000","last_clean":"2024-09-12T02:59:20.221668+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:20.221668+0000","last_undegraded":"2024-09-12T02:59:20.221668+0000","last_fullsized":"2024-09-12T02:59:20.221668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.271840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555552+0000","last_change":"2024-09-12T02:59:08.061102+0000","last_active":"2024-09-12T02:59:20.555552+0000","last_peered":"2024-09-12T02:59:20.555552+0000","last_clean":"2024-09-12T02:59:20.555552+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:20.555552+0000","last_undegraded":"2024-09-12T02:59:20.555552+0000","last_fullsized":"2024-09-12T02:59:20.555552+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:58.125545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.549630+0000","last_change":"2024-09-12T02:57:04.852817+0000","last_active":"2024-09-12T02:59:25.549630+0000","last_peered":"2024-09-12T02:59:25.549630+0000","last_clean":"2024-09-12T02:59:25.549630+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:25.549630+0000","last_undegraded":"2024-09-12T02:59:25.549630+0000","last_fullsized":"2024-09-12T02:59:25.549630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:51.955247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.095128+0000","last_change":"2024-09-12T02:57:03.802392+0000","last_active":"2024-09-12T02:59:21.095128+0000","last_peered":"2024-09-12T02:59:21.095128+0000","last_clean":"2024-09-12T02:59:21.095128+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:21.095128+0000","last_undegraded":"2024-09-12T02:59:21.095128+0000","last_fullsized":"2024-09-12T02:59:21.095128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.783167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.227503+0000","last_change":"2024-09-12T02:59:06.046162+0000","last_active":"2024-09-12T02:59:20.227503+0000","last_peered":"2024-09-12T02:59:20.227503+0000","last_clean":"2024-09-12T02:59:20.227503+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:20.227503+0000","last_undegraded":"2024-09-12T02:59:20.227503+0000","last_fullsized":"2024-09-12T02:59:20.227503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.056594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.524751+0000","last_change":"2024-09-12T02:57:04.848720+0000","last_active":"2024-09-12T02:59:25.524751+0000","last_peered":"2024-09-12T02:59:25.524751+0000","last_clean":"2024-09-12T02:59:25.524751+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:25.524751+0000","last_undegraded":"2024-09-12T02:59:25.524751+0000","last_fullsized":"2024-09-12T02:59:25.524751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:37.716140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'26","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.468232+0000","last_change":"2024-09-12T02:57:03.809560+0000","last_active":"2024-09-12T02:59:25.468232+0000","last_peered":"2024-09-12T02:59:25.468232+0000","last_clean":"2024-09-12T02:59:25.468232+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:25.468232+0000","last_undegraded":"2024-09-12T02:59:25.468232+0000","last_fullsized":"2024-09-12T02:59:25.468232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:50.992418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220586+0000","last_change":"2024-09-12T02:59:08.086853+0000","last_active":"2024-09-12T02:59:20.220586+0000","last_peered":"2024-09-12T02:59:20.220586+0000","last_clean":"2024-09-12T02:59:20.220586+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:20.220586+0000","last_undegraded":"2024-09-12T02:59:20.220586+0000","last_fullsized":"2024-09-12T02:59:20.220586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:02.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.556091+0000","last_change":"2024-09-12T02:57:04.840971+0000","last_active":"2024-09-12T02:59:25.556091+0000","last_peered":"2024-09-12T02:59:25.556091+0000","last_clean":"2024-09-12T02:59:25.556091+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:25.556091+0000","last_undegraded":"2024-09-12T02:59:25.556091+0000","last_fullsized":"2024-09-12T02:59:25.556091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:11.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"60'5","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.220978+0000","last_change":"2024-09-12T02:59:08.072309+0000","last_active":"2024-09-12T02:59:20.220978+0000","last_peered":"2024-09-12T02:59:20.220978+0000","last_clean":"2024-09-12T02:59:20.220978+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:20.220978+0000","last_undegraded":"2024-09-12T02:59:20.220978+0000","last_fullsized":"2024-09-12T02:59:20.220978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:22.473638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.223656+0000","last_change":"2024-09-12T02:59:08.080949+0000","last_active":"2024-09-12T02:59:20.223656+0000","last_peered":"2024-09-12T02:59:20.223656+0000","last_clean":"2024-09-12T02:59:20.223656+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:20.223656+0000","last_undegraded":"2024-09-12T02:59:20.223656+0000","last_fullsized":"2024-09-12T02:59:20.223656+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:41.284531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":141,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.564611+0000","last_change":"2024-09-12T02:59:06.040772+0000","last_active":"2024-09-12T02:59:25.564611+0000","last_peered":"2024-09-12T02:59:25.564611+0000","last_clean":"2024-09-12T02:59:25.564611+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:25.564611+0000","last_undegraded":"2024-09-12T02:59:25.564611+0000","last_fullsized":"2024-09-12T02:59:25.564611+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:31.077375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.225642+0000","last_change":"2024-09-12T02:59:06.033384+0000","last_active":"2024-09-12T02:59:20.225642+0000","last_peered":"2024-09-12T02:59:20.225642+0000","last_clean":"2024-09-12T02:59:20.225642+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:20.225642+0000","last_undegraded":"2024-09-12T02:59:20.225642+0000","last_fullsized":"2024-09-12T02:59:20.225642+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:41.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555414+0000","last_change":"2024-09-12T02:59:08.074397+0000","last_active":"2024-09-12T02:59:20.555414+0000","last_peered":"2024-09-12T02:59:20.555414+0000","last_clean":"2024-09-12T02:59:20.555414+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:20.555414+0000","last_undegraded":"2024-09-12T02:59:20.555414+0000","last_fullsized":"2024-09-12T02:59:20.555414+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:11.510184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":58,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.564031+0000","last_change":"2024-09-12T02:59:06.035397+0000","last_active":"2024-09-12T02:59:25.564031+0000","last_peered":"2024-09-12T02:59:25.564031+0000","last_clean":"2024-09-12T02:59:25.564031+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:25.564031+0000","last_undegraded":"2024-09-12T02:59:25.564031+0000","last_fullsized":"2024-09-12T02:59:25.564031+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:13.552932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652658+0000","last_change":"2024-09-12T02:59:06.055518+0000","last_active":"2024-09-12T02:59:20.652658+0000","last_peered":"2024-09-12T02:59:20.652658+0000","last_clean":"2024-09-12T02:59:20.652658+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:20.652658+0000","last_undegraded":"2024-09-12T02:59:20.652658+0000","last_fullsized":"2024-09-12T02:59:20.652658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:09.456324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555310+0000","last_change":"2024-09-12T02:59:06.038606+0000","last_active":"2024-09-12T02:59:20.555310+0000","last_peered":"2024-09-12T02:59:20.555310+0000","last_clean":"2024-09-12T02:59:20.555310+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:20.555310+0000","last_undegraded":"2024-09-12T02:59:20.555310+0000","last_fullsized":"2024-09-12T02:59:20.555310+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.456399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:21.093743+0000","last_change":"2024-09-12T02:57:09.029637+0000","last_active":"2024-09-12T02:59:21.093743+0000","last_peered":"2024-09-12T02:59:21.093743+0000","last_clean":"2024-09-12T02:59:21.093743+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:21.093743+0000","last_undegraded":"2024-09-12T02:59:21.093743+0000","last_fullsized":"2024-09-12T02:59:21.093743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:53.652187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.500575+0000","last_change":"2024-09-12T02:59:08.058453+0000","last_active":"2024-09-12T02:59:25.500575+0000","last_peered":"2024-09-12T02:59:25.500575+0000","last_clean":"2024-09-12T02:59:25.500575+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:25.500575+0000","last_undegraded":"2024-09-12T02:59:25.500575+0000","last_fullsized":"2024-09-12T02:59:25.500575+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.734564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":48,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.221549+0000","last_change":"2024-09-12T02:59:06.065547+0000","last_active":"2024-09-12T02:59:20.221549+0000","last_peered":"2024-09-12T02:59:20.221549+0000","last_clean":"2024-09-12T02:59:20.221549+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:20.221549+0000","last_undegraded":"2024-09-12T02:59:20.221549+0000","last_fullsized":"2024-09-12T02:59:20.221549+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:31.274480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.652330+0000","last_change":"2024-09-12T02:59:06.057027+0000","last_active":"2024-09-12T02:59:20.652330+0000","last_peered":"2024-09-12T02:59:20.652330+0000","last_clean":"2024-09-12T02:59:20.652330+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:20.652330+0000","last_undegraded":"2024-09-12T02:59:20.652330+0000","last_fullsized":"2024-09-12T02:59:20.652330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:00.045309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.509252+0000","last_change":"2024-09-12T02:57:04.835320+0000","last_active":"2024-09-12T02:59:25.509252+0000","last_peered":"2024-09-12T02:59:25.509252+0000","last_clean":"2024-09-12T02:59:25.509252+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:25.509252+0000","last_undegraded":"2024-09-12T02:59:25.509252+0000","last_fullsized":"2024-09-12T02:59:25.509252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554716+0000","last_change":"2024-09-12T02:57:03.804483+0000","last_active":"2024-09-12T02:59:20.554716+0000","last_peered":"2024-09-12T02:59:20.554716+0000","last_clean":"2024-09-12T02:59:20.554716+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:20.554716+0000","last_undegraded":"2024-09-12T02:59:20.554716+0000","last_fullsized":"2024-09-12T02:59:20.554716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:45.039277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.651664+0000","last_change":"2024-09-12T02:57:03.816031+0000","last_active":"2024-09-12T02:59:20.651664+0000","last_peered":"2024-09-12T02:59:20.651664+0000","last_clean":"2024-09-12T02:59:20.651664+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:20.651664+0000","last_undegraded":"2024-09-12T02:59:20.651664+0000","last_fullsized":"2024-09-12T02:59:20.651664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:52.397584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.521345+0000","last_change":"2024-09-12T02:57:04.868916+0000","last_active":"2024-09-12T02:59:25.521345+0000","last_peered":"2024-09-12T02:59:25.521345+0000","last_clean":"2024-09-12T02:59:25.521345+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:25.521345+0000","last_undegraded":"2024-09-12T02:59:25.521345+0000","last_fullsized":"2024-09-12T02:59:25.521345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.893710+0000","last_change":"2024-09-12T02:59:06.049017+0000","last_active":"2024-09-12T02:59:20.893710+0000","last_peered":"2024-09-12T02:59:20.893710+0000","last_clean":"2024-09-12T02:59:20.893710+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:20.893710+0000","last_undegraded":"2024-09-12T02:59:20.893710+0000","last_fullsized":"2024-09-12T02:59:20.893710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.513391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.554672+0000","last_change":"2024-09-12T02:57:03.819110+0000","last_active":"2024-09-12T02:59:20.554672+0000","last_peered":"2024-09-12T02:59:20.554672+0000","last_clean":"2024-09-12T02:59:20.554672+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:20.554672+0000","last_undegraded":"2024-09-12T02:59:20.554672+0000","last_fullsized":"2024-09-12T02:59:20.554672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:22.258181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.503292+0000","last_change":"2024-09-12T02:57:04.837895+0000","last_active":"2024-09-12T02:59:25.503292+0000","last_peered":"2024-09-12T02:59:25.503292+0000","last_clean":"2024-09-12T02:59:25.503292+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:25.503292+0000","last_undegraded":"2024-09-12T02:59:25.503292+0000","last_fullsized":"2024-09-12T02:59:25.503292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:32.331528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:20.555699+0000","last_change":"2024-09-12T02:57:08.870685+0000","last_active":"2024-09-12T02:59:20.555699+0000","last_peered":"2024-09-12T02:59:20.555699+0000","last_clean":"2024-09-12T02:59:20.555699+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:20.555699+0000","last_undegraded":"2024-09-12T02:59:20.555699+0000","last_fullsized":"2024-09-12T02:59:20.555699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:04.208734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.532088+0000","last_change":"2024-09-12T02:57:04.848835+0000","last_active":"2024-09-12T02:59:25.532088+0000","last_peered":"2024-09-12T02:59:25.532088+0000","last_clean":"2024-09-12T02:59:25.532088+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:25.532088+0000","last_undegraded":"2024-09-12T02:59:25.532088+0000","last_fullsized":"2024-09-12T02:59:25.532088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:04.175247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.554097+0000","last_change":"2024-09-12T02:59:06.035202+0000","last_active":"2024-09-12T02:59:25.554097+0000","last_peered":"2024-09-12T02:59:25.554097+0000","last_clean":"2024-09-12T02:59:25.554097+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:25.554097+0000","last_undegraded":"2024-09-12T02:59:25.554097+0000","last_fullsized":"2024-09-12T02:59:25.554097+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:38.826721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.562327+0000","last_change":"2024-09-12T02:59:06.039795+0000","last_active":"2024-09-12T02:59:25.562327+0000","last_peered":"2024-09-12T02:59:25.562327+0000","last_clean":"2024-09-12T02:59:25.562327+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:25.562327+0000","last_undegraded":"2024-09-12T02:59:25.562327+0000","last_fullsized":"2024-09-12T02:59:25.562327+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.507483+0000","last_change":"2024-09-12T02:57:04.847115+0000","last_active":"2024-09-12T02:59:25.507483+0000","last_peered":"2024-09-12T02:59:25.507483+0000","last_clean":"2024-09-12T02:59:25.507483+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:25.507483+0000","last_undegraded":"2024-09-12T02:59:25.507483+0000","last_fullsized":"2024-09-12T02:59:25.507483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.356599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.521611+0000","last_change":"2024-09-12T02:57:04.868860+0000","last_active":"2024-09-12T02:59:25.521611+0000","last_peered":"2024-09-12T02:59:25.521611+0000","last_clean":"2024-09-12T02:59:25.521611+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:25.521611+0000","last_undegraded":"2024-09-12T02:59:25.521611+0000","last_fullsized":"2024-09-12T02:59:25.521611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:39.080055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.501192+0000","last_change":"2024-09-12T02:59:08.055950+0000","last_active":"2024-09-12T02:59:25.501192+0000","last_peered":"2024-09-12T02:59:25.501192+0000","last_clean":"2024-09-12T02:59:25.501192+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:25.501192+0000","last_undegraded":"2024-09-12T02:59:25.501192+0000","last_fullsized":"2024-09-12T02:59:25.501192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.808972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":139,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.549916+0000","last_change":"2024-09-12T02:57:04.853496+0000","last_active":"2024-09-12T02:59:25.549916+0000","last_peered":"2024-09-12T02:59:25.549916+0000","last_clean":"2024-09-12T02:59:25.549916+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:25.549916+0000","last_undegraded":"2024-09-12T02:59:25.549916+0000","last_fullsized":"2024-09-12T02:59:25.549916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.520962+0000","last_change":"2024-09-12T02:57:04.857176+0000","last_active":"2024-09-12T02:59:25.520962+0000","last_peered":"2024-09-12T02:59:25.520962+0000","last_clean":"2024-09-12T02:59:25.520962+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:25.520962+0000","last_undegraded":"2024-09-12T02:59:25.520962+0000","last_fullsized":"2024-09-12T02:59:25.520962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:11.898580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.563039+0000","last_change":"2024-09-12T02:59:06.064508+0000","last_active":"2024-09-12T02:59:25.563039+0000","last_peered":"2024-09-12T02:59:25.563039+0000","last_clean":"2024-09-12T02:59:25.563039+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:25.563039+0000","last_undegraded":"2024-09-12T02:59:25.563039+0000","last_fullsized":"2024-09-12T02:59:25.563039+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:09.089943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.521336+0000","last_change":"2024-09-12T02:57:04.870686+0000","last_active":"2024-09-12T02:59:25.521336+0000","last_peered":"2024-09-12T02:59:25.521336+0000","last_clean":"2024-09-12T02:59:25.521336+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:25.521336+0000","last_undegraded":"2024-09-12T02:59:25.521336+0000","last_fullsized":"2024-09-12T02:59:25.521336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":57,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.563710+0000","last_change":"2024-09-12T02:59:06.039130+0000","last_active":"2024-09-12T02:59:25.563710+0000","last_peered":"2024-09-12T02:59:25.563710+0000","last_clean":"2024-09-12T02:59:25.563710+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:25.563710+0000","last_undegraded":"2024-09-12T02:59:25.563710+0000","last_fullsized":"2024-09-12T02:59:25.563710+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:47.700652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.550007+0000","last_change":"2024-09-12T02:57:04.852823+0000","last_active":"2024-09-12T02:59:25.550007+0000","last_peered":"2024-09-12T02:59:25.550007+0000","last_clean":"2024-09-12T02:59:25.550007+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:25.550007+0000","last_undegraded":"2024-09-12T02:59:25.550007+0000","last_fullsized":"2024-09-12T02:59:25.550007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.533009+0000","last_change":"2024-09-12T02:57:04.870843+0000","last_active":"2024-09-12T02:59:25.533009+0000","last_peered":"2024-09-12T02:59:25.533009+0000","last_clean":"2024-09-12T02:59:25.533009+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:25.533009+0000","last_undegraded":"2024-09-12T02:59:25.533009+0000","last_fullsized":"2024-09-12T02:59:25.533009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.450094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.546596+0000","last_change":"2024-09-12T02:57:04.853343+0000","last_active":"2024-09-12T02:59:25.546596+0000","last_peered":"2024-09-12T02:59:25.546596+0000","last_clean":"2024-09-12T02:59:25.546596+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:25.546596+0000","last_undegraded":"2024-09-12T02:59:25.546596+0000","last_fullsized":"2024-09-12T02:59:25.546596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:00.400578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.529999+0000","last_change":"2024-09-12T02:57:04.858323+0000","last_active":"2024-09-12T02:59:25.529999+0000","last_peered":"2024-09-12T02:59:25.529999+0000","last_clean":"2024-09-12T02:59:25.529999+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:25.529999+0000","last_undegraded":"2024-09-12T02:59:25.529999+0000","last_fullsized":"2024-09-12T02:59:25.529999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.896065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.562193+0000","last_change":"2024-09-12T02:59:06.052737+0000","last_active":"2024-09-12T02:59:25.562193+0000","last_peered":"2024-09-12T02:59:25.562193+0000","last_clean":"2024-09-12T02:59:25.562193+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:25.562193+0000","last_undegraded":"2024-09-12T02:59:25.562193+0000","last_fullsized":"2024-09-12T02:59:25.562193+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:35.122045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.563316+0000","last_change":"2024-09-12T02:59:06.033376+0000","last_active":"2024-09-12T02:59:25.563316+0000","last_peered":"2024-09-12T02:59:25.563316+0000","last_clean":"2024-09-12T02:59:25.563316+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:25.563316+0000","last_undegraded":"2024-09-12T02:59:25.563316+0000","last_fullsized":"2024-09-12T02:59:25.563316+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:58.904459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.505167+0000","last_change":"2024-09-12T02:59:08.058142+0000","last_active":"2024-09-12T02:59:25.505167+0000","last_peered":"2024-09-12T02:59:25.505167+0000","last_clean":"2024-09-12T02:59:25.505167+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:25.505167+0000","last_undegraded":"2024-09-12T02:59:25.505167+0000","last_fullsized":"2024-09-12T02:59:25.505167+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:34.922114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.502422+0000","last_change":"2024-09-12T02:57:04.842663+0000","last_active":"2024-09-12T02:59:25.502422+0000","last_peered":"2024-09-12T02:59:25.502422+0000","last_clean":"2024-09-12T02:59:25.502422+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:25.502422+0000","last_undegraded":"2024-09-12T02:59:25.502422+0000","last_fullsized":"2024-09-12T02:59:25.502422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.747138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.530158+0000","last_change":"2024-09-12T02:57:04.858059+0000","last_active":"2024-09-12T02:59:25.530158+0000","last_peered":"2024-09-12T02:59:25.530158+0000","last_clean":"2024-09-12T02:59:25.530158+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:25.530158+0000","last_undegraded":"2024-09-12T02:59:25.530158+0000","last_fullsized":"2024-09-12T02:59:25.530158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.505916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.532892+0000","last_change":"2024-09-12T02:57:04.867205+0000","last_active":"2024-09-12T02:59:25.532892+0000","last_peered":"2024-09-12T02:59:25.532892+0000","last_clean":"2024-09-12T02:59:25.532892+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:25.532892+0000","last_undegraded":"2024-09-12T02:59:25.532892+0000","last_fullsized":"2024-09-12T02:59:25.532892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:24.247665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.561834+0000","last_change":"2024-09-12T02:59:06.053463+0000","last_active":"2024-09-12T02:59:25.561834+0000","last_peered":"2024-09-12T02:59:25.561834+0000","last_clean":"2024-09-12T02:59:25.561834+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:25.561834+0000","last_undegraded":"2024-09-12T02:59:25.561834+0000","last_fullsized":"2024-09-12T02:59:25.561834+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:12.272345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.544748+0000","last_change":"2024-09-12T02:57:47.806046+0000","last_active":"2024-09-12T02:59:25.544748+0000","last_peered":"2024-09-12T02:59:25.544748+0000","last_clean":"2024-09-12T02:59:25.544748+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:25.544748+0000","last_undegraded":"2024-09-12T02:59:25.544748+0000","last_fullsized":"2024-09-12T02:59:25.544748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:11.597994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":142,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.563101+0000","last_change":"2024-09-12T02:59:06.058593+0000","last_active":"2024-09-12T02:59:25.563101+0000","last_peered":"2024-09-12T02:59:25.563101+0000","last_clean":"2024-09-12T02:59:25.563101+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:25.563101+0000","last_undegraded":"2024-09-12T02:59:25.563101+0000","last_fullsized":"2024-09-12T02:59:25.563101+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.306038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":139,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.558519+0000","last_change":"2024-09-12T02:59:06.066878+0000","last_active":"2024-09-12T02:59:25.558519+0000","last_peered":"2024-09-12T02:59:25.558519+0000","last_clean":"2024-09-12T02:59:25.558519+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:25.558519+0000","last_undegraded":"2024-09-12T02:59:25.558519+0000","last_fullsized":"2024-09-12T02:59:25.558519+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:37.621838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":129,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.537763+0000","last_change":"2024-09-12T02:57:04.846477+0000","last_active":"2024-09-12T02:59:25.537763+0000","last_peered":"2024-09-12T02:59:25.537763+0000","last_clean":"2024-09-12T02:59:25.537763+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:25.537763+0000","last_undegraded":"2024-09-12T02:59:25.537763+0000","last_fullsized":"2024-09-12T02:59:25.537763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:23.122196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.562915+0000","last_change":"2024-09-12T02:59:06.052855+0000","last_active":"2024-09-12T02:59:25.562915+0000","last_peered":"2024-09-12T02:59:25.562915+0000","last_clean":"2024-09-12T02:59:25.562915+0000","last_became_active":"2024-09-12T02:59:06.051893+0000","last_became_peered":"2024-09-12T02:59:06.051893+0000","last_unstale":"2024-09-12T02:59:25.562915+0000","last_undegraded":"2024-09-12T02:59:25.562915+0000","last_fullsized":"2024-09-12T02:59:25.562915+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:59.682086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":128,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.538055+0000","last_change":"2024-09-12T02:57:04.842862+0000","last_active":"2024-09-12T02:59:25.538055+0000","last_peered":"2024-09-12T02:59:25.538055+0000","last_clean":"2024-09-12T02:59:25.538055+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:25.538055+0000","last_undegraded":"2024-09-12T02:59:25.538055+0000","last_fullsized":"2024-09-12T02:59:25.538055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:25.467096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.564349+0000","last_change":"2024-09-12T02:59:06.050998+0000","last_active":"2024-09-12T02:59:25.564349+0000","last_peered":"2024-09-12T02:59:25.564349+0000","last_clean":"2024-09-12T02:59:25.564349+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:25.564349+0000","last_undegraded":"2024-09-12T02:59:25.564349+0000","last_fullsized":"2024-09-12T02:59:25.564349+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:41.882534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.502793+0000","last_change":"2024-09-12T02:57:04.840965+0000","last_active":"2024-09-12T02:59:25.502793+0000","last_peered":"2024-09-12T02:59:25.502793+0000","last_clean":"2024-09-12T02:59:25.502793+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:25.502793+0000","last_undegraded":"2024-09-12T02:59:25.502793+0000","last_fullsized":"2024-09-12T02:59:25.502793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:59.551389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.501551+0000","last_change":"2024-09-12T02:59:08.055576+0000","last_active":"2024-09-12T02:59:25.501551+0000","last_peered":"2024-09-12T02:59:25.501551+0000","last_clean":"2024-09-12T02:59:25.501551+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:25.501551+0000","last_undegraded":"2024-09-12T02:59:25.501551+0000","last_fullsized":"2024-09-12T02:59:25.501551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:55.285218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":133,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T02:59:25.555875+0000","last_change":"2024-09-12T02:57:04.851358+0000","last_active":"2024-09-12T02:59:25.555875+0000","last_peered":"2024-09-12T02:59:25.555875+0000","last_clean":"2024-09-12T02:59:25.555875+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:25.555875+0000","last_undegraded":"2024-09-12T02:59:25.555875+0000","last_fullsized":"2024-09-12T02:59:25.555875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:49.075084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":974848,"data_stored":516274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":925696,"data_stored":478424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509477,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1527808,"data_stored":1069119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542181,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28508,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343332,"statfs":{"total":96636764160,"available":96607571968,"internally_reserved":0,"allocated":1519616,"data_stored":1069063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":970752,"data_stored":515963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906951,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29016,"kb_used_data":904,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342824,"statfs":{"total":96636764160,"available":96607051776,"internally_reserved":0,"allocated":925696,"data_stored":478203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":933888,"data_stored":478239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":478273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:59:33.586 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.586 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.586 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.586 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.587 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.587 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.587 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.587 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.587 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.587 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.587 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.587 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.587 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.588 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.588 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.588 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.588 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.588 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.588 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.588 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.588 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.588 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.589 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.589 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.589 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.589 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.589 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.589 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.589 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.589 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.590 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.590 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.590 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.590 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.590 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.590 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.590 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.591 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.591 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.591 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.591 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.591 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.591 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.591 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.591 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.591 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.592 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.592 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T02:56:54.718508+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=56, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.592 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.592 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.592 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.592 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.592 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.592 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.592 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.593 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.593 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.593 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.593 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.593 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.593 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.593 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.593 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.594 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.594 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.594 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.594 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.594 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.594 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.594 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.594 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.595 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.595 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.595 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.595 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.595 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.595 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.595 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.595 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.595 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.596 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.596 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.596 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.596 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.596 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.596 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.596 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.596 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.597 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.597 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.597 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.597 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.597 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.597 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.597 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.597 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.598 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.598 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.598 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.598 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.598 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.598 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.598 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.598 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.598 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.599 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.599 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.599 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.599 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.599 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.599 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.600 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.600 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.600 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.600 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.600 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.600 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.600 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.601 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.601 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.601 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.601 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.601 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.601 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.602 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.602 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.602 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.602 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.602 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:33.602 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T02:59:33.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:59:33.702 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T02:59:53.603 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T02:59:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.756+0000 7f4b53200640 1 Processor -- start 2024-09-12T02:59:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.756+0000 7f4b53200640 1 -- start start 2024-09-12T02:59:53.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b53200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b54157f70 0x7f4b540c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:53.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b53200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b54070240 0x7f4b5406cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:53.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b53200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b54070da0 con 0x7f4b5415b3c0 2024-09-12T02:59:53.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b53200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f4b5415b920 con 0x7f4b54157f70 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b53200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4b54070820 con 0x7f4b54070240 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b51e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b54157f70 0x7f4b540c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b52800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4b5415b3c0 0x7f4b540ce1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:42134/0 (socket says 172.21.15.63:42134) 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b52800640 1 -- 172.21.15.63:0/2926126498 learned_addr learned my addr 172.21.15.63:0/2926126498 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b49400640 1 --2- 172.21.15.63:0/2926126498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b54070240 0x7f4b5406cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b51e00640 1 -- 172.21.15.63:0/2926126498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b54070240 msgr2=0x7f4b5406cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b51e00640 1 --2- 172.21.15.63:0/2926126498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b54070240 0x7f4b5406cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b51e00640 1 -- 172.21.15.63:0/2926126498 >> v1:172.21.15.63:6789/0 conn(0x7f4b5415b3c0 legacy=0x7f4b540ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b51e00640 1 -- 172.21.15.63:0/2926126498 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b54071040 con 0x7f4b54157f70 2024-09-12T02:59:53.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.760+0000 7f4b51400640 1 -- 172.21.15.63:0/2926126498 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815707217 0 0) 0x7f4b54070da0 con 0x7f4b5415b3c0 2024-09-12T02:59:53.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b51e00640 1 --2- 172.21.15.63:0/2926126498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 0x7f4b540c8c80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009d90 tx=0x7f4b4401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196199234793ca73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:53.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b51400640 1 -- 172.21.15.63:0/2926126498 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b440b4070 con 0x7f4b54157f70 2024-09-12T02:59:53.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b51400640 1 -- 172.21.15.63:0/2926126498 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b440af600 con 0x7f4b54157f70 2024-09-12T02:59:53.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b51400640 1 -- 172.21.15.63:0/2926126498 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b440af9d0 con 0x7f4b54157f70 2024-09-12T02:59:53.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 -- 172.21.15.63:0/2926126498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 msgr2=0x7f4b540c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:53.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 --2- 172.21.15.63:0/2926126498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 0x7f4b540c8c80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009d90 tx=0x7f4b4401f150 comp rx=0 tx=0).stop 2024-09-12T02:59:53.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 -- 172.21.15.63:0/2926126498 shutdown_connections 2024-09-12T02:59:53.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 --2- 172.21.15.63:0/2926126498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b54070240 0x7f4b5406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:53.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 --2- 172.21.15.63:0/2926126498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 0x7f4b540c8c80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:53.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 -- 172.21.15.63:0/2926126498 >> 172.21.15.63:0/2926126498 conn(0x7f4b54067a00 msgr2=0x7f4b54067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:53.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 -- 172.21.15.63:0/2926126498 shutdown_connections 2024-09-12T02:59:53.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 -- 172.21.15.63:0/2926126498 wait complete. 2024-09-12T02:59:53.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 Processor -- start 2024-09-12T02:59:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 -- start start 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b54070240 0x7f4b540c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 0x7f4b540af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b5415b3c0 0x7f4b540afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5406d2c0 con 0x7f4b54157f70 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.764+0000 7f4b53200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5406ece0 con 0x7f4b54070240 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b53200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4b540ce900 con 0x7f4b5415b3c0 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b49400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 0x7f4b540af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b49400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 0x7f4b540af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42206/0 (socket says 172.21.15.63:42206) 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b49400640 1 -- 172.21.15.63:0/81385950 learned_addr learned my addr 172.21.15.63:0/81385950 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b51e00640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b54070240 0x7f4b540c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b52800640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b5415b3c0 0x7f4b540afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b49400640 1 -- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b5415b3c0 msgr2=0x7f4b540afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b49400640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b5415b3c0 0x7f4b540afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b49400640 1 -- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b54070240 msgr2=0x7f4b540c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b49400640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b54070240 0x7f4b540c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b49400640 1 -- 172.21.15.63:0/81385950 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b540c3d50 con 0x7f4b54157f70 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b51e00640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b54070240 0x7f4b540c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b52800640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b5415b3c0 0x7f4b540afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b49400640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 0x7f4b540af4d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00d7d0 tx=0x7f4b3c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b4aa00640 1 -- 172.21.15.63:0/81385950 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00b6c0 con 0x7f4b54157f70 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b4aa00640 1 -- 172.21.15.63:0/81385950 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3c019070 con 0x7f4b54157f70 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b540c3fc0 con 0x7f4b54157f70 2024-09-12T02:59:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b4aa00640 1 -- 172.21.15.63:0/81385950 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00baa0 con 0x7f4b54157f70 2024-09-12T02:59:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b540aecd0 con 0x7f4b54157f70 2024-09-12T02:59:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b54158350 con 0x7f4b54157f70 2024-09-12T02:59:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.768+0000 7f4b4aa00640 1 -- 172.21.15.63:0/81385950 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b3c00bc40 con 0x7f4b54157f70 2024-09-12T02:59:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.772+0000 7f4b4aa00640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4b300678c0 0x7f4b30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:59:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.772+0000 7f4b4aa00640 1 -- 172.21.15.63:0/81385950 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f4b3c086580 con 0x7f4b54157f70 2024-09-12T02:59:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.772+0000 7f4b51e00640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4b300678c0 0x7f4b30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:59:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.772+0000 7f4b51e00640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4b300678c0 0x7f4b30069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4b440b1000 tx=0x7f4b440aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:59:53.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.776+0000 7f4b4aa00640 1 -- 172.21.15.63:0/81385950 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b3c056c90 con 0x7f4b54157f70 2024-09-12T02:59:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.940+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b540b1dd0 con 0x7f4b300678c0 2024-09-12T02:59:53.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.964+0000 7f4b4aa00640 1 -- 172.21.15.63:0/81385950 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332808 (secure 0 0 0) 0x7f4b540b1dd0 con 0x7f4b300678c0 2024-09-12T02:59:53.970 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T02:59:53.972 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T02:59:53.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4b300678c0 msgr2=0x7f4b30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:53.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4b300678c0 0x7f4b30069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4b440b1000 tx=0x7f4b440aa000 comp rx=0 tx=0).stop 2024-09-12T02:59:53.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 msgr2=0x7f4b540af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:59:53.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 0x7f4b540af4d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00d7d0 tx=0x7f4b3c00dc90 comp rx=0 tx=0).stop 2024-09-12T02:59:53.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 shutdown_connections 2024-09-12T02:59:53.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4b300678c0 0x7f4b30069d80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:53.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b5415b3c0 0x7f4b540afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:53.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b54157f70 0x7f4b540af4d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:53.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 --2- 172.21.15.63:0/81385950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b54070240 0x7f4b540c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:59:53.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 >> 172.21.15.63:0/81385950 conn(0x7f4b54067a00 msgr2=0x7f4b54155960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:59:53.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 shutdown_connections 2024-09-12T02:59:53.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T02:59:53.968+0000 7f4b53200640 1 -- 172.21.15.63:0/81385950 wait complete. 2024-09-12T02:59:53.997 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-09-12T02:59:53.810592+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":321,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238496,"kb_used_data":8696,"kb_used_omap":15,"kb_used_meta":229616,"kb_avail":754736224,"statfs":{"total":773094113280,"available":772849893376,"internally_reserved":0,"allocated":8904704,"data_stored":5195750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":235127470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003329"},"pg_stats":[{"pgid":"2.1f","version":"79'6","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975802+0000","last_change":"2024-09-12T02:59:32.000879+0000","last_active":"2024-09-12T02:59:47.975802+0000","last_peered":"2024-09-12T02:59:47.975802+0000","last_clean":"2024-09-12T02:59:47.975802+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:47.975802+0000","last_undegraded":"2024-09-12T02:59:47.975802+0000","last_fullsized":"2024-09-12T02:59:47.975802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.000756+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.073437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971575+0000","last_change":"2024-09-12T02:59:43.632597+0000","last_active":"2024-09-12T02:59:47.971575+0000","last_peered":"2024-09-12T02:59:47.971575+0000","last_clean":"2024-09-12T02:59:47.971575+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:47.971575+0000","last_undegraded":"2024-09-12T02:59:47.971575+0000","last_fullsized":"2024-09-12T02:59:47.971575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.632456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:01.396201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970626+0000","last_change":"2024-09-12T02:59:45.690062+0000","last_active":"2024-09-12T02:59:47.970626+0000","last_peered":"2024-09-12T02:59:47.970626+0000","last_clean":"2024-09-12T02:59:47.970626+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:47.970626+0000","last_undegraded":"2024-09-12T02:59:47.970626+0000","last_fullsized":"2024-09-12T02:59:47.970626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.689949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:02.009111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971761+0000","last_change":"2024-09-12T02:59:36.630496+0000","last_active":"2024-09-12T02:59:47.971761+0000","last_peered":"2024-09-12T02:59:47.971761+0000","last_clean":"2024-09-12T02:59:47.971761+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:47.971761+0000","last_undegraded":"2024-09-12T02:59:47.971761+0000","last_fullsized":"2024-09-12T02:59:47.971761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.630383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:49.675255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975685+0000","last_change":"2024-09-12T02:59:44.081098+0000","last_active":"2024-09-12T02:59:47.975685+0000","last_peered":"2024-09-12T02:59:47.975685+0000","last_clean":"2024-09-12T02:59:47.975685+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:47.975685+0000","last_undegraded":"2024-09-12T02:59:47.975685+0000","last_fullsized":"2024-09-12T02:59:47.975685+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.080989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:55.266943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970430+0000","last_change":"2024-09-12T02:59:41.662320+0000","last_active":"2024-09-12T02:59:47.970430+0000","last_peered":"2024-09-12T02:59:47.970430+0000","last_clean":"2024-09-12T02:59:47.970430+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:47.970430+0000","last_undegraded":"2024-09-12T02:59:47.970430+0000","last_fullsized":"2024-09-12T02:59:47.970430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.662088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:28.169111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989531+0000","last_change":"2024-09-12T02:59:37.757533+0000","last_active":"2024-09-12T02:59:47.989531+0000","last_peered":"2024-09-12T02:59:47.989531+0000","last_clean":"2024-09-12T02:59:47.989531+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:47.989531+0000","last_undegraded":"2024-09-12T02:59:47.989531+0000","last_fullsized":"2024-09-12T02:59:47.989531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.757250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:10.370609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972764+0000","last_change":"2024-09-12T02:59:35.959195+0000","last_active":"2024-09-12T02:59:47.972764+0000","last_peered":"2024-09-12T02:59:47.972764+0000","last_clean":"2024-09-12T02:59:47.972764+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:47.972764+0000","last_undegraded":"2024-09-12T02:59:47.972764+0000","last_fullsized":"2024-09-12T02:59:47.972764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.958975+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.932192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972153+0000","last_change":"2024-09-12T02:59:43.619841+0000","last_active":"2024-09-12T02:59:47.972153+0000","last_peered":"2024-09-12T02:59:47.972153+0000","last_clean":"2024-09-12T02:59:47.972153+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:47.972153+0000","last_undegraded":"2024-09-12T02:59:47.972153+0000","last_fullsized":"2024-09-12T02:59:47.972153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.619594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:49.784818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'3","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989105+0000","last_change":"2024-09-12T02:59:47.847154+0000","last_active":"2024-09-12T02:59:47.989105+0000","last_peered":"2024-09-12T02:59:47.989105+0000","last_clean":"2024-09-12T02:59:47.989105+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:47.989105+0000","last_undegraded":"2024-09-12T02:59:47.989105+0000","last_fullsized":"2024-09-12T02:59:47.989105+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.846797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.835241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973740+0000","last_change":"2024-09-12T02:59:44.041049+0000","last_active":"2024-09-12T02:59:47.973740+0000","last_peered":"2024-09-12T02:59:47.973740+0000","last_clean":"2024-09-12T02:59:47.973740+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:47.973740+0000","last_undegraded":"2024-09-12T02:59:47.973740+0000","last_fullsized":"2024-09-12T02:59:47.973740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.040815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.885096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970873+0000","last_change":"2024-09-12T02:59:40.700614+0000","last_active":"2024-09-12T02:59:47.970873+0000","last_peered":"2024-09-12T02:59:47.970873+0000","last_clean":"2024-09-12T02:59:47.970873+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:47.970873+0000","last_undegraded":"2024-09-12T02:59:47.970873+0000","last_fullsized":"2024-09-12T02:59:47.970873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.700368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:48.928824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986635+0000","last_change":"2024-09-12T02:59:39.629343+0000","last_active":"2024-09-12T02:59:47.986635+0000","last_peered":"2024-09-12T02:59:47.986635+0000","last_clean":"2024-09-12T02:59:47.986635+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:47.986635+0000","last_undegraded":"2024-09-12T02:59:47.986635+0000","last_fullsized":"2024-09-12T02:59:47.986635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.629058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:43.299464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988800+0000","last_change":"2024-09-12T02:59:36.789441+0000","last_active":"2024-09-12T02:59:47.988800+0000","last_peered":"2024-09-12T02:59:47.988800+0000","last_clean":"2024-09-12T02:59:47.988800+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:47.988800+0000","last_undegraded":"2024-09-12T02:59:47.988800+0000","last_fullsized":"2024-09-12T02:59:47.988800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.789151+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:41.135081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974912+0000","last_change":"2024-09-12T02:59:37.711523+0000","last_active":"2024-09-12T02:59:47.974912+0000","last_peered":"2024-09-12T02:59:47.974912+0000","last_clean":"2024-09-12T02:59:47.974912+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:47.974912+0000","last_undegraded":"2024-09-12T02:59:47.974912+0000","last_fullsized":"2024-09-12T02:59:47.974912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.711188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.241632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970941+0000","last_change":"2024-09-12T02:59:40.677307+0000","last_active":"2024-09-12T02:59:47.970941+0000","last_peered":"2024-09-12T02:59:47.970941+0000","last_clean":"2024-09-12T02:59:47.970941+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:47.970941+0000","last_undegraded":"2024-09-12T02:59:47.970941+0000","last_fullsized":"2024-09-12T02:59:47.970941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.677196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:18.992896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967755+0000","last_change":"2024-09-12T02:59:42.816275+0000","last_active":"2024-09-12T02:59:47.967755+0000","last_peered":"2024-09-12T02:59:47.967755+0000","last_clean":"2024-09-12T02:59:47.967755+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:47.967755+0000","last_undegraded":"2024-09-12T02:59:47.967755+0000","last_fullsized":"2024-09-12T02:59:47.967755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.816152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:29.323176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973221+0000","last_change":"2024-09-12T02:59:38.719352+0000","last_active":"2024-09-12T02:59:47.973221+0000","last_peered":"2024-09-12T02:59:47.973221+0000","last_clean":"2024-09-12T02:59:47.973221+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:47.973221+0000","last_undegraded":"2024-09-12T02:59:47.973221+0000","last_fullsized":"2024-09-12T02:59:47.973221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.719131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.333596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971546+0000","last_change":"2024-09-12T02:59:08.063392+0000","last_active":"2024-09-12T02:59:47.971546+0000","last_peered":"2024-09-12T02:59:47.971546+0000","last_clean":"2024-09-12T02:59:47.971546+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:47.971546+0000","last_undegraded":"2024-09-12T02:59:47.971546+0000","last_fullsized":"2024-09-12T02:59:47.971546+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967868+0000","last_change":"2024-09-12T02:59:32.776350+0000","last_active":"2024-09-12T02:59:47.967868+0000","last_peered":"2024-09-12T02:59:47.967868+0000","last_clean":"2024-09-12T02:59:47.967868+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:47.967868+0000","last_undegraded":"2024-09-12T02:59:47.967868+0000","last_fullsized":"2024-09-12T02:59:47.967868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.776267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:58.890222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968625+0000","last_change":"2024-09-12T02:59:34.789313+0000","last_active":"2024-09-12T02:59:47.968625+0000","last_peered":"2024-09-12T02:59:47.968625+0000","last_clean":"2024-09-12T02:59:47.968625+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:47.968625+0000","last_undegraded":"2024-09-12T02:59:47.968625+0000","last_fullsized":"2024-09-12T02:59:47.968625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.789214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.790935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971730+0000","last_change":"2024-09-12T02:59:34.632579+0000","last_active":"2024-09-12T02:59:47.971730+0000","last_peered":"2024-09-12T02:59:47.971730+0000","last_clean":"2024-09-12T02:59:47.971730+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:47.971730+0000","last_undegraded":"2024-09-12T02:59:47.971730+0000","last_fullsized":"2024-09-12T02:59:47.971730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.632350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.978281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987412+0000","last_change":"2024-09-12T02:59:35.785814+0000","last_active":"2024-09-12T02:59:47.987412+0000","last_peered":"2024-09-12T02:59:47.987412+0000","last_clean":"2024-09-12T02:59:47.987412+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:47.987412+0000","last_undegraded":"2024-09-12T02:59:47.987412+0000","last_fullsized":"2024-09-12T02:59:47.987412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.785459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.907074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975052+0000","last_change":"2024-09-12T02:59:44.644342+0000","last_active":"2024-09-12T02:59:47.975052+0000","last_peered":"2024-09-12T02:59:47.975052+0000","last_clean":"2024-09-12T02:59:47.975052+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:47.975052+0000","last_undegraded":"2024-09-12T02:59:47.975052+0000","last_fullsized":"2024-09-12T02:59:47.975052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.644026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:49.273561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975392+0000","last_change":"2024-09-12T02:59:46.131647+0000","last_active":"2024-09-12T02:59:47.975392+0000","last_peered":"2024-09-12T02:59:47.975392+0000","last_clean":"2024-09-12T02:59:47.975392+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:47.975392+0000","last_undegraded":"2024-09-12T02:59:47.975392+0000","last_fullsized":"2024-09-12T02:59:47.975392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.131533+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:06.802576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987954+0000","last_change":"2024-09-12T02:59:35.721123+0000","last_active":"2024-09-12T02:59:47.987954+0000","last_peered":"2024-09-12T02:59:47.987954+0000","last_clean":"2024-09-12T02:59:47.987954+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:47.987954+0000","last_undegraded":"2024-09-12T02:59:47.987954+0000","last_fullsized":"2024-09-12T02:59:47.987954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.720761+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:17.277216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971041+0000","last_change":"2024-09-12T02:59:39.707123+0000","last_active":"2024-09-12T02:59:47.971041+0000","last_peered":"2024-09-12T02:59:47.971041+0000","last_clean":"2024-09-12T02:59:47.971041+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:47.971041+0000","last_undegraded":"2024-09-12T02:59:47.971041+0000","last_fullsized":"2024-09-12T02:59:47.971041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.706899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:08.753477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972457+0000","last_change":"2024-09-12T02:59:41.667809+0000","last_active":"2024-09-12T02:59:47.972457+0000","last_peered":"2024-09-12T02:59:47.972457+0000","last_clean":"2024-09-12T02:59:47.972457+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:47.972457+0000","last_undegraded":"2024-09-12T02:59:47.972457+0000","last_fullsized":"2024-09-12T02:59:47.972457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.667707+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:52.853661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968963+0000","last_change":"2024-09-12T02:59:45.841193+0000","last_active":"2024-09-12T02:59:47.968963+0000","last_peered":"2024-09-12T02:59:47.968963+0000","last_clean":"2024-09-12T02:59:47.968963+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:47.968963+0000","last_undegraded":"2024-09-12T02:59:47.968963+0000","last_fullsized":"2024-09-12T02:59:47.968963+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.841069+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:50.470604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.991190+0000","last_change":"2024-09-12T02:59:47.991190+0000","last_active":"2024-09-12T02:59:47.991190+0000","last_peered":"2024-09-12T02:59:47.991190+0000","last_clean":"2024-09-12T02:59:47.991190+0000","last_became_active":"2024-09-12T02:59:47.990629+0000","last_became_peered":"2024-09-12T02:59:47.990629+0000","last_unstale":"2024-09-12T02:59:47.991190+0000","last_undegraded":"2024-09-12T02:59:47.991190+0000","last_fullsized":"2024-09-12T02:59:47.991190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.643595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.689482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968239+0000","last_change":"2024-09-12T02:59:36.821336+0000","last_active":"2024-09-12T02:59:47.968239+0000","last_peered":"2024-09-12T02:59:47.968239+0000","last_clean":"2024-09-12T02:59:47.968239+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:47.968239+0000","last_undegraded":"2024-09-12T02:59:47.968239+0000","last_fullsized":"2024-09-12T02:59:47.968239+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.821234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.321748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989802+0000","last_change":"2024-09-12T02:59:38.763406+0000","last_active":"2024-09-12T02:59:47.989802+0000","last_peered":"2024-09-12T02:59:47.989802+0000","last_clean":"2024-09-12T02:59:47.989802+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:47.989802+0000","last_undegraded":"2024-09-12T02:59:47.989802+0000","last_fullsized":"2024-09-12T02:59:47.989802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.763178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.755095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975077+0000","last_change":"2024-09-12T02:59:42.071495+0000","last_active":"2024-09-12T02:59:47.975077+0000","last_peered":"2024-09-12T02:59:47.975077+0000","last_clean":"2024-09-12T02:59:47.975077+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:47.975077+0000","last_undegraded":"2024-09-12T02:59:47.975077+0000","last_fullsized":"2024-09-12T02:59:47.975077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.071362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:30.775559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973317+0000","last_change":"2024-09-12T02:59:39.026655+0000","last_active":"2024-09-12T02:59:47.973317+0000","last_peered":"2024-09-12T02:59:47.973317+0000","last_clean":"2024-09-12T02:59:47.973317+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:47.973317+0000","last_undegraded":"2024-09-12T02:59:47.973317+0000","last_fullsized":"2024-09-12T02:59:47.973317+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.026365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:52.426930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968304+0000","last_change":"2024-09-12T02:59:37.791375+0000","last_active":"2024-09-12T02:59:47.968304+0000","last_peered":"2024-09-12T02:59:47.968304+0000","last_clean":"2024-09-12T02:59:47.968304+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:47.968304+0000","last_undegraded":"2024-09-12T02:59:47.968304+0000","last_fullsized":"2024-09-12T02:59:47.968304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.791278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:11.783194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967761+0000","last_change":"2024-09-12T02:59:43.858969+0000","last_active":"2024-09-12T02:59:47.967761+0000","last_peered":"2024-09-12T02:59:47.967761+0000","last_clean":"2024-09-12T02:59:47.967761+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:47.967761+0000","last_undegraded":"2024-09-12T02:59:47.967761+0000","last_fullsized":"2024-09-12T02:59:47.967761+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.858860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972713+0000","last_change":"2024-09-12T02:59:35.662731+0000","last_active":"2024-09-12T02:59:47.972713+0000","last_peered":"2024-09-12T02:59:47.972713+0000","last_clean":"2024-09-12T02:59:47.972713+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:47.972713+0000","last_undegraded":"2024-09-12T02:59:47.972713+0000","last_fullsized":"2024-09-12T02:59:47.972713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.662469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:08.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971604+0000","last_change":"2024-09-12T02:59:32.999842+0000","last_active":"2024-09-12T02:59:47.971604+0000","last_peered":"2024-09-12T02:59:47.971604+0000","last_clean":"2024-09-12T02:59:47.971604+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:47.971604+0000","last_undegraded":"2024-09-12T02:59:47.971604+0000","last_fullsized":"2024-09-12T02:59:47.971604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.999508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:43.870533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.055203+0000","last_change":"2024-09-12T02:59:48.055261+0000","last_active":"2024-09-12T02:59:48.055203+0000","last_peered":"2024-09-12T02:59:48.055203+0000","last_clean":"2024-09-12T02:59:48.055203+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:48.055203+0000","last_undegraded":"2024-09-12T02:59:48.055203+0000","last_fullsized":"2024-09-12T02:59:48.055203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.055039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.593082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967922+0000","last_change":"2024-09-12T02:59:33.818250+0000","last_active":"2024-09-12T02:59:47.967922+0000","last_peered":"2024-09-12T02:59:47.967922+0000","last_clean":"2024-09-12T02:59:47.967922+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:47.967922+0000","last_undegraded":"2024-09-12T02:59:47.967922+0000","last_fullsized":"2024-09-12T02:59:47.967922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.818171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:46.646434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"79'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971823+0000","last_change":"2024-09-12T02:59:31.836989+0000","last_active":"2024-09-12T02:59:47.971823+0000","last_peered":"2024-09-12T02:59:47.971823+0000","last_clean":"2024-09-12T02:59:47.971823+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:47.971823+0000","last_undegraded":"2024-09-12T02:59:47.971823+0000","last_fullsized":"2024-09-12T02:59:47.971823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.836905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:53.031692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968330+0000","last_change":"2024-09-12T02:59:39.791877+0000","last_active":"2024-09-12T02:59:47.968330+0000","last_peered":"2024-09-12T02:59:47.968330+0000","last_clean":"2024-09-12T02:59:47.968330+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:47.968330+0000","last_undegraded":"2024-09-12T02:59:47.968330+0000","last_fullsized":"2024-09-12T02:59:47.968330+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.791761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:25.406226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974670+0000","last_change":"2024-09-12T02:59:30.045775+0000","last_active":"2024-09-12T02:59:47.974670+0000","last_peered":"2024-09-12T02:59:47.974670+0000","last_clean":"2024-09-12T02:59:47.974670+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:47.974670+0000","last_undegraded":"2024-09-12T02:59:47.974670+0000","last_fullsized":"2024-09-12T02:59:47.974670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.045690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:33.716096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.861880+0000","last_change":"2024-09-12T02:59:49.861935+0000","last_active":"2024-09-12T02:59:49.861880+0000","last_peered":"2024-09-12T02:59:49.861880+0000","last_clean":"2024-09-12T02:59:49.861880+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:49.861880+0000","last_undegraded":"2024-09-12T02:59:49.861880+0000","last_fullsized":"2024-09-12T02:59:49.861880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.861705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:39.315077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975242+0000","last_change":"2024-09-12T02:59:40.118829+0000","last_active":"2024-09-12T02:59:47.975242+0000","last_peered":"2024-09-12T02:59:47.975242+0000","last_clean":"2024-09-12T02:59:47.975242+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:47.975242+0000","last_undegraded":"2024-09-12T02:59:47.975242+0000","last_fullsized":"2024-09-12T02:59:47.975242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.118699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:10.405280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970876+0000","last_change":"2024-09-12T02:59:47.676864+0000","last_active":"2024-09-12T02:59:47.970876+0000","last_peered":"2024-09-12T02:59:47.970876+0000","last_clean":"2024-09-12T02:59:47.970876+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:47.970876+0000","last_undegraded":"2024-09-12T02:59:47.970876+0000","last_fullsized":"2024-09-12T02:59:47.970876+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.676747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.675367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971929+0000","last_change":"2024-09-12T02:59:40.971763+0000","last_active":"2024-09-12T02:59:47.971929+0000","last_peered":"2024-09-12T02:59:47.971929+0000","last_clean":"2024-09-12T02:59:47.971929+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:47.971929+0000","last_undegraded":"2024-09-12T02:59:47.971929+0000","last_fullsized":"2024-09-12T02:59:47.971929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.971535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:04.999865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"79'119","reported_seq":298,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987941+0000","last_change":"2024-09-12T02:59:34.803297+0000","last_active":"2024-09-12T02:59:47.987941+0000","last_peered":"2024-09-12T02:59:47.987941+0000","last_clean":"2024-09-12T02:59:47.987941+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:47.987941+0000","last_undegraded":"2024-09-12T02:59:47.987941+0000","last_fullsized":"2024-09-12T02:59:47.987941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.802947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:59.161855+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986419+0000","last_change":"2024-09-12T02:59:42.682806+0000","last_active":"2024-09-12T02:59:47.986419+0000","last_peered":"2024-09-12T02:59:47.986419+0000","last_clean":"2024-09-12T02:59:47.986419+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:47.986419+0000","last_undegraded":"2024-09-12T02:59:47.986419+0000","last_fullsized":"2024-09-12T02:59:47.986419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.682574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:22.933579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968481+0000","last_change":"2024-09-12T02:59:35.830230+0000","last_active":"2024-09-12T02:59:47.968481+0000","last_peered":"2024-09-12T02:59:47.968481+0000","last_clean":"2024-09-12T02:59:47.968481+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:47.968481+0000","last_undegraded":"2024-09-12T02:59:47.968481+0000","last_fullsized":"2024-09-12T02:59:47.968481+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.830121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.993178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972431+0000","last_change":"2024-09-12T02:59:35.842501+0000","last_active":"2024-09-12T02:59:47.972431+0000","last_peered":"2024-09-12T02:59:47.972431+0000","last_clean":"2024-09-12T02:59:47.972431+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:47.972431+0000","last_undegraded":"2024-09-12T02:59:47.972431+0000","last_fullsized":"2024-09-12T02:59:47.972431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.842396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:47.840469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986324+0000","last_change":"2024-09-12T02:59:41.651678+0000","last_active":"2024-09-12T02:59:47.986324+0000","last_peered":"2024-09-12T02:59:47.986324+0000","last_clean":"2024-09-12T02:59:47.986324+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:47.986324+0000","last_undegraded":"2024-09-12T02:59:47.986324+0000","last_fullsized":"2024-09-12T02:59:47.986324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.651443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:40.919631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973325+0000","last_change":"2024-09-12T02:59:34.986788+0000","last_active":"2024-09-12T02:59:47.973325+0000","last_peered":"2024-09-12T02:59:47.973325+0000","last_clean":"2024-09-12T02:59:47.973325+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:47.973325+0000","last_undegraded":"2024-09-12T02:59:47.973325+0000","last_fullsized":"2024-09-12T02:59:47.973325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.986542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:35.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968801+0000","last_change":"2024-09-12T02:59:31.772320+0000","last_active":"2024-09-12T02:59:47.968801+0000","last_peered":"2024-09-12T02:59:47.968801+0000","last_clean":"2024-09-12T02:59:47.968801+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:47.968801+0000","last_undegraded":"2024-09-12T02:59:47.968801+0000","last_fullsized":"2024-09-12T02:59:47.968801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.772236+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:19.909174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975319+0000","last_change":"2024-09-12T02:59:43.053479+0000","last_active":"2024-09-12T02:59:47.975319+0000","last_peered":"2024-09-12T02:59:47.975319+0000","last_clean":"2024-09-12T02:59:47.975319+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:47.975319+0000","last_undegraded":"2024-09-12T02:59:47.975319+0000","last_fullsized":"2024-09-12T02:59:47.975319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.053377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:21.369077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989656+0000","last_change":"2024-09-12T02:59:46.862199+0000","last_active":"2024-09-12T02:59:47.989656+0000","last_peered":"2024-09-12T02:59:47.989656+0000","last_clean":"2024-09-12T02:59:47.989656+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:47.989656+0000","last_undegraded":"2024-09-12T02:59:47.989656+0000","last_fullsized":"2024-09-12T02:59:47.989656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.861972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:51.491507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'3","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972717+0000","last_change":"2024-09-12T02:59:30.860535+0000","last_active":"2024-09-12T02:59:47.972717+0000","last_peered":"2024-09-12T02:59:47.972717+0000","last_clean":"2024-09-12T02:59:47.972717+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:47.972717+0000","last_undegraded":"2024-09-12T02:59:47.972717+0000","last_fullsized":"2024-09-12T02:59:47.972717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.860444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:23.065975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970742+0000","last_change":"2024-09-12T02:59:06.062947+0000","last_active":"2024-09-12T02:59:47.970742+0000","last_peered":"2024-09-12T02:59:47.970742+0000","last_clean":"2024-09-12T02:59:47.970742+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:47.970742+0000","last_undegraded":"2024-09-12T02:59:47.970742+0000","last_fullsized":"2024-09-12T02:59:47.970742+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989405+0000","last_change":"2024-09-12T02:59:44.860343+0000","last_active":"2024-09-12T02:59:47.989405+0000","last_peered":"2024-09-12T02:59:47.989405+0000","last_clean":"2024-09-12T02:59:47.989405+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:47.989405+0000","last_undegraded":"2024-09-12T02:59:47.989405+0000","last_fullsized":"2024-09-12T02:59:47.989405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.860002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:03.716731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975421+0000","last_change":"2024-09-12T02:59:31.636304+0000","last_active":"2024-09-12T02:59:47.975421+0000","last_peered":"2024-09-12T02:59:47.975421+0000","last_clean":"2024-09-12T02:59:47.975421+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:47.975421+0000","last_undegraded":"2024-09-12T02:59:47.975421+0000","last_fullsized":"2024-09-12T02:59:47.975421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.636071+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:48.966306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974472+0000","last_change":"2024-09-12T02:59:42.661415+0000","last_active":"2024-09-12T02:59:47.974472+0000","last_peered":"2024-09-12T02:59:47.974472+0000","last_clean":"2024-09-12T02:59:47.974472+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:47.974472+0000","last_undegraded":"2024-09-12T02:59:47.974472+0000","last_fullsized":"2024-09-12T02:59:47.974472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.661146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986300+0000","last_change":"2024-09-12T02:59:45.832208+0000","last_active":"2024-09-12T02:59:47.986300+0000","last_peered":"2024-09-12T02:59:47.986300+0000","last_clean":"2024-09-12T02:59:47.986300+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:47.986300+0000","last_undegraded":"2024-09-12T02:59:47.986300+0000","last_fullsized":"2024-09-12T02:59:47.986300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.831975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'12","reported_seq":184,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971562+0000","last_change":"2024-09-12T02:59:36.886312+0000","last_active":"2024-09-12T02:59:47.971562+0000","last_peered":"2024-09-12T02:59:47.971562+0000","last_clean":"2024-09-12T02:59:47.971562+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:47.971562+0000","last_undegraded":"2024-09-12T02:59:47.971562+0000","last_fullsized":"2024-09-12T02:59:47.971562+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.886179+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:45.626516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975159+0000","last_change":"2024-09-12T02:59:39.156656+0000","last_active":"2024-09-12T02:59:47.975159+0000","last_peered":"2024-09-12T02:59:47.975159+0000","last_clean":"2024-09-12T02:59:47.975159+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:47.975159+0000","last_undegraded":"2024-09-12T02:59:47.975159+0000","last_fullsized":"2024-09-12T02:59:47.975159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.156542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:34.954291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987400+0000","last_change":"2024-09-12T02:59:37.673643+0000","last_active":"2024-09-12T02:59:47.987400+0000","last_peered":"2024-09-12T02:59:47.987400+0000","last_clean":"2024-09-12T02:59:47.987400+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:47.987400+0000","last_undegraded":"2024-09-12T02:59:47.987400+0000","last_fullsized":"2024-09-12T02:59:47.987400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.673292+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.523545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988581+0000","last_change":"2024-09-12T02:59:33.671444+0000","last_active":"2024-09-12T02:59:47.988581+0000","last_peered":"2024-09-12T02:59:47.988581+0000","last_clean":"2024-09-12T02:59:47.988581+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:47.988581+0000","last_undegraded":"2024-09-12T02:59:47.988581+0000","last_fullsized":"2024-09-12T02:59:47.988581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.671212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:45.669284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972298+0000","last_change":"2024-09-12T02:59:34.590629+0000","last_active":"2024-09-12T02:59:47.972298+0000","last_peered":"2024-09-12T02:59:47.972298+0000","last_clean":"2024-09-12T02:59:47.972298+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:47.972298+0000","last_undegraded":"2024-09-12T02:59:47.972298+0000","last_fullsized":"2024-09-12T02:59:47.972298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.590531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.762881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988612+0000","last_change":"2024-09-12T02:59:43.837261+0000","last_active":"2024-09-12T02:59:47.988612+0000","last_peered":"2024-09-12T02:59:47.988612+0000","last_clean":"2024-09-12T02:59:47.988612+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:47.988612+0000","last_undegraded":"2024-09-12T02:59:47.988612+0000","last_fullsized":"2024-09-12T02:59:47.988612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.836980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.344004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970476+0000","last_change":"2024-09-12T02:59:45.048563+0000","last_active":"2024-09-12T02:59:47.970476+0000","last_peered":"2024-09-12T02:59:47.970476+0000","last_clean":"2024-09-12T02:59:47.970476+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:47.970476+0000","last_undegraded":"2024-09-12T02:59:47.970476+0000","last_fullsized":"2024-09-12T02:59:47.970476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.048315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:20.692033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970971+0000","last_change":"2024-09-12T02:59:08.061102+0000","last_active":"2024-09-12T02:59:47.970971+0000","last_peered":"2024-09-12T02:59:47.970971+0000","last_clean":"2024-09-12T02:59:47.970971+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:47.970971+0000","last_undegraded":"2024-09-12T02:59:47.970971+0000","last_fullsized":"2024-09-12T02:59:47.970971+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975259+0000","last_change":"2024-09-12T02:59:36.076892+0000","last_active":"2024-09-12T02:59:47.975259+0000","last_peered":"2024-09-12T02:59:47.975259+0000","last_clean":"2024-09-12T02:59:47.975259+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:47.975259+0000","last_undegraded":"2024-09-12T02:59:47.975259+0000","last_fullsized":"2024-09-12T02:59:47.975259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.076727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:26.666775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975590+0000","last_change":"2024-09-12T02:59:30.999792+0000","last_active":"2024-09-12T02:59:47.975590+0000","last_peered":"2024-09-12T02:59:47.975590+0000","last_clean":"2024-09-12T02:59:47.975590+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:47.975590+0000","last_undegraded":"2024-09-12T02:59:47.975590+0000","last_fullsized":"2024-09-12T02:59:47.975590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.999703+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:17.375066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973863+0000","last_change":"2024-09-12T02:59:34.015485+0000","last_active":"2024-09-12T02:59:47.973863+0000","last_peered":"2024-09-12T02:59:47.973863+0000","last_clean":"2024-09-12T02:59:47.973863+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:47.973863+0000","last_undegraded":"2024-09-12T02:59:47.973863+0000","last_fullsized":"2024-09-12T02:59:47.973863+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.015247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:05.065563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989055+0000","last_change":"2024-09-12T02:59:41.793529+0000","last_active":"2024-09-12T02:59:47.989055+0000","last_peered":"2024-09-12T02:59:47.989055+0000","last_clean":"2024-09-12T02:59:47.989055+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:47.989055+0000","last_undegraded":"2024-09-12T02:59:47.989055+0000","last_fullsized":"2024-09-12T02:59:47.989055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.793303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.839881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":167,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987810+0000","last_change":"2024-09-12T02:59:32.647074+0000","last_active":"2024-09-12T02:59:47.987810+0000","last_peered":"2024-09-12T02:59:47.987810+0000","last_clean":"2024-09-12T02:59:47.987810+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:47.987810+0000","last_undegraded":"2024-09-12T02:59:47.987810+0000","last_fullsized":"2024-09-12T02:59:47.987810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'28","last_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_deep_scrub":"79'28","last_deep_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.646844+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:46.886484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968042+0000","last_change":"2024-09-12T02:59:46.857630+0000","last_active":"2024-09-12T02:59:47.968042+0000","last_peered":"2024-09-12T02:59:47.968042+0000","last_clean":"2024-09-12T02:59:47.968042+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:47.968042+0000","last_undegraded":"2024-09-12T02:59:47.968042+0000","last_fullsized":"2024-09-12T02:59:47.968042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.857527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.845970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974062+0000","last_change":"2024-09-12T02:59:33.680657+0000","last_active":"2024-09-12T02:59:47.974062+0000","last_peered":"2024-09-12T02:59:47.974062+0000","last_clean":"2024-09-12T02:59:47.974062+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:47.974062+0000","last_undegraded":"2024-09-12T02:59:47.974062+0000","last_fullsized":"2024-09-12T02:59:47.974062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.680411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:15.802027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968679+0000","last_change":"2024-09-12T02:59:44.852192+0000","last_active":"2024-09-12T02:59:47.968679+0000","last_peered":"2024-09-12T02:59:47.968679+0000","last_clean":"2024-09-12T02:59:47.968679+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:47.968679+0000","last_undegraded":"2024-09-12T02:59:47.968679+0000","last_fullsized":"2024-09-12T02:59:47.968679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.852086+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.017309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":166,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971894+0000","last_change":"2024-09-12T02:59:45.664653+0000","last_active":"2024-09-12T02:59:47.971894+0000","last_peered":"2024-09-12T02:59:47.971894+0000","last_clean":"2024-09-12T02:59:47.971894+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:47.971894+0000","last_undegraded":"2024-09-12T02:59:47.971894+0000","last_fullsized":"2024-09-12T02:59:47.971894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.664314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.652758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975774+0000","last_change":"2024-09-12T02:59:45.129108+0000","last_active":"2024-09-12T02:59:47.975774+0000","last_peered":"2024-09-12T02:59:47.975774+0000","last_clean":"2024-09-12T02:59:47.975774+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:47.975774+0000","last_undegraded":"2024-09-12T02:59:47.975774+0000","last_fullsized":"2024-09-12T02:59:47.975774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.128965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.549002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973885+0000","last_change":"2024-09-12T02:59:37.986005+0000","last_active":"2024-09-12T02:59:47.973885+0000","last_peered":"2024-09-12T02:59:47.973885+0000","last_clean":"2024-09-12T02:59:47.973885+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:47.973885+0000","last_undegraded":"2024-09-12T02:59:47.973885+0000","last_fullsized":"2024-09-12T02:59:47.973885+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.985746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:14.181632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971321+0000","last_change":"2024-09-12T02:59:08.074397+0000","last_active":"2024-09-12T02:59:47.971321+0000","last_peered":"2024-09-12T02:59:47.971321+0000","last_clean":"2024-09-12T02:59:47.971321+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:47.971321+0000","last_undegraded":"2024-09-12T02:59:47.971321+0000","last_fullsized":"2024-09-12T02:59:47.971321+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:07.839778+0000","last_clean_scrub_stamp":"2024-09-12T02:57:07.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974029+0000","last_change":"2024-09-12T02:59:39.987993+0000","last_active":"2024-09-12T02:59:47.974029+0000","last_peered":"2024-09-12T02:59:47.974029+0000","last_clean":"2024-09-12T02:59:47.974029+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:47.974029+0000","last_undegraded":"2024-09-12T02:59:47.974029+0000","last_fullsized":"2024-09-12T02:59:47.974029+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.987743+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:04.424759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987757+0000","last_change":"2024-09-12T02:59:45.721685+0000","last_active":"2024-09-12T02:59:47.987757+0000","last_peered":"2024-09-12T02:59:47.987757+0000","last_clean":"2024-09-12T02:59:47.987757+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:47.987757+0000","last_undegraded":"2024-09-12T02:59:47.987757+0000","last_fullsized":"2024-09-12T02:59:47.987757+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.721444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.143614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970794+0000","last_change":"2024-09-12T02:59:46.669010+0000","last_active":"2024-09-12T02:59:47.970794+0000","last_peered":"2024-09-12T02:59:47.970794+0000","last_clean":"2024-09-12T02:59:47.970794+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:47.970794+0000","last_undegraded":"2024-09-12T02:59:47.970794+0000","last_fullsized":"2024-09-12T02:59:47.970794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.668894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:22.826170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975072+0000","last_change":"2024-09-12T02:59:41.077595+0000","last_active":"2024-09-12T02:59:47.975072+0000","last_peered":"2024-09-12T02:59:47.975072+0000","last_clean":"2024-09-12T02:59:47.975072+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:47.975072+0000","last_undegraded":"2024-09-12T02:59:47.975072+0000","last_fullsized":"2024-09-12T02:59:47.975072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.077484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:52.294457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967726+0000","last_change":"2024-09-12T02:59:41.841470+0000","last_active":"2024-09-12T02:59:47.967726+0000","last_peered":"2024-09-12T02:59:47.967726+0000","last_clean":"2024-09-12T02:59:47.967726+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:47.967726+0000","last_undegraded":"2024-09-12T02:59:47.967726+0000","last_fullsized":"2024-09-12T02:59:47.967726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.841333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.069789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970463+0000","last_change":"2024-09-12T02:59:06.065547+0000","last_active":"2024-09-12T02:59:47.970463+0000","last_peered":"2024-09-12T02:59:47.970463+0000","last_clean":"2024-09-12T02:59:47.970463+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:47.970463+0000","last_undegraded":"2024-09-12T02:59:47.970463+0000","last_fullsized":"2024-09-12T02:59:47.970463+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:02.759027+0000","last_clean_scrub_stamp":"2024-09-12T02:57:02.759027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987223+0000","last_change":"2024-09-12T02:59:46.767895+0000","last_active":"2024-09-12T02:59:47.987223+0000","last_peered":"2024-09-12T02:59:47.987223+0000","last_clean":"2024-09-12T02:59:47.987223+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:47.987223+0000","last_undegraded":"2024-09-12T02:59:47.987223+0000","last_fullsized":"2024-09-12T02:59:47.987223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.767560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.939911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971399+0000","last_change":"2024-09-12T02:59:39.674943+0000","last_active":"2024-09-12T02:59:47.971399+0000","last_peered":"2024-09-12T02:59:47.971399+0000","last_clean":"2024-09-12T02:59:47.971399+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:47.971399+0000","last_undegraded":"2024-09-12T02:59:47.971399+0000","last_fullsized":"2024-09-12T02:59:47.971399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.674831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:28.379028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970981+0000","last_change":"2024-09-12T02:59:37.660153+0000","last_active":"2024-09-12T02:59:47.970981+0000","last_peered":"2024-09-12T02:59:47.970981+0000","last_clean":"2024-09-12T02:59:47.970981+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:47.970981+0000","last_undegraded":"2024-09-12T02:59:47.970981+0000","last_fullsized":"2024-09-12T02:59:47.970981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.660048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:32.261376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987111+0000","last_change":"2024-09-12T02:59:34.716068+0000","last_active":"2024-09-12T02:59:47.987111+0000","last_peered":"2024-09-12T02:59:47.987111+0000","last_clean":"2024-09-12T02:59:47.987111+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:47.987111+0000","last_undegraded":"2024-09-12T02:59:47.987111+0000","last_fullsized":"2024-09-12T02:59:47.987111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.715793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:43.456130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975476+0000","last_change":"2024-09-12T02:59:38.162584+0000","last_active":"2024-09-12T02:59:47.975476+0000","last_peered":"2024-09-12T02:59:47.975476+0000","last_clean":"2024-09-12T02:59:47.975476+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:47.975476+0000","last_undegraded":"2024-09-12T02:59:47.975476+0000","last_fullsized":"2024-09-12T02:59:47.975476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.162461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:51.207333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972265+0000","last_change":"2024-09-12T02:59:34.845414+0000","last_active":"2024-09-12T02:59:47.972265+0000","last_peered":"2024-09-12T02:59:47.972265+0000","last_clean":"2024-09-12T02:59:47.972265+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:47.972265+0000","last_undegraded":"2024-09-12T02:59:47.972265+0000","last_fullsized":"2024-09-12T02:59:47.972265+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.845313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:49.084952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971084+0000","last_change":"2024-09-12T02:59:38.676599+0000","last_active":"2024-09-12T02:59:47.971084+0000","last_peered":"2024-09-12T02:59:47.971084+0000","last_clean":"2024-09-12T02:59:47.971084+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:47.971084+0000","last_undegraded":"2024-09-12T02:59:47.971084+0000","last_fullsized":"2024-09-12T02:59:47.971084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.676453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:08.813287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971443+0000","last_change":"2024-09-12T02:59:32.676152+0000","last_active":"2024-09-12T02:59:47.971443+0000","last_peered":"2024-09-12T02:59:47.971443+0000","last_clean":"2024-09-12T02:59:47.971443+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:47.971443+0000","last_undegraded":"2024-09-12T02:59:47.971443+0000","last_fullsized":"2024-09-12T02:59:47.971443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.675897+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971857+0000","last_change":"2024-09-12T02:59:32.600836+0000","last_active":"2024-09-12T02:59:47.971857+0000","last_peered":"2024-09-12T02:59:47.971857+0000","last_clean":"2024-09-12T02:59:47.971857+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:47.971857+0000","last_undegraded":"2024-09-12T02:59:47.971857+0000","last_fullsized":"2024-09-12T02:59:47.971857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.600751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:36.409439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986975+0000","last_change":"2024-09-12T02:59:36.720562+0000","last_active":"2024-09-12T02:59:47.986975+0000","last_peered":"2024-09-12T02:59:47.986975+0000","last_clean":"2024-09-12T02:59:47.986975+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:47.986975+0000","last_undegraded":"2024-09-12T02:59:47.986975+0000","last_fullsized":"2024-09-12T02:59:47.986975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.720181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.336802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971697+0000","last_change":"2024-09-12T02:59:33.813763+0000","last_active":"2024-09-12T02:59:47.971697+0000","last_peered":"2024-09-12T02:59:47.971697+0000","last_clean":"2024-09-12T02:59:47.971697+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:47.971697+0000","last_undegraded":"2024-09-12T02:59:47.971697+0000","last_fullsized":"2024-09-12T02:59:47.971697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.813677+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:54.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971176+0000","last_change":"2024-09-12T02:59:43.020950+0000","last_active":"2024-09-12T02:59:47.971176+0000","last_peered":"2024-09-12T02:59:47.971176+0000","last_clean":"2024-09-12T02:59:47.971176+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:47.971176+0000","last_undegraded":"2024-09-12T02:59:47.971176+0000","last_fullsized":"2024-09-12T02:59:47.971176+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.020633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:20.020956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975501+0000","last_change":"2024-09-12T02:59:35.065915+0000","last_active":"2024-09-12T02:59:47.975501+0000","last_peered":"2024-09-12T02:59:47.975501+0000","last_clean":"2024-09-12T02:59:47.975501+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:47.975501+0000","last_undegraded":"2024-09-12T02:59:47.975501+0000","last_fullsized":"2024-09-12T02:59:47.975501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.065802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:51.998513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971305+0000","last_change":"2024-09-12T02:59:33.570266+0000","last_active":"2024-09-12T02:59:47.971305+0000","last_peered":"2024-09-12T02:59:47.971305+0000","last_clean":"2024-09-12T02:59:47.971305+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:47.971305+0000","last_undegraded":"2024-09-12T02:59:47.971305+0000","last_fullsized":"2024-09-12T02:59:47.971305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.570177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:57.992347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968334+0000","last_change":"2024-09-12T02:59:30.749318+0000","last_active":"2024-09-12T02:59:47.968334+0000","last_peered":"2024-09-12T02:59:47.968334+0000","last_clean":"2024-09-12T02:59:47.968334+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:47.968334+0000","last_undegraded":"2024-09-12T02:59:47.968334+0000","last_fullsized":"2024-09-12T02:59:47.968334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.749228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:31.541524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987453+0000","last_change":"2024-09-12T02:59:38.651039+0000","last_active":"2024-09-12T02:59:47.987453+0000","last_peered":"2024-09-12T02:59:47.987453+0000","last_clean":"2024-09-12T02:59:47.987453+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:47.987453+0000","last_undegraded":"2024-09-12T02:59:47.987453+0000","last_fullsized":"2024-09-12T02:59:47.987453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.650631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.137855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972409+0000","last_change":"2024-09-12T02:59:42.663691+0000","last_active":"2024-09-12T02:59:47.972409+0000","last_peered":"2024-09-12T02:59:47.972409+0000","last_clean":"2024-09-12T02:59:47.972409+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:47.972409+0000","last_undegraded":"2024-09-12T02:59:47.972409+0000","last_fullsized":"2024-09-12T02:59:47.972409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.663586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:23.083624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971007+0000","last_change":"2024-09-12T02:59:06.064508+0000","last_active":"2024-09-12T02:59:47.971007+0000","last_peered":"2024-09-12T02:59:47.971007+0000","last_clean":"2024-09-12T02:59:47.971007+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:47.971007+0000","last_undegraded":"2024-09-12T02:59:47.971007+0000","last_fullsized":"2024-09-12T02:59:47.971007+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970603+0000","last_change":"2024-09-12T02:59:31.642639+0000","last_active":"2024-09-12T02:59:47.970603+0000","last_peered":"2024-09-12T02:59:47.970603+0000","last_clean":"2024-09-12T02:59:47.970603+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:47.970603+0000","last_undegraded":"2024-09-12T02:59:47.970603+0000","last_fullsized":"2024-09-12T02:59:47.970603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.642539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:45.910007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970879+0000","last_change":"2024-09-12T02:59:42.020010+0000","last_active":"2024-09-12T02:59:47.970879+0000","last_peered":"2024-09-12T02:59:47.970879+0000","last_clean":"2024-09-12T02:59:47.970879+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:47.970879+0000","last_undegraded":"2024-09-12T02:59:47.970879+0000","last_fullsized":"2024-09-12T02:59:47.970879+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.019770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:02.627789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975198+0000","last_change":"2024-09-12T02:59:37.126601+0000","last_active":"2024-09-12T02:59:47.975198+0000","last_peered":"2024-09-12T02:59:47.975198+0000","last_clean":"2024-09-12T02:59:47.975198+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:47.975198+0000","last_undegraded":"2024-09-12T02:59:47.975198+0000","last_fullsized":"2024-09-12T02:59:47.975198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.126497+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:41.431052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987704+0000","last_change":"2024-09-12T02:59:40.644873+0000","last_active":"2024-09-12T02:59:47.987704+0000","last_peered":"2024-09-12T02:59:47.987704+0000","last_clean":"2024-09-12T02:59:47.987704+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:47.987704+0000","last_undegraded":"2024-09-12T02:59:47.987704+0000","last_fullsized":"2024-09-12T02:59:47.987704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.644626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:27.019990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989535+0000","last_change":"2024-09-12T02:59:42.787927+0000","last_active":"2024-09-12T02:59:47.989535+0000","last_peered":"2024-09-12T02:59:47.989535+0000","last_clean":"2024-09-12T02:59:47.989535+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:47.989535+0000","last_undegraded":"2024-09-12T02:59:47.989535+0000","last_fullsized":"2024-09-12T02:59:47.989535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.787542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.015998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972705+0000","last_change":"2024-09-12T02:59:32.823831+0000","last_active":"2024-09-12T02:59:47.972705+0000","last_peered":"2024-09-12T02:59:47.972705+0000","last_clean":"2024-09-12T02:59:47.972705+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:47.972705+0000","last_undegraded":"2024-09-12T02:59:47.972705+0000","last_fullsized":"2024-09-12T02:59:47.972705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.823742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:34.576078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974455+0000","last_change":"2024-09-12T02:59:47.049456+0000","last_active":"2024-09-12T02:59:47.974455+0000","last_peered":"2024-09-12T02:59:47.974455+0000","last_clean":"2024-09-12T02:59:47.974455+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:47.974455+0000","last_undegraded":"2024-09-12T02:59:47.974455+0000","last_fullsized":"2024-09-12T02:59:47.974455+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.049206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:32.900134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971264+0000","last_change":"2024-09-12T02:59:37.007470+0000","last_active":"2024-09-12T02:59:47.971264+0000","last_peered":"2024-09-12T02:59:47.971264+0000","last_clean":"2024-09-12T02:59:47.971264+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:47.971264+0000","last_undegraded":"2024-09-12T02:59:47.971264+0000","last_fullsized":"2024-09-12T02:59:47.971264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.007224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:18.542924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967806+0000","last_change":"2024-09-12T02:59:40.838979+0000","last_active":"2024-09-12T02:59:47.967806+0000","last_peered":"2024-09-12T02:59:47.967806+0000","last_clean":"2024-09-12T02:59:47.967806+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:47.967806+0000","last_undegraded":"2024-09-12T02:59:47.967806+0000","last_fullsized":"2024-09-12T02:59:47.967806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.838843+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:09.885421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975113+0000","last_change":"2024-09-12T02:59:34.019995+0000","last_active":"2024-09-12T02:59:47.975113+0000","last_peered":"2024-09-12T02:59:47.975113+0000","last_clean":"2024-09-12T02:59:47.975113+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:47.975113+0000","last_undegraded":"2024-09-12T02:59:47.975113+0000","last_fullsized":"2024-09-12T02:59:47.975113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.019910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.828598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970779+0000","last_change":"2024-09-12T02:59:35.597391+0000","last_active":"2024-09-12T02:59:47.970779+0000","last_peered":"2024-09-12T02:59:47.970779+0000","last_clean":"2024-09-12T02:59:47.970779+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:47.970779+0000","last_undegraded":"2024-09-12T02:59:47.970779+0000","last_fullsized":"2024-09-12T02:59:47.970779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.597291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:38.185412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973797+0000","last_change":"2024-09-12T02:59:36.682299+0000","last_active":"2024-09-12T02:59:47.973797+0000","last_peered":"2024-09-12T02:59:47.973797+0000","last_clean":"2024-09-12T02:59:47.973797+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:47.973797+0000","last_undegraded":"2024-09-12T02:59:47.973797+0000","last_fullsized":"2024-09-12T02:59:47.973797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.682064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:10.673981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986906+0000","last_change":"2024-09-12T02:59:44.683736+0000","last_active":"2024-09-12T02:59:47.986906+0000","last_peered":"2024-09-12T02:59:47.986906+0000","last_clean":"2024-09-12T02:59:47.986906+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:47.986906+0000","last_undegraded":"2024-09-12T02:59:47.986906+0000","last_fullsized":"2024-09-12T02:59:47.986906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.683432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.492120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987167+0000","last_change":"2024-09-12T02:59:43.695797+0000","last_active":"2024-09-12T02:59:47.987167+0000","last_peered":"2024-09-12T02:59:47.987167+0000","last_clean":"2024-09-12T02:59:47.987167+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:47.987167+0000","last_undegraded":"2024-09-12T02:59:47.987167+0000","last_fullsized":"2024-09-12T02:59:47.987167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'16","last_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_deep_scrub":"79'16","last_deep_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.695424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:57.962892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.814119+0000","last_change":"2024-09-12T02:59:48.814183+0000","last_active":"2024-09-12T02:59:48.814119+0000","last_peered":"2024-09-12T02:59:48.814119+0000","last_clean":"2024-09-12T02:59:48.814119+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:48.814119+0000","last_undegraded":"2024-09-12T02:59:48.814119+0000","last_fullsized":"2024-09-12T02:59:48.814119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.813942+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:41.235405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.652380+0000","last_change":"2024-09-12T02:59:48.652404+0000","last_active":"2024-09-12T02:59:48.652380+0000","last_peered":"2024-09-12T02:59:48.652380+0000","last_clean":"2024-09-12T02:59:48.652380+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:48.652380+0000","last_undegraded":"2024-09-12T02:59:48.652380+0000","last_fullsized":"2024-09-12T02:59:48.652380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.652295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:24.469845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986239+0000","last_change":"2024-09-12T02:59:40.773384+0000","last_active":"2024-09-12T02:59:47.986239+0000","last_peered":"2024-09-12T02:59:47.986239+0000","last_clean":"2024-09-12T02:59:47.986239+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:47.986239+0000","last_undegraded":"2024-09-12T02:59:47.986239+0000","last_fullsized":"2024-09-12T02:59:47.986239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.773129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.980310+0000","last_change":"2024-09-12T02:59:47.977081+0000","last_active":"2024-09-12T02:59:47.980310+0000","last_peered":"2024-09-12T02:59:47.980310+0000","last_clean":"2024-09-12T02:59:47.980310+0000","last_became_active":"2024-09-12T02:59:47.976687+0000","last_became_peered":"2024-09-12T02:59:47.976687+0000","last_unstale":"2024-09-12T02:59:47.980310+0000","last_undegraded":"2024-09-12T02:59:47.980310+0000","last_fullsized":"2024-09-12T02:59:47.980310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988297+0000","last_change":"2024-09-12T02:59:39.769618+0000","last_active":"2024-09-12T02:59:47.988297+0000","last_peered":"2024-09-12T02:59:47.988297+0000","last_clean":"2024-09-12T02:59:47.988297+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:47.988297+0000","last_undegraded":"2024-09-12T02:59:47.988297+0000","last_fullsized":"2024-09-12T02:59:47.988297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.769355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:44.299798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973047+0000","last_change":"2024-09-12T02:59:46.045977+0000","last_active":"2024-09-12T02:59:47.973047+0000","last_peered":"2024-09-12T02:59:47.973047+0000","last_clean":"2024-09-12T02:59:47.973047+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:47.973047+0000","last_undegraded":"2024-09-12T02:59:47.973047+0000","last_fullsized":"2024-09-12T02:59:47.973047+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.045725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:00.846357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974947+0000","last_change":"2024-09-12T02:59:33.045189+0000","last_active":"2024-09-12T02:59:47.974947+0000","last_peered":"2024-09-12T02:59:47.974947+0000","last_clean":"2024-09-12T02:59:47.974947+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:47.974947+0000","last_undegraded":"2024-09-12T02:59:47.974947+0000","last_fullsized":"2024-09-12T02:59:47.974947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.045042+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:47.312510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969171+0000","last_change":"2024-09-12T02:59:38.788525+0000","last_active":"2024-09-12T02:59:47.969171+0000","last_peered":"2024-09-12T02:59:47.969171+0000","last_clean":"2024-09-12T02:59:47.969171+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:47.969171+0000","last_undegraded":"2024-09-12T02:59:47.969171+0000","last_fullsized":"2024-09-12T02:59:47.969171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.788431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:20.633132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988967+0000","last_change":"2024-09-12T02:59:33.741380+0000","last_active":"2024-09-12T02:59:47.988967+0000","last_peered":"2024-09-12T02:59:47.988967+0000","last_clean":"2024-09-12T02:59:47.988967+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:47.988967+0000","last_undegraded":"2024-09-12T02:59:47.988967+0000","last_fullsized":"2024-09-12T02:59:47.988967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.741253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:51.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509479,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":999424,"data_stored":530298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1552384,"data_stored":1083143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1544192,"data_stored":1083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":995328,"data_stored":529987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906955,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29048,"kb_used_data":928,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342792,"statfs":{"total":96636764160,"available":96607019008,"internally_reserved":0,"allocated":950272,"data_stored":492227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":492263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":492297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:59:54.003 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:54.003 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:54.004 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:54.004 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T02:57:07.839778+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:54.004 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-12T02:57:02.759027+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:54.004 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:54.005 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T02:59:54.005 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T03:00:03.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:00:03.846 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:00:14.006 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:00:14.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b8c00640 1 Processor -- start 2024-09-12T03:00:14.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b8c00640 1 -- start start 2024-09-12T03:00:14.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b8c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc6b41527e0 0x7fc6b40c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:14.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b8c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc6b40c7a00 0x7fc6b40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:14.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b8c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 0x7fc6b40cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:14.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b8c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b4159520 con 0x7fc6b41527e0 2024-09-12T03:00:14.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b8c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b41589a0 con 0x7fc6b40c7a00 2024-09-12T03:00:14.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b8c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b4158c80 con 0x7fc6b40c61e0 2024-09-12T03:00:14.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b1e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc6b41527e0 0x7fc6b40c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:14.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b1e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc6b41527e0 0x7fc6b40c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59282/0 (socket says 172.21.15.63:59282) 2024-09-12T03:00:14.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b1e00640 1 -- 172.21.15.63:0/1487989107 learned_addr learned my addr 172.21.15.63:0/1487989107 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:00:14.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b1400640 1 --2- 172.21.15.63:0/1487989107 >> v2:172.21.15.119:3300/0 conn(0x7fc6b40c7a00 0x7fc6b40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:14.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b2800640 1 --2- 172.21.15.63:0/1487989107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 0x7fc6b40cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:14.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b1e00640 1 -- 172.21.15.63:0/1487989107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 msgr2=0x7fc6b40cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:14.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b1e00640 1 --2- 172.21.15.63:0/1487989107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 0x7fc6b40cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b1e00640 1 -- 172.21.15.63:0/1487989107 >> v2:172.21.15.119:3300/0 conn(0x7fc6b40c7a00 msgr2=0x7fc6b40c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:14.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b1e00640 1 --2- 172.21.15.63:0/1487989107 >> v2:172.21.15.119:3300/0 conn(0x7fc6b40c7a00 0x7fc6b40c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b1e00640 1 -- 172.21.15.63:0/1487989107 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b4158f60 con 0x7fc6b41527e0 2024-09-12T03:00:14.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.159+0000 7fc6b2800640 1 --2- 172.21.15.63:0/1487989107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 0x7fc6b40cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:00:14.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b1e00640 1 --2- 172.21.15.63:0/1487989107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 0x7fc6b40c6970 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc6b415cbf0 tx=0x7fc6a401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99218fcc704b9f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b0a00640 1 -- 172.21.15.63:0/1487989107 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40aa610 con 0x7fc6b41527e0 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b0a00640 1 -- 172.21.15.63:0/1487989107 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a40af070 con 0x7fc6b41527e0 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b0a00640 1 -- 172.21.15.63:0/1487989107 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40aa9d0 con 0x7fc6b41527e0 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b8c00640 1 -- 172.21.15.63:0/1487989107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 msgr2=0x7fc6b40c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/1487989107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 0x7fc6b40c6970 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc6b415cbf0 tx=0x7fc6a401c4f0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b8c00640 1 -- 172.21.15.63:0/1487989107 shutdown_connections 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/1487989107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 0x7fc6b40cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/1487989107 >> v2:172.21.15.119:3300/0 conn(0x7fc6b40c7a00 0x7fc6b40c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/1487989107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 0x7fc6b40c6970 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b8c00640 1 -- 172.21.15.63:0/1487989107 >> 172.21.15.63:0/1487989107 conn(0x7fc6b406f3d0 msgr2=0x7fc6b406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b8c00640 1 -- 172.21.15.63:0/1487989107 shutdown_connections 2024-09-12T03:00:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.163+0000 7fc6b8c00640 1 -- 172.21.15.63:0/1487989107 wait complete. 2024-09-12T03:00:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 Processor -- start 2024-09-12T03:00:14.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 -- start start 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 0x7fc6b40cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b40c7a00 0x7fc6b4156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 0x7fc6b414cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4158560 con 0x7fc6b41527e0 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b40ccea0 con 0x7fc6b40c7a00 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b41586e0 con 0x7fc6b40c61e0 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b2800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 0x7fc6b414cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b2800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 0x7fc6b414cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:59288/0 (socket says 172.21.15.63:59288) 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b2800640 1 -- 172.21.15.63:0/2376018887 learned_addr learned my addr 172.21.15.63:0/2376018887 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b1400640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b40c7a00 0x7fc6b4156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:14.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b1e00640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 0x7fc6b40cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:14.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b2800640 1 -- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 msgr2=0x7fc6b40cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:14.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b2800640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 0x7fc6b40cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b2800640 1 -- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b40c7a00 msgr2=0x7fc6b4156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b2800640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b40c7a00 0x7fc6b4156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b2800640 1 -- 172.21.15.63:0/2376018887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b4157060 con 0x7fc6b41527e0 2024-09-12T03:00:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b2800640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 0x7fc6b414cf00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac007e20 tx=0x7fc6ac00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6aa000640 1 -- 172.21.15.63:0/2376018887 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac01a070 con 0x7fc6b41527e0 2024-09-12T03:00:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6aa000640 1 -- 172.21.15.63:0/2376018887 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac003ba0 con 0x7fc6b41527e0 2024-09-12T03:00:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b40c4410 con 0x7fc6b41527e0 2024-09-12T03:00:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6aa000640 1 -- 172.21.15.63:0/2376018887 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac00de80 con 0x7fc6b41527e0 2024-09-12T03:00:14.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b40c49d0 con 0x7fc6b41527e0 2024-09-12T03:00:14.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.167+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b40cc550 con 0x7fc6b41527e0 2024-09-12T03:00:14.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.171+0000 7fc6aa000640 1 -- 172.21.15.63:0/2376018887 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6ac01d070 con 0x7fc6b41527e0 2024-09-12T03:00:14.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.171+0000 7fc6aa000640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6940678f0 0x7fc694069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:14.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.171+0000 7fc6aa000640 1 -- 172.21.15.63:0/2376018887 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7fc6ac0863a0 con 0x7fc6b41527e0 2024-09-12T03:00:14.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.171+0000 7fc6b1e00640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6940678f0 0x7fc694069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:14.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.171+0000 7fc6b1e00640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6940678f0 0x7fc694069db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40ae000 tx=0x7fc6a40a7000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:14.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.175+0000 7fc6aa000640 1 -- 172.21.15.63:0/2376018887 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc6ac010070 con 0x7fc6b41527e0 2024-09-12T03:00:14.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.339+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6b40c6800 con 0x7fc6940678f0 2024-09-12T03:00:14.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.359+0000 7fc6aa000640 1 -- 172.21.15.63:0/2376018887 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332999 (secure 0 0 0) 0x7fc6b40c6800 con 0x7fc6940678f0 2024-09-12T03:00:14.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:00:14.373 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T03:00:14.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6940678f0 msgr2=0x7fc694069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6940678f0 0x7fc694069db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc6a40ae000 tx=0x7fc6a40a7000 comp rx=0 tx=0).stop 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 msgr2=0x7fc6b414cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 0x7fc6b414cf00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac007e20 tx=0x7fc6ac00d4a0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 shutdown_connections 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6b41527e0 0x7fc6b414cf00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6b40c7a00 0x7fc6b4156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fc6940678f0 0x7fc694069db0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 --2- 172.21.15.63:0/2376018887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6b40c61e0 0x7fc6b40cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 >> 172.21.15.63:0/2376018887 conn(0x7fc6b406f3d0 msgr2=0x7fc6b40c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 shutdown_connections 2024-09-12T03:00:14.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:14.363+0000 7fc6b8c00640 1 -- 172.21.15.63:0/2376018887 wait complete. 2024-09-12T03:00:14.389 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":175,"stamp":"2024-09-12T03:00:13.818785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238480,"kb_used_data":8696,"kb_used_omap":15,"kb_used_meta":229616,"kb_avail":754736240,"statfs":{"total":773094113280,"available":772849909760,"internally_reserved":0,"allocated":8904704,"data_stored":5195750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":235127470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004688"},"pg_stats":[{"pgid":"2.1f","version":"79'6","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975802+0000","last_change":"2024-09-12T02:59:32.000879+0000","last_active":"2024-09-12T02:59:47.975802+0000","last_peered":"2024-09-12T02:59:47.975802+0000","last_clean":"2024-09-12T02:59:47.975802+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:47.975802+0000","last_undegraded":"2024-09-12T02:59:47.975802+0000","last_fullsized":"2024-09-12T02:59:47.975802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.000756+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.073437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971575+0000","last_change":"2024-09-12T02:59:43.632597+0000","last_active":"2024-09-12T02:59:47.971575+0000","last_peered":"2024-09-12T02:59:47.971575+0000","last_clean":"2024-09-12T02:59:47.971575+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:47.971575+0000","last_undegraded":"2024-09-12T02:59:47.971575+0000","last_fullsized":"2024-09-12T02:59:47.971575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.632456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:01.396201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970626+0000","last_change":"2024-09-12T02:59:45.690062+0000","last_active":"2024-09-12T02:59:47.970626+0000","last_peered":"2024-09-12T02:59:47.970626+0000","last_clean":"2024-09-12T02:59:47.970626+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:47.970626+0000","last_undegraded":"2024-09-12T02:59:47.970626+0000","last_fullsized":"2024-09-12T02:59:47.970626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.689949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:02.009111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971761+0000","last_change":"2024-09-12T02:59:36.630496+0000","last_active":"2024-09-12T02:59:47.971761+0000","last_peered":"2024-09-12T02:59:47.971761+0000","last_clean":"2024-09-12T02:59:47.971761+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:47.971761+0000","last_undegraded":"2024-09-12T02:59:47.971761+0000","last_fullsized":"2024-09-12T02:59:47.971761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.630383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:49.675255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975685+0000","last_change":"2024-09-12T02:59:44.081098+0000","last_active":"2024-09-12T02:59:47.975685+0000","last_peered":"2024-09-12T02:59:47.975685+0000","last_clean":"2024-09-12T02:59:47.975685+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:47.975685+0000","last_undegraded":"2024-09-12T02:59:47.975685+0000","last_fullsized":"2024-09-12T02:59:47.975685+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.080989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:55.266943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970430+0000","last_change":"2024-09-12T02:59:41.662320+0000","last_active":"2024-09-12T02:59:47.970430+0000","last_peered":"2024-09-12T02:59:47.970430+0000","last_clean":"2024-09-12T02:59:47.970430+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:47.970430+0000","last_undegraded":"2024-09-12T02:59:47.970430+0000","last_fullsized":"2024-09-12T02:59:47.970430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.662088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:28.169111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989531+0000","last_change":"2024-09-12T02:59:37.757533+0000","last_active":"2024-09-12T02:59:47.989531+0000","last_peered":"2024-09-12T02:59:47.989531+0000","last_clean":"2024-09-12T02:59:47.989531+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:47.989531+0000","last_undegraded":"2024-09-12T02:59:47.989531+0000","last_fullsized":"2024-09-12T02:59:47.989531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.757250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:10.370609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972764+0000","last_change":"2024-09-12T02:59:35.959195+0000","last_active":"2024-09-12T02:59:47.972764+0000","last_peered":"2024-09-12T02:59:47.972764+0000","last_clean":"2024-09-12T02:59:47.972764+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:47.972764+0000","last_undegraded":"2024-09-12T02:59:47.972764+0000","last_fullsized":"2024-09-12T02:59:47.972764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.958975+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.932192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972153+0000","last_change":"2024-09-12T02:59:43.619841+0000","last_active":"2024-09-12T02:59:47.972153+0000","last_peered":"2024-09-12T02:59:47.972153+0000","last_clean":"2024-09-12T02:59:47.972153+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:47.972153+0000","last_undegraded":"2024-09-12T02:59:47.972153+0000","last_fullsized":"2024-09-12T02:59:47.972153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.619594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:49.784818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'3","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989105+0000","last_change":"2024-09-12T02:59:47.847154+0000","last_active":"2024-09-12T02:59:47.989105+0000","last_peered":"2024-09-12T02:59:47.989105+0000","last_clean":"2024-09-12T02:59:47.989105+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:47.989105+0000","last_undegraded":"2024-09-12T02:59:47.989105+0000","last_fullsized":"2024-09-12T02:59:47.989105+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.846797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.835241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973740+0000","last_change":"2024-09-12T02:59:44.041049+0000","last_active":"2024-09-12T02:59:47.973740+0000","last_peered":"2024-09-12T02:59:47.973740+0000","last_clean":"2024-09-12T02:59:47.973740+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:47.973740+0000","last_undegraded":"2024-09-12T02:59:47.973740+0000","last_fullsized":"2024-09-12T02:59:47.973740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.040815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.885096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970873+0000","last_change":"2024-09-12T02:59:40.700614+0000","last_active":"2024-09-12T02:59:47.970873+0000","last_peered":"2024-09-12T02:59:47.970873+0000","last_clean":"2024-09-12T02:59:47.970873+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:47.970873+0000","last_undegraded":"2024-09-12T02:59:47.970873+0000","last_fullsized":"2024-09-12T02:59:47.970873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.700368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:48.928824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986635+0000","last_change":"2024-09-12T02:59:39.629343+0000","last_active":"2024-09-12T02:59:47.986635+0000","last_peered":"2024-09-12T02:59:47.986635+0000","last_clean":"2024-09-12T02:59:47.986635+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:47.986635+0000","last_undegraded":"2024-09-12T02:59:47.986635+0000","last_fullsized":"2024-09-12T02:59:47.986635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.629058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:43.299464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988800+0000","last_change":"2024-09-12T02:59:36.789441+0000","last_active":"2024-09-12T02:59:47.988800+0000","last_peered":"2024-09-12T02:59:47.988800+0000","last_clean":"2024-09-12T02:59:47.988800+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:47.988800+0000","last_undegraded":"2024-09-12T02:59:47.988800+0000","last_fullsized":"2024-09-12T02:59:47.988800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.789151+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:41.135081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974912+0000","last_change":"2024-09-12T02:59:37.711523+0000","last_active":"2024-09-12T02:59:47.974912+0000","last_peered":"2024-09-12T02:59:47.974912+0000","last_clean":"2024-09-12T02:59:47.974912+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:47.974912+0000","last_undegraded":"2024-09-12T02:59:47.974912+0000","last_fullsized":"2024-09-12T02:59:47.974912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.711188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.241632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970941+0000","last_change":"2024-09-12T02:59:40.677307+0000","last_active":"2024-09-12T02:59:47.970941+0000","last_peered":"2024-09-12T02:59:47.970941+0000","last_clean":"2024-09-12T02:59:47.970941+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:47.970941+0000","last_undegraded":"2024-09-12T02:59:47.970941+0000","last_fullsized":"2024-09-12T02:59:47.970941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.677196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:18.992896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967755+0000","last_change":"2024-09-12T02:59:42.816275+0000","last_active":"2024-09-12T02:59:47.967755+0000","last_peered":"2024-09-12T02:59:47.967755+0000","last_clean":"2024-09-12T02:59:47.967755+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:47.967755+0000","last_undegraded":"2024-09-12T02:59:47.967755+0000","last_fullsized":"2024-09-12T02:59:47.967755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.816152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:29.323176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973221+0000","last_change":"2024-09-12T02:59:38.719352+0000","last_active":"2024-09-12T02:59:47.973221+0000","last_peered":"2024-09-12T02:59:47.973221+0000","last_clean":"2024-09-12T02:59:47.973221+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:47.973221+0000","last_undegraded":"2024-09-12T02:59:47.973221+0000","last_fullsized":"2024-09-12T02:59:47.973221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.719131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.333596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.642704+0000","last_change":"2024-09-12T02:59:50.642733+0000","last_active":"2024-09-12T02:59:50.642704+0000","last_peered":"2024-09-12T02:59:50.642704+0000","last_clean":"2024-09-12T02:59:50.642704+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:50.642704+0000","last_undegraded":"2024-09-12T02:59:50.642704+0000","last_fullsized":"2024-09-12T02:59:50.642704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.642614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967868+0000","last_change":"2024-09-12T02:59:32.776350+0000","last_active":"2024-09-12T02:59:47.967868+0000","last_peered":"2024-09-12T02:59:47.967868+0000","last_clean":"2024-09-12T02:59:47.967868+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:47.967868+0000","last_undegraded":"2024-09-12T02:59:47.967868+0000","last_fullsized":"2024-09-12T02:59:47.967868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.776267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:58.890222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968625+0000","last_change":"2024-09-12T02:59:34.789313+0000","last_active":"2024-09-12T02:59:47.968625+0000","last_peered":"2024-09-12T02:59:47.968625+0000","last_clean":"2024-09-12T02:59:47.968625+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:47.968625+0000","last_undegraded":"2024-09-12T02:59:47.968625+0000","last_fullsized":"2024-09-12T02:59:47.968625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.789214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.790935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971730+0000","last_change":"2024-09-12T02:59:34.632579+0000","last_active":"2024-09-12T02:59:47.971730+0000","last_peered":"2024-09-12T02:59:47.971730+0000","last_clean":"2024-09-12T02:59:47.971730+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:47.971730+0000","last_undegraded":"2024-09-12T02:59:47.971730+0000","last_fullsized":"2024-09-12T02:59:47.971730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.632350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.978281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987412+0000","last_change":"2024-09-12T02:59:35.785814+0000","last_active":"2024-09-12T02:59:47.987412+0000","last_peered":"2024-09-12T02:59:47.987412+0000","last_clean":"2024-09-12T02:59:47.987412+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:47.987412+0000","last_undegraded":"2024-09-12T02:59:47.987412+0000","last_fullsized":"2024-09-12T02:59:47.987412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.785459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.907074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975052+0000","last_change":"2024-09-12T02:59:44.644342+0000","last_active":"2024-09-12T02:59:47.975052+0000","last_peered":"2024-09-12T02:59:47.975052+0000","last_clean":"2024-09-12T02:59:47.975052+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:47.975052+0000","last_undegraded":"2024-09-12T02:59:47.975052+0000","last_fullsized":"2024-09-12T02:59:47.975052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.644026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:49.273561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975392+0000","last_change":"2024-09-12T02:59:46.131647+0000","last_active":"2024-09-12T02:59:47.975392+0000","last_peered":"2024-09-12T02:59:47.975392+0000","last_clean":"2024-09-12T02:59:47.975392+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:47.975392+0000","last_undegraded":"2024-09-12T02:59:47.975392+0000","last_fullsized":"2024-09-12T02:59:47.975392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.131533+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:06.802576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987954+0000","last_change":"2024-09-12T02:59:35.721123+0000","last_active":"2024-09-12T02:59:47.987954+0000","last_peered":"2024-09-12T02:59:47.987954+0000","last_clean":"2024-09-12T02:59:47.987954+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:47.987954+0000","last_undegraded":"2024-09-12T02:59:47.987954+0000","last_fullsized":"2024-09-12T02:59:47.987954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.720761+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:17.277216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971041+0000","last_change":"2024-09-12T02:59:39.707123+0000","last_active":"2024-09-12T02:59:47.971041+0000","last_peered":"2024-09-12T02:59:47.971041+0000","last_clean":"2024-09-12T02:59:47.971041+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:47.971041+0000","last_undegraded":"2024-09-12T02:59:47.971041+0000","last_fullsized":"2024-09-12T02:59:47.971041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.706899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:08.753477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972457+0000","last_change":"2024-09-12T02:59:41.667809+0000","last_active":"2024-09-12T02:59:47.972457+0000","last_peered":"2024-09-12T02:59:47.972457+0000","last_clean":"2024-09-12T02:59:47.972457+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:47.972457+0000","last_undegraded":"2024-09-12T02:59:47.972457+0000","last_fullsized":"2024-09-12T02:59:47.972457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.667707+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:52.853661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968963+0000","last_change":"2024-09-12T02:59:45.841193+0000","last_active":"2024-09-12T02:59:47.968963+0000","last_peered":"2024-09-12T02:59:47.968963+0000","last_clean":"2024-09-12T02:59:47.968963+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:47.968963+0000","last_undegraded":"2024-09-12T02:59:47.968963+0000","last_fullsized":"2024-09-12T02:59:47.968963+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.841069+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:50.470604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.991190+0000","last_change":"2024-09-12T02:59:47.991190+0000","last_active":"2024-09-12T02:59:47.991190+0000","last_peered":"2024-09-12T02:59:47.991190+0000","last_clean":"2024-09-12T02:59:47.991190+0000","last_became_active":"2024-09-12T02:59:47.990629+0000","last_became_peered":"2024-09-12T02:59:47.990629+0000","last_unstale":"2024-09-12T02:59:47.991190+0000","last_undegraded":"2024-09-12T02:59:47.991190+0000","last_fullsized":"2024-09-12T02:59:47.991190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.643595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.689482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968239+0000","last_change":"2024-09-12T02:59:36.821336+0000","last_active":"2024-09-12T02:59:47.968239+0000","last_peered":"2024-09-12T02:59:47.968239+0000","last_clean":"2024-09-12T02:59:47.968239+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:47.968239+0000","last_undegraded":"2024-09-12T02:59:47.968239+0000","last_fullsized":"2024-09-12T02:59:47.968239+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.821234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.321748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989802+0000","last_change":"2024-09-12T02:59:38.763406+0000","last_active":"2024-09-12T02:59:47.989802+0000","last_peered":"2024-09-12T02:59:47.989802+0000","last_clean":"2024-09-12T02:59:47.989802+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:47.989802+0000","last_undegraded":"2024-09-12T02:59:47.989802+0000","last_fullsized":"2024-09-12T02:59:47.989802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.763178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.755095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975077+0000","last_change":"2024-09-12T02:59:42.071495+0000","last_active":"2024-09-12T02:59:47.975077+0000","last_peered":"2024-09-12T02:59:47.975077+0000","last_clean":"2024-09-12T02:59:47.975077+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:47.975077+0000","last_undegraded":"2024-09-12T02:59:47.975077+0000","last_fullsized":"2024-09-12T02:59:47.975077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.071362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:30.775559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973317+0000","last_change":"2024-09-12T02:59:39.026655+0000","last_active":"2024-09-12T02:59:47.973317+0000","last_peered":"2024-09-12T02:59:47.973317+0000","last_clean":"2024-09-12T02:59:47.973317+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:47.973317+0000","last_undegraded":"2024-09-12T02:59:47.973317+0000","last_fullsized":"2024-09-12T02:59:47.973317+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.026365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:52.426930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968304+0000","last_change":"2024-09-12T02:59:37.791375+0000","last_active":"2024-09-12T02:59:47.968304+0000","last_peered":"2024-09-12T02:59:47.968304+0000","last_clean":"2024-09-12T02:59:47.968304+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:47.968304+0000","last_undegraded":"2024-09-12T02:59:47.968304+0000","last_fullsized":"2024-09-12T02:59:47.968304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.791278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:11.783194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967761+0000","last_change":"2024-09-12T02:59:43.858969+0000","last_active":"2024-09-12T02:59:47.967761+0000","last_peered":"2024-09-12T02:59:47.967761+0000","last_clean":"2024-09-12T02:59:47.967761+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:47.967761+0000","last_undegraded":"2024-09-12T02:59:47.967761+0000","last_fullsized":"2024-09-12T02:59:47.967761+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.858860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972713+0000","last_change":"2024-09-12T02:59:35.662731+0000","last_active":"2024-09-12T02:59:47.972713+0000","last_peered":"2024-09-12T02:59:47.972713+0000","last_clean":"2024-09-12T02:59:47.972713+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:47.972713+0000","last_undegraded":"2024-09-12T02:59:47.972713+0000","last_fullsized":"2024-09-12T02:59:47.972713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.662469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:08.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971604+0000","last_change":"2024-09-12T02:59:32.999842+0000","last_active":"2024-09-12T02:59:47.971604+0000","last_peered":"2024-09-12T02:59:47.971604+0000","last_clean":"2024-09-12T02:59:47.971604+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:47.971604+0000","last_undegraded":"2024-09-12T02:59:47.971604+0000","last_fullsized":"2024-09-12T02:59:47.971604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.999508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:43.870533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.055203+0000","last_change":"2024-09-12T02:59:48.055261+0000","last_active":"2024-09-12T02:59:48.055203+0000","last_peered":"2024-09-12T02:59:48.055203+0000","last_clean":"2024-09-12T02:59:48.055203+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:48.055203+0000","last_undegraded":"2024-09-12T02:59:48.055203+0000","last_fullsized":"2024-09-12T02:59:48.055203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.055039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.593082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967922+0000","last_change":"2024-09-12T02:59:33.818250+0000","last_active":"2024-09-12T02:59:47.967922+0000","last_peered":"2024-09-12T02:59:47.967922+0000","last_clean":"2024-09-12T02:59:47.967922+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:47.967922+0000","last_undegraded":"2024-09-12T02:59:47.967922+0000","last_fullsized":"2024-09-12T02:59:47.967922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.818171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:46.646434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"79'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971823+0000","last_change":"2024-09-12T02:59:31.836989+0000","last_active":"2024-09-12T02:59:47.971823+0000","last_peered":"2024-09-12T02:59:47.971823+0000","last_clean":"2024-09-12T02:59:47.971823+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:47.971823+0000","last_undegraded":"2024-09-12T02:59:47.971823+0000","last_fullsized":"2024-09-12T02:59:47.971823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.836905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:53.031692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968330+0000","last_change":"2024-09-12T02:59:39.791877+0000","last_active":"2024-09-12T02:59:47.968330+0000","last_peered":"2024-09-12T02:59:47.968330+0000","last_clean":"2024-09-12T02:59:47.968330+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:47.968330+0000","last_undegraded":"2024-09-12T02:59:47.968330+0000","last_fullsized":"2024-09-12T02:59:47.968330+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.791761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:25.406226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974670+0000","last_change":"2024-09-12T02:59:30.045775+0000","last_active":"2024-09-12T02:59:47.974670+0000","last_peered":"2024-09-12T02:59:47.974670+0000","last_clean":"2024-09-12T02:59:47.974670+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:47.974670+0000","last_undegraded":"2024-09-12T02:59:47.974670+0000","last_fullsized":"2024-09-12T02:59:47.974670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.045690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:33.716096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.861880+0000","last_change":"2024-09-12T02:59:49.861935+0000","last_active":"2024-09-12T02:59:49.861880+0000","last_peered":"2024-09-12T02:59:49.861880+0000","last_clean":"2024-09-12T02:59:49.861880+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:49.861880+0000","last_undegraded":"2024-09-12T02:59:49.861880+0000","last_fullsized":"2024-09-12T02:59:49.861880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.861705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:39.315077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975242+0000","last_change":"2024-09-12T02:59:40.118829+0000","last_active":"2024-09-12T02:59:47.975242+0000","last_peered":"2024-09-12T02:59:47.975242+0000","last_clean":"2024-09-12T02:59:47.975242+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:47.975242+0000","last_undegraded":"2024-09-12T02:59:47.975242+0000","last_fullsized":"2024-09-12T02:59:47.975242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.118699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:10.405280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970876+0000","last_change":"2024-09-12T02:59:47.676864+0000","last_active":"2024-09-12T02:59:47.970876+0000","last_peered":"2024-09-12T02:59:47.970876+0000","last_clean":"2024-09-12T02:59:47.970876+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:47.970876+0000","last_undegraded":"2024-09-12T02:59:47.970876+0000","last_fullsized":"2024-09-12T02:59:47.970876+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.676747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.675367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971929+0000","last_change":"2024-09-12T02:59:40.971763+0000","last_active":"2024-09-12T02:59:47.971929+0000","last_peered":"2024-09-12T02:59:47.971929+0000","last_clean":"2024-09-12T02:59:47.971929+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:47.971929+0000","last_undegraded":"2024-09-12T02:59:47.971929+0000","last_fullsized":"2024-09-12T02:59:47.971929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.971535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:04.999865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"79'119","reported_seq":298,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987941+0000","last_change":"2024-09-12T02:59:34.803297+0000","last_active":"2024-09-12T02:59:47.987941+0000","last_peered":"2024-09-12T02:59:47.987941+0000","last_clean":"2024-09-12T02:59:47.987941+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:47.987941+0000","last_undegraded":"2024-09-12T02:59:47.987941+0000","last_fullsized":"2024-09-12T02:59:47.987941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.802947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:59.161855+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986419+0000","last_change":"2024-09-12T02:59:42.682806+0000","last_active":"2024-09-12T02:59:47.986419+0000","last_peered":"2024-09-12T02:59:47.986419+0000","last_clean":"2024-09-12T02:59:47.986419+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:47.986419+0000","last_undegraded":"2024-09-12T02:59:47.986419+0000","last_fullsized":"2024-09-12T02:59:47.986419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.682574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:22.933579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968536+0000","last_change":"2024-09-12T02:59:35.830230+0000","last_active":"2024-09-12T02:59:47.968536+0000","last_peered":"2024-09-12T02:59:47.968536+0000","last_clean":"2024-09-12T02:59:47.968536+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:47.968536+0000","last_undegraded":"2024-09-12T02:59:47.968536+0000","last_fullsized":"2024-09-12T02:59:47.968536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.830121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.993178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972431+0000","last_change":"2024-09-12T02:59:35.842501+0000","last_active":"2024-09-12T02:59:47.972431+0000","last_peered":"2024-09-12T02:59:47.972431+0000","last_clean":"2024-09-12T02:59:47.972431+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:47.972431+0000","last_undegraded":"2024-09-12T02:59:47.972431+0000","last_fullsized":"2024-09-12T02:59:47.972431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.842396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:47.840469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986324+0000","last_change":"2024-09-12T02:59:41.651678+0000","last_active":"2024-09-12T02:59:47.986324+0000","last_peered":"2024-09-12T02:59:47.986324+0000","last_clean":"2024-09-12T02:59:47.986324+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:47.986324+0000","last_undegraded":"2024-09-12T02:59:47.986324+0000","last_fullsized":"2024-09-12T02:59:47.986324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.651443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:40.919631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973325+0000","last_change":"2024-09-12T02:59:34.986788+0000","last_active":"2024-09-12T02:59:47.973325+0000","last_peered":"2024-09-12T02:59:47.973325+0000","last_clean":"2024-09-12T02:59:47.973325+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:47.973325+0000","last_undegraded":"2024-09-12T02:59:47.973325+0000","last_fullsized":"2024-09-12T02:59:47.973325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.986542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:35.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968801+0000","last_change":"2024-09-12T02:59:31.772320+0000","last_active":"2024-09-12T02:59:47.968801+0000","last_peered":"2024-09-12T02:59:47.968801+0000","last_clean":"2024-09-12T02:59:47.968801+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:47.968801+0000","last_undegraded":"2024-09-12T02:59:47.968801+0000","last_fullsized":"2024-09-12T02:59:47.968801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.772236+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:19.909174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975319+0000","last_change":"2024-09-12T02:59:43.053479+0000","last_active":"2024-09-12T02:59:47.975319+0000","last_peered":"2024-09-12T02:59:47.975319+0000","last_clean":"2024-09-12T02:59:47.975319+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:47.975319+0000","last_undegraded":"2024-09-12T02:59:47.975319+0000","last_fullsized":"2024-09-12T02:59:47.975319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.053377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:21.369077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989656+0000","last_change":"2024-09-12T02:59:46.862199+0000","last_active":"2024-09-12T02:59:47.989656+0000","last_peered":"2024-09-12T02:59:47.989656+0000","last_clean":"2024-09-12T02:59:47.989656+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:47.989656+0000","last_undegraded":"2024-09-12T02:59:47.989656+0000","last_fullsized":"2024-09-12T02:59:47.989656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.861972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:51.491507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'3","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972717+0000","last_change":"2024-09-12T02:59:30.860535+0000","last_active":"2024-09-12T02:59:47.972717+0000","last_peered":"2024-09-12T02:59:47.972717+0000","last_clean":"2024-09-12T02:59:47.972717+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:47.972717+0000","last_undegraded":"2024-09-12T02:59:47.972717+0000","last_fullsized":"2024-09-12T02:59:47.972717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.860444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:23.065975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.093595+0000","last_change":"2024-09-12T02:59:49.093650+0000","last_active":"2024-09-12T02:59:49.093595+0000","last_peered":"2024-09-12T02:59:49.093595+0000","last_clean":"2024-09-12T02:59:49.093595+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:49.093595+0000","last_undegraded":"2024-09-12T02:59:49.093595+0000","last_fullsized":"2024-09-12T02:59:49.093595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.093403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.133030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989405+0000","last_change":"2024-09-12T02:59:44.860343+0000","last_active":"2024-09-12T02:59:47.989405+0000","last_peered":"2024-09-12T02:59:47.989405+0000","last_clean":"2024-09-12T02:59:47.989405+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:47.989405+0000","last_undegraded":"2024-09-12T02:59:47.989405+0000","last_fullsized":"2024-09-12T02:59:47.989405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.860002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:03.716731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975421+0000","last_change":"2024-09-12T02:59:31.636304+0000","last_active":"2024-09-12T02:59:47.975421+0000","last_peered":"2024-09-12T02:59:47.975421+0000","last_clean":"2024-09-12T02:59:47.975421+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:47.975421+0000","last_undegraded":"2024-09-12T02:59:47.975421+0000","last_fullsized":"2024-09-12T02:59:47.975421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.636071+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:48.966306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974472+0000","last_change":"2024-09-12T02:59:42.661415+0000","last_active":"2024-09-12T02:59:47.974472+0000","last_peered":"2024-09-12T02:59:47.974472+0000","last_clean":"2024-09-12T02:59:47.974472+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:47.974472+0000","last_undegraded":"2024-09-12T02:59:47.974472+0000","last_fullsized":"2024-09-12T02:59:47.974472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.661146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986300+0000","last_change":"2024-09-12T02:59:45.832208+0000","last_active":"2024-09-12T02:59:47.986300+0000","last_peered":"2024-09-12T02:59:47.986300+0000","last_clean":"2024-09-12T02:59:47.986300+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:47.986300+0000","last_undegraded":"2024-09-12T02:59:47.986300+0000","last_fullsized":"2024-09-12T02:59:47.986300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.831975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'12","reported_seq":184,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971562+0000","last_change":"2024-09-12T02:59:36.886312+0000","last_active":"2024-09-12T02:59:47.971562+0000","last_peered":"2024-09-12T02:59:47.971562+0000","last_clean":"2024-09-12T02:59:47.971562+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:47.971562+0000","last_undegraded":"2024-09-12T02:59:47.971562+0000","last_fullsized":"2024-09-12T02:59:47.971562+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.886179+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:45.626516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975159+0000","last_change":"2024-09-12T02:59:39.156656+0000","last_active":"2024-09-12T02:59:47.975159+0000","last_peered":"2024-09-12T02:59:47.975159+0000","last_clean":"2024-09-12T02:59:47.975159+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:47.975159+0000","last_undegraded":"2024-09-12T02:59:47.975159+0000","last_fullsized":"2024-09-12T02:59:47.975159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.156542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:34.954291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987400+0000","last_change":"2024-09-12T02:59:37.673643+0000","last_active":"2024-09-12T02:59:47.987400+0000","last_peered":"2024-09-12T02:59:47.987400+0000","last_clean":"2024-09-12T02:59:47.987400+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:47.987400+0000","last_undegraded":"2024-09-12T02:59:47.987400+0000","last_fullsized":"2024-09-12T02:59:47.987400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.673292+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.523545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988581+0000","last_change":"2024-09-12T02:59:33.671444+0000","last_active":"2024-09-12T02:59:47.988581+0000","last_peered":"2024-09-12T02:59:47.988581+0000","last_clean":"2024-09-12T02:59:47.988581+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:47.988581+0000","last_undegraded":"2024-09-12T02:59:47.988581+0000","last_fullsized":"2024-09-12T02:59:47.988581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.671212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:45.669284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972298+0000","last_change":"2024-09-12T02:59:34.590629+0000","last_active":"2024-09-12T02:59:47.972298+0000","last_peered":"2024-09-12T02:59:47.972298+0000","last_clean":"2024-09-12T02:59:47.972298+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:47.972298+0000","last_undegraded":"2024-09-12T02:59:47.972298+0000","last_fullsized":"2024-09-12T02:59:47.972298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.590531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.762881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988612+0000","last_change":"2024-09-12T02:59:43.837261+0000","last_active":"2024-09-12T02:59:47.988612+0000","last_peered":"2024-09-12T02:59:47.988612+0000","last_clean":"2024-09-12T02:59:47.988612+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:47.988612+0000","last_undegraded":"2024-09-12T02:59:47.988612+0000","last_fullsized":"2024-09-12T02:59:47.988612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.836980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.344004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970476+0000","last_change":"2024-09-12T02:59:45.048563+0000","last_active":"2024-09-12T02:59:47.970476+0000","last_peered":"2024-09-12T02:59:47.970476+0000","last_clean":"2024-09-12T02:59:47.970476+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:47.970476+0000","last_undegraded":"2024-09-12T02:59:47.970476+0000","last_fullsized":"2024-09-12T02:59:47.970476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.048315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:20.692033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.611665+0000","last_change":"2024-09-12T02:59:49.611694+0000","last_active":"2024-09-12T02:59:49.611665+0000","last_peered":"2024-09-12T02:59:49.611665+0000","last_clean":"2024-09-12T02:59:49.611665+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:49.611665+0000","last_undegraded":"2024-09-12T02:59:49.611665+0000","last_fullsized":"2024-09-12T02:59:49.611665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.611569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:05.308212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975259+0000","last_change":"2024-09-12T02:59:36.076892+0000","last_active":"2024-09-12T02:59:47.975259+0000","last_peered":"2024-09-12T02:59:47.975259+0000","last_clean":"2024-09-12T02:59:47.975259+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:47.975259+0000","last_undegraded":"2024-09-12T02:59:47.975259+0000","last_fullsized":"2024-09-12T02:59:47.975259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.076727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:26.666775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975590+0000","last_change":"2024-09-12T02:59:30.999792+0000","last_active":"2024-09-12T02:59:47.975590+0000","last_peered":"2024-09-12T02:59:47.975590+0000","last_clean":"2024-09-12T02:59:47.975590+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:47.975590+0000","last_undegraded":"2024-09-12T02:59:47.975590+0000","last_fullsized":"2024-09-12T02:59:47.975590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.999703+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:17.375066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973863+0000","last_change":"2024-09-12T02:59:34.015485+0000","last_active":"2024-09-12T02:59:47.973863+0000","last_peered":"2024-09-12T02:59:47.973863+0000","last_clean":"2024-09-12T02:59:47.973863+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:47.973863+0000","last_undegraded":"2024-09-12T02:59:47.973863+0000","last_fullsized":"2024-09-12T02:59:47.973863+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.015247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:05.065563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989055+0000","last_change":"2024-09-12T02:59:41.793529+0000","last_active":"2024-09-12T02:59:47.989055+0000","last_peered":"2024-09-12T02:59:47.989055+0000","last_clean":"2024-09-12T02:59:47.989055+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:47.989055+0000","last_undegraded":"2024-09-12T02:59:47.989055+0000","last_fullsized":"2024-09-12T02:59:47.989055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.793303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.839881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":167,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987810+0000","last_change":"2024-09-12T02:59:32.647074+0000","last_active":"2024-09-12T02:59:47.987810+0000","last_peered":"2024-09-12T02:59:47.987810+0000","last_clean":"2024-09-12T02:59:47.987810+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:47.987810+0000","last_undegraded":"2024-09-12T02:59:47.987810+0000","last_fullsized":"2024-09-12T02:59:47.987810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'28","last_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_deep_scrub":"79'28","last_deep_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.646844+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:46.886484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968042+0000","last_change":"2024-09-12T02:59:46.857630+0000","last_active":"2024-09-12T02:59:47.968042+0000","last_peered":"2024-09-12T02:59:47.968042+0000","last_clean":"2024-09-12T02:59:47.968042+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:47.968042+0000","last_undegraded":"2024-09-12T02:59:47.968042+0000","last_fullsized":"2024-09-12T02:59:47.968042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.857527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.845970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974062+0000","last_change":"2024-09-12T02:59:33.680657+0000","last_active":"2024-09-12T02:59:47.974062+0000","last_peered":"2024-09-12T02:59:47.974062+0000","last_clean":"2024-09-12T02:59:47.974062+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:47.974062+0000","last_undegraded":"2024-09-12T02:59:47.974062+0000","last_fullsized":"2024-09-12T02:59:47.974062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.680411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:15.802027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968679+0000","last_change":"2024-09-12T02:59:44.852192+0000","last_active":"2024-09-12T02:59:47.968679+0000","last_peered":"2024-09-12T02:59:47.968679+0000","last_clean":"2024-09-12T02:59:47.968679+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:47.968679+0000","last_undegraded":"2024-09-12T02:59:47.968679+0000","last_fullsized":"2024-09-12T02:59:47.968679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.852086+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.017309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":166,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971894+0000","last_change":"2024-09-12T02:59:45.664653+0000","last_active":"2024-09-12T02:59:47.971894+0000","last_peered":"2024-09-12T02:59:47.971894+0000","last_clean":"2024-09-12T02:59:47.971894+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:47.971894+0000","last_undegraded":"2024-09-12T02:59:47.971894+0000","last_fullsized":"2024-09-12T02:59:47.971894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.664314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.652758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975774+0000","last_change":"2024-09-12T02:59:45.129108+0000","last_active":"2024-09-12T02:59:47.975774+0000","last_peered":"2024-09-12T02:59:47.975774+0000","last_clean":"2024-09-12T02:59:47.975774+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:47.975774+0000","last_undegraded":"2024-09-12T02:59:47.975774+0000","last_fullsized":"2024-09-12T02:59:47.975774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.128965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.549002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973885+0000","last_change":"2024-09-12T02:59:37.986005+0000","last_active":"2024-09-12T02:59:47.973885+0000","last_peered":"2024-09-12T02:59:47.973885+0000","last_clean":"2024-09-12T02:59:47.973885+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:47.973885+0000","last_undegraded":"2024-09-12T02:59:47.973885+0000","last_fullsized":"2024-09-12T02:59:47.973885+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.985746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:14.181632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.639758+0000","last_change":"2024-09-12T02:59:51.639783+0000","last_active":"2024-09-12T02:59:51.639758+0000","last_peered":"2024-09-12T02:59:51.639758+0000","last_clean":"2024-09-12T02:59:51.639758+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:51.639758+0000","last_undegraded":"2024-09-12T02:59:51.639758+0000","last_fullsized":"2024-09-12T02:59:51.639758+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.639668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.759727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974029+0000","last_change":"2024-09-12T02:59:39.987993+0000","last_active":"2024-09-12T02:59:47.974029+0000","last_peered":"2024-09-12T02:59:47.974029+0000","last_clean":"2024-09-12T02:59:47.974029+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:47.974029+0000","last_undegraded":"2024-09-12T02:59:47.974029+0000","last_fullsized":"2024-09-12T02:59:47.974029+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.987743+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:04.424759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987757+0000","last_change":"2024-09-12T02:59:45.721685+0000","last_active":"2024-09-12T02:59:47.987757+0000","last_peered":"2024-09-12T02:59:47.987757+0000","last_clean":"2024-09-12T02:59:47.987757+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:47.987757+0000","last_undegraded":"2024-09-12T02:59:47.987757+0000","last_fullsized":"2024-09-12T02:59:47.987757+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.721444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.143614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970794+0000","last_change":"2024-09-12T02:59:46.669010+0000","last_active":"2024-09-12T02:59:47.970794+0000","last_peered":"2024-09-12T02:59:47.970794+0000","last_clean":"2024-09-12T02:59:47.970794+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:47.970794+0000","last_undegraded":"2024-09-12T02:59:47.970794+0000","last_fullsized":"2024-09-12T02:59:47.970794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.668894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:22.826170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975072+0000","last_change":"2024-09-12T02:59:41.077595+0000","last_active":"2024-09-12T02:59:47.975072+0000","last_peered":"2024-09-12T02:59:47.975072+0000","last_clean":"2024-09-12T02:59:47.975072+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:47.975072+0000","last_undegraded":"2024-09-12T02:59:47.975072+0000","last_fullsized":"2024-09-12T02:59:47.975072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.077484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:52.294457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967726+0000","last_change":"2024-09-12T02:59:41.841470+0000","last_active":"2024-09-12T02:59:47.967726+0000","last_peered":"2024-09-12T02:59:47.967726+0000","last_clean":"2024-09-12T02:59:47.967726+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:47.967726+0000","last_undegraded":"2024-09-12T02:59:47.967726+0000","last_fullsized":"2024-09-12T02:59:47.967726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.841333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.069789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.131581+0000","last_change":"2024-09-12T02:59:51.131633+0000","last_active":"2024-09-12T02:59:51.131581+0000","last_peered":"2024-09-12T02:59:51.131581+0000","last_clean":"2024-09-12T02:59:51.131581+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:51.131581+0000","last_undegraded":"2024-09-12T02:59:51.131581+0000","last_fullsized":"2024-09-12T02:59:51.131581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.131397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:19.953861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987223+0000","last_change":"2024-09-12T02:59:46.767895+0000","last_active":"2024-09-12T02:59:47.987223+0000","last_peered":"2024-09-12T02:59:47.987223+0000","last_clean":"2024-09-12T02:59:47.987223+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:47.987223+0000","last_undegraded":"2024-09-12T02:59:47.987223+0000","last_fullsized":"2024-09-12T02:59:47.987223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.767560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.939911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971399+0000","last_change":"2024-09-12T02:59:39.674943+0000","last_active":"2024-09-12T02:59:47.971399+0000","last_peered":"2024-09-12T02:59:47.971399+0000","last_clean":"2024-09-12T02:59:47.971399+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:47.971399+0000","last_undegraded":"2024-09-12T02:59:47.971399+0000","last_fullsized":"2024-09-12T02:59:47.971399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.674831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:28.379028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970981+0000","last_change":"2024-09-12T02:59:37.660153+0000","last_active":"2024-09-12T02:59:47.970981+0000","last_peered":"2024-09-12T02:59:47.970981+0000","last_clean":"2024-09-12T02:59:47.970981+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:47.970981+0000","last_undegraded":"2024-09-12T02:59:47.970981+0000","last_fullsized":"2024-09-12T02:59:47.970981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.660048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:32.261376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987111+0000","last_change":"2024-09-12T02:59:34.716068+0000","last_active":"2024-09-12T02:59:47.987111+0000","last_peered":"2024-09-12T02:59:47.987111+0000","last_clean":"2024-09-12T02:59:47.987111+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:47.987111+0000","last_undegraded":"2024-09-12T02:59:47.987111+0000","last_fullsized":"2024-09-12T02:59:47.987111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.715793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:43.456130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975476+0000","last_change":"2024-09-12T02:59:38.162584+0000","last_active":"2024-09-12T02:59:47.975476+0000","last_peered":"2024-09-12T02:59:47.975476+0000","last_clean":"2024-09-12T02:59:47.975476+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:47.975476+0000","last_undegraded":"2024-09-12T02:59:47.975476+0000","last_fullsized":"2024-09-12T02:59:47.975476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.162461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:51.207333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972265+0000","last_change":"2024-09-12T02:59:34.845414+0000","last_active":"2024-09-12T02:59:47.972265+0000","last_peered":"2024-09-12T02:59:47.972265+0000","last_clean":"2024-09-12T02:59:47.972265+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:47.972265+0000","last_undegraded":"2024-09-12T02:59:47.972265+0000","last_fullsized":"2024-09-12T02:59:47.972265+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.845313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:49.084952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971084+0000","last_change":"2024-09-12T02:59:38.676599+0000","last_active":"2024-09-12T02:59:47.971084+0000","last_peered":"2024-09-12T02:59:47.971084+0000","last_clean":"2024-09-12T02:59:47.971084+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:47.971084+0000","last_undegraded":"2024-09-12T02:59:47.971084+0000","last_fullsized":"2024-09-12T02:59:47.971084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.676453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:08.813287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971443+0000","last_change":"2024-09-12T02:59:32.676152+0000","last_active":"2024-09-12T02:59:47.971443+0000","last_peered":"2024-09-12T02:59:47.971443+0000","last_clean":"2024-09-12T02:59:47.971443+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:47.971443+0000","last_undegraded":"2024-09-12T02:59:47.971443+0000","last_fullsized":"2024-09-12T02:59:47.971443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.675897+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971857+0000","last_change":"2024-09-12T02:59:32.600836+0000","last_active":"2024-09-12T02:59:47.971857+0000","last_peered":"2024-09-12T02:59:47.971857+0000","last_clean":"2024-09-12T02:59:47.971857+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:47.971857+0000","last_undegraded":"2024-09-12T02:59:47.971857+0000","last_fullsized":"2024-09-12T02:59:47.971857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.600751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:36.409439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986975+0000","last_change":"2024-09-12T02:59:36.720562+0000","last_active":"2024-09-12T02:59:47.986975+0000","last_peered":"2024-09-12T02:59:47.986975+0000","last_clean":"2024-09-12T02:59:47.986975+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:47.986975+0000","last_undegraded":"2024-09-12T02:59:47.986975+0000","last_fullsized":"2024-09-12T02:59:47.986975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.720181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.336802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971697+0000","last_change":"2024-09-12T02:59:33.813763+0000","last_active":"2024-09-12T02:59:47.971697+0000","last_peered":"2024-09-12T02:59:47.971697+0000","last_clean":"2024-09-12T02:59:47.971697+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:47.971697+0000","last_undegraded":"2024-09-12T02:59:47.971697+0000","last_fullsized":"2024-09-12T02:59:47.971697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.813677+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:54.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971176+0000","last_change":"2024-09-12T02:59:43.020950+0000","last_active":"2024-09-12T02:59:47.971176+0000","last_peered":"2024-09-12T02:59:47.971176+0000","last_clean":"2024-09-12T02:59:47.971176+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:47.971176+0000","last_undegraded":"2024-09-12T02:59:47.971176+0000","last_fullsized":"2024-09-12T02:59:47.971176+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.020633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:20.020956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975501+0000","last_change":"2024-09-12T02:59:35.065915+0000","last_active":"2024-09-12T02:59:47.975501+0000","last_peered":"2024-09-12T02:59:47.975501+0000","last_clean":"2024-09-12T02:59:47.975501+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:47.975501+0000","last_undegraded":"2024-09-12T02:59:47.975501+0000","last_fullsized":"2024-09-12T02:59:47.975501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.065802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:51.998513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971305+0000","last_change":"2024-09-12T02:59:33.570266+0000","last_active":"2024-09-12T02:59:47.971305+0000","last_peered":"2024-09-12T02:59:47.971305+0000","last_clean":"2024-09-12T02:59:47.971305+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:47.971305+0000","last_undegraded":"2024-09-12T02:59:47.971305+0000","last_fullsized":"2024-09-12T02:59:47.971305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.570177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:57.992347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968334+0000","last_change":"2024-09-12T02:59:30.749318+0000","last_active":"2024-09-12T02:59:47.968334+0000","last_peered":"2024-09-12T02:59:47.968334+0000","last_clean":"2024-09-12T02:59:47.968334+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:47.968334+0000","last_undegraded":"2024-09-12T02:59:47.968334+0000","last_fullsized":"2024-09-12T02:59:47.968334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.749228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:31.541524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987453+0000","last_change":"2024-09-12T02:59:38.651039+0000","last_active":"2024-09-12T02:59:47.987453+0000","last_peered":"2024-09-12T02:59:47.987453+0000","last_clean":"2024-09-12T02:59:47.987453+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:47.987453+0000","last_undegraded":"2024-09-12T02:59:47.987453+0000","last_fullsized":"2024-09-12T02:59:47.987453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.650631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.137855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972409+0000","last_change":"2024-09-12T02:59:42.663691+0000","last_active":"2024-09-12T02:59:47.972409+0000","last_peered":"2024-09-12T02:59:47.972409+0000","last_clean":"2024-09-12T02:59:47.972409+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:47.972409+0000","last_undegraded":"2024-09-12T02:59:47.972409+0000","last_fullsized":"2024-09-12T02:59:47.972409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.663586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:23.083624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.118661+0000","last_change":"2024-09-12T02:59:50.118766+0000","last_active":"2024-09-12T02:59:50.118661+0000","last_peered":"2024-09-12T02:59:50.118661+0000","last_clean":"2024-09-12T02:59:50.118661+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:50.118661+0000","last_undegraded":"2024-09-12T02:59:50.118661+0000","last_fullsized":"2024-09-12T02:59:50.118661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.118459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:39.693765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970603+0000","last_change":"2024-09-12T02:59:31.642639+0000","last_active":"2024-09-12T02:59:47.970603+0000","last_peered":"2024-09-12T02:59:47.970603+0000","last_clean":"2024-09-12T02:59:47.970603+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:47.970603+0000","last_undegraded":"2024-09-12T02:59:47.970603+0000","last_fullsized":"2024-09-12T02:59:47.970603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.642539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:45.910007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970879+0000","last_change":"2024-09-12T02:59:42.020010+0000","last_active":"2024-09-12T02:59:47.970879+0000","last_peered":"2024-09-12T02:59:47.970879+0000","last_clean":"2024-09-12T02:59:47.970879+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:47.970879+0000","last_undegraded":"2024-09-12T02:59:47.970879+0000","last_fullsized":"2024-09-12T02:59:47.970879+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.019770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:02.627789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975198+0000","last_change":"2024-09-12T02:59:37.126601+0000","last_active":"2024-09-12T02:59:47.975198+0000","last_peered":"2024-09-12T02:59:47.975198+0000","last_clean":"2024-09-12T02:59:47.975198+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:47.975198+0000","last_undegraded":"2024-09-12T02:59:47.975198+0000","last_fullsized":"2024-09-12T02:59:47.975198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.126497+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:41.431052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987704+0000","last_change":"2024-09-12T02:59:40.644873+0000","last_active":"2024-09-12T02:59:47.987704+0000","last_peered":"2024-09-12T02:59:47.987704+0000","last_clean":"2024-09-12T02:59:47.987704+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:47.987704+0000","last_undegraded":"2024-09-12T02:59:47.987704+0000","last_fullsized":"2024-09-12T02:59:47.987704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.644626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:27.019990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989535+0000","last_change":"2024-09-12T02:59:42.787927+0000","last_active":"2024-09-12T02:59:47.989535+0000","last_peered":"2024-09-12T02:59:47.989535+0000","last_clean":"2024-09-12T02:59:47.989535+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:47.989535+0000","last_undegraded":"2024-09-12T02:59:47.989535+0000","last_fullsized":"2024-09-12T02:59:47.989535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.787542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.015998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972705+0000","last_change":"2024-09-12T02:59:32.823831+0000","last_active":"2024-09-12T02:59:47.972705+0000","last_peered":"2024-09-12T02:59:47.972705+0000","last_clean":"2024-09-12T02:59:47.972705+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:47.972705+0000","last_undegraded":"2024-09-12T02:59:47.972705+0000","last_fullsized":"2024-09-12T02:59:47.972705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.823742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:34.576078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974455+0000","last_change":"2024-09-12T02:59:47.049456+0000","last_active":"2024-09-12T02:59:47.974455+0000","last_peered":"2024-09-12T02:59:47.974455+0000","last_clean":"2024-09-12T02:59:47.974455+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:47.974455+0000","last_undegraded":"2024-09-12T02:59:47.974455+0000","last_fullsized":"2024-09-12T02:59:47.974455+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.049206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:32.900134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971264+0000","last_change":"2024-09-12T02:59:37.007470+0000","last_active":"2024-09-12T02:59:47.971264+0000","last_peered":"2024-09-12T02:59:47.971264+0000","last_clean":"2024-09-12T02:59:47.971264+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:47.971264+0000","last_undegraded":"2024-09-12T02:59:47.971264+0000","last_fullsized":"2024-09-12T02:59:47.971264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.007224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:18.542924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967806+0000","last_change":"2024-09-12T02:59:40.838979+0000","last_active":"2024-09-12T02:59:47.967806+0000","last_peered":"2024-09-12T02:59:47.967806+0000","last_clean":"2024-09-12T02:59:47.967806+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:47.967806+0000","last_undegraded":"2024-09-12T02:59:47.967806+0000","last_fullsized":"2024-09-12T02:59:47.967806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.838843+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:09.885421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975113+0000","last_change":"2024-09-12T02:59:34.019995+0000","last_active":"2024-09-12T02:59:47.975113+0000","last_peered":"2024-09-12T02:59:47.975113+0000","last_clean":"2024-09-12T02:59:47.975113+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:47.975113+0000","last_undegraded":"2024-09-12T02:59:47.975113+0000","last_fullsized":"2024-09-12T02:59:47.975113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.019910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.828598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970779+0000","last_change":"2024-09-12T02:59:35.597391+0000","last_active":"2024-09-12T02:59:47.970779+0000","last_peered":"2024-09-12T02:59:47.970779+0000","last_clean":"2024-09-12T02:59:47.970779+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:47.970779+0000","last_undegraded":"2024-09-12T02:59:47.970779+0000","last_fullsized":"2024-09-12T02:59:47.970779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.597291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:38.185412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973797+0000","last_change":"2024-09-12T02:59:36.682299+0000","last_active":"2024-09-12T02:59:47.973797+0000","last_peered":"2024-09-12T02:59:47.973797+0000","last_clean":"2024-09-12T02:59:47.973797+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:47.973797+0000","last_undegraded":"2024-09-12T02:59:47.973797+0000","last_fullsized":"2024-09-12T02:59:47.973797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.682064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:10.673981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986906+0000","last_change":"2024-09-12T02:59:44.683736+0000","last_active":"2024-09-12T02:59:47.986906+0000","last_peered":"2024-09-12T02:59:47.986906+0000","last_clean":"2024-09-12T02:59:47.986906+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:47.986906+0000","last_undegraded":"2024-09-12T02:59:47.986906+0000","last_fullsized":"2024-09-12T02:59:47.986906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.683432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.492120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987167+0000","last_change":"2024-09-12T02:59:43.695797+0000","last_active":"2024-09-12T02:59:47.987167+0000","last_peered":"2024-09-12T02:59:47.987167+0000","last_clean":"2024-09-12T02:59:47.987167+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:47.987167+0000","last_undegraded":"2024-09-12T02:59:47.987167+0000","last_fullsized":"2024-09-12T02:59:47.987167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'16","last_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_deep_scrub":"79'16","last_deep_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.695424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:57.962892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.814119+0000","last_change":"2024-09-12T02:59:48.814183+0000","last_active":"2024-09-12T02:59:48.814119+0000","last_peered":"2024-09-12T02:59:48.814119+0000","last_clean":"2024-09-12T02:59:48.814119+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:48.814119+0000","last_undegraded":"2024-09-12T02:59:48.814119+0000","last_fullsized":"2024-09-12T02:59:48.814119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.813942+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:41.235405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.652380+0000","last_change":"2024-09-12T02:59:48.652404+0000","last_active":"2024-09-12T02:59:48.652380+0000","last_peered":"2024-09-12T02:59:48.652380+0000","last_clean":"2024-09-12T02:59:48.652380+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:48.652380+0000","last_undegraded":"2024-09-12T02:59:48.652380+0000","last_fullsized":"2024-09-12T02:59:48.652380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.652295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:24.469845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986239+0000","last_change":"2024-09-12T02:59:40.773384+0000","last_active":"2024-09-12T02:59:47.986239+0000","last_peered":"2024-09-12T02:59:47.986239+0000","last_clean":"2024-09-12T02:59:47.986239+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:47.986239+0000","last_undegraded":"2024-09-12T02:59:47.986239+0000","last_fullsized":"2024-09-12T02:59:47.986239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.773129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.980310+0000","last_change":"2024-09-12T02:59:47.977081+0000","last_active":"2024-09-12T02:59:47.980310+0000","last_peered":"2024-09-12T02:59:47.980310+0000","last_clean":"2024-09-12T02:59:47.980310+0000","last_became_active":"2024-09-12T02:59:47.976687+0000","last_became_peered":"2024-09-12T02:59:47.976687+0000","last_unstale":"2024-09-12T02:59:47.980310+0000","last_undegraded":"2024-09-12T02:59:47.980310+0000","last_fullsized":"2024-09-12T02:59:47.980310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988297+0000","last_change":"2024-09-12T02:59:39.769618+0000","last_active":"2024-09-12T02:59:47.988297+0000","last_peered":"2024-09-12T02:59:47.988297+0000","last_clean":"2024-09-12T02:59:47.988297+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:47.988297+0000","last_undegraded":"2024-09-12T02:59:47.988297+0000","last_fullsized":"2024-09-12T02:59:47.988297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.769355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:44.299798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973047+0000","last_change":"2024-09-12T02:59:46.045977+0000","last_active":"2024-09-12T02:59:47.973047+0000","last_peered":"2024-09-12T02:59:47.973047+0000","last_clean":"2024-09-12T02:59:47.973047+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:47.973047+0000","last_undegraded":"2024-09-12T02:59:47.973047+0000","last_fullsized":"2024-09-12T02:59:47.973047+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.045725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:00.846357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974947+0000","last_change":"2024-09-12T02:59:33.045189+0000","last_active":"2024-09-12T02:59:47.974947+0000","last_peered":"2024-09-12T02:59:47.974947+0000","last_clean":"2024-09-12T02:59:47.974947+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:47.974947+0000","last_undegraded":"2024-09-12T02:59:47.974947+0000","last_fullsized":"2024-09-12T02:59:47.974947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.045042+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:47.312510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969171+0000","last_change":"2024-09-12T02:59:38.788525+0000","last_active":"2024-09-12T02:59:47.969171+0000","last_peered":"2024-09-12T02:59:47.969171+0000","last_clean":"2024-09-12T02:59:47.969171+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:47.969171+0000","last_undegraded":"2024-09-12T02:59:47.969171+0000","last_fullsized":"2024-09-12T02:59:47.969171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.788431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:20.633132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988967+0000","last_change":"2024-09-12T02:59:33.741380+0000","last_active":"2024-09-12T02:59:47.988967+0000","last_peered":"2024-09-12T02:59:47.988967+0000","last_clean":"2024-09-12T02:59:47.988967+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:47.988967+0000","last_undegraded":"2024-09-12T02:59:47.988967+0000","last_fullsized":"2024-09-12T02:59:47.988967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.741253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:51.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":530298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509485,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1552384,"data_stored":1083143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1544192,"data_stored":1083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":995328,"data_stored":529987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906959,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":928,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":950272,"data_stored":492227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":492263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":492297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:00:14.397 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T03:00:14.398 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T03:00:33.895 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:00:33.899 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:00:34.398 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:00:34.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f911d800640 1 Processor -- start 2024-09-12T03:00:34.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f911d800640 1 -- start start 2024-09-12T03:00:34.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f911d800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91181527e0 0x7f91180c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f911d800640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91180c61e0 0x7f91180c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f911d800640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9118159520 con 0x7f91180c7a00 2024-09-12T03:00:34.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f911d800640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f91181589a0 con 0x7f91180c61e0 2024-09-12T03:00:34.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f911d800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9118158c80 con 0x7f91181527e0 2024-09-12T03:00:34.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f9117400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91180c61e0 0x7f91180c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f9116a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91181527e0 0x7f91180c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f910e000640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f91180c7a00 0x7f91180cc550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:50094/0 (socket says 172.21.15.63:50094) 2024-09-12T03:00:34.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f910e000640 1 -- 172.21.15.63:0/3129410817 learned_addr learned my addr 172.21.15.63:0/3129410817 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T03:00:34.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f9117400640 1 -- 172.21.15.63:0/3129410817 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91181527e0 msgr2=0x7f91180c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:00:34.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f9117400640 1 --2- 172.21.15.63:0/3129410817 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91181527e0 0x7f91180c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f9117400640 1 -- 172.21.15.63:0/3129410817 >> v1:172.21.15.119:6789/0 conn(0x7f91180c7a00 legacy=0x7f91180cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.547+0000 7f9117400640 1 -- 172.21.15.63:0/3129410817 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9118158f60 con 0x7f91180c61e0 2024-09-12T03:00:34.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f9117400640 1 --2- 172.21.15.63:0/3129410817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91180c61e0 0x7f91180c6eb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91100097c0 tx=0x7f911001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff2f1ea8e0697f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:34.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f9116000640 1 -- 172.21.15.63:0/3129410817 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91100a7070 con 0x7f91180c61e0 2024-09-12T03:00:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f9116000640 1 -- 172.21.15.63:0/3129410817 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91100b0070 con 0x7f91180c61e0 2024-09-12T03:00:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f9116000640 1 -- 172.21.15.63:0/3129410817 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91100ab890 con 0x7f91180c61e0 2024-09-12T03:00:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f911d800640 1 -- 172.21.15.63:0/3129410817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91180c61e0 msgr2=0x7f91180c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f911d800640 1 --2- 172.21.15.63:0/3129410817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91180c61e0 0x7f91180c6eb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f91100097c0 tx=0x7f911001c470 comp rx=0 tx=0).stop 2024-09-12T03:00:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f911d800640 1 -- 172.21.15.63:0/3129410817 shutdown_connections 2024-09-12T03:00:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f911d800640 1 --2- 172.21.15.63:0/3129410817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91180c61e0 0x7f91180c6eb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f911d800640 1 --2- 172.21.15.63:0/3129410817 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91181527e0 0x7f91180c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f911d800640 1 -- 172.21.15.63:0/3129410817 >> 172.21.15.63:0/3129410817 conn(0x7f911806f3d0 msgr2=0x7f911806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f911d800640 1 -- 172.21.15.63:0/3129410817 shutdown_connections 2024-09-12T03:00:34.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.551+0000 7f911d800640 1 -- 172.21.15.63:0/3129410817 wait complete. 2024-09-12T03:00:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 Processor -- start 2024-09-12T03:00:34.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 -- start start 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91180c61e0 0x7f91181461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91180c7a00 0x7f91181501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91181527e0 0x7f9118151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f91181586e0 con 0x7f91181527e0 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9118158560 con 0x7f91180c7a00 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f9118165700 con 0x7f91180c61e0 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9117400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91181527e0 0x7f9118151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9117400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91181527e0 0x7f9118151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36734/0 (socket says 172.21.15.63:36734) 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9117400640 1 -- 172.21.15.63:0/2370508305 learned_addr learned my addr 172.21.15.63:0/2370508305 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9116a00640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91180c61e0 0x7f91181461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f910e000640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91180c7a00 0x7f91181501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9117400640 1 -- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91180c61e0 msgr2=0x7f91181461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9117400640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91180c61e0 0x7f91181461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9117400640 1 -- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91180c7a00 msgr2=0x7f91181501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9117400640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91180c7a00 0x7f91181501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9117400640 1 -- 172.21.15.63:0/2370508305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91181f6c50 con 0x7f91181527e0 2024-09-12T03:00:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f9117400640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91181527e0 0x7f9118151000 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f91100097c0 tx=0x7f911001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f910f400640 1 -- 172.21.15.63:0/2370508305 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110006e20 con 0x7f91181527e0 2024-09-12T03:00:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f910f400640 1 -- 172.21.15.63:0/2370508305 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91100bf610 con 0x7f91181527e0 2024-09-12T03:00:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9118144630 con 0x7f91181527e0 2024-09-12T03:00:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f910f400640 1 -- 172.21.15.63:0/2370508305 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91100bf9e0 con 0x7f91181527e0 2024-09-12T03:00:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.555+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9118144bf0 con 0x7f91181527e0 2024-09-12T03:00:34.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.559+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91180cc550 con 0x7f91181527e0 2024-09-12T03:00:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.559+0000 7f910f400640 1 -- 172.21.15.63:0/2370508305 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91100bd020 con 0x7f91181527e0 2024-09-12T03:00:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.559+0000 7f910f400640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f90f40678c0 0x7f90f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:34.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.559+0000 7f910f400640 1 -- 172.21.15.63:0/2370508305 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f9110120850 con 0x7f91181527e0 2024-09-12T03:00:34.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.559+0000 7f9116a00640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f90f40678c0 0x7f90f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:34.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.559+0000 7f9116a00640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f90f40678c0 0x7f90f4069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9108011340 tx=0x7f910800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:34.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.563+0000 7f910f400640 1 -- 172.21.15.63:0/2370508305 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9110016090 con 0x7f91181527e0 2024-09-12T03:00:34.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.727+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f911806d240 con 0x7f90f40678c0 2024-09-12T03:00:34.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.751+0000 7f910f400640 1 -- 172.21.15.63:0/2370508305 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332999 (secure 0 0 0) 0x7f911806d240 con 0x7f90f40678c0 2024-09-12T03:00:34.758 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:00:34.760 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T03:00:34.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f90f40678c0 msgr2=0x7f90f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f90f40678c0 0x7f90f4069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9108011340 tx=0x7f910800b040 comp rx=0 tx=0).stop 2024-09-12T03:00:34.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91181527e0 msgr2=0x7f9118151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:34.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91181527e0 0x7f9118151000 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f91100097c0 tx=0x7f911001acb0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 shutdown_connections 2024-09-12T03:00:34.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91181527e0 0x7f9118151000 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91180c7a00 0x7f91181501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f90f40678c0 0x7f90f4069d80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 --2- 172.21.15.63:0/2370508305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91180c61e0 0x7f91181461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:34.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 >> 172.21.15.63:0/2370508305 conn(0x7f911806f3d0 msgr2=0x7f91180c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:34.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 shutdown_connections 2024-09-12T03:00:34.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:34.755+0000 7f911d800640 1 -- 172.21.15.63:0/2370508305 wait complete. 2024-09-12T03:00:34.779 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-09-12T03:00:33.827155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238480,"kb_used_data":8696,"kb_used_omap":15,"kb_used_meta":229616,"kb_avail":754736240,"statfs":{"total":773094113280,"available":772849909760,"internally_reserved":0,"allocated":8904704,"data_stored":5195750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":235127470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004855"},"pg_stats":[{"pgid":"2.1f","version":"79'6","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975802+0000","last_change":"2024-09-12T02:59:32.000879+0000","last_active":"2024-09-12T02:59:47.975802+0000","last_peered":"2024-09-12T02:59:47.975802+0000","last_clean":"2024-09-12T02:59:47.975802+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:47.975802+0000","last_undegraded":"2024-09-12T02:59:47.975802+0000","last_fullsized":"2024-09-12T02:59:47.975802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.000756+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.073437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971575+0000","last_change":"2024-09-12T02:59:43.632597+0000","last_active":"2024-09-12T02:59:47.971575+0000","last_peered":"2024-09-12T02:59:47.971575+0000","last_clean":"2024-09-12T02:59:47.971575+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:47.971575+0000","last_undegraded":"2024-09-12T02:59:47.971575+0000","last_fullsized":"2024-09-12T02:59:47.971575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.632456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:01.396201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970626+0000","last_change":"2024-09-12T02:59:45.690062+0000","last_active":"2024-09-12T02:59:47.970626+0000","last_peered":"2024-09-12T02:59:47.970626+0000","last_clean":"2024-09-12T02:59:47.970626+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:47.970626+0000","last_undegraded":"2024-09-12T02:59:47.970626+0000","last_fullsized":"2024-09-12T02:59:47.970626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.689949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:02.009111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971761+0000","last_change":"2024-09-12T02:59:36.630496+0000","last_active":"2024-09-12T02:59:47.971761+0000","last_peered":"2024-09-12T02:59:47.971761+0000","last_clean":"2024-09-12T02:59:47.971761+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:47.971761+0000","last_undegraded":"2024-09-12T02:59:47.971761+0000","last_fullsized":"2024-09-12T02:59:47.971761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.630383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:49.675255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975685+0000","last_change":"2024-09-12T02:59:44.081098+0000","last_active":"2024-09-12T02:59:47.975685+0000","last_peered":"2024-09-12T02:59:47.975685+0000","last_clean":"2024-09-12T02:59:47.975685+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:47.975685+0000","last_undegraded":"2024-09-12T02:59:47.975685+0000","last_fullsized":"2024-09-12T02:59:47.975685+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.080989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:55.266943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970430+0000","last_change":"2024-09-12T02:59:41.662320+0000","last_active":"2024-09-12T02:59:47.970430+0000","last_peered":"2024-09-12T02:59:47.970430+0000","last_clean":"2024-09-12T02:59:47.970430+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:47.970430+0000","last_undegraded":"2024-09-12T02:59:47.970430+0000","last_fullsized":"2024-09-12T02:59:47.970430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.662088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:28.169111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989531+0000","last_change":"2024-09-12T02:59:37.757533+0000","last_active":"2024-09-12T02:59:47.989531+0000","last_peered":"2024-09-12T02:59:47.989531+0000","last_clean":"2024-09-12T02:59:47.989531+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:47.989531+0000","last_undegraded":"2024-09-12T02:59:47.989531+0000","last_fullsized":"2024-09-12T02:59:47.989531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.757250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:10.370609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972764+0000","last_change":"2024-09-12T02:59:35.959195+0000","last_active":"2024-09-12T02:59:47.972764+0000","last_peered":"2024-09-12T02:59:47.972764+0000","last_clean":"2024-09-12T02:59:47.972764+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:47.972764+0000","last_undegraded":"2024-09-12T02:59:47.972764+0000","last_fullsized":"2024-09-12T02:59:47.972764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.958975+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.932192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972153+0000","last_change":"2024-09-12T02:59:43.619841+0000","last_active":"2024-09-12T02:59:47.972153+0000","last_peered":"2024-09-12T02:59:47.972153+0000","last_clean":"2024-09-12T02:59:47.972153+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:47.972153+0000","last_undegraded":"2024-09-12T02:59:47.972153+0000","last_fullsized":"2024-09-12T02:59:47.972153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.619594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:49.784818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'3","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989105+0000","last_change":"2024-09-12T02:59:47.847154+0000","last_active":"2024-09-12T02:59:47.989105+0000","last_peered":"2024-09-12T02:59:47.989105+0000","last_clean":"2024-09-12T02:59:47.989105+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:47.989105+0000","last_undegraded":"2024-09-12T02:59:47.989105+0000","last_fullsized":"2024-09-12T02:59:47.989105+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.846797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.835241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973740+0000","last_change":"2024-09-12T02:59:44.041049+0000","last_active":"2024-09-12T02:59:47.973740+0000","last_peered":"2024-09-12T02:59:47.973740+0000","last_clean":"2024-09-12T02:59:47.973740+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:47.973740+0000","last_undegraded":"2024-09-12T02:59:47.973740+0000","last_fullsized":"2024-09-12T02:59:47.973740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.040815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.885096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970873+0000","last_change":"2024-09-12T02:59:40.700614+0000","last_active":"2024-09-12T02:59:47.970873+0000","last_peered":"2024-09-12T02:59:47.970873+0000","last_clean":"2024-09-12T02:59:47.970873+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:47.970873+0000","last_undegraded":"2024-09-12T02:59:47.970873+0000","last_fullsized":"2024-09-12T02:59:47.970873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.700368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:48.928824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986635+0000","last_change":"2024-09-12T02:59:39.629343+0000","last_active":"2024-09-12T02:59:47.986635+0000","last_peered":"2024-09-12T02:59:47.986635+0000","last_clean":"2024-09-12T02:59:47.986635+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:47.986635+0000","last_undegraded":"2024-09-12T02:59:47.986635+0000","last_fullsized":"2024-09-12T02:59:47.986635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.629058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:43.299464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988800+0000","last_change":"2024-09-12T02:59:36.789441+0000","last_active":"2024-09-12T02:59:47.988800+0000","last_peered":"2024-09-12T02:59:47.988800+0000","last_clean":"2024-09-12T02:59:47.988800+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:47.988800+0000","last_undegraded":"2024-09-12T02:59:47.988800+0000","last_fullsized":"2024-09-12T02:59:47.988800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.789151+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:41.135081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974912+0000","last_change":"2024-09-12T02:59:37.711523+0000","last_active":"2024-09-12T02:59:47.974912+0000","last_peered":"2024-09-12T02:59:47.974912+0000","last_clean":"2024-09-12T02:59:47.974912+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:47.974912+0000","last_undegraded":"2024-09-12T02:59:47.974912+0000","last_fullsized":"2024-09-12T02:59:47.974912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.711188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.241632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970941+0000","last_change":"2024-09-12T02:59:40.677307+0000","last_active":"2024-09-12T02:59:47.970941+0000","last_peered":"2024-09-12T02:59:47.970941+0000","last_clean":"2024-09-12T02:59:47.970941+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:47.970941+0000","last_undegraded":"2024-09-12T02:59:47.970941+0000","last_fullsized":"2024-09-12T02:59:47.970941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.677196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:18.992896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967755+0000","last_change":"2024-09-12T02:59:42.816275+0000","last_active":"2024-09-12T02:59:47.967755+0000","last_peered":"2024-09-12T02:59:47.967755+0000","last_clean":"2024-09-12T02:59:47.967755+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:47.967755+0000","last_undegraded":"2024-09-12T02:59:47.967755+0000","last_fullsized":"2024-09-12T02:59:47.967755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.816152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:29.323176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973221+0000","last_change":"2024-09-12T02:59:38.719352+0000","last_active":"2024-09-12T02:59:47.973221+0000","last_peered":"2024-09-12T02:59:47.973221+0000","last_clean":"2024-09-12T02:59:47.973221+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:47.973221+0000","last_undegraded":"2024-09-12T02:59:47.973221+0000","last_fullsized":"2024-09-12T02:59:47.973221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.719131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.333596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.642704+0000","last_change":"2024-09-12T02:59:50.642733+0000","last_active":"2024-09-12T02:59:50.642704+0000","last_peered":"2024-09-12T02:59:50.642704+0000","last_clean":"2024-09-12T02:59:50.642704+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:50.642704+0000","last_undegraded":"2024-09-12T02:59:50.642704+0000","last_fullsized":"2024-09-12T02:59:50.642704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.642614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967868+0000","last_change":"2024-09-12T02:59:32.776350+0000","last_active":"2024-09-12T02:59:47.967868+0000","last_peered":"2024-09-12T02:59:47.967868+0000","last_clean":"2024-09-12T02:59:47.967868+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:47.967868+0000","last_undegraded":"2024-09-12T02:59:47.967868+0000","last_fullsized":"2024-09-12T02:59:47.967868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.776267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:58.890222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968625+0000","last_change":"2024-09-12T02:59:34.789313+0000","last_active":"2024-09-12T02:59:47.968625+0000","last_peered":"2024-09-12T02:59:47.968625+0000","last_clean":"2024-09-12T02:59:47.968625+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:47.968625+0000","last_undegraded":"2024-09-12T02:59:47.968625+0000","last_fullsized":"2024-09-12T02:59:47.968625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.789214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.790935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971730+0000","last_change":"2024-09-12T02:59:34.632579+0000","last_active":"2024-09-12T02:59:47.971730+0000","last_peered":"2024-09-12T02:59:47.971730+0000","last_clean":"2024-09-12T02:59:47.971730+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:47.971730+0000","last_undegraded":"2024-09-12T02:59:47.971730+0000","last_fullsized":"2024-09-12T02:59:47.971730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.632350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.978281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987412+0000","last_change":"2024-09-12T02:59:35.785814+0000","last_active":"2024-09-12T02:59:47.987412+0000","last_peered":"2024-09-12T02:59:47.987412+0000","last_clean":"2024-09-12T02:59:47.987412+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:47.987412+0000","last_undegraded":"2024-09-12T02:59:47.987412+0000","last_fullsized":"2024-09-12T02:59:47.987412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.785459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.907074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975052+0000","last_change":"2024-09-12T02:59:44.644342+0000","last_active":"2024-09-12T02:59:47.975052+0000","last_peered":"2024-09-12T02:59:47.975052+0000","last_clean":"2024-09-12T02:59:47.975052+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:47.975052+0000","last_undegraded":"2024-09-12T02:59:47.975052+0000","last_fullsized":"2024-09-12T02:59:47.975052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.644026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:49.273561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975392+0000","last_change":"2024-09-12T02:59:46.131647+0000","last_active":"2024-09-12T02:59:47.975392+0000","last_peered":"2024-09-12T02:59:47.975392+0000","last_clean":"2024-09-12T02:59:47.975392+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:47.975392+0000","last_undegraded":"2024-09-12T02:59:47.975392+0000","last_fullsized":"2024-09-12T02:59:47.975392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.131533+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:06.802576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987954+0000","last_change":"2024-09-12T02:59:35.721123+0000","last_active":"2024-09-12T02:59:47.987954+0000","last_peered":"2024-09-12T02:59:47.987954+0000","last_clean":"2024-09-12T02:59:47.987954+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:47.987954+0000","last_undegraded":"2024-09-12T02:59:47.987954+0000","last_fullsized":"2024-09-12T02:59:47.987954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.720761+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:17.277216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971041+0000","last_change":"2024-09-12T02:59:39.707123+0000","last_active":"2024-09-12T02:59:47.971041+0000","last_peered":"2024-09-12T02:59:47.971041+0000","last_clean":"2024-09-12T02:59:47.971041+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:47.971041+0000","last_undegraded":"2024-09-12T02:59:47.971041+0000","last_fullsized":"2024-09-12T02:59:47.971041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.706899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:08.753477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972457+0000","last_change":"2024-09-12T02:59:41.667809+0000","last_active":"2024-09-12T02:59:47.972457+0000","last_peered":"2024-09-12T02:59:47.972457+0000","last_clean":"2024-09-12T02:59:47.972457+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:47.972457+0000","last_undegraded":"2024-09-12T02:59:47.972457+0000","last_fullsized":"2024-09-12T02:59:47.972457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.667707+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:52.853661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968963+0000","last_change":"2024-09-12T02:59:45.841193+0000","last_active":"2024-09-12T02:59:47.968963+0000","last_peered":"2024-09-12T02:59:47.968963+0000","last_clean":"2024-09-12T02:59:47.968963+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:47.968963+0000","last_undegraded":"2024-09-12T02:59:47.968963+0000","last_fullsized":"2024-09-12T02:59:47.968963+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.841069+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:50.470604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.991190+0000","last_change":"2024-09-12T02:59:47.991190+0000","last_active":"2024-09-12T02:59:47.991190+0000","last_peered":"2024-09-12T02:59:47.991190+0000","last_clean":"2024-09-12T02:59:47.991190+0000","last_became_active":"2024-09-12T02:59:47.990629+0000","last_became_peered":"2024-09-12T02:59:47.990629+0000","last_unstale":"2024-09-12T02:59:47.991190+0000","last_undegraded":"2024-09-12T02:59:47.991190+0000","last_fullsized":"2024-09-12T02:59:47.991190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.643595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.689482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968239+0000","last_change":"2024-09-12T02:59:36.821336+0000","last_active":"2024-09-12T02:59:47.968239+0000","last_peered":"2024-09-12T02:59:47.968239+0000","last_clean":"2024-09-12T02:59:47.968239+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:47.968239+0000","last_undegraded":"2024-09-12T02:59:47.968239+0000","last_fullsized":"2024-09-12T02:59:47.968239+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.821234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.321748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989802+0000","last_change":"2024-09-12T02:59:38.763406+0000","last_active":"2024-09-12T02:59:47.989802+0000","last_peered":"2024-09-12T02:59:47.989802+0000","last_clean":"2024-09-12T02:59:47.989802+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:47.989802+0000","last_undegraded":"2024-09-12T02:59:47.989802+0000","last_fullsized":"2024-09-12T02:59:47.989802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.763178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.755095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975077+0000","last_change":"2024-09-12T02:59:42.071495+0000","last_active":"2024-09-12T02:59:47.975077+0000","last_peered":"2024-09-12T02:59:47.975077+0000","last_clean":"2024-09-12T02:59:47.975077+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:47.975077+0000","last_undegraded":"2024-09-12T02:59:47.975077+0000","last_fullsized":"2024-09-12T02:59:47.975077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.071362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:30.775559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973317+0000","last_change":"2024-09-12T02:59:39.026655+0000","last_active":"2024-09-12T02:59:47.973317+0000","last_peered":"2024-09-12T02:59:47.973317+0000","last_clean":"2024-09-12T02:59:47.973317+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:47.973317+0000","last_undegraded":"2024-09-12T02:59:47.973317+0000","last_fullsized":"2024-09-12T02:59:47.973317+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.026365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:52.426930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968304+0000","last_change":"2024-09-12T02:59:37.791375+0000","last_active":"2024-09-12T02:59:47.968304+0000","last_peered":"2024-09-12T02:59:47.968304+0000","last_clean":"2024-09-12T02:59:47.968304+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:47.968304+0000","last_undegraded":"2024-09-12T02:59:47.968304+0000","last_fullsized":"2024-09-12T02:59:47.968304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.791278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:11.783194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967761+0000","last_change":"2024-09-12T02:59:43.858969+0000","last_active":"2024-09-12T02:59:47.967761+0000","last_peered":"2024-09-12T02:59:47.967761+0000","last_clean":"2024-09-12T02:59:47.967761+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:47.967761+0000","last_undegraded":"2024-09-12T02:59:47.967761+0000","last_fullsized":"2024-09-12T02:59:47.967761+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.858860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972713+0000","last_change":"2024-09-12T02:59:35.662731+0000","last_active":"2024-09-12T02:59:47.972713+0000","last_peered":"2024-09-12T02:59:47.972713+0000","last_clean":"2024-09-12T02:59:47.972713+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:47.972713+0000","last_undegraded":"2024-09-12T02:59:47.972713+0000","last_fullsized":"2024-09-12T02:59:47.972713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.662469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:08.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971604+0000","last_change":"2024-09-12T02:59:32.999842+0000","last_active":"2024-09-12T02:59:47.971604+0000","last_peered":"2024-09-12T02:59:47.971604+0000","last_clean":"2024-09-12T02:59:47.971604+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:47.971604+0000","last_undegraded":"2024-09-12T02:59:47.971604+0000","last_fullsized":"2024-09-12T02:59:47.971604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.999508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:43.870533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.055203+0000","last_change":"2024-09-12T02:59:48.055261+0000","last_active":"2024-09-12T02:59:48.055203+0000","last_peered":"2024-09-12T02:59:48.055203+0000","last_clean":"2024-09-12T02:59:48.055203+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:48.055203+0000","last_undegraded":"2024-09-12T02:59:48.055203+0000","last_fullsized":"2024-09-12T02:59:48.055203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.055039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.593082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967922+0000","last_change":"2024-09-12T02:59:33.818250+0000","last_active":"2024-09-12T02:59:47.967922+0000","last_peered":"2024-09-12T02:59:47.967922+0000","last_clean":"2024-09-12T02:59:47.967922+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:47.967922+0000","last_undegraded":"2024-09-12T02:59:47.967922+0000","last_fullsized":"2024-09-12T02:59:47.967922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.818171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:46.646434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"79'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971823+0000","last_change":"2024-09-12T02:59:31.836989+0000","last_active":"2024-09-12T02:59:47.971823+0000","last_peered":"2024-09-12T02:59:47.971823+0000","last_clean":"2024-09-12T02:59:47.971823+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:47.971823+0000","last_undegraded":"2024-09-12T02:59:47.971823+0000","last_fullsized":"2024-09-12T02:59:47.971823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.836905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:53.031692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968330+0000","last_change":"2024-09-12T02:59:39.791877+0000","last_active":"2024-09-12T02:59:47.968330+0000","last_peered":"2024-09-12T02:59:47.968330+0000","last_clean":"2024-09-12T02:59:47.968330+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:47.968330+0000","last_undegraded":"2024-09-12T02:59:47.968330+0000","last_fullsized":"2024-09-12T02:59:47.968330+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.791761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:25.406226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974670+0000","last_change":"2024-09-12T02:59:30.045775+0000","last_active":"2024-09-12T02:59:47.974670+0000","last_peered":"2024-09-12T02:59:47.974670+0000","last_clean":"2024-09-12T02:59:47.974670+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:47.974670+0000","last_undegraded":"2024-09-12T02:59:47.974670+0000","last_fullsized":"2024-09-12T02:59:47.974670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.045690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:33.716096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.861880+0000","last_change":"2024-09-12T02:59:49.861935+0000","last_active":"2024-09-12T02:59:49.861880+0000","last_peered":"2024-09-12T02:59:49.861880+0000","last_clean":"2024-09-12T02:59:49.861880+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:49.861880+0000","last_undegraded":"2024-09-12T02:59:49.861880+0000","last_fullsized":"2024-09-12T02:59:49.861880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.861705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:39.315077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975242+0000","last_change":"2024-09-12T02:59:40.118829+0000","last_active":"2024-09-12T02:59:47.975242+0000","last_peered":"2024-09-12T02:59:47.975242+0000","last_clean":"2024-09-12T02:59:47.975242+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:47.975242+0000","last_undegraded":"2024-09-12T02:59:47.975242+0000","last_fullsized":"2024-09-12T02:59:47.975242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.118699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:10.405280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970876+0000","last_change":"2024-09-12T02:59:47.676864+0000","last_active":"2024-09-12T02:59:47.970876+0000","last_peered":"2024-09-12T02:59:47.970876+0000","last_clean":"2024-09-12T02:59:47.970876+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:47.970876+0000","last_undegraded":"2024-09-12T02:59:47.970876+0000","last_fullsized":"2024-09-12T02:59:47.970876+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.676747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.675367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971929+0000","last_change":"2024-09-12T02:59:40.971763+0000","last_active":"2024-09-12T02:59:47.971929+0000","last_peered":"2024-09-12T02:59:47.971929+0000","last_clean":"2024-09-12T02:59:47.971929+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:47.971929+0000","last_undegraded":"2024-09-12T02:59:47.971929+0000","last_fullsized":"2024-09-12T02:59:47.971929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.971535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:04.999865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"79'119","reported_seq":298,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987941+0000","last_change":"2024-09-12T02:59:34.803297+0000","last_active":"2024-09-12T02:59:47.987941+0000","last_peered":"2024-09-12T02:59:47.987941+0000","last_clean":"2024-09-12T02:59:47.987941+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:47.987941+0000","last_undegraded":"2024-09-12T02:59:47.987941+0000","last_fullsized":"2024-09-12T02:59:47.987941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.802947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:59.161855+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986419+0000","last_change":"2024-09-12T02:59:42.682806+0000","last_active":"2024-09-12T02:59:47.986419+0000","last_peered":"2024-09-12T02:59:47.986419+0000","last_clean":"2024-09-12T02:59:47.986419+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:47.986419+0000","last_undegraded":"2024-09-12T02:59:47.986419+0000","last_fullsized":"2024-09-12T02:59:47.986419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.682574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:22.933579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968536+0000","last_change":"2024-09-12T02:59:35.830230+0000","last_active":"2024-09-12T02:59:47.968536+0000","last_peered":"2024-09-12T02:59:47.968536+0000","last_clean":"2024-09-12T02:59:47.968536+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:47.968536+0000","last_undegraded":"2024-09-12T02:59:47.968536+0000","last_fullsized":"2024-09-12T02:59:47.968536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.830121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.993178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972431+0000","last_change":"2024-09-12T02:59:35.842501+0000","last_active":"2024-09-12T02:59:47.972431+0000","last_peered":"2024-09-12T02:59:47.972431+0000","last_clean":"2024-09-12T02:59:47.972431+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:47.972431+0000","last_undegraded":"2024-09-12T02:59:47.972431+0000","last_fullsized":"2024-09-12T02:59:47.972431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.842396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:47.840469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986324+0000","last_change":"2024-09-12T02:59:41.651678+0000","last_active":"2024-09-12T02:59:47.986324+0000","last_peered":"2024-09-12T02:59:47.986324+0000","last_clean":"2024-09-12T02:59:47.986324+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:47.986324+0000","last_undegraded":"2024-09-12T02:59:47.986324+0000","last_fullsized":"2024-09-12T02:59:47.986324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.651443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:40.919631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973325+0000","last_change":"2024-09-12T02:59:34.986788+0000","last_active":"2024-09-12T02:59:47.973325+0000","last_peered":"2024-09-12T02:59:47.973325+0000","last_clean":"2024-09-12T02:59:47.973325+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:47.973325+0000","last_undegraded":"2024-09-12T02:59:47.973325+0000","last_fullsized":"2024-09-12T02:59:47.973325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.986542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:35.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968801+0000","last_change":"2024-09-12T02:59:31.772320+0000","last_active":"2024-09-12T02:59:47.968801+0000","last_peered":"2024-09-12T02:59:47.968801+0000","last_clean":"2024-09-12T02:59:47.968801+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:47.968801+0000","last_undegraded":"2024-09-12T02:59:47.968801+0000","last_fullsized":"2024-09-12T02:59:47.968801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.772236+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:19.909174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975319+0000","last_change":"2024-09-12T02:59:43.053479+0000","last_active":"2024-09-12T02:59:47.975319+0000","last_peered":"2024-09-12T02:59:47.975319+0000","last_clean":"2024-09-12T02:59:47.975319+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:47.975319+0000","last_undegraded":"2024-09-12T02:59:47.975319+0000","last_fullsized":"2024-09-12T02:59:47.975319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.053377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:21.369077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989656+0000","last_change":"2024-09-12T02:59:46.862199+0000","last_active":"2024-09-12T02:59:47.989656+0000","last_peered":"2024-09-12T02:59:47.989656+0000","last_clean":"2024-09-12T02:59:47.989656+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:47.989656+0000","last_undegraded":"2024-09-12T02:59:47.989656+0000","last_fullsized":"2024-09-12T02:59:47.989656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.861972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:51.491507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'3","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972717+0000","last_change":"2024-09-12T02:59:30.860535+0000","last_active":"2024-09-12T02:59:47.972717+0000","last_peered":"2024-09-12T02:59:47.972717+0000","last_clean":"2024-09-12T02:59:47.972717+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:47.972717+0000","last_undegraded":"2024-09-12T02:59:47.972717+0000","last_fullsized":"2024-09-12T02:59:47.972717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.860444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:23.065975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.093595+0000","last_change":"2024-09-12T02:59:49.093650+0000","last_active":"2024-09-12T02:59:49.093595+0000","last_peered":"2024-09-12T02:59:49.093595+0000","last_clean":"2024-09-12T02:59:49.093595+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:49.093595+0000","last_undegraded":"2024-09-12T02:59:49.093595+0000","last_fullsized":"2024-09-12T02:59:49.093595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.093403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.133030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989405+0000","last_change":"2024-09-12T02:59:44.860343+0000","last_active":"2024-09-12T02:59:47.989405+0000","last_peered":"2024-09-12T02:59:47.989405+0000","last_clean":"2024-09-12T02:59:47.989405+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:47.989405+0000","last_undegraded":"2024-09-12T02:59:47.989405+0000","last_fullsized":"2024-09-12T02:59:47.989405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.860002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:03.716731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975421+0000","last_change":"2024-09-12T02:59:31.636304+0000","last_active":"2024-09-12T02:59:47.975421+0000","last_peered":"2024-09-12T02:59:47.975421+0000","last_clean":"2024-09-12T02:59:47.975421+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:47.975421+0000","last_undegraded":"2024-09-12T02:59:47.975421+0000","last_fullsized":"2024-09-12T02:59:47.975421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.636071+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:48.966306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974472+0000","last_change":"2024-09-12T02:59:42.661415+0000","last_active":"2024-09-12T02:59:47.974472+0000","last_peered":"2024-09-12T02:59:47.974472+0000","last_clean":"2024-09-12T02:59:47.974472+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:47.974472+0000","last_undegraded":"2024-09-12T02:59:47.974472+0000","last_fullsized":"2024-09-12T02:59:47.974472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.661146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986300+0000","last_change":"2024-09-12T02:59:45.832208+0000","last_active":"2024-09-12T02:59:47.986300+0000","last_peered":"2024-09-12T02:59:47.986300+0000","last_clean":"2024-09-12T02:59:47.986300+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:47.986300+0000","last_undegraded":"2024-09-12T02:59:47.986300+0000","last_fullsized":"2024-09-12T02:59:47.986300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.831975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'12","reported_seq":184,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971562+0000","last_change":"2024-09-12T02:59:36.886312+0000","last_active":"2024-09-12T02:59:47.971562+0000","last_peered":"2024-09-12T02:59:47.971562+0000","last_clean":"2024-09-12T02:59:47.971562+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:47.971562+0000","last_undegraded":"2024-09-12T02:59:47.971562+0000","last_fullsized":"2024-09-12T02:59:47.971562+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.886179+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:45.626516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975159+0000","last_change":"2024-09-12T02:59:39.156656+0000","last_active":"2024-09-12T02:59:47.975159+0000","last_peered":"2024-09-12T02:59:47.975159+0000","last_clean":"2024-09-12T02:59:47.975159+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:47.975159+0000","last_undegraded":"2024-09-12T02:59:47.975159+0000","last_fullsized":"2024-09-12T02:59:47.975159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.156542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:34.954291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987400+0000","last_change":"2024-09-12T02:59:37.673643+0000","last_active":"2024-09-12T02:59:47.987400+0000","last_peered":"2024-09-12T02:59:47.987400+0000","last_clean":"2024-09-12T02:59:47.987400+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:47.987400+0000","last_undegraded":"2024-09-12T02:59:47.987400+0000","last_fullsized":"2024-09-12T02:59:47.987400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.673292+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.523545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988581+0000","last_change":"2024-09-12T02:59:33.671444+0000","last_active":"2024-09-12T02:59:47.988581+0000","last_peered":"2024-09-12T02:59:47.988581+0000","last_clean":"2024-09-12T02:59:47.988581+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:47.988581+0000","last_undegraded":"2024-09-12T02:59:47.988581+0000","last_fullsized":"2024-09-12T02:59:47.988581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.671212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:45.669284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972298+0000","last_change":"2024-09-12T02:59:34.590629+0000","last_active":"2024-09-12T02:59:47.972298+0000","last_peered":"2024-09-12T02:59:47.972298+0000","last_clean":"2024-09-12T02:59:47.972298+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:47.972298+0000","last_undegraded":"2024-09-12T02:59:47.972298+0000","last_fullsized":"2024-09-12T02:59:47.972298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.590531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.762881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988612+0000","last_change":"2024-09-12T02:59:43.837261+0000","last_active":"2024-09-12T02:59:47.988612+0000","last_peered":"2024-09-12T02:59:47.988612+0000","last_clean":"2024-09-12T02:59:47.988612+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:47.988612+0000","last_undegraded":"2024-09-12T02:59:47.988612+0000","last_fullsized":"2024-09-12T02:59:47.988612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.836980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.344004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970476+0000","last_change":"2024-09-12T02:59:45.048563+0000","last_active":"2024-09-12T02:59:47.970476+0000","last_peered":"2024-09-12T02:59:47.970476+0000","last_clean":"2024-09-12T02:59:47.970476+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:47.970476+0000","last_undegraded":"2024-09-12T02:59:47.970476+0000","last_fullsized":"2024-09-12T02:59:47.970476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.048315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:20.692033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.611665+0000","last_change":"2024-09-12T02:59:49.611694+0000","last_active":"2024-09-12T02:59:49.611665+0000","last_peered":"2024-09-12T02:59:49.611665+0000","last_clean":"2024-09-12T02:59:49.611665+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:49.611665+0000","last_undegraded":"2024-09-12T02:59:49.611665+0000","last_fullsized":"2024-09-12T02:59:49.611665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.611569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:05.308212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975259+0000","last_change":"2024-09-12T02:59:36.076892+0000","last_active":"2024-09-12T02:59:47.975259+0000","last_peered":"2024-09-12T02:59:47.975259+0000","last_clean":"2024-09-12T02:59:47.975259+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:47.975259+0000","last_undegraded":"2024-09-12T02:59:47.975259+0000","last_fullsized":"2024-09-12T02:59:47.975259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.076727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:26.666775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975590+0000","last_change":"2024-09-12T02:59:30.999792+0000","last_active":"2024-09-12T02:59:47.975590+0000","last_peered":"2024-09-12T02:59:47.975590+0000","last_clean":"2024-09-12T02:59:47.975590+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:47.975590+0000","last_undegraded":"2024-09-12T02:59:47.975590+0000","last_fullsized":"2024-09-12T02:59:47.975590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.999703+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:17.375066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973863+0000","last_change":"2024-09-12T02:59:34.015485+0000","last_active":"2024-09-12T02:59:47.973863+0000","last_peered":"2024-09-12T02:59:47.973863+0000","last_clean":"2024-09-12T02:59:47.973863+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:47.973863+0000","last_undegraded":"2024-09-12T02:59:47.973863+0000","last_fullsized":"2024-09-12T02:59:47.973863+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.015247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:05.065563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989055+0000","last_change":"2024-09-12T02:59:41.793529+0000","last_active":"2024-09-12T02:59:47.989055+0000","last_peered":"2024-09-12T02:59:47.989055+0000","last_clean":"2024-09-12T02:59:47.989055+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:47.989055+0000","last_undegraded":"2024-09-12T02:59:47.989055+0000","last_fullsized":"2024-09-12T02:59:47.989055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.793303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.839881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":167,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987810+0000","last_change":"2024-09-12T02:59:32.647074+0000","last_active":"2024-09-12T02:59:47.987810+0000","last_peered":"2024-09-12T02:59:47.987810+0000","last_clean":"2024-09-12T02:59:47.987810+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:47.987810+0000","last_undegraded":"2024-09-12T02:59:47.987810+0000","last_fullsized":"2024-09-12T02:59:47.987810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'28","last_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_deep_scrub":"79'28","last_deep_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.646844+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:46.886484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968042+0000","last_change":"2024-09-12T02:59:46.857630+0000","last_active":"2024-09-12T02:59:47.968042+0000","last_peered":"2024-09-12T02:59:47.968042+0000","last_clean":"2024-09-12T02:59:47.968042+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:47.968042+0000","last_undegraded":"2024-09-12T02:59:47.968042+0000","last_fullsized":"2024-09-12T02:59:47.968042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.857527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.845970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974062+0000","last_change":"2024-09-12T02:59:33.680657+0000","last_active":"2024-09-12T02:59:47.974062+0000","last_peered":"2024-09-12T02:59:47.974062+0000","last_clean":"2024-09-12T02:59:47.974062+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:47.974062+0000","last_undegraded":"2024-09-12T02:59:47.974062+0000","last_fullsized":"2024-09-12T02:59:47.974062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.680411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:15.802027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968679+0000","last_change":"2024-09-12T02:59:44.852192+0000","last_active":"2024-09-12T02:59:47.968679+0000","last_peered":"2024-09-12T02:59:47.968679+0000","last_clean":"2024-09-12T02:59:47.968679+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:47.968679+0000","last_undegraded":"2024-09-12T02:59:47.968679+0000","last_fullsized":"2024-09-12T02:59:47.968679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.852086+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.017309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":166,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971894+0000","last_change":"2024-09-12T02:59:45.664653+0000","last_active":"2024-09-12T02:59:47.971894+0000","last_peered":"2024-09-12T02:59:47.971894+0000","last_clean":"2024-09-12T02:59:47.971894+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:47.971894+0000","last_undegraded":"2024-09-12T02:59:47.971894+0000","last_fullsized":"2024-09-12T02:59:47.971894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.664314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.652758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975774+0000","last_change":"2024-09-12T02:59:45.129108+0000","last_active":"2024-09-12T02:59:47.975774+0000","last_peered":"2024-09-12T02:59:47.975774+0000","last_clean":"2024-09-12T02:59:47.975774+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:47.975774+0000","last_undegraded":"2024-09-12T02:59:47.975774+0000","last_fullsized":"2024-09-12T02:59:47.975774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.128965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.549002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973885+0000","last_change":"2024-09-12T02:59:37.986005+0000","last_active":"2024-09-12T02:59:47.973885+0000","last_peered":"2024-09-12T02:59:47.973885+0000","last_clean":"2024-09-12T02:59:47.973885+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:47.973885+0000","last_undegraded":"2024-09-12T02:59:47.973885+0000","last_fullsized":"2024-09-12T02:59:47.973885+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.985746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:14.181632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.639758+0000","last_change":"2024-09-12T02:59:51.639783+0000","last_active":"2024-09-12T02:59:51.639758+0000","last_peered":"2024-09-12T02:59:51.639758+0000","last_clean":"2024-09-12T02:59:51.639758+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:51.639758+0000","last_undegraded":"2024-09-12T02:59:51.639758+0000","last_fullsized":"2024-09-12T02:59:51.639758+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.639668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.759727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974029+0000","last_change":"2024-09-12T02:59:39.987993+0000","last_active":"2024-09-12T02:59:47.974029+0000","last_peered":"2024-09-12T02:59:47.974029+0000","last_clean":"2024-09-12T02:59:47.974029+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:47.974029+0000","last_undegraded":"2024-09-12T02:59:47.974029+0000","last_fullsized":"2024-09-12T02:59:47.974029+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.987743+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:04.424759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987757+0000","last_change":"2024-09-12T02:59:45.721685+0000","last_active":"2024-09-12T02:59:47.987757+0000","last_peered":"2024-09-12T02:59:47.987757+0000","last_clean":"2024-09-12T02:59:47.987757+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:47.987757+0000","last_undegraded":"2024-09-12T02:59:47.987757+0000","last_fullsized":"2024-09-12T02:59:47.987757+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.721444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.143614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970794+0000","last_change":"2024-09-12T02:59:46.669010+0000","last_active":"2024-09-12T02:59:47.970794+0000","last_peered":"2024-09-12T02:59:47.970794+0000","last_clean":"2024-09-12T02:59:47.970794+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:47.970794+0000","last_undegraded":"2024-09-12T02:59:47.970794+0000","last_fullsized":"2024-09-12T02:59:47.970794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.668894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:22.826170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975072+0000","last_change":"2024-09-12T02:59:41.077595+0000","last_active":"2024-09-12T02:59:47.975072+0000","last_peered":"2024-09-12T02:59:47.975072+0000","last_clean":"2024-09-12T02:59:47.975072+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:47.975072+0000","last_undegraded":"2024-09-12T02:59:47.975072+0000","last_fullsized":"2024-09-12T02:59:47.975072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.077484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:52.294457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967726+0000","last_change":"2024-09-12T02:59:41.841470+0000","last_active":"2024-09-12T02:59:47.967726+0000","last_peered":"2024-09-12T02:59:47.967726+0000","last_clean":"2024-09-12T02:59:47.967726+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:47.967726+0000","last_undegraded":"2024-09-12T02:59:47.967726+0000","last_fullsized":"2024-09-12T02:59:47.967726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.841333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.069789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.131581+0000","last_change":"2024-09-12T02:59:51.131633+0000","last_active":"2024-09-12T02:59:51.131581+0000","last_peered":"2024-09-12T02:59:51.131581+0000","last_clean":"2024-09-12T02:59:51.131581+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:51.131581+0000","last_undegraded":"2024-09-12T02:59:51.131581+0000","last_fullsized":"2024-09-12T02:59:51.131581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.131397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:19.953861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987223+0000","last_change":"2024-09-12T02:59:46.767895+0000","last_active":"2024-09-12T02:59:47.987223+0000","last_peered":"2024-09-12T02:59:47.987223+0000","last_clean":"2024-09-12T02:59:47.987223+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:47.987223+0000","last_undegraded":"2024-09-12T02:59:47.987223+0000","last_fullsized":"2024-09-12T02:59:47.987223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.767560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.939911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971399+0000","last_change":"2024-09-12T02:59:39.674943+0000","last_active":"2024-09-12T02:59:47.971399+0000","last_peered":"2024-09-12T02:59:47.971399+0000","last_clean":"2024-09-12T02:59:47.971399+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:47.971399+0000","last_undegraded":"2024-09-12T02:59:47.971399+0000","last_fullsized":"2024-09-12T02:59:47.971399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.674831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:28.379028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970981+0000","last_change":"2024-09-12T02:59:37.660153+0000","last_active":"2024-09-12T02:59:47.970981+0000","last_peered":"2024-09-12T02:59:47.970981+0000","last_clean":"2024-09-12T02:59:47.970981+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:47.970981+0000","last_undegraded":"2024-09-12T02:59:47.970981+0000","last_fullsized":"2024-09-12T02:59:47.970981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.660048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:32.261376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987111+0000","last_change":"2024-09-12T02:59:34.716068+0000","last_active":"2024-09-12T02:59:47.987111+0000","last_peered":"2024-09-12T02:59:47.987111+0000","last_clean":"2024-09-12T02:59:47.987111+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:47.987111+0000","last_undegraded":"2024-09-12T02:59:47.987111+0000","last_fullsized":"2024-09-12T02:59:47.987111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.715793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:43.456130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975476+0000","last_change":"2024-09-12T02:59:38.162584+0000","last_active":"2024-09-12T02:59:47.975476+0000","last_peered":"2024-09-12T02:59:47.975476+0000","last_clean":"2024-09-12T02:59:47.975476+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:47.975476+0000","last_undegraded":"2024-09-12T02:59:47.975476+0000","last_fullsized":"2024-09-12T02:59:47.975476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.162461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:51.207333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972265+0000","last_change":"2024-09-12T02:59:34.845414+0000","last_active":"2024-09-12T02:59:47.972265+0000","last_peered":"2024-09-12T02:59:47.972265+0000","last_clean":"2024-09-12T02:59:47.972265+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:47.972265+0000","last_undegraded":"2024-09-12T02:59:47.972265+0000","last_fullsized":"2024-09-12T02:59:47.972265+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.845313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:49.084952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971084+0000","last_change":"2024-09-12T02:59:38.676599+0000","last_active":"2024-09-12T02:59:47.971084+0000","last_peered":"2024-09-12T02:59:47.971084+0000","last_clean":"2024-09-12T02:59:47.971084+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:47.971084+0000","last_undegraded":"2024-09-12T02:59:47.971084+0000","last_fullsized":"2024-09-12T02:59:47.971084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.676453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:08.813287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971443+0000","last_change":"2024-09-12T02:59:32.676152+0000","last_active":"2024-09-12T02:59:47.971443+0000","last_peered":"2024-09-12T02:59:47.971443+0000","last_clean":"2024-09-12T02:59:47.971443+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:47.971443+0000","last_undegraded":"2024-09-12T02:59:47.971443+0000","last_fullsized":"2024-09-12T02:59:47.971443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.675897+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971857+0000","last_change":"2024-09-12T02:59:32.600836+0000","last_active":"2024-09-12T02:59:47.971857+0000","last_peered":"2024-09-12T02:59:47.971857+0000","last_clean":"2024-09-12T02:59:47.971857+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:47.971857+0000","last_undegraded":"2024-09-12T02:59:47.971857+0000","last_fullsized":"2024-09-12T02:59:47.971857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.600751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:36.409439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986975+0000","last_change":"2024-09-12T02:59:36.720562+0000","last_active":"2024-09-12T02:59:47.986975+0000","last_peered":"2024-09-12T02:59:47.986975+0000","last_clean":"2024-09-12T02:59:47.986975+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:47.986975+0000","last_undegraded":"2024-09-12T02:59:47.986975+0000","last_fullsized":"2024-09-12T02:59:47.986975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.720181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.336802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971697+0000","last_change":"2024-09-12T02:59:33.813763+0000","last_active":"2024-09-12T02:59:47.971697+0000","last_peered":"2024-09-12T02:59:47.971697+0000","last_clean":"2024-09-12T02:59:47.971697+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:47.971697+0000","last_undegraded":"2024-09-12T02:59:47.971697+0000","last_fullsized":"2024-09-12T02:59:47.971697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.813677+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:54.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971176+0000","last_change":"2024-09-12T02:59:43.020950+0000","last_active":"2024-09-12T02:59:47.971176+0000","last_peered":"2024-09-12T02:59:47.971176+0000","last_clean":"2024-09-12T02:59:47.971176+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:47.971176+0000","last_undegraded":"2024-09-12T02:59:47.971176+0000","last_fullsized":"2024-09-12T02:59:47.971176+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.020633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:20.020956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975501+0000","last_change":"2024-09-12T02:59:35.065915+0000","last_active":"2024-09-12T02:59:47.975501+0000","last_peered":"2024-09-12T02:59:47.975501+0000","last_clean":"2024-09-12T02:59:47.975501+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:47.975501+0000","last_undegraded":"2024-09-12T02:59:47.975501+0000","last_fullsized":"2024-09-12T02:59:47.975501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.065802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:51.998513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971305+0000","last_change":"2024-09-12T02:59:33.570266+0000","last_active":"2024-09-12T02:59:47.971305+0000","last_peered":"2024-09-12T02:59:47.971305+0000","last_clean":"2024-09-12T02:59:47.971305+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:47.971305+0000","last_undegraded":"2024-09-12T02:59:47.971305+0000","last_fullsized":"2024-09-12T02:59:47.971305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.570177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:57.992347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968334+0000","last_change":"2024-09-12T02:59:30.749318+0000","last_active":"2024-09-12T02:59:47.968334+0000","last_peered":"2024-09-12T02:59:47.968334+0000","last_clean":"2024-09-12T02:59:47.968334+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:47.968334+0000","last_undegraded":"2024-09-12T02:59:47.968334+0000","last_fullsized":"2024-09-12T02:59:47.968334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.749228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:31.541524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987453+0000","last_change":"2024-09-12T02:59:38.651039+0000","last_active":"2024-09-12T02:59:47.987453+0000","last_peered":"2024-09-12T02:59:47.987453+0000","last_clean":"2024-09-12T02:59:47.987453+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:47.987453+0000","last_undegraded":"2024-09-12T02:59:47.987453+0000","last_fullsized":"2024-09-12T02:59:47.987453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.650631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.137855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972409+0000","last_change":"2024-09-12T02:59:42.663691+0000","last_active":"2024-09-12T02:59:47.972409+0000","last_peered":"2024-09-12T02:59:47.972409+0000","last_clean":"2024-09-12T02:59:47.972409+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:47.972409+0000","last_undegraded":"2024-09-12T02:59:47.972409+0000","last_fullsized":"2024-09-12T02:59:47.972409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.663586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:23.083624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.118661+0000","last_change":"2024-09-12T02:59:50.118766+0000","last_active":"2024-09-12T02:59:50.118661+0000","last_peered":"2024-09-12T02:59:50.118661+0000","last_clean":"2024-09-12T02:59:50.118661+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:50.118661+0000","last_undegraded":"2024-09-12T02:59:50.118661+0000","last_fullsized":"2024-09-12T02:59:50.118661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.118459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:39.693765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970603+0000","last_change":"2024-09-12T02:59:31.642639+0000","last_active":"2024-09-12T02:59:47.970603+0000","last_peered":"2024-09-12T02:59:47.970603+0000","last_clean":"2024-09-12T02:59:47.970603+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:47.970603+0000","last_undegraded":"2024-09-12T02:59:47.970603+0000","last_fullsized":"2024-09-12T02:59:47.970603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.642539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:45.910007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970879+0000","last_change":"2024-09-12T02:59:42.020010+0000","last_active":"2024-09-12T02:59:47.970879+0000","last_peered":"2024-09-12T02:59:47.970879+0000","last_clean":"2024-09-12T02:59:47.970879+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:47.970879+0000","last_undegraded":"2024-09-12T02:59:47.970879+0000","last_fullsized":"2024-09-12T02:59:47.970879+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.019770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:02.627789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975198+0000","last_change":"2024-09-12T02:59:37.126601+0000","last_active":"2024-09-12T02:59:47.975198+0000","last_peered":"2024-09-12T02:59:47.975198+0000","last_clean":"2024-09-12T02:59:47.975198+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:47.975198+0000","last_undegraded":"2024-09-12T02:59:47.975198+0000","last_fullsized":"2024-09-12T02:59:47.975198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.126497+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:41.431052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987704+0000","last_change":"2024-09-12T02:59:40.644873+0000","last_active":"2024-09-12T02:59:47.987704+0000","last_peered":"2024-09-12T02:59:47.987704+0000","last_clean":"2024-09-12T02:59:47.987704+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:47.987704+0000","last_undegraded":"2024-09-12T02:59:47.987704+0000","last_fullsized":"2024-09-12T02:59:47.987704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.644626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:27.019990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989535+0000","last_change":"2024-09-12T02:59:42.787927+0000","last_active":"2024-09-12T02:59:47.989535+0000","last_peered":"2024-09-12T02:59:47.989535+0000","last_clean":"2024-09-12T02:59:47.989535+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:47.989535+0000","last_undegraded":"2024-09-12T02:59:47.989535+0000","last_fullsized":"2024-09-12T02:59:47.989535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.787542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.015998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972705+0000","last_change":"2024-09-12T02:59:32.823831+0000","last_active":"2024-09-12T02:59:47.972705+0000","last_peered":"2024-09-12T02:59:47.972705+0000","last_clean":"2024-09-12T02:59:47.972705+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:47.972705+0000","last_undegraded":"2024-09-12T02:59:47.972705+0000","last_fullsized":"2024-09-12T02:59:47.972705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.823742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:34.576078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974455+0000","last_change":"2024-09-12T02:59:47.049456+0000","last_active":"2024-09-12T02:59:47.974455+0000","last_peered":"2024-09-12T02:59:47.974455+0000","last_clean":"2024-09-12T02:59:47.974455+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:47.974455+0000","last_undegraded":"2024-09-12T02:59:47.974455+0000","last_fullsized":"2024-09-12T02:59:47.974455+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.049206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:32.900134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971264+0000","last_change":"2024-09-12T02:59:37.007470+0000","last_active":"2024-09-12T02:59:47.971264+0000","last_peered":"2024-09-12T02:59:47.971264+0000","last_clean":"2024-09-12T02:59:47.971264+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:47.971264+0000","last_undegraded":"2024-09-12T02:59:47.971264+0000","last_fullsized":"2024-09-12T02:59:47.971264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.007224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:18.542924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967806+0000","last_change":"2024-09-12T02:59:40.838979+0000","last_active":"2024-09-12T02:59:47.967806+0000","last_peered":"2024-09-12T02:59:47.967806+0000","last_clean":"2024-09-12T02:59:47.967806+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:47.967806+0000","last_undegraded":"2024-09-12T02:59:47.967806+0000","last_fullsized":"2024-09-12T02:59:47.967806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.838843+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:09.885421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975113+0000","last_change":"2024-09-12T02:59:34.019995+0000","last_active":"2024-09-12T02:59:47.975113+0000","last_peered":"2024-09-12T02:59:47.975113+0000","last_clean":"2024-09-12T02:59:47.975113+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:47.975113+0000","last_undegraded":"2024-09-12T02:59:47.975113+0000","last_fullsized":"2024-09-12T02:59:47.975113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.019910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.828598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970779+0000","last_change":"2024-09-12T02:59:35.597391+0000","last_active":"2024-09-12T02:59:47.970779+0000","last_peered":"2024-09-12T02:59:47.970779+0000","last_clean":"2024-09-12T02:59:47.970779+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:47.970779+0000","last_undegraded":"2024-09-12T02:59:47.970779+0000","last_fullsized":"2024-09-12T02:59:47.970779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.597291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:38.185412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973797+0000","last_change":"2024-09-12T02:59:36.682299+0000","last_active":"2024-09-12T02:59:47.973797+0000","last_peered":"2024-09-12T02:59:47.973797+0000","last_clean":"2024-09-12T02:59:47.973797+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:47.973797+0000","last_undegraded":"2024-09-12T02:59:47.973797+0000","last_fullsized":"2024-09-12T02:59:47.973797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.682064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:10.673981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986906+0000","last_change":"2024-09-12T02:59:44.683736+0000","last_active":"2024-09-12T02:59:47.986906+0000","last_peered":"2024-09-12T02:59:47.986906+0000","last_clean":"2024-09-12T02:59:47.986906+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:47.986906+0000","last_undegraded":"2024-09-12T02:59:47.986906+0000","last_fullsized":"2024-09-12T02:59:47.986906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.683432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.492120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987167+0000","last_change":"2024-09-12T02:59:43.695797+0000","last_active":"2024-09-12T02:59:47.987167+0000","last_peered":"2024-09-12T02:59:47.987167+0000","last_clean":"2024-09-12T02:59:47.987167+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:47.987167+0000","last_undegraded":"2024-09-12T02:59:47.987167+0000","last_fullsized":"2024-09-12T02:59:47.987167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'16","last_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_deep_scrub":"79'16","last_deep_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.695424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:57.962892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.814119+0000","last_change":"2024-09-12T02:59:48.814183+0000","last_active":"2024-09-12T02:59:48.814119+0000","last_peered":"2024-09-12T02:59:48.814119+0000","last_clean":"2024-09-12T02:59:48.814119+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:48.814119+0000","last_undegraded":"2024-09-12T02:59:48.814119+0000","last_fullsized":"2024-09-12T02:59:48.814119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.813942+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:41.235405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.652380+0000","last_change":"2024-09-12T02:59:48.652404+0000","last_active":"2024-09-12T02:59:48.652380+0000","last_peered":"2024-09-12T02:59:48.652380+0000","last_clean":"2024-09-12T02:59:48.652380+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:48.652380+0000","last_undegraded":"2024-09-12T02:59:48.652380+0000","last_fullsized":"2024-09-12T02:59:48.652380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.652295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:24.469845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986239+0000","last_change":"2024-09-12T02:59:40.773384+0000","last_active":"2024-09-12T02:59:47.986239+0000","last_peered":"2024-09-12T02:59:47.986239+0000","last_clean":"2024-09-12T02:59:47.986239+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:47.986239+0000","last_undegraded":"2024-09-12T02:59:47.986239+0000","last_fullsized":"2024-09-12T02:59:47.986239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.773129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.980310+0000","last_change":"2024-09-12T02:59:47.977081+0000","last_active":"2024-09-12T02:59:47.980310+0000","last_peered":"2024-09-12T02:59:47.980310+0000","last_clean":"2024-09-12T02:59:47.980310+0000","last_became_active":"2024-09-12T02:59:47.976687+0000","last_became_peered":"2024-09-12T02:59:47.976687+0000","last_unstale":"2024-09-12T02:59:47.980310+0000","last_undegraded":"2024-09-12T02:59:47.980310+0000","last_fullsized":"2024-09-12T02:59:47.980310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988297+0000","last_change":"2024-09-12T02:59:39.769618+0000","last_active":"2024-09-12T02:59:47.988297+0000","last_peered":"2024-09-12T02:59:47.988297+0000","last_clean":"2024-09-12T02:59:47.988297+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:47.988297+0000","last_undegraded":"2024-09-12T02:59:47.988297+0000","last_fullsized":"2024-09-12T02:59:47.988297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.769355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:44.299798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973047+0000","last_change":"2024-09-12T02:59:46.045977+0000","last_active":"2024-09-12T02:59:47.973047+0000","last_peered":"2024-09-12T02:59:47.973047+0000","last_clean":"2024-09-12T02:59:47.973047+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:47.973047+0000","last_undegraded":"2024-09-12T02:59:47.973047+0000","last_fullsized":"2024-09-12T02:59:47.973047+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.045725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:00.846357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974947+0000","last_change":"2024-09-12T02:59:33.045189+0000","last_active":"2024-09-12T02:59:47.974947+0000","last_peered":"2024-09-12T02:59:47.974947+0000","last_clean":"2024-09-12T02:59:47.974947+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:47.974947+0000","last_undegraded":"2024-09-12T02:59:47.974947+0000","last_fullsized":"2024-09-12T02:59:47.974947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.045042+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:47.312510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969171+0000","last_change":"2024-09-12T02:59:38.788525+0000","last_active":"2024-09-12T02:59:47.969171+0000","last_peered":"2024-09-12T02:59:47.969171+0000","last_clean":"2024-09-12T02:59:47.969171+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:47.969171+0000","last_undegraded":"2024-09-12T02:59:47.969171+0000","last_fullsized":"2024-09-12T02:59:47.969171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.788431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:20.633132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988967+0000","last_change":"2024-09-12T02:59:33.741380+0000","last_active":"2024-09-12T02:59:47.988967+0000","last_peered":"2024-09-12T02:59:47.988967+0000","last_clean":"2024-09-12T02:59:47.988967+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:47.988967+0000","last_undegraded":"2024-09-12T02:59:47.988967+0000","last_fullsized":"2024-09-12T02:59:47.988967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.741253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:51.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509487,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":530298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509489,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1552384,"data_stored":1083143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1544192,"data_stored":1083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":995328,"data_stored":529987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906963,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":928,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":950272,"data_stored":492227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":492263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":492297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:00:34.834 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T03:00:34.834 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T03:00:54.835 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:00:54.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.983+0000 7f472d600640 1 Processor -- start 2024-09-12T03:00:54.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.983+0000 7f472d600640 1 -- start start 2024-09-12T03:00:54.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.983+0000 7f472d600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f47280c2a90 0x7f4728162e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:54.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.983+0000 7f472d600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47281580c0 con 0x7f4728074070 2024-09-12T03:00:54.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.983+0000 7f472d600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47281583a0 con 0x7f4728151a80 2024-09-12T03:00:54.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.983+0000 7f472d600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f47280c8500 con 0x7f47280c2a90 2024-09-12T03:00:54.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.983+0000 7f471e000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4728074070 0x7f47280c2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46924/0 (socket says 172.21.15.63:46924) 2024-09-12T03:00:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.983+0000 7f471e000640 1 -- 172.21.15.63:0/248973228 learned_addr learned my addr 172.21.15.63:0/248973228 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T03:00:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.983+0000 7f4727400640 1 --2- 172.21.15.63:0/248973228 >> v2:172.21.15.119:3300/0 conn(0x7f47280c2a90 0x7f4728162e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.987+0000 7f4726000640 1 -- 172.21.15.63:0/248973228 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142526216 0 0) 0x7f47281580c0 con 0x7f4728074070 2024-09-12T03:00:54.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.987+0000 7f4726000640 1 -- 172.21.15.63:0/248973228 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f470c003530 con 0x7f4728074070 2024-09-12T03:00:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.987+0000 7f4727400640 1 -- 172.21.15.63:0/248973228 >> v1:172.21.15.119:6789/0 conn(0x7f4728151a80 legacy=0x7f4728072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.987+0000 7f4727400640 1 -- 172.21.15.63:0/248973228 >> v1:172.21.15.63:6789/0 conn(0x7f4728074070 legacy=0x7f47280c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:54.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.987+0000 7f4727400640 1 -- 172.21.15.63:0/248973228 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47280cbf00 con 0x7f47280c2a90 2024-09-12T03:00:54.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.987+0000 7f4727400640 1 --2- 172.21.15.63:0/248973228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47280c2a90 0x7f4728162e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4720009d90 tx=0x7f472001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91077ac5bfff2f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:54.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.987+0000 7f4726000640 1 -- 172.21.15.63:0/248973228 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47200b4070 con 0x7f47280c2a90 2024-09-12T03:00:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.987+0000 7f4726000640 1 -- 172.21.15.63:0/248973228 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47200af600 con 0x7f47280c2a90 2024-09-12T03:00:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.987+0000 7f4726000640 1 -- 172.21.15.63:0/248973228 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47200af9b0 con 0x7f47280c2a90 2024-09-12T03:00:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 -- 172.21.15.63:0/248973228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47280c2a90 msgr2=0x7f4728162e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 --2- 172.21.15.63:0/248973228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47280c2a90 0x7f4728162e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4720009d90 tx=0x7f472001f150 comp rx=0 tx=0).stop 2024-09-12T03:00:54.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 -- 172.21.15.63:0/248973228 shutdown_connections 2024-09-12T03:00:54.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 --2- 172.21.15.63:0/248973228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47280c2a90 0x7f4728162e40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:54.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 -- 172.21.15.63:0/248973228 >> 172.21.15.63:0/248973228 conn(0x7f472806f3d0 msgr2=0x7f472806f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:54.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 -- 172.21.15.63:0/248973228 shutdown_connections 2024-09-12T03:00:54.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 -- 172.21.15.63:0/248973228 wait complete. 2024-09-12T03:00:54.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 Processor -- start 2024-09-12T03:00:54.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 -- start start 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4728074070 0x7f47281450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47280c2a90 0x7f472814c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4728151a80 0x7f472814f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f47280c81f0 con 0x7f4728151a80 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f47280cc4c0 con 0x7f47280c2a90 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f472d600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f47280c7cf0 con 0x7f4728074070 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4727400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4728151a80 0x7f472814f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4727400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4728151a80 0x7f472814f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35708/0 (socket says 172.21.15.63:35708) 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4727400640 1 -- 172.21.15.63:0/4105767835 learned_addr learned my addr 172.21.15.63:0/4105767835 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f471e000640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47280c2a90 0x7f472814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:54.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4726a00640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4728074070 0x7f47281450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4727400640 1 -- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4728074070 msgr2=0x7f47281450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4727400640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4728074070 0x7f47281450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4727400640 1 -- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47280c2a90 msgr2=0x7f472814c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4727400640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47280c2a90 0x7f472814c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4727400640 1 -- 172.21.15.63:0/4105767835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472814e040 con 0x7f4728151a80 2024-09-12T03:00:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.991+0000 7f4726a00640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4728074070 0x7f47281450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:00:54.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f4727400640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4728151a80 0x7f472814f2b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4720009d90 tx=0x7f472001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f471f400640 1 -- 172.21.15.63:0/4105767835 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47200b4040 con 0x7f4728151a80 2024-09-12T03:00:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f471f400640 1 -- 172.21.15.63:0/4105767835 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47200af400 con 0x7f4728151a80 2024-09-12T03:00:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472814e2b0 con 0x7f4728151a80 2024-09-12T03:00:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f471f400640 1 -- 172.21.15.63:0/4105767835 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47200af9b0 con 0x7f4728151a80 2024-09-12T03:00:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47281e4a30 con 0x7f4728151a80 2024-09-12T03:00:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472806fef0 con 0x7f4728151a80 2024-09-12T03:00:55.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f471f400640 1 -- 172.21.15.63:0/4105767835 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47200c1020 con 0x7f4728151a80 2024-09-12T03:00:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f471f400640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f47040678c0 0x7f4704069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:00:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f471f400640 1 -- 172.21.15.63:0/4105767835 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f4720123bf0 con 0x7f4728151a80 2024-09-12T03:00:55.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.995+0000 7f4726a00640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f47040678c0 0x7f4704069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:00:55.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.999+0000 7f4726a00640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f47040678c0 0x7f4704069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4718000f70 tx=0x7f4718009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:00:55.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:54.999+0000 7f471f400640 1 -- 172.21.15.63:0/4105767835 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4720018cb0 con 0x7f4728151a80 2024-09-12T03:00:55.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.167+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f472814da70 con 0x7f47040678c0 2024-09-12T03:00:55.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.191+0000 7f471f400640 1 -- 172.21.15.63:0/4105767835 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332999 (secure 0 0 0) 0x7f472814da70 con 0x7f47040678c0 2024-09-12T03:00:55.198 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:00:55.200 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T03:00:55.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f47040678c0 msgr2=0x7f4704069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:55.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f47040678c0 0x7f4704069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4718000f70 tx=0x7f4718009040 comp rx=0 tx=0).stop 2024-09-12T03:00:55.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4728151a80 msgr2=0x7f472814f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:00:55.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4728151a80 0x7f472814f2b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4720009d90 tx=0x7f472001bef0 comp rx=0 tx=0).stop 2024-09-12T03:00:55.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 shutdown_connections 2024-09-12T03:00:55.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4728151a80 0x7f472814f2b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:55.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47280c2a90 0x7f472814c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:55.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f47040678c0 0x7f4704069d80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:55.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 --2- 172.21.15.63:0/4105767835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4728074070 0x7f47281450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:00:55.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 >> 172.21.15.63:0/4105767835 conn(0x7f472806f3d0 msgr2=0x7f47281576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:00:55.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 shutdown_connections 2024-09-12T03:00:55.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:00:55.195+0000 7f472d600640 1 -- 172.21.15.63:0/4105767835 wait complete. 2024-09-12T03:00:55.218 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-12T03:00:53.835639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238480,"kb_used_data":8696,"kb_used_omap":15,"kb_used_meta":229616,"kb_avail":754736240,"statfs":{"total":773094113280,"available":772849909760,"internally_reserved":0,"allocated":8904704,"data_stored":5195750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":235127470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004872"},"pg_stats":[{"pgid":"2.1f","version":"79'6","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975802+0000","last_change":"2024-09-12T02:59:32.000879+0000","last_active":"2024-09-12T02:59:47.975802+0000","last_peered":"2024-09-12T02:59:47.975802+0000","last_clean":"2024-09-12T02:59:47.975802+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:47.975802+0000","last_undegraded":"2024-09-12T02:59:47.975802+0000","last_fullsized":"2024-09-12T02:59:47.975802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.000756+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.073437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971575+0000","last_change":"2024-09-12T02:59:43.632597+0000","last_active":"2024-09-12T02:59:47.971575+0000","last_peered":"2024-09-12T02:59:47.971575+0000","last_clean":"2024-09-12T02:59:47.971575+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:47.971575+0000","last_undegraded":"2024-09-12T02:59:47.971575+0000","last_fullsized":"2024-09-12T02:59:47.971575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.632456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:01.396201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970626+0000","last_change":"2024-09-12T02:59:45.690062+0000","last_active":"2024-09-12T02:59:47.970626+0000","last_peered":"2024-09-12T02:59:47.970626+0000","last_clean":"2024-09-12T02:59:47.970626+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:47.970626+0000","last_undegraded":"2024-09-12T02:59:47.970626+0000","last_fullsized":"2024-09-12T02:59:47.970626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.689949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:02.009111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971761+0000","last_change":"2024-09-12T02:59:36.630496+0000","last_active":"2024-09-12T02:59:47.971761+0000","last_peered":"2024-09-12T02:59:47.971761+0000","last_clean":"2024-09-12T02:59:47.971761+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:47.971761+0000","last_undegraded":"2024-09-12T02:59:47.971761+0000","last_fullsized":"2024-09-12T02:59:47.971761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.630383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:49.675255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975685+0000","last_change":"2024-09-12T02:59:44.081098+0000","last_active":"2024-09-12T02:59:47.975685+0000","last_peered":"2024-09-12T02:59:47.975685+0000","last_clean":"2024-09-12T02:59:47.975685+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:47.975685+0000","last_undegraded":"2024-09-12T02:59:47.975685+0000","last_fullsized":"2024-09-12T02:59:47.975685+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.080989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:55.266943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970430+0000","last_change":"2024-09-12T02:59:41.662320+0000","last_active":"2024-09-12T02:59:47.970430+0000","last_peered":"2024-09-12T02:59:47.970430+0000","last_clean":"2024-09-12T02:59:47.970430+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:47.970430+0000","last_undegraded":"2024-09-12T02:59:47.970430+0000","last_fullsized":"2024-09-12T02:59:47.970430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.662088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:28.169111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989531+0000","last_change":"2024-09-12T02:59:37.757533+0000","last_active":"2024-09-12T02:59:47.989531+0000","last_peered":"2024-09-12T02:59:47.989531+0000","last_clean":"2024-09-12T02:59:47.989531+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:47.989531+0000","last_undegraded":"2024-09-12T02:59:47.989531+0000","last_fullsized":"2024-09-12T02:59:47.989531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.757250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:10.370609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972764+0000","last_change":"2024-09-12T02:59:35.959195+0000","last_active":"2024-09-12T02:59:47.972764+0000","last_peered":"2024-09-12T02:59:47.972764+0000","last_clean":"2024-09-12T02:59:47.972764+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:47.972764+0000","last_undegraded":"2024-09-12T02:59:47.972764+0000","last_fullsized":"2024-09-12T02:59:47.972764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.958975+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.932192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972153+0000","last_change":"2024-09-12T02:59:43.619841+0000","last_active":"2024-09-12T02:59:47.972153+0000","last_peered":"2024-09-12T02:59:47.972153+0000","last_clean":"2024-09-12T02:59:47.972153+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:47.972153+0000","last_undegraded":"2024-09-12T02:59:47.972153+0000","last_fullsized":"2024-09-12T02:59:47.972153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.619594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:49.784818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'3","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989105+0000","last_change":"2024-09-12T02:59:47.847154+0000","last_active":"2024-09-12T02:59:47.989105+0000","last_peered":"2024-09-12T02:59:47.989105+0000","last_clean":"2024-09-12T02:59:47.989105+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:47.989105+0000","last_undegraded":"2024-09-12T02:59:47.989105+0000","last_fullsized":"2024-09-12T02:59:47.989105+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.846797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.835241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973740+0000","last_change":"2024-09-12T02:59:44.041049+0000","last_active":"2024-09-12T02:59:47.973740+0000","last_peered":"2024-09-12T02:59:47.973740+0000","last_clean":"2024-09-12T02:59:47.973740+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:47.973740+0000","last_undegraded":"2024-09-12T02:59:47.973740+0000","last_fullsized":"2024-09-12T02:59:47.973740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.040815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.885096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970873+0000","last_change":"2024-09-12T02:59:40.700614+0000","last_active":"2024-09-12T02:59:47.970873+0000","last_peered":"2024-09-12T02:59:47.970873+0000","last_clean":"2024-09-12T02:59:47.970873+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:47.970873+0000","last_undegraded":"2024-09-12T02:59:47.970873+0000","last_fullsized":"2024-09-12T02:59:47.970873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.700368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:48.928824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986635+0000","last_change":"2024-09-12T02:59:39.629343+0000","last_active":"2024-09-12T02:59:47.986635+0000","last_peered":"2024-09-12T02:59:47.986635+0000","last_clean":"2024-09-12T02:59:47.986635+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:47.986635+0000","last_undegraded":"2024-09-12T02:59:47.986635+0000","last_fullsized":"2024-09-12T02:59:47.986635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.629058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:43.299464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988800+0000","last_change":"2024-09-12T02:59:36.789441+0000","last_active":"2024-09-12T02:59:47.988800+0000","last_peered":"2024-09-12T02:59:47.988800+0000","last_clean":"2024-09-12T02:59:47.988800+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:47.988800+0000","last_undegraded":"2024-09-12T02:59:47.988800+0000","last_fullsized":"2024-09-12T02:59:47.988800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.789151+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:41.135081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974912+0000","last_change":"2024-09-12T02:59:37.711523+0000","last_active":"2024-09-12T02:59:47.974912+0000","last_peered":"2024-09-12T02:59:47.974912+0000","last_clean":"2024-09-12T02:59:47.974912+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:47.974912+0000","last_undegraded":"2024-09-12T02:59:47.974912+0000","last_fullsized":"2024-09-12T02:59:47.974912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.711188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.241632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970941+0000","last_change":"2024-09-12T02:59:40.677307+0000","last_active":"2024-09-12T02:59:47.970941+0000","last_peered":"2024-09-12T02:59:47.970941+0000","last_clean":"2024-09-12T02:59:47.970941+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:47.970941+0000","last_undegraded":"2024-09-12T02:59:47.970941+0000","last_fullsized":"2024-09-12T02:59:47.970941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.677196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:18.992896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967755+0000","last_change":"2024-09-12T02:59:42.816275+0000","last_active":"2024-09-12T02:59:47.967755+0000","last_peered":"2024-09-12T02:59:47.967755+0000","last_clean":"2024-09-12T02:59:47.967755+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:47.967755+0000","last_undegraded":"2024-09-12T02:59:47.967755+0000","last_fullsized":"2024-09-12T02:59:47.967755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.816152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:29.323176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973221+0000","last_change":"2024-09-12T02:59:38.719352+0000","last_active":"2024-09-12T02:59:47.973221+0000","last_peered":"2024-09-12T02:59:47.973221+0000","last_clean":"2024-09-12T02:59:47.973221+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:47.973221+0000","last_undegraded":"2024-09-12T02:59:47.973221+0000","last_fullsized":"2024-09-12T02:59:47.973221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.719131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.333596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.642704+0000","last_change":"2024-09-12T02:59:50.642733+0000","last_active":"2024-09-12T02:59:50.642704+0000","last_peered":"2024-09-12T02:59:50.642704+0000","last_clean":"2024-09-12T02:59:50.642704+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:50.642704+0000","last_undegraded":"2024-09-12T02:59:50.642704+0000","last_fullsized":"2024-09-12T02:59:50.642704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.642614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967868+0000","last_change":"2024-09-12T02:59:32.776350+0000","last_active":"2024-09-12T02:59:47.967868+0000","last_peered":"2024-09-12T02:59:47.967868+0000","last_clean":"2024-09-12T02:59:47.967868+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:47.967868+0000","last_undegraded":"2024-09-12T02:59:47.967868+0000","last_fullsized":"2024-09-12T02:59:47.967868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.776267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:58.890222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968625+0000","last_change":"2024-09-12T02:59:34.789313+0000","last_active":"2024-09-12T02:59:47.968625+0000","last_peered":"2024-09-12T02:59:47.968625+0000","last_clean":"2024-09-12T02:59:47.968625+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:47.968625+0000","last_undegraded":"2024-09-12T02:59:47.968625+0000","last_fullsized":"2024-09-12T02:59:47.968625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.789214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.790935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971730+0000","last_change":"2024-09-12T02:59:34.632579+0000","last_active":"2024-09-12T02:59:47.971730+0000","last_peered":"2024-09-12T02:59:47.971730+0000","last_clean":"2024-09-12T02:59:47.971730+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:47.971730+0000","last_undegraded":"2024-09-12T02:59:47.971730+0000","last_fullsized":"2024-09-12T02:59:47.971730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.632350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.978281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987412+0000","last_change":"2024-09-12T02:59:35.785814+0000","last_active":"2024-09-12T02:59:47.987412+0000","last_peered":"2024-09-12T02:59:47.987412+0000","last_clean":"2024-09-12T02:59:47.987412+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:47.987412+0000","last_undegraded":"2024-09-12T02:59:47.987412+0000","last_fullsized":"2024-09-12T02:59:47.987412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.785459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.907074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975052+0000","last_change":"2024-09-12T02:59:44.644342+0000","last_active":"2024-09-12T02:59:47.975052+0000","last_peered":"2024-09-12T02:59:47.975052+0000","last_clean":"2024-09-12T02:59:47.975052+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:47.975052+0000","last_undegraded":"2024-09-12T02:59:47.975052+0000","last_fullsized":"2024-09-12T02:59:47.975052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.644026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:49.273561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975392+0000","last_change":"2024-09-12T02:59:46.131647+0000","last_active":"2024-09-12T02:59:47.975392+0000","last_peered":"2024-09-12T02:59:47.975392+0000","last_clean":"2024-09-12T02:59:47.975392+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:47.975392+0000","last_undegraded":"2024-09-12T02:59:47.975392+0000","last_fullsized":"2024-09-12T02:59:47.975392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.131533+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:06.802576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987954+0000","last_change":"2024-09-12T02:59:35.721123+0000","last_active":"2024-09-12T02:59:47.987954+0000","last_peered":"2024-09-12T02:59:47.987954+0000","last_clean":"2024-09-12T02:59:47.987954+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:47.987954+0000","last_undegraded":"2024-09-12T02:59:47.987954+0000","last_fullsized":"2024-09-12T02:59:47.987954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.720761+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:17.277216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971041+0000","last_change":"2024-09-12T02:59:39.707123+0000","last_active":"2024-09-12T02:59:47.971041+0000","last_peered":"2024-09-12T02:59:47.971041+0000","last_clean":"2024-09-12T02:59:47.971041+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:47.971041+0000","last_undegraded":"2024-09-12T02:59:47.971041+0000","last_fullsized":"2024-09-12T02:59:47.971041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.706899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:08.753477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972457+0000","last_change":"2024-09-12T02:59:41.667809+0000","last_active":"2024-09-12T02:59:47.972457+0000","last_peered":"2024-09-12T02:59:47.972457+0000","last_clean":"2024-09-12T02:59:47.972457+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:47.972457+0000","last_undegraded":"2024-09-12T02:59:47.972457+0000","last_fullsized":"2024-09-12T02:59:47.972457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.667707+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:52.853661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968963+0000","last_change":"2024-09-12T02:59:45.841193+0000","last_active":"2024-09-12T02:59:47.968963+0000","last_peered":"2024-09-12T02:59:47.968963+0000","last_clean":"2024-09-12T02:59:47.968963+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:47.968963+0000","last_undegraded":"2024-09-12T02:59:47.968963+0000","last_fullsized":"2024-09-12T02:59:47.968963+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.841069+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:50.470604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.991190+0000","last_change":"2024-09-12T02:59:47.991190+0000","last_active":"2024-09-12T02:59:47.991190+0000","last_peered":"2024-09-12T02:59:47.991190+0000","last_clean":"2024-09-12T02:59:47.991190+0000","last_became_active":"2024-09-12T02:59:47.990629+0000","last_became_peered":"2024-09-12T02:59:47.990629+0000","last_unstale":"2024-09-12T02:59:47.991190+0000","last_undegraded":"2024-09-12T02:59:47.991190+0000","last_fullsized":"2024-09-12T02:59:47.991190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.643595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.689482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968239+0000","last_change":"2024-09-12T02:59:36.821336+0000","last_active":"2024-09-12T02:59:47.968239+0000","last_peered":"2024-09-12T02:59:47.968239+0000","last_clean":"2024-09-12T02:59:47.968239+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:47.968239+0000","last_undegraded":"2024-09-12T02:59:47.968239+0000","last_fullsized":"2024-09-12T02:59:47.968239+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.821234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.321748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989802+0000","last_change":"2024-09-12T02:59:38.763406+0000","last_active":"2024-09-12T02:59:47.989802+0000","last_peered":"2024-09-12T02:59:47.989802+0000","last_clean":"2024-09-12T02:59:47.989802+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:47.989802+0000","last_undegraded":"2024-09-12T02:59:47.989802+0000","last_fullsized":"2024-09-12T02:59:47.989802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.763178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.755095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975077+0000","last_change":"2024-09-12T02:59:42.071495+0000","last_active":"2024-09-12T02:59:47.975077+0000","last_peered":"2024-09-12T02:59:47.975077+0000","last_clean":"2024-09-12T02:59:47.975077+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:47.975077+0000","last_undegraded":"2024-09-12T02:59:47.975077+0000","last_fullsized":"2024-09-12T02:59:47.975077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.071362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:30.775559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973317+0000","last_change":"2024-09-12T02:59:39.026655+0000","last_active":"2024-09-12T02:59:47.973317+0000","last_peered":"2024-09-12T02:59:47.973317+0000","last_clean":"2024-09-12T02:59:47.973317+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:47.973317+0000","last_undegraded":"2024-09-12T02:59:47.973317+0000","last_fullsized":"2024-09-12T02:59:47.973317+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.026365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:52.426930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968304+0000","last_change":"2024-09-12T02:59:37.791375+0000","last_active":"2024-09-12T02:59:47.968304+0000","last_peered":"2024-09-12T02:59:47.968304+0000","last_clean":"2024-09-12T02:59:47.968304+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:47.968304+0000","last_undegraded":"2024-09-12T02:59:47.968304+0000","last_fullsized":"2024-09-12T02:59:47.968304+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.791278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:11.783194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967761+0000","last_change":"2024-09-12T02:59:43.858969+0000","last_active":"2024-09-12T02:59:47.967761+0000","last_peered":"2024-09-12T02:59:47.967761+0000","last_clean":"2024-09-12T02:59:47.967761+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:47.967761+0000","last_undegraded":"2024-09-12T02:59:47.967761+0000","last_fullsized":"2024-09-12T02:59:47.967761+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.858860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972713+0000","last_change":"2024-09-12T02:59:35.662731+0000","last_active":"2024-09-12T02:59:47.972713+0000","last_peered":"2024-09-12T02:59:47.972713+0000","last_clean":"2024-09-12T02:59:47.972713+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:47.972713+0000","last_undegraded":"2024-09-12T02:59:47.972713+0000","last_fullsized":"2024-09-12T02:59:47.972713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.662469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:08.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971604+0000","last_change":"2024-09-12T02:59:32.999842+0000","last_active":"2024-09-12T02:59:47.971604+0000","last_peered":"2024-09-12T02:59:47.971604+0000","last_clean":"2024-09-12T02:59:47.971604+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:47.971604+0000","last_undegraded":"2024-09-12T02:59:47.971604+0000","last_fullsized":"2024-09-12T02:59:47.971604+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.999508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:43.870533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.055203+0000","last_change":"2024-09-12T02:59:48.055261+0000","last_active":"2024-09-12T02:59:48.055203+0000","last_peered":"2024-09-12T02:59:48.055203+0000","last_clean":"2024-09-12T02:59:48.055203+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:48.055203+0000","last_undegraded":"2024-09-12T02:59:48.055203+0000","last_fullsized":"2024-09-12T02:59:48.055203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.055039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.593082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967922+0000","last_change":"2024-09-12T02:59:33.818250+0000","last_active":"2024-09-12T02:59:47.967922+0000","last_peered":"2024-09-12T02:59:47.967922+0000","last_clean":"2024-09-12T02:59:47.967922+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:47.967922+0000","last_undegraded":"2024-09-12T02:59:47.967922+0000","last_fullsized":"2024-09-12T02:59:47.967922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.818171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:46.646434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"79'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971823+0000","last_change":"2024-09-12T02:59:31.836989+0000","last_active":"2024-09-12T02:59:47.971823+0000","last_peered":"2024-09-12T02:59:47.971823+0000","last_clean":"2024-09-12T02:59:47.971823+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:47.971823+0000","last_undegraded":"2024-09-12T02:59:47.971823+0000","last_fullsized":"2024-09-12T02:59:47.971823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.836905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:53.031692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968330+0000","last_change":"2024-09-12T02:59:39.791877+0000","last_active":"2024-09-12T02:59:47.968330+0000","last_peered":"2024-09-12T02:59:47.968330+0000","last_clean":"2024-09-12T02:59:47.968330+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:47.968330+0000","last_undegraded":"2024-09-12T02:59:47.968330+0000","last_fullsized":"2024-09-12T02:59:47.968330+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.791761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:25.406226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974670+0000","last_change":"2024-09-12T02:59:30.045775+0000","last_active":"2024-09-12T02:59:47.974670+0000","last_peered":"2024-09-12T02:59:47.974670+0000","last_clean":"2024-09-12T02:59:47.974670+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:47.974670+0000","last_undegraded":"2024-09-12T02:59:47.974670+0000","last_fullsized":"2024-09-12T02:59:47.974670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.045690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:33.716096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.861880+0000","last_change":"2024-09-12T02:59:49.861935+0000","last_active":"2024-09-12T02:59:49.861880+0000","last_peered":"2024-09-12T02:59:49.861880+0000","last_clean":"2024-09-12T02:59:49.861880+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:49.861880+0000","last_undegraded":"2024-09-12T02:59:49.861880+0000","last_fullsized":"2024-09-12T02:59:49.861880+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.861705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:39.315077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975242+0000","last_change":"2024-09-12T02:59:40.118829+0000","last_active":"2024-09-12T02:59:47.975242+0000","last_peered":"2024-09-12T02:59:47.975242+0000","last_clean":"2024-09-12T02:59:47.975242+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:47.975242+0000","last_undegraded":"2024-09-12T02:59:47.975242+0000","last_fullsized":"2024-09-12T02:59:47.975242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.118699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:10.405280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970876+0000","last_change":"2024-09-12T02:59:47.676864+0000","last_active":"2024-09-12T02:59:47.970876+0000","last_peered":"2024-09-12T02:59:47.970876+0000","last_clean":"2024-09-12T02:59:47.970876+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:47.970876+0000","last_undegraded":"2024-09-12T02:59:47.970876+0000","last_fullsized":"2024-09-12T02:59:47.970876+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.676747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.675367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971929+0000","last_change":"2024-09-12T02:59:40.971763+0000","last_active":"2024-09-12T02:59:47.971929+0000","last_peered":"2024-09-12T02:59:47.971929+0000","last_clean":"2024-09-12T02:59:47.971929+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:47.971929+0000","last_undegraded":"2024-09-12T02:59:47.971929+0000","last_fullsized":"2024-09-12T02:59:47.971929+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.971535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:04.999865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"79'119","reported_seq":298,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987941+0000","last_change":"2024-09-12T02:59:34.803297+0000","last_active":"2024-09-12T02:59:47.987941+0000","last_peered":"2024-09-12T02:59:47.987941+0000","last_clean":"2024-09-12T02:59:47.987941+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:47.987941+0000","last_undegraded":"2024-09-12T02:59:47.987941+0000","last_fullsized":"2024-09-12T02:59:47.987941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.802947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:59.161855+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986419+0000","last_change":"2024-09-12T02:59:42.682806+0000","last_active":"2024-09-12T02:59:47.986419+0000","last_peered":"2024-09-12T02:59:47.986419+0000","last_clean":"2024-09-12T02:59:47.986419+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:47.986419+0000","last_undegraded":"2024-09-12T02:59:47.986419+0000","last_fullsized":"2024-09-12T02:59:47.986419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.682574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:22.933579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968536+0000","last_change":"2024-09-12T02:59:35.830230+0000","last_active":"2024-09-12T02:59:47.968536+0000","last_peered":"2024-09-12T02:59:47.968536+0000","last_clean":"2024-09-12T02:59:47.968536+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:47.968536+0000","last_undegraded":"2024-09-12T02:59:47.968536+0000","last_fullsized":"2024-09-12T02:59:47.968536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.830121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.993178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972431+0000","last_change":"2024-09-12T02:59:35.842501+0000","last_active":"2024-09-12T02:59:47.972431+0000","last_peered":"2024-09-12T02:59:47.972431+0000","last_clean":"2024-09-12T02:59:47.972431+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:47.972431+0000","last_undegraded":"2024-09-12T02:59:47.972431+0000","last_fullsized":"2024-09-12T02:59:47.972431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.842396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:47.840469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986324+0000","last_change":"2024-09-12T02:59:41.651678+0000","last_active":"2024-09-12T02:59:47.986324+0000","last_peered":"2024-09-12T02:59:47.986324+0000","last_clean":"2024-09-12T02:59:47.986324+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:47.986324+0000","last_undegraded":"2024-09-12T02:59:47.986324+0000","last_fullsized":"2024-09-12T02:59:47.986324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.651443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:40.919631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973325+0000","last_change":"2024-09-12T02:59:34.986788+0000","last_active":"2024-09-12T02:59:47.973325+0000","last_peered":"2024-09-12T02:59:47.973325+0000","last_clean":"2024-09-12T02:59:47.973325+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:47.973325+0000","last_undegraded":"2024-09-12T02:59:47.973325+0000","last_fullsized":"2024-09-12T02:59:47.973325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.986542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:35.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968801+0000","last_change":"2024-09-12T02:59:31.772320+0000","last_active":"2024-09-12T02:59:47.968801+0000","last_peered":"2024-09-12T02:59:47.968801+0000","last_clean":"2024-09-12T02:59:47.968801+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:47.968801+0000","last_undegraded":"2024-09-12T02:59:47.968801+0000","last_fullsized":"2024-09-12T02:59:47.968801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.772236+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:19.909174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975319+0000","last_change":"2024-09-12T02:59:43.053479+0000","last_active":"2024-09-12T02:59:47.975319+0000","last_peered":"2024-09-12T02:59:47.975319+0000","last_clean":"2024-09-12T02:59:47.975319+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:47.975319+0000","last_undegraded":"2024-09-12T02:59:47.975319+0000","last_fullsized":"2024-09-12T02:59:47.975319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.053377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:21.369077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989656+0000","last_change":"2024-09-12T02:59:46.862199+0000","last_active":"2024-09-12T02:59:47.989656+0000","last_peered":"2024-09-12T02:59:47.989656+0000","last_clean":"2024-09-12T02:59:47.989656+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:47.989656+0000","last_undegraded":"2024-09-12T02:59:47.989656+0000","last_fullsized":"2024-09-12T02:59:47.989656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.861972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:51.491507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'3","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972717+0000","last_change":"2024-09-12T02:59:30.860535+0000","last_active":"2024-09-12T02:59:47.972717+0000","last_peered":"2024-09-12T02:59:47.972717+0000","last_clean":"2024-09-12T02:59:47.972717+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:47.972717+0000","last_undegraded":"2024-09-12T02:59:47.972717+0000","last_fullsized":"2024-09-12T02:59:47.972717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.860444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:23.065975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.093595+0000","last_change":"2024-09-12T02:59:49.093650+0000","last_active":"2024-09-12T02:59:49.093595+0000","last_peered":"2024-09-12T02:59:49.093595+0000","last_clean":"2024-09-12T02:59:49.093595+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:49.093595+0000","last_undegraded":"2024-09-12T02:59:49.093595+0000","last_fullsized":"2024-09-12T02:59:49.093595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.093403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.133030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989405+0000","last_change":"2024-09-12T02:59:44.860343+0000","last_active":"2024-09-12T02:59:47.989405+0000","last_peered":"2024-09-12T02:59:47.989405+0000","last_clean":"2024-09-12T02:59:47.989405+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:47.989405+0000","last_undegraded":"2024-09-12T02:59:47.989405+0000","last_fullsized":"2024-09-12T02:59:47.989405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.860002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:03.716731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975421+0000","last_change":"2024-09-12T02:59:31.636304+0000","last_active":"2024-09-12T02:59:47.975421+0000","last_peered":"2024-09-12T02:59:47.975421+0000","last_clean":"2024-09-12T02:59:47.975421+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:47.975421+0000","last_undegraded":"2024-09-12T02:59:47.975421+0000","last_fullsized":"2024-09-12T02:59:47.975421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.636071+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:48.966306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974472+0000","last_change":"2024-09-12T02:59:42.661415+0000","last_active":"2024-09-12T02:59:47.974472+0000","last_peered":"2024-09-12T02:59:47.974472+0000","last_clean":"2024-09-12T02:59:47.974472+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:47.974472+0000","last_undegraded":"2024-09-12T02:59:47.974472+0000","last_fullsized":"2024-09-12T02:59:47.974472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.661146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986300+0000","last_change":"2024-09-12T02:59:45.832208+0000","last_active":"2024-09-12T02:59:47.986300+0000","last_peered":"2024-09-12T02:59:47.986300+0000","last_clean":"2024-09-12T02:59:47.986300+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:47.986300+0000","last_undegraded":"2024-09-12T02:59:47.986300+0000","last_fullsized":"2024-09-12T02:59:47.986300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.831975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'12","reported_seq":184,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971562+0000","last_change":"2024-09-12T02:59:36.886312+0000","last_active":"2024-09-12T02:59:47.971562+0000","last_peered":"2024-09-12T02:59:47.971562+0000","last_clean":"2024-09-12T02:59:47.971562+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:47.971562+0000","last_undegraded":"2024-09-12T02:59:47.971562+0000","last_fullsized":"2024-09-12T02:59:47.971562+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.886179+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:45.626516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975159+0000","last_change":"2024-09-12T02:59:39.156656+0000","last_active":"2024-09-12T02:59:47.975159+0000","last_peered":"2024-09-12T02:59:47.975159+0000","last_clean":"2024-09-12T02:59:47.975159+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:47.975159+0000","last_undegraded":"2024-09-12T02:59:47.975159+0000","last_fullsized":"2024-09-12T02:59:47.975159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.156542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:34.954291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987400+0000","last_change":"2024-09-12T02:59:37.673643+0000","last_active":"2024-09-12T02:59:47.987400+0000","last_peered":"2024-09-12T02:59:47.987400+0000","last_clean":"2024-09-12T02:59:47.987400+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:47.987400+0000","last_undegraded":"2024-09-12T02:59:47.987400+0000","last_fullsized":"2024-09-12T02:59:47.987400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.673292+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.523545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988581+0000","last_change":"2024-09-12T02:59:33.671444+0000","last_active":"2024-09-12T02:59:47.988581+0000","last_peered":"2024-09-12T02:59:47.988581+0000","last_clean":"2024-09-12T02:59:47.988581+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:47.988581+0000","last_undegraded":"2024-09-12T02:59:47.988581+0000","last_fullsized":"2024-09-12T02:59:47.988581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.671212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:45.669284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972298+0000","last_change":"2024-09-12T02:59:34.590629+0000","last_active":"2024-09-12T02:59:47.972298+0000","last_peered":"2024-09-12T02:59:47.972298+0000","last_clean":"2024-09-12T02:59:47.972298+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:47.972298+0000","last_undegraded":"2024-09-12T02:59:47.972298+0000","last_fullsized":"2024-09-12T02:59:47.972298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.590531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.762881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988612+0000","last_change":"2024-09-12T02:59:43.837261+0000","last_active":"2024-09-12T02:59:47.988612+0000","last_peered":"2024-09-12T02:59:47.988612+0000","last_clean":"2024-09-12T02:59:47.988612+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:47.988612+0000","last_undegraded":"2024-09-12T02:59:47.988612+0000","last_fullsized":"2024-09-12T02:59:47.988612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.836980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.344004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970476+0000","last_change":"2024-09-12T02:59:45.048563+0000","last_active":"2024-09-12T02:59:47.970476+0000","last_peered":"2024-09-12T02:59:47.970476+0000","last_clean":"2024-09-12T02:59:47.970476+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:47.970476+0000","last_undegraded":"2024-09-12T02:59:47.970476+0000","last_fullsized":"2024-09-12T02:59:47.970476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.048315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:20.692033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.611665+0000","last_change":"2024-09-12T02:59:49.611694+0000","last_active":"2024-09-12T02:59:49.611665+0000","last_peered":"2024-09-12T02:59:49.611665+0000","last_clean":"2024-09-12T02:59:49.611665+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:49.611665+0000","last_undegraded":"2024-09-12T02:59:49.611665+0000","last_fullsized":"2024-09-12T02:59:49.611665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.611569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:05.308212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975259+0000","last_change":"2024-09-12T02:59:36.076892+0000","last_active":"2024-09-12T02:59:47.975259+0000","last_peered":"2024-09-12T02:59:47.975259+0000","last_clean":"2024-09-12T02:59:47.975259+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:47.975259+0000","last_undegraded":"2024-09-12T02:59:47.975259+0000","last_fullsized":"2024-09-12T02:59:47.975259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.076727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:26.666775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975590+0000","last_change":"2024-09-12T02:59:30.999792+0000","last_active":"2024-09-12T02:59:47.975590+0000","last_peered":"2024-09-12T02:59:47.975590+0000","last_clean":"2024-09-12T02:59:47.975590+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:47.975590+0000","last_undegraded":"2024-09-12T02:59:47.975590+0000","last_fullsized":"2024-09-12T02:59:47.975590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.999703+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:17.375066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973863+0000","last_change":"2024-09-12T02:59:34.015485+0000","last_active":"2024-09-12T02:59:47.973863+0000","last_peered":"2024-09-12T02:59:47.973863+0000","last_clean":"2024-09-12T02:59:47.973863+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:47.973863+0000","last_undegraded":"2024-09-12T02:59:47.973863+0000","last_fullsized":"2024-09-12T02:59:47.973863+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.015247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:05.065563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989055+0000","last_change":"2024-09-12T02:59:41.793529+0000","last_active":"2024-09-12T02:59:47.989055+0000","last_peered":"2024-09-12T02:59:47.989055+0000","last_clean":"2024-09-12T02:59:47.989055+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:47.989055+0000","last_undegraded":"2024-09-12T02:59:47.989055+0000","last_fullsized":"2024-09-12T02:59:47.989055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.793303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.839881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":167,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987810+0000","last_change":"2024-09-12T02:59:32.647074+0000","last_active":"2024-09-12T02:59:47.987810+0000","last_peered":"2024-09-12T02:59:47.987810+0000","last_clean":"2024-09-12T02:59:47.987810+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:47.987810+0000","last_undegraded":"2024-09-12T02:59:47.987810+0000","last_fullsized":"2024-09-12T02:59:47.987810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'28","last_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_deep_scrub":"79'28","last_deep_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.646844+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:46.886484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968042+0000","last_change":"2024-09-12T02:59:46.857630+0000","last_active":"2024-09-12T02:59:47.968042+0000","last_peered":"2024-09-12T02:59:47.968042+0000","last_clean":"2024-09-12T02:59:47.968042+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:47.968042+0000","last_undegraded":"2024-09-12T02:59:47.968042+0000","last_fullsized":"2024-09-12T02:59:47.968042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.857527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.845970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974062+0000","last_change":"2024-09-12T02:59:33.680657+0000","last_active":"2024-09-12T02:59:47.974062+0000","last_peered":"2024-09-12T02:59:47.974062+0000","last_clean":"2024-09-12T02:59:47.974062+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:47.974062+0000","last_undegraded":"2024-09-12T02:59:47.974062+0000","last_fullsized":"2024-09-12T02:59:47.974062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.680411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:15.802027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968679+0000","last_change":"2024-09-12T02:59:44.852192+0000","last_active":"2024-09-12T02:59:47.968679+0000","last_peered":"2024-09-12T02:59:47.968679+0000","last_clean":"2024-09-12T02:59:47.968679+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:47.968679+0000","last_undegraded":"2024-09-12T02:59:47.968679+0000","last_fullsized":"2024-09-12T02:59:47.968679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.852086+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.017309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":166,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971894+0000","last_change":"2024-09-12T02:59:45.664653+0000","last_active":"2024-09-12T02:59:47.971894+0000","last_peered":"2024-09-12T02:59:47.971894+0000","last_clean":"2024-09-12T02:59:47.971894+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:47.971894+0000","last_undegraded":"2024-09-12T02:59:47.971894+0000","last_fullsized":"2024-09-12T02:59:47.971894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.664314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.652758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975774+0000","last_change":"2024-09-12T02:59:45.129108+0000","last_active":"2024-09-12T02:59:47.975774+0000","last_peered":"2024-09-12T02:59:47.975774+0000","last_clean":"2024-09-12T02:59:47.975774+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:47.975774+0000","last_undegraded":"2024-09-12T02:59:47.975774+0000","last_fullsized":"2024-09-12T02:59:47.975774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.128965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.549002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973885+0000","last_change":"2024-09-12T02:59:37.986005+0000","last_active":"2024-09-12T02:59:47.973885+0000","last_peered":"2024-09-12T02:59:47.973885+0000","last_clean":"2024-09-12T02:59:47.973885+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:47.973885+0000","last_undegraded":"2024-09-12T02:59:47.973885+0000","last_fullsized":"2024-09-12T02:59:47.973885+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.985746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:14.181632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.639758+0000","last_change":"2024-09-12T02:59:51.639783+0000","last_active":"2024-09-12T02:59:51.639758+0000","last_peered":"2024-09-12T02:59:51.639758+0000","last_clean":"2024-09-12T02:59:51.639758+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:51.639758+0000","last_undegraded":"2024-09-12T02:59:51.639758+0000","last_fullsized":"2024-09-12T02:59:51.639758+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.639668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.759727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974029+0000","last_change":"2024-09-12T02:59:39.987993+0000","last_active":"2024-09-12T02:59:47.974029+0000","last_peered":"2024-09-12T02:59:47.974029+0000","last_clean":"2024-09-12T02:59:47.974029+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:47.974029+0000","last_undegraded":"2024-09-12T02:59:47.974029+0000","last_fullsized":"2024-09-12T02:59:47.974029+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.987743+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:04.424759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987757+0000","last_change":"2024-09-12T02:59:45.721685+0000","last_active":"2024-09-12T02:59:47.987757+0000","last_peered":"2024-09-12T02:59:47.987757+0000","last_clean":"2024-09-12T02:59:47.987757+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:47.987757+0000","last_undegraded":"2024-09-12T02:59:47.987757+0000","last_fullsized":"2024-09-12T02:59:47.987757+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.721444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.143614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970794+0000","last_change":"2024-09-12T02:59:46.669010+0000","last_active":"2024-09-12T02:59:47.970794+0000","last_peered":"2024-09-12T02:59:47.970794+0000","last_clean":"2024-09-12T02:59:47.970794+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:47.970794+0000","last_undegraded":"2024-09-12T02:59:47.970794+0000","last_fullsized":"2024-09-12T02:59:47.970794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.668894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:22.826170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975072+0000","last_change":"2024-09-12T02:59:41.077595+0000","last_active":"2024-09-12T02:59:47.975072+0000","last_peered":"2024-09-12T02:59:47.975072+0000","last_clean":"2024-09-12T02:59:47.975072+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:47.975072+0000","last_undegraded":"2024-09-12T02:59:47.975072+0000","last_fullsized":"2024-09-12T02:59:47.975072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.077484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:52.294457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967726+0000","last_change":"2024-09-12T02:59:41.841470+0000","last_active":"2024-09-12T02:59:47.967726+0000","last_peered":"2024-09-12T02:59:47.967726+0000","last_clean":"2024-09-12T02:59:47.967726+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:47.967726+0000","last_undegraded":"2024-09-12T02:59:47.967726+0000","last_fullsized":"2024-09-12T02:59:47.967726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.841333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.069789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.131581+0000","last_change":"2024-09-12T02:59:51.131633+0000","last_active":"2024-09-12T02:59:51.131581+0000","last_peered":"2024-09-12T02:59:51.131581+0000","last_clean":"2024-09-12T02:59:51.131581+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:51.131581+0000","last_undegraded":"2024-09-12T02:59:51.131581+0000","last_fullsized":"2024-09-12T02:59:51.131581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.131397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:19.953861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987223+0000","last_change":"2024-09-12T02:59:46.767895+0000","last_active":"2024-09-12T02:59:47.987223+0000","last_peered":"2024-09-12T02:59:47.987223+0000","last_clean":"2024-09-12T02:59:47.987223+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:47.987223+0000","last_undegraded":"2024-09-12T02:59:47.987223+0000","last_fullsized":"2024-09-12T02:59:47.987223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.767560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.939911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971399+0000","last_change":"2024-09-12T02:59:39.674943+0000","last_active":"2024-09-12T02:59:47.971399+0000","last_peered":"2024-09-12T02:59:47.971399+0000","last_clean":"2024-09-12T02:59:47.971399+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:47.971399+0000","last_undegraded":"2024-09-12T02:59:47.971399+0000","last_fullsized":"2024-09-12T02:59:47.971399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.674831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:28.379028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970981+0000","last_change":"2024-09-12T02:59:37.660153+0000","last_active":"2024-09-12T02:59:47.970981+0000","last_peered":"2024-09-12T02:59:47.970981+0000","last_clean":"2024-09-12T02:59:47.970981+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:47.970981+0000","last_undegraded":"2024-09-12T02:59:47.970981+0000","last_fullsized":"2024-09-12T02:59:47.970981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.660048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:32.261376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987111+0000","last_change":"2024-09-12T02:59:34.716068+0000","last_active":"2024-09-12T02:59:47.987111+0000","last_peered":"2024-09-12T02:59:47.987111+0000","last_clean":"2024-09-12T02:59:47.987111+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:47.987111+0000","last_undegraded":"2024-09-12T02:59:47.987111+0000","last_fullsized":"2024-09-12T02:59:47.987111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.715793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:43.456130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975476+0000","last_change":"2024-09-12T02:59:38.162584+0000","last_active":"2024-09-12T02:59:47.975476+0000","last_peered":"2024-09-12T02:59:47.975476+0000","last_clean":"2024-09-12T02:59:47.975476+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:47.975476+0000","last_undegraded":"2024-09-12T02:59:47.975476+0000","last_fullsized":"2024-09-12T02:59:47.975476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.162461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:51.207333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972265+0000","last_change":"2024-09-12T02:59:34.845414+0000","last_active":"2024-09-12T02:59:47.972265+0000","last_peered":"2024-09-12T02:59:47.972265+0000","last_clean":"2024-09-12T02:59:47.972265+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:47.972265+0000","last_undegraded":"2024-09-12T02:59:47.972265+0000","last_fullsized":"2024-09-12T02:59:47.972265+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.845313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:49.084952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971084+0000","last_change":"2024-09-12T02:59:38.676599+0000","last_active":"2024-09-12T02:59:47.971084+0000","last_peered":"2024-09-12T02:59:47.971084+0000","last_clean":"2024-09-12T02:59:47.971084+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:47.971084+0000","last_undegraded":"2024-09-12T02:59:47.971084+0000","last_fullsized":"2024-09-12T02:59:47.971084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.676453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:08.813287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971443+0000","last_change":"2024-09-12T02:59:32.676152+0000","last_active":"2024-09-12T02:59:47.971443+0000","last_peered":"2024-09-12T02:59:47.971443+0000","last_clean":"2024-09-12T02:59:47.971443+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:47.971443+0000","last_undegraded":"2024-09-12T02:59:47.971443+0000","last_fullsized":"2024-09-12T02:59:47.971443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.675897+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971857+0000","last_change":"2024-09-12T02:59:32.600836+0000","last_active":"2024-09-12T02:59:47.971857+0000","last_peered":"2024-09-12T02:59:47.971857+0000","last_clean":"2024-09-12T02:59:47.971857+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:47.971857+0000","last_undegraded":"2024-09-12T02:59:47.971857+0000","last_fullsized":"2024-09-12T02:59:47.971857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.600751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:36.409439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986975+0000","last_change":"2024-09-12T02:59:36.720562+0000","last_active":"2024-09-12T02:59:47.986975+0000","last_peered":"2024-09-12T02:59:47.986975+0000","last_clean":"2024-09-12T02:59:47.986975+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:47.986975+0000","last_undegraded":"2024-09-12T02:59:47.986975+0000","last_fullsized":"2024-09-12T02:59:47.986975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.720181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.336802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971697+0000","last_change":"2024-09-12T02:59:33.813763+0000","last_active":"2024-09-12T02:59:47.971697+0000","last_peered":"2024-09-12T02:59:47.971697+0000","last_clean":"2024-09-12T02:59:47.971697+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:47.971697+0000","last_undegraded":"2024-09-12T02:59:47.971697+0000","last_fullsized":"2024-09-12T02:59:47.971697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.813677+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:54.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971176+0000","last_change":"2024-09-12T02:59:43.020950+0000","last_active":"2024-09-12T02:59:47.971176+0000","last_peered":"2024-09-12T02:59:47.971176+0000","last_clean":"2024-09-12T02:59:47.971176+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:47.971176+0000","last_undegraded":"2024-09-12T02:59:47.971176+0000","last_fullsized":"2024-09-12T02:59:47.971176+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.020633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:20.020956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975501+0000","last_change":"2024-09-12T02:59:35.065915+0000","last_active":"2024-09-12T02:59:47.975501+0000","last_peered":"2024-09-12T02:59:47.975501+0000","last_clean":"2024-09-12T02:59:47.975501+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:47.975501+0000","last_undegraded":"2024-09-12T02:59:47.975501+0000","last_fullsized":"2024-09-12T02:59:47.975501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.065802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:51.998513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971305+0000","last_change":"2024-09-12T02:59:33.570266+0000","last_active":"2024-09-12T02:59:47.971305+0000","last_peered":"2024-09-12T02:59:47.971305+0000","last_clean":"2024-09-12T02:59:47.971305+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:47.971305+0000","last_undegraded":"2024-09-12T02:59:47.971305+0000","last_fullsized":"2024-09-12T02:59:47.971305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.570177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:57.992347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968334+0000","last_change":"2024-09-12T02:59:30.749318+0000","last_active":"2024-09-12T02:59:47.968334+0000","last_peered":"2024-09-12T02:59:47.968334+0000","last_clean":"2024-09-12T02:59:47.968334+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:47.968334+0000","last_undegraded":"2024-09-12T02:59:47.968334+0000","last_fullsized":"2024-09-12T02:59:47.968334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.749228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:31.541524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987453+0000","last_change":"2024-09-12T02:59:38.651039+0000","last_active":"2024-09-12T02:59:47.987453+0000","last_peered":"2024-09-12T02:59:47.987453+0000","last_clean":"2024-09-12T02:59:47.987453+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:47.987453+0000","last_undegraded":"2024-09-12T02:59:47.987453+0000","last_fullsized":"2024-09-12T02:59:47.987453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.650631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.137855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972409+0000","last_change":"2024-09-12T02:59:42.663691+0000","last_active":"2024-09-12T02:59:47.972409+0000","last_peered":"2024-09-12T02:59:47.972409+0000","last_clean":"2024-09-12T02:59:47.972409+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:47.972409+0000","last_undegraded":"2024-09-12T02:59:47.972409+0000","last_fullsized":"2024-09-12T02:59:47.972409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.663586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:23.083624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.118661+0000","last_change":"2024-09-12T02:59:50.118766+0000","last_active":"2024-09-12T02:59:50.118661+0000","last_peered":"2024-09-12T02:59:50.118661+0000","last_clean":"2024-09-12T02:59:50.118661+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:50.118661+0000","last_undegraded":"2024-09-12T02:59:50.118661+0000","last_fullsized":"2024-09-12T02:59:50.118661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.118459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:39.693765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970603+0000","last_change":"2024-09-12T02:59:31.642639+0000","last_active":"2024-09-12T02:59:47.970603+0000","last_peered":"2024-09-12T02:59:47.970603+0000","last_clean":"2024-09-12T02:59:47.970603+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:47.970603+0000","last_undegraded":"2024-09-12T02:59:47.970603+0000","last_fullsized":"2024-09-12T02:59:47.970603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.642539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:45.910007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970879+0000","last_change":"2024-09-12T02:59:42.020010+0000","last_active":"2024-09-12T02:59:47.970879+0000","last_peered":"2024-09-12T02:59:47.970879+0000","last_clean":"2024-09-12T02:59:47.970879+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:47.970879+0000","last_undegraded":"2024-09-12T02:59:47.970879+0000","last_fullsized":"2024-09-12T02:59:47.970879+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.019770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:02.627789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975198+0000","last_change":"2024-09-12T02:59:37.126601+0000","last_active":"2024-09-12T02:59:47.975198+0000","last_peered":"2024-09-12T02:59:47.975198+0000","last_clean":"2024-09-12T02:59:47.975198+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:47.975198+0000","last_undegraded":"2024-09-12T02:59:47.975198+0000","last_fullsized":"2024-09-12T02:59:47.975198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.126497+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:41.431052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987704+0000","last_change":"2024-09-12T02:59:40.644873+0000","last_active":"2024-09-12T02:59:47.987704+0000","last_peered":"2024-09-12T02:59:47.987704+0000","last_clean":"2024-09-12T02:59:47.987704+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:47.987704+0000","last_undegraded":"2024-09-12T02:59:47.987704+0000","last_fullsized":"2024-09-12T02:59:47.987704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.644626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:27.019990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989535+0000","last_change":"2024-09-12T02:59:42.787927+0000","last_active":"2024-09-12T02:59:47.989535+0000","last_peered":"2024-09-12T02:59:47.989535+0000","last_clean":"2024-09-12T02:59:47.989535+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:47.989535+0000","last_undegraded":"2024-09-12T02:59:47.989535+0000","last_fullsized":"2024-09-12T02:59:47.989535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.787542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.015998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972705+0000","last_change":"2024-09-12T02:59:32.823831+0000","last_active":"2024-09-12T02:59:47.972705+0000","last_peered":"2024-09-12T02:59:47.972705+0000","last_clean":"2024-09-12T02:59:47.972705+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:47.972705+0000","last_undegraded":"2024-09-12T02:59:47.972705+0000","last_fullsized":"2024-09-12T02:59:47.972705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.823742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:34.576078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974455+0000","last_change":"2024-09-12T02:59:47.049456+0000","last_active":"2024-09-12T02:59:47.974455+0000","last_peered":"2024-09-12T02:59:47.974455+0000","last_clean":"2024-09-12T02:59:47.974455+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:47.974455+0000","last_undegraded":"2024-09-12T02:59:47.974455+0000","last_fullsized":"2024-09-12T02:59:47.974455+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.049206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:32.900134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971264+0000","last_change":"2024-09-12T02:59:37.007470+0000","last_active":"2024-09-12T02:59:47.971264+0000","last_peered":"2024-09-12T02:59:47.971264+0000","last_clean":"2024-09-12T02:59:47.971264+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:47.971264+0000","last_undegraded":"2024-09-12T02:59:47.971264+0000","last_fullsized":"2024-09-12T02:59:47.971264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.007224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:18.542924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967806+0000","last_change":"2024-09-12T02:59:40.838979+0000","last_active":"2024-09-12T02:59:47.967806+0000","last_peered":"2024-09-12T02:59:47.967806+0000","last_clean":"2024-09-12T02:59:47.967806+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:47.967806+0000","last_undegraded":"2024-09-12T02:59:47.967806+0000","last_fullsized":"2024-09-12T02:59:47.967806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.838843+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:09.885421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975113+0000","last_change":"2024-09-12T02:59:34.019995+0000","last_active":"2024-09-12T02:59:47.975113+0000","last_peered":"2024-09-12T02:59:47.975113+0000","last_clean":"2024-09-12T02:59:47.975113+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:47.975113+0000","last_undegraded":"2024-09-12T02:59:47.975113+0000","last_fullsized":"2024-09-12T02:59:47.975113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.019910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.828598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970779+0000","last_change":"2024-09-12T02:59:35.597391+0000","last_active":"2024-09-12T02:59:47.970779+0000","last_peered":"2024-09-12T02:59:47.970779+0000","last_clean":"2024-09-12T02:59:47.970779+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:47.970779+0000","last_undegraded":"2024-09-12T02:59:47.970779+0000","last_fullsized":"2024-09-12T02:59:47.970779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.597291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:38.185412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973797+0000","last_change":"2024-09-12T02:59:36.682299+0000","last_active":"2024-09-12T02:59:47.973797+0000","last_peered":"2024-09-12T02:59:47.973797+0000","last_clean":"2024-09-12T02:59:47.973797+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:47.973797+0000","last_undegraded":"2024-09-12T02:59:47.973797+0000","last_fullsized":"2024-09-12T02:59:47.973797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.682064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:10.673981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986906+0000","last_change":"2024-09-12T02:59:44.683736+0000","last_active":"2024-09-12T02:59:47.986906+0000","last_peered":"2024-09-12T02:59:47.986906+0000","last_clean":"2024-09-12T02:59:47.986906+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:47.986906+0000","last_undegraded":"2024-09-12T02:59:47.986906+0000","last_fullsized":"2024-09-12T02:59:47.986906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.683432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.492120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987167+0000","last_change":"2024-09-12T02:59:43.695797+0000","last_active":"2024-09-12T02:59:47.987167+0000","last_peered":"2024-09-12T02:59:47.987167+0000","last_clean":"2024-09-12T02:59:47.987167+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:47.987167+0000","last_undegraded":"2024-09-12T02:59:47.987167+0000","last_fullsized":"2024-09-12T02:59:47.987167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'16","last_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_deep_scrub":"79'16","last_deep_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.695424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:57.962892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.814119+0000","last_change":"2024-09-12T02:59:48.814183+0000","last_active":"2024-09-12T02:59:48.814119+0000","last_peered":"2024-09-12T02:59:48.814119+0000","last_clean":"2024-09-12T02:59:48.814119+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:48.814119+0000","last_undegraded":"2024-09-12T02:59:48.814119+0000","last_fullsized":"2024-09-12T02:59:48.814119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.813942+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:41.235405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.652380+0000","last_change":"2024-09-12T02:59:48.652404+0000","last_active":"2024-09-12T02:59:48.652380+0000","last_peered":"2024-09-12T02:59:48.652380+0000","last_clean":"2024-09-12T02:59:48.652380+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:48.652380+0000","last_undegraded":"2024-09-12T02:59:48.652380+0000","last_fullsized":"2024-09-12T02:59:48.652380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.652295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:24.469845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986239+0000","last_change":"2024-09-12T02:59:40.773384+0000","last_active":"2024-09-12T02:59:47.986239+0000","last_peered":"2024-09-12T02:59:47.986239+0000","last_clean":"2024-09-12T02:59:47.986239+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:47.986239+0000","last_undegraded":"2024-09-12T02:59:47.986239+0000","last_fullsized":"2024-09-12T02:59:47.986239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.773129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.980310+0000","last_change":"2024-09-12T02:59:47.977081+0000","last_active":"2024-09-12T02:59:47.980310+0000","last_peered":"2024-09-12T02:59:47.980310+0000","last_clean":"2024-09-12T02:59:47.980310+0000","last_became_active":"2024-09-12T02:59:47.976687+0000","last_became_peered":"2024-09-12T02:59:47.976687+0000","last_unstale":"2024-09-12T02:59:47.980310+0000","last_undegraded":"2024-09-12T02:59:47.980310+0000","last_fullsized":"2024-09-12T02:59:47.980310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988297+0000","last_change":"2024-09-12T02:59:39.769618+0000","last_active":"2024-09-12T02:59:47.988297+0000","last_peered":"2024-09-12T02:59:47.988297+0000","last_clean":"2024-09-12T02:59:47.988297+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:47.988297+0000","last_undegraded":"2024-09-12T02:59:47.988297+0000","last_fullsized":"2024-09-12T02:59:47.988297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.769355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:44.299798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973047+0000","last_change":"2024-09-12T02:59:46.045977+0000","last_active":"2024-09-12T02:59:47.973047+0000","last_peered":"2024-09-12T02:59:47.973047+0000","last_clean":"2024-09-12T02:59:47.973047+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:47.973047+0000","last_undegraded":"2024-09-12T02:59:47.973047+0000","last_fullsized":"2024-09-12T02:59:47.973047+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.045725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:00.846357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974947+0000","last_change":"2024-09-12T02:59:33.045189+0000","last_active":"2024-09-12T02:59:47.974947+0000","last_peered":"2024-09-12T02:59:47.974947+0000","last_clean":"2024-09-12T02:59:47.974947+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:47.974947+0000","last_undegraded":"2024-09-12T02:59:47.974947+0000","last_fullsized":"2024-09-12T02:59:47.974947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.045042+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:47.312510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969171+0000","last_change":"2024-09-12T02:59:38.788525+0000","last_active":"2024-09-12T02:59:47.969171+0000","last_peered":"2024-09-12T02:59:47.969171+0000","last_clean":"2024-09-12T02:59:47.969171+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:47.969171+0000","last_undegraded":"2024-09-12T02:59:47.969171+0000","last_fullsized":"2024-09-12T02:59:47.969171+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.788431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:20.633132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988967+0000","last_change":"2024-09-12T02:59:33.741380+0000","last_active":"2024-09-12T02:59:47.988967+0000","last_peered":"2024-09-12T02:59:47.988967+0000","last_clean":"2024-09-12T02:59:47.988967+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:47.988967+0000","last_undegraded":"2024-09-12T02:59:47.988967+0000","last_fullsized":"2024-09-12T02:59:47.988967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.741253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:51.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":530298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1552384,"data_stored":1083143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542198,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1544192,"data_stored":1083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":995328,"data_stored":529987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906967,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":928,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":950272,"data_stored":492227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":492263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":492297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:00:55.225 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T03:00:55.225 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T03:01:04.009 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:01:04.013 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:01:15.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:01:15.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d2be00640 1 Processor -- start 2024-09-12T03:01:15.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d2be00640 1 -- start start 2024-09-12T03:01:15.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d2be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5d24151a80 0x7f5d24072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d2be00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d241580c0 con 0x7f5d240c2a90 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d2be00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d241583a0 con 0x7f5d24074070 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d2be00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f5d240c8500 con 0x7f5d24151a80 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d29400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5d24151a80 0x7f5d24072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d29400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5d24151a80 0x7f5d24072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48904/0 (socket says 172.21.15.63:48904) 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d29400640 1 -- 172.21.15.63:0/477105134 learned_addr learned my addr 172.21.15.63:0/477105134 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d29e00640 1 --1- 172.21.15.63:0/477105134 >> v1:172.21.15.63:6789/0 conn(0x7f5d240c2a90 0x7f5d24161e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52604/0 (socket says 172.21.15.63:52604) 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d29400640 1 -- 172.21.15.63:0/477105134 >> v1:172.21.15.119:6789/0 conn(0x7f5d24074070 legacy=0x7f5d240c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d29400640 1 -- 172.21.15.63:0/477105134 >> v1:172.21.15.63:6789/0 conn(0x7f5d240c2a90 legacy=0x7f5d24161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:15.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.379+0000 7f5d29400640 1 -- 172.21.15.63:0/477105134 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d240cbf00 con 0x7f5d24151a80 2024-09-12T03:01:15.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d29400640 1 --2- 172.21.15.63:0/477105134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d24151a80 0x7f5d24072e50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5d18009870 tx=0x7f5d1801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7ce523235bd920 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:15.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d23e00640 1 -- 172.21.15.63:0/477105134 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d180b5070 con 0x7f5d24151a80 2024-09-12T03:01:15.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d23e00640 1 -- 172.21.15.63:0/477105134 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d180a8a50 con 0x7f5d24151a80 2024-09-12T03:01:15.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d23e00640 1 -- 172.21.15.63:0/477105134 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d180a8e20 con 0x7f5d24151a80 2024-09-12T03:01:15.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d2be00640 1 -- 172.21.15.63:0/477105134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d24151a80 msgr2=0x7f5d24072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:15.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d2be00640 1 --2- 172.21.15.63:0/477105134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d24151a80 0x7f5d24072e50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5d18009870 tx=0x7f5d1801ed50 comp rx=0 tx=0).stop 2024-09-12T03:01:15.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d2be00640 1 -- 172.21.15.63:0/477105134 shutdown_connections 2024-09-12T03:01:15.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d2be00640 1 --2- 172.21.15.63:0/477105134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d24151a80 0x7f5d24072e50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:15.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d2be00640 1 -- 172.21.15.63:0/477105134 >> 172.21.15.63:0/477105134 conn(0x7f5d2406f3d0 msgr2=0x7f5d2406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:15.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d2be00640 1 -- 172.21.15.63:0/477105134 shutdown_connections 2024-09-12T03:01:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.383+0000 7f5d2be00640 1 -- 172.21.15.63:0/477105134 wait complete. 2024-09-12T03:01:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 Processor -- start 2024-09-12T03:01:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 -- start start 2024-09-12T03:01:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d24074070 0x7f5d24156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d240c2a90 0x7f5d24149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d24151a80 0x7f5d2414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5d240c81f0 con 0x7f5d240c2a90 2024-09-12T03:01:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5d240cc4c0 con 0x7f5d24151a80 2024-09-12T03:01:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f5d240c7cf0 con 0x7f5d24074070 2024-09-12T03:01:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d28a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d240c2a90 0x7f5d24149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d28a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d240c2a90 0x7f5d24149e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48918/0 (socket says 172.21.15.63:48918) 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d28a00640 1 -- 172.21.15.63:0/2116911770 learned_addr learned my addr 172.21.15.63:0/2116911770 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d29400640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d24074070 0x7f5d24156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d29e00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d24151a80 0x7f5d2414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d28a00640 1 -- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d24074070 msgr2=0x7f5d24156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d28a00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d24074070 0x7f5d24156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d28a00640 1 -- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d24151a80 msgr2=0x7f5d2414a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d28a00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d24151a80 0x7f5d2414a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d28a00640 1 -- 172.21.15.63:0/2116911770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d24148b50 con 0x7f5d240c2a90 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d29e00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d24151a80 0x7f5d2414a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:01:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d28a00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d240c2a90 0x7f5d24149e90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000c450 tx=0x7f5d1000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d21600640 1 -- 172.21.15.63:0/2116911770 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10016020 con 0x7f5d240c2a90 2024-09-12T03:01:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d21600640 1 -- 172.21.15.63:0/2116911770 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d100052d0 con 0x7f5d240c2a90 2024-09-12T03:01:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d21600640 1 -- 172.21.15.63:0/2116911770 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10007260 con 0x7f5d240c2a90 2024-09-12T03:01:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2406fa60 con 0x7f5d240c2a90 2024-09-12T03:01:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.387+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d241490d0 con 0x7f5d240c2a90 2024-09-12T03:01:15.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.391+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d2406fef0 con 0x7f5d240c2a90 2024-09-12T03:01:15.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.391+0000 7f5d21600640 1 -- 172.21.15.63:0/2116911770 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d10007400 con 0x7f5d240c2a90 2024-09-12T03:01:15.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.391+0000 7f5d21600640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d040678f0 0x7f5d04069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:15.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.391+0000 7f5d21600640 1 -- 172.21.15.63:0/2116911770 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f5d10085ab0 con 0x7f5d240c2a90 2024-09-12T03:01:15.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.391+0000 7f5d29400640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d040678f0 0x7f5d04069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:15.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.391+0000 7f5d29400640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d040678f0 0x7f5d04069db0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5d180b2000 tx=0x7f5d18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:15.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.395+0000 7f5d21600640 1 -- 172.21.15.63:0/2116911770 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5d10020020 con 0x7f5d240c2a90 2024-09-12T03:01:15.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.559+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d2414bb10 con 0x7f5d040678f0 2024-09-12T03:01:15.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.579+0000 7f5d21600640 1 -- 172.21.15.63:0/2116911770 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332999 (secure 0 0 0) 0x7f5d2414bb10 con 0x7f5d040678f0 2024-09-12T03:01:15.585 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:01:15.587 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.583+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d040678f0 msgr2=0x7f5d04069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.583+0000 7f5d2be00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d040678f0 0x7f5d04069db0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5d180b2000 tx=0x7f5d18009040 comp rx=0 tx=0).stop 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d240c2a90 msgr2=0x7f5d24149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d240c2a90 0x7f5d24149e90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000c450 tx=0x7f5d1000c910 comp rx=0 tx=0).stop 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 shutdown_connections 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d24151a80 0x7f5d2414a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d240c2a90 0x7f5d24149e90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f5d040678f0 0x7f5d04069db0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 --2- 172.21.15.63:0/2116911770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d24074070 0x7f5d24156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 >> 172.21.15.63:0/2116911770 conn(0x7f5d2406f3d0 msgr2=0x7f5d24157910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 shutdown_connections 2024-09-12T03:01:15.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:15.587+0000 7f5d2be00640 1 -- 172.21.15.63:0/2116911770 wait complete. 2024-09-12T03:01:15.605 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-12T03:01:13.844147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238480,"kb_used_data":8696,"kb_used_omap":15,"kb_used_meta":229616,"kb_avail":754736240,"statfs":{"total":773094113280,"available":772849909760,"internally_reserved":0,"allocated":8904704,"data_stored":5195750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":235127470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004731"},"pg_stats":[{"pgid":"2.1f","version":"79'6","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975802+0000","last_change":"2024-09-12T02:59:32.000879+0000","last_active":"2024-09-12T02:59:47.975802+0000","last_peered":"2024-09-12T02:59:47.975802+0000","last_clean":"2024-09-12T02:59:47.975802+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:47.975802+0000","last_undegraded":"2024-09-12T02:59:47.975802+0000","last_fullsized":"2024-09-12T02:59:47.975802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.000756+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.073437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971629+0000","last_change":"2024-09-12T02:59:43.632597+0000","last_active":"2024-09-12T02:59:47.971629+0000","last_peered":"2024-09-12T02:59:47.971629+0000","last_clean":"2024-09-12T02:59:47.971629+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:47.971629+0000","last_undegraded":"2024-09-12T02:59:47.971629+0000","last_fullsized":"2024-09-12T02:59:47.971629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.632456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:01.396201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970626+0000","last_change":"2024-09-12T02:59:45.690062+0000","last_active":"2024-09-12T02:59:47.970626+0000","last_peered":"2024-09-12T02:59:47.970626+0000","last_clean":"2024-09-12T02:59:47.970626+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:47.970626+0000","last_undegraded":"2024-09-12T02:59:47.970626+0000","last_fullsized":"2024-09-12T02:59:47.970626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.689949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:02.009111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971812+0000","last_change":"2024-09-12T02:59:36.630496+0000","last_active":"2024-09-12T02:59:47.971812+0000","last_peered":"2024-09-12T02:59:47.971812+0000","last_clean":"2024-09-12T02:59:47.971812+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:47.971812+0000","last_undegraded":"2024-09-12T02:59:47.971812+0000","last_fullsized":"2024-09-12T02:59:47.971812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.630383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:49.675255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975685+0000","last_change":"2024-09-12T02:59:44.081098+0000","last_active":"2024-09-12T02:59:47.975685+0000","last_peered":"2024-09-12T02:59:47.975685+0000","last_clean":"2024-09-12T02:59:47.975685+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:47.975685+0000","last_undegraded":"2024-09-12T02:59:47.975685+0000","last_fullsized":"2024-09-12T02:59:47.975685+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.080989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:55.266943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970430+0000","last_change":"2024-09-12T02:59:41.662320+0000","last_active":"2024-09-12T02:59:47.970430+0000","last_peered":"2024-09-12T02:59:47.970430+0000","last_clean":"2024-09-12T02:59:47.970430+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:47.970430+0000","last_undegraded":"2024-09-12T02:59:47.970430+0000","last_fullsized":"2024-09-12T02:59:47.970430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.662088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:28.169111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989531+0000","last_change":"2024-09-12T02:59:37.757533+0000","last_active":"2024-09-12T02:59:47.989531+0000","last_peered":"2024-09-12T02:59:47.989531+0000","last_clean":"2024-09-12T02:59:47.989531+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:47.989531+0000","last_undegraded":"2024-09-12T02:59:47.989531+0000","last_fullsized":"2024-09-12T02:59:47.989531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.757250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:10.370609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972764+0000","last_change":"2024-09-12T02:59:35.959195+0000","last_active":"2024-09-12T02:59:47.972764+0000","last_peered":"2024-09-12T02:59:47.972764+0000","last_clean":"2024-09-12T02:59:47.972764+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:47.972764+0000","last_undegraded":"2024-09-12T02:59:47.972764+0000","last_fullsized":"2024-09-12T02:59:47.972764+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.958975+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.932192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972153+0000","last_change":"2024-09-12T02:59:43.619841+0000","last_active":"2024-09-12T02:59:47.972153+0000","last_peered":"2024-09-12T02:59:47.972153+0000","last_clean":"2024-09-12T02:59:47.972153+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:47.972153+0000","last_undegraded":"2024-09-12T02:59:47.972153+0000","last_fullsized":"2024-09-12T02:59:47.972153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.619594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:49.784818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'3","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989105+0000","last_change":"2024-09-12T02:59:47.847154+0000","last_active":"2024-09-12T02:59:47.989105+0000","last_peered":"2024-09-12T02:59:47.989105+0000","last_clean":"2024-09-12T02:59:47.989105+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:47.989105+0000","last_undegraded":"2024-09-12T02:59:47.989105+0000","last_fullsized":"2024-09-12T02:59:47.989105+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.846797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.835241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973740+0000","last_change":"2024-09-12T02:59:44.041049+0000","last_active":"2024-09-12T02:59:47.973740+0000","last_peered":"2024-09-12T02:59:47.973740+0000","last_clean":"2024-09-12T02:59:47.973740+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:47.973740+0000","last_undegraded":"2024-09-12T02:59:47.973740+0000","last_fullsized":"2024-09-12T02:59:47.973740+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.040815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.885096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970873+0000","last_change":"2024-09-12T02:59:40.700614+0000","last_active":"2024-09-12T02:59:47.970873+0000","last_peered":"2024-09-12T02:59:47.970873+0000","last_clean":"2024-09-12T02:59:47.970873+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:47.970873+0000","last_undegraded":"2024-09-12T02:59:47.970873+0000","last_fullsized":"2024-09-12T02:59:47.970873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.700368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:48.928824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986635+0000","last_change":"2024-09-12T02:59:39.629343+0000","last_active":"2024-09-12T02:59:47.986635+0000","last_peered":"2024-09-12T02:59:47.986635+0000","last_clean":"2024-09-12T02:59:47.986635+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:47.986635+0000","last_undegraded":"2024-09-12T02:59:47.986635+0000","last_fullsized":"2024-09-12T02:59:47.986635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.629058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:43.299464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988800+0000","last_change":"2024-09-12T02:59:36.789441+0000","last_active":"2024-09-12T02:59:47.988800+0000","last_peered":"2024-09-12T02:59:47.988800+0000","last_clean":"2024-09-12T02:59:47.988800+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:47.988800+0000","last_undegraded":"2024-09-12T02:59:47.988800+0000","last_fullsized":"2024-09-12T02:59:47.988800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.789151+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:41.135081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974912+0000","last_change":"2024-09-12T02:59:37.711523+0000","last_active":"2024-09-12T02:59:47.974912+0000","last_peered":"2024-09-12T02:59:47.974912+0000","last_clean":"2024-09-12T02:59:47.974912+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:47.974912+0000","last_undegraded":"2024-09-12T02:59:47.974912+0000","last_fullsized":"2024-09-12T02:59:47.974912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.711188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.241632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970941+0000","last_change":"2024-09-12T02:59:40.677307+0000","last_active":"2024-09-12T02:59:47.970941+0000","last_peered":"2024-09-12T02:59:47.970941+0000","last_clean":"2024-09-12T02:59:47.970941+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:47.970941+0000","last_undegraded":"2024-09-12T02:59:47.970941+0000","last_fullsized":"2024-09-12T02:59:47.970941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.677196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:18.992896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967755+0000","last_change":"2024-09-12T02:59:42.816275+0000","last_active":"2024-09-12T02:59:47.967755+0000","last_peered":"2024-09-12T02:59:47.967755+0000","last_clean":"2024-09-12T02:59:47.967755+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:47.967755+0000","last_undegraded":"2024-09-12T02:59:47.967755+0000","last_fullsized":"2024-09-12T02:59:47.967755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.816152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:29.323176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973221+0000","last_change":"2024-09-12T02:59:38.719352+0000","last_active":"2024-09-12T02:59:47.973221+0000","last_peered":"2024-09-12T02:59:47.973221+0000","last_clean":"2024-09-12T02:59:47.973221+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:47.973221+0000","last_undegraded":"2024-09-12T02:59:47.973221+0000","last_fullsized":"2024-09-12T02:59:47.973221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.719131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.333596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.642704+0000","last_change":"2024-09-12T02:59:50.642733+0000","last_active":"2024-09-12T02:59:50.642704+0000","last_peered":"2024-09-12T02:59:50.642704+0000","last_clean":"2024-09-12T02:59:50.642704+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:50.642704+0000","last_undegraded":"2024-09-12T02:59:50.642704+0000","last_fullsized":"2024-09-12T02:59:50.642704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.642614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967868+0000","last_change":"2024-09-12T02:59:32.776350+0000","last_active":"2024-09-12T02:59:47.967868+0000","last_peered":"2024-09-12T02:59:47.967868+0000","last_clean":"2024-09-12T02:59:47.967868+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:47.967868+0000","last_undegraded":"2024-09-12T02:59:47.967868+0000","last_fullsized":"2024-09-12T02:59:47.967868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.776267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:58.890222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968625+0000","last_change":"2024-09-12T02:59:34.789313+0000","last_active":"2024-09-12T02:59:47.968625+0000","last_peered":"2024-09-12T02:59:47.968625+0000","last_clean":"2024-09-12T02:59:47.968625+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:47.968625+0000","last_undegraded":"2024-09-12T02:59:47.968625+0000","last_fullsized":"2024-09-12T02:59:47.968625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.789214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.790935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971730+0000","last_change":"2024-09-12T02:59:34.632579+0000","last_active":"2024-09-12T02:59:47.971730+0000","last_peered":"2024-09-12T02:59:47.971730+0000","last_clean":"2024-09-12T02:59:47.971730+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:47.971730+0000","last_undegraded":"2024-09-12T02:59:47.971730+0000","last_fullsized":"2024-09-12T02:59:47.971730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.632350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.978281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987412+0000","last_change":"2024-09-12T02:59:35.785814+0000","last_active":"2024-09-12T02:59:47.987412+0000","last_peered":"2024-09-12T02:59:47.987412+0000","last_clean":"2024-09-12T02:59:47.987412+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:47.987412+0000","last_undegraded":"2024-09-12T02:59:47.987412+0000","last_fullsized":"2024-09-12T02:59:47.987412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.785459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.907074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975052+0000","last_change":"2024-09-12T02:59:44.644342+0000","last_active":"2024-09-12T02:59:47.975052+0000","last_peered":"2024-09-12T02:59:47.975052+0000","last_clean":"2024-09-12T02:59:47.975052+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:47.975052+0000","last_undegraded":"2024-09-12T02:59:47.975052+0000","last_fullsized":"2024-09-12T02:59:47.975052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.644026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:49.273561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975392+0000","last_change":"2024-09-12T02:59:46.131647+0000","last_active":"2024-09-12T02:59:47.975392+0000","last_peered":"2024-09-12T02:59:47.975392+0000","last_clean":"2024-09-12T02:59:47.975392+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:47.975392+0000","last_undegraded":"2024-09-12T02:59:47.975392+0000","last_fullsized":"2024-09-12T02:59:47.975392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.131533+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:06.802576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987954+0000","last_change":"2024-09-12T02:59:35.721123+0000","last_active":"2024-09-12T02:59:47.987954+0000","last_peered":"2024-09-12T02:59:47.987954+0000","last_clean":"2024-09-12T02:59:47.987954+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:47.987954+0000","last_undegraded":"2024-09-12T02:59:47.987954+0000","last_fullsized":"2024-09-12T02:59:47.987954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.720761+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:17.277216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971041+0000","last_change":"2024-09-12T02:59:39.707123+0000","last_active":"2024-09-12T02:59:47.971041+0000","last_peered":"2024-09-12T02:59:47.971041+0000","last_clean":"2024-09-12T02:59:47.971041+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:47.971041+0000","last_undegraded":"2024-09-12T02:59:47.971041+0000","last_fullsized":"2024-09-12T02:59:47.971041+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.706899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:08.753477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972457+0000","last_change":"2024-09-12T02:59:41.667809+0000","last_active":"2024-09-12T02:59:47.972457+0000","last_peered":"2024-09-12T02:59:47.972457+0000","last_clean":"2024-09-12T02:59:47.972457+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:47.972457+0000","last_undegraded":"2024-09-12T02:59:47.972457+0000","last_fullsized":"2024-09-12T02:59:47.972457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.667707+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:52.853661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968963+0000","last_change":"2024-09-12T02:59:45.841193+0000","last_active":"2024-09-12T02:59:47.968963+0000","last_peered":"2024-09-12T02:59:47.968963+0000","last_clean":"2024-09-12T02:59:47.968963+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:47.968963+0000","last_undegraded":"2024-09-12T02:59:47.968963+0000","last_fullsized":"2024-09-12T02:59:47.968963+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.841069+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:50.470604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.993328+0000","last_change":"2024-09-12T02:59:47.991190+0000","last_active":"2024-09-12T02:59:47.993328+0000","last_peered":"2024-09-12T02:59:47.993328+0000","last_clean":"2024-09-12T02:59:47.993328+0000","last_became_active":"2024-09-12T02:59:47.990629+0000","last_became_peered":"2024-09-12T02:59:47.990629+0000","last_unstale":"2024-09-12T02:59:47.993328+0000","last_undegraded":"2024-09-12T02:59:47.993328+0000","last_fullsized":"2024-09-12T02:59:47.993328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.643595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.689482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968300+0000","last_change":"2024-09-12T02:59:36.821336+0000","last_active":"2024-09-12T02:59:47.968300+0000","last_peered":"2024-09-12T02:59:47.968300+0000","last_clean":"2024-09-12T02:59:47.968300+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:47.968300+0000","last_undegraded":"2024-09-12T02:59:47.968300+0000","last_fullsized":"2024-09-12T02:59:47.968300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.821234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.321748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989889+0000","last_change":"2024-09-12T02:59:38.763406+0000","last_active":"2024-09-12T02:59:47.989889+0000","last_peered":"2024-09-12T02:59:47.989889+0000","last_clean":"2024-09-12T02:59:47.989889+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:47.989889+0000","last_undegraded":"2024-09-12T02:59:47.989889+0000","last_fullsized":"2024-09-12T02:59:47.989889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.763178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.755095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975077+0000","last_change":"2024-09-12T02:59:42.071495+0000","last_active":"2024-09-12T02:59:47.975077+0000","last_peered":"2024-09-12T02:59:47.975077+0000","last_clean":"2024-09-12T02:59:47.975077+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:47.975077+0000","last_undegraded":"2024-09-12T02:59:47.975077+0000","last_fullsized":"2024-09-12T02:59:47.975077+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.071362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:30.775559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973454+0000","last_change":"2024-09-12T02:59:39.026655+0000","last_active":"2024-09-12T02:59:47.973454+0000","last_peered":"2024-09-12T02:59:47.973454+0000","last_clean":"2024-09-12T02:59:47.973454+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:47.973454+0000","last_undegraded":"2024-09-12T02:59:47.973454+0000","last_fullsized":"2024-09-12T02:59:47.973454+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.026365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:52.426930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968353+0000","last_change":"2024-09-12T02:59:37.791375+0000","last_active":"2024-09-12T02:59:47.968353+0000","last_peered":"2024-09-12T02:59:47.968353+0000","last_clean":"2024-09-12T02:59:47.968353+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:47.968353+0000","last_undegraded":"2024-09-12T02:59:47.968353+0000","last_fullsized":"2024-09-12T02:59:47.968353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.791278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:11.783194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967824+0000","last_change":"2024-09-12T02:59:43.858969+0000","last_active":"2024-09-12T02:59:47.967824+0000","last_peered":"2024-09-12T02:59:47.967824+0000","last_clean":"2024-09-12T02:59:47.967824+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:47.967824+0000","last_undegraded":"2024-09-12T02:59:47.967824+0000","last_fullsized":"2024-09-12T02:59:47.967824+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.858860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972713+0000","last_change":"2024-09-12T02:59:35.662731+0000","last_active":"2024-09-12T02:59:47.972713+0000","last_peered":"2024-09-12T02:59:47.972713+0000","last_clean":"2024-09-12T02:59:47.972713+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:47.972713+0000","last_undegraded":"2024-09-12T02:59:47.972713+0000","last_fullsized":"2024-09-12T02:59:47.972713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.662469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:08.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971714+0000","last_change":"2024-09-12T02:59:32.999842+0000","last_active":"2024-09-12T02:59:47.971714+0000","last_peered":"2024-09-12T02:59:47.971714+0000","last_clean":"2024-09-12T02:59:47.971714+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:47.971714+0000","last_undegraded":"2024-09-12T02:59:47.971714+0000","last_fullsized":"2024-09-12T02:59:47.971714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.999508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:43.870533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.055261+0000","last_change":"2024-09-12T02:59:48.055261+0000","last_active":"2024-09-12T02:59:48.055261+0000","last_peered":"2024-09-12T02:59:48.055261+0000","last_clean":"2024-09-12T02:59:48.055261+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:48.055261+0000","last_undegraded":"2024-09-12T02:59:48.055261+0000","last_fullsized":"2024-09-12T02:59:48.055261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.055039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.593082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967982+0000","last_change":"2024-09-12T02:59:33.818250+0000","last_active":"2024-09-12T02:59:47.967982+0000","last_peered":"2024-09-12T02:59:47.967982+0000","last_clean":"2024-09-12T02:59:47.967982+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:47.967982+0000","last_undegraded":"2024-09-12T02:59:47.967982+0000","last_fullsized":"2024-09-12T02:59:47.967982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.818171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:46.646434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"79'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971823+0000","last_change":"2024-09-12T02:59:31.836989+0000","last_active":"2024-09-12T02:59:47.971823+0000","last_peered":"2024-09-12T02:59:47.971823+0000","last_clean":"2024-09-12T02:59:47.971823+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:47.971823+0000","last_undegraded":"2024-09-12T02:59:47.971823+0000","last_fullsized":"2024-09-12T02:59:47.971823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.836905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:53.031692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968330+0000","last_change":"2024-09-12T02:59:39.791877+0000","last_active":"2024-09-12T02:59:47.968330+0000","last_peered":"2024-09-12T02:59:47.968330+0000","last_clean":"2024-09-12T02:59:47.968330+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:47.968330+0000","last_undegraded":"2024-09-12T02:59:47.968330+0000","last_fullsized":"2024-09-12T02:59:47.968330+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.791761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:25.406226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974670+0000","last_change":"2024-09-12T02:59:30.045775+0000","last_active":"2024-09-12T02:59:47.974670+0000","last_peered":"2024-09-12T02:59:47.974670+0000","last_clean":"2024-09-12T02:59:47.974670+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:47.974670+0000","last_undegraded":"2024-09-12T02:59:47.974670+0000","last_fullsized":"2024-09-12T02:59:47.974670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.045690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:33.716096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.861935+0000","last_change":"2024-09-12T02:59:49.861935+0000","last_active":"2024-09-12T02:59:49.861935+0000","last_peered":"2024-09-12T02:59:49.861935+0000","last_clean":"2024-09-12T02:59:49.861935+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:49.861935+0000","last_undegraded":"2024-09-12T02:59:49.861935+0000","last_fullsized":"2024-09-12T02:59:49.861935+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.861705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:39.315077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975242+0000","last_change":"2024-09-12T02:59:40.118829+0000","last_active":"2024-09-12T02:59:47.975242+0000","last_peered":"2024-09-12T02:59:47.975242+0000","last_clean":"2024-09-12T02:59:47.975242+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:47.975242+0000","last_undegraded":"2024-09-12T02:59:47.975242+0000","last_fullsized":"2024-09-12T02:59:47.975242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.118699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:10.405280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970876+0000","last_change":"2024-09-12T02:59:47.676864+0000","last_active":"2024-09-12T02:59:47.970876+0000","last_peered":"2024-09-12T02:59:47.970876+0000","last_clean":"2024-09-12T02:59:47.970876+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:47.970876+0000","last_undegraded":"2024-09-12T02:59:47.970876+0000","last_fullsized":"2024-09-12T02:59:47.970876+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.676747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.675367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972045+0000","last_change":"2024-09-12T02:59:40.971763+0000","last_active":"2024-09-12T02:59:47.972045+0000","last_peered":"2024-09-12T02:59:47.972045+0000","last_clean":"2024-09-12T02:59:47.972045+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:47.972045+0000","last_undegraded":"2024-09-12T02:59:47.972045+0000","last_fullsized":"2024-09-12T02:59:47.972045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.971535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:04.999865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"79'119","reported_seq":299,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988085+0000","last_change":"2024-09-12T02:59:34.803297+0000","last_active":"2024-09-12T02:59:47.988085+0000","last_peered":"2024-09-12T02:59:47.988085+0000","last_clean":"2024-09-12T02:59:47.988085+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:47.988085+0000","last_undegraded":"2024-09-12T02:59:47.988085+0000","last_fullsized":"2024-09-12T02:59:47.988085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.802947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:59.161855+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986419+0000","last_change":"2024-09-12T02:59:42.682806+0000","last_active":"2024-09-12T02:59:47.986419+0000","last_peered":"2024-09-12T02:59:47.986419+0000","last_clean":"2024-09-12T02:59:47.986419+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:47.986419+0000","last_undegraded":"2024-09-12T02:59:47.986419+0000","last_fullsized":"2024-09-12T02:59:47.986419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.682574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:22.933579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968536+0000","last_change":"2024-09-12T02:59:35.830230+0000","last_active":"2024-09-12T02:59:47.968536+0000","last_peered":"2024-09-12T02:59:47.968536+0000","last_clean":"2024-09-12T02:59:47.968536+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:47.968536+0000","last_undegraded":"2024-09-12T02:59:47.968536+0000","last_fullsized":"2024-09-12T02:59:47.968536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.830121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.993178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972431+0000","last_change":"2024-09-12T02:59:35.842501+0000","last_active":"2024-09-12T02:59:47.972431+0000","last_peered":"2024-09-12T02:59:47.972431+0000","last_clean":"2024-09-12T02:59:47.972431+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:47.972431+0000","last_undegraded":"2024-09-12T02:59:47.972431+0000","last_fullsized":"2024-09-12T02:59:47.972431+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.842396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:47.840469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986324+0000","last_change":"2024-09-12T02:59:41.651678+0000","last_active":"2024-09-12T02:59:47.986324+0000","last_peered":"2024-09-12T02:59:47.986324+0000","last_clean":"2024-09-12T02:59:47.986324+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:47.986324+0000","last_undegraded":"2024-09-12T02:59:47.986324+0000","last_fullsized":"2024-09-12T02:59:47.986324+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.651443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:40.919631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973325+0000","last_change":"2024-09-12T02:59:34.986788+0000","last_active":"2024-09-12T02:59:47.973325+0000","last_peered":"2024-09-12T02:59:47.973325+0000","last_clean":"2024-09-12T02:59:47.973325+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:47.973325+0000","last_undegraded":"2024-09-12T02:59:47.973325+0000","last_fullsized":"2024-09-12T02:59:47.973325+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.986542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:35.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968801+0000","last_change":"2024-09-12T02:59:31.772320+0000","last_active":"2024-09-12T02:59:47.968801+0000","last_peered":"2024-09-12T02:59:47.968801+0000","last_clean":"2024-09-12T02:59:47.968801+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:47.968801+0000","last_undegraded":"2024-09-12T02:59:47.968801+0000","last_fullsized":"2024-09-12T02:59:47.968801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.772236+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:19.909174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975319+0000","last_change":"2024-09-12T02:59:43.053479+0000","last_active":"2024-09-12T02:59:47.975319+0000","last_peered":"2024-09-12T02:59:47.975319+0000","last_clean":"2024-09-12T02:59:47.975319+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:47.975319+0000","last_undegraded":"2024-09-12T02:59:47.975319+0000","last_fullsized":"2024-09-12T02:59:47.975319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.053377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:21.369077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989656+0000","last_change":"2024-09-12T02:59:46.862199+0000","last_active":"2024-09-12T02:59:47.989656+0000","last_peered":"2024-09-12T02:59:47.989656+0000","last_clean":"2024-09-12T02:59:47.989656+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:47.989656+0000","last_undegraded":"2024-09-12T02:59:47.989656+0000","last_fullsized":"2024-09-12T02:59:47.989656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.861972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:51.491507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'3","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972717+0000","last_change":"2024-09-12T02:59:30.860535+0000","last_active":"2024-09-12T02:59:47.972717+0000","last_peered":"2024-09-12T02:59:47.972717+0000","last_clean":"2024-09-12T02:59:47.972717+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:47.972717+0000","last_undegraded":"2024-09-12T02:59:47.972717+0000","last_fullsized":"2024-09-12T02:59:47.972717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.860444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:23.065975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.093595+0000","last_change":"2024-09-12T02:59:49.093650+0000","last_active":"2024-09-12T02:59:49.093595+0000","last_peered":"2024-09-12T02:59:49.093595+0000","last_clean":"2024-09-12T02:59:49.093595+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:49.093595+0000","last_undegraded":"2024-09-12T02:59:49.093595+0000","last_fullsized":"2024-09-12T02:59:49.093595+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.093403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.133030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989405+0000","last_change":"2024-09-12T02:59:44.860343+0000","last_active":"2024-09-12T02:59:47.989405+0000","last_peered":"2024-09-12T02:59:47.989405+0000","last_clean":"2024-09-12T02:59:47.989405+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:47.989405+0000","last_undegraded":"2024-09-12T02:59:47.989405+0000","last_fullsized":"2024-09-12T02:59:47.989405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.860002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:03.716731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975421+0000","last_change":"2024-09-12T02:59:31.636304+0000","last_active":"2024-09-12T02:59:47.975421+0000","last_peered":"2024-09-12T02:59:47.975421+0000","last_clean":"2024-09-12T02:59:47.975421+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:47.975421+0000","last_undegraded":"2024-09-12T02:59:47.975421+0000","last_fullsized":"2024-09-12T02:59:47.975421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.636071+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:48.966306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974472+0000","last_change":"2024-09-12T02:59:42.661415+0000","last_active":"2024-09-12T02:59:47.974472+0000","last_peered":"2024-09-12T02:59:47.974472+0000","last_clean":"2024-09-12T02:59:47.974472+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:47.974472+0000","last_undegraded":"2024-09-12T02:59:47.974472+0000","last_fullsized":"2024-09-12T02:59:47.974472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.661146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986300+0000","last_change":"2024-09-12T02:59:45.832208+0000","last_active":"2024-09-12T02:59:47.986300+0000","last_peered":"2024-09-12T02:59:47.986300+0000","last_clean":"2024-09-12T02:59:47.986300+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:47.986300+0000","last_undegraded":"2024-09-12T02:59:47.986300+0000","last_fullsized":"2024-09-12T02:59:47.986300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.831975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'12","reported_seq":184,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971562+0000","last_change":"2024-09-12T02:59:36.886312+0000","last_active":"2024-09-12T02:59:47.971562+0000","last_peered":"2024-09-12T02:59:47.971562+0000","last_clean":"2024-09-12T02:59:47.971562+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:47.971562+0000","last_undegraded":"2024-09-12T02:59:47.971562+0000","last_fullsized":"2024-09-12T02:59:47.971562+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.886179+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:45.626516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975159+0000","last_change":"2024-09-12T02:59:39.156656+0000","last_active":"2024-09-12T02:59:47.975159+0000","last_peered":"2024-09-12T02:59:47.975159+0000","last_clean":"2024-09-12T02:59:47.975159+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:47.975159+0000","last_undegraded":"2024-09-12T02:59:47.975159+0000","last_fullsized":"2024-09-12T02:59:47.975159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.156542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:34.954291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987400+0000","last_change":"2024-09-12T02:59:37.673643+0000","last_active":"2024-09-12T02:59:47.987400+0000","last_peered":"2024-09-12T02:59:47.987400+0000","last_clean":"2024-09-12T02:59:47.987400+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:47.987400+0000","last_undegraded":"2024-09-12T02:59:47.987400+0000","last_fullsized":"2024-09-12T02:59:47.987400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.673292+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.523545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988581+0000","last_change":"2024-09-12T02:59:33.671444+0000","last_active":"2024-09-12T02:59:47.988581+0000","last_peered":"2024-09-12T02:59:47.988581+0000","last_clean":"2024-09-12T02:59:47.988581+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:47.988581+0000","last_undegraded":"2024-09-12T02:59:47.988581+0000","last_fullsized":"2024-09-12T02:59:47.988581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.671212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:45.669284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972298+0000","last_change":"2024-09-12T02:59:34.590629+0000","last_active":"2024-09-12T02:59:47.972298+0000","last_peered":"2024-09-12T02:59:47.972298+0000","last_clean":"2024-09-12T02:59:47.972298+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:47.972298+0000","last_undegraded":"2024-09-12T02:59:47.972298+0000","last_fullsized":"2024-09-12T02:59:47.972298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.590531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.762881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988612+0000","last_change":"2024-09-12T02:59:43.837261+0000","last_active":"2024-09-12T02:59:47.988612+0000","last_peered":"2024-09-12T02:59:47.988612+0000","last_clean":"2024-09-12T02:59:47.988612+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:47.988612+0000","last_undegraded":"2024-09-12T02:59:47.988612+0000","last_fullsized":"2024-09-12T02:59:47.988612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.836980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.344004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970476+0000","last_change":"2024-09-12T02:59:45.048563+0000","last_active":"2024-09-12T02:59:47.970476+0000","last_peered":"2024-09-12T02:59:47.970476+0000","last_clean":"2024-09-12T02:59:47.970476+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:47.970476+0000","last_undegraded":"2024-09-12T02:59:47.970476+0000","last_fullsized":"2024-09-12T02:59:47.970476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.048315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:20.692033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.611665+0000","last_change":"2024-09-12T02:59:49.611694+0000","last_active":"2024-09-12T02:59:49.611665+0000","last_peered":"2024-09-12T02:59:49.611665+0000","last_clean":"2024-09-12T02:59:49.611665+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:49.611665+0000","last_undegraded":"2024-09-12T02:59:49.611665+0000","last_fullsized":"2024-09-12T02:59:49.611665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.611569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:05.308212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975259+0000","last_change":"2024-09-12T02:59:36.076892+0000","last_active":"2024-09-12T02:59:47.975259+0000","last_peered":"2024-09-12T02:59:47.975259+0000","last_clean":"2024-09-12T02:59:47.975259+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:47.975259+0000","last_undegraded":"2024-09-12T02:59:47.975259+0000","last_fullsized":"2024-09-12T02:59:47.975259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.076727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:26.666775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975590+0000","last_change":"2024-09-12T02:59:30.999792+0000","last_active":"2024-09-12T02:59:47.975590+0000","last_peered":"2024-09-12T02:59:47.975590+0000","last_clean":"2024-09-12T02:59:47.975590+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:47.975590+0000","last_undegraded":"2024-09-12T02:59:47.975590+0000","last_fullsized":"2024-09-12T02:59:47.975590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.999703+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:17.375066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973863+0000","last_change":"2024-09-12T02:59:34.015485+0000","last_active":"2024-09-12T02:59:47.973863+0000","last_peered":"2024-09-12T02:59:47.973863+0000","last_clean":"2024-09-12T02:59:47.973863+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:47.973863+0000","last_undegraded":"2024-09-12T02:59:47.973863+0000","last_fullsized":"2024-09-12T02:59:47.973863+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.015247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:05.065563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989055+0000","last_change":"2024-09-12T02:59:41.793529+0000","last_active":"2024-09-12T02:59:47.989055+0000","last_peered":"2024-09-12T02:59:47.989055+0000","last_clean":"2024-09-12T02:59:47.989055+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:47.989055+0000","last_undegraded":"2024-09-12T02:59:47.989055+0000","last_fullsized":"2024-09-12T02:59:47.989055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.793303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.839881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":167,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987810+0000","last_change":"2024-09-12T02:59:32.647074+0000","last_active":"2024-09-12T02:59:47.987810+0000","last_peered":"2024-09-12T02:59:47.987810+0000","last_clean":"2024-09-12T02:59:47.987810+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:47.987810+0000","last_undegraded":"2024-09-12T02:59:47.987810+0000","last_fullsized":"2024-09-12T02:59:47.987810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'28","last_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_deep_scrub":"79'28","last_deep_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.646844+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:46.886484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968042+0000","last_change":"2024-09-12T02:59:46.857630+0000","last_active":"2024-09-12T02:59:47.968042+0000","last_peered":"2024-09-12T02:59:47.968042+0000","last_clean":"2024-09-12T02:59:47.968042+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:47.968042+0000","last_undegraded":"2024-09-12T02:59:47.968042+0000","last_fullsized":"2024-09-12T02:59:47.968042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.857527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.845970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974062+0000","last_change":"2024-09-12T02:59:33.680657+0000","last_active":"2024-09-12T02:59:47.974062+0000","last_peered":"2024-09-12T02:59:47.974062+0000","last_clean":"2024-09-12T02:59:47.974062+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:47.974062+0000","last_undegraded":"2024-09-12T02:59:47.974062+0000","last_fullsized":"2024-09-12T02:59:47.974062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.680411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:15.802027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968679+0000","last_change":"2024-09-12T02:59:44.852192+0000","last_active":"2024-09-12T02:59:47.968679+0000","last_peered":"2024-09-12T02:59:47.968679+0000","last_clean":"2024-09-12T02:59:47.968679+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:47.968679+0000","last_undegraded":"2024-09-12T02:59:47.968679+0000","last_fullsized":"2024-09-12T02:59:47.968679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.852086+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.017309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":166,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971894+0000","last_change":"2024-09-12T02:59:45.664653+0000","last_active":"2024-09-12T02:59:47.971894+0000","last_peered":"2024-09-12T02:59:47.971894+0000","last_clean":"2024-09-12T02:59:47.971894+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:47.971894+0000","last_undegraded":"2024-09-12T02:59:47.971894+0000","last_fullsized":"2024-09-12T02:59:47.971894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.664314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.652758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975774+0000","last_change":"2024-09-12T02:59:45.129108+0000","last_active":"2024-09-12T02:59:47.975774+0000","last_peered":"2024-09-12T02:59:47.975774+0000","last_clean":"2024-09-12T02:59:47.975774+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:47.975774+0000","last_undegraded":"2024-09-12T02:59:47.975774+0000","last_fullsized":"2024-09-12T02:59:47.975774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.128965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.549002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973885+0000","last_change":"2024-09-12T02:59:37.986005+0000","last_active":"2024-09-12T02:59:47.973885+0000","last_peered":"2024-09-12T02:59:47.973885+0000","last_clean":"2024-09-12T02:59:47.973885+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:47.973885+0000","last_undegraded":"2024-09-12T02:59:47.973885+0000","last_fullsized":"2024-09-12T02:59:47.973885+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.985746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:14.181632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.639758+0000","last_change":"2024-09-12T02:59:51.639783+0000","last_active":"2024-09-12T02:59:51.639758+0000","last_peered":"2024-09-12T02:59:51.639758+0000","last_clean":"2024-09-12T02:59:51.639758+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:51.639758+0000","last_undegraded":"2024-09-12T02:59:51.639758+0000","last_fullsized":"2024-09-12T02:59:51.639758+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.639668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.759727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974029+0000","last_change":"2024-09-12T02:59:39.987993+0000","last_active":"2024-09-12T02:59:47.974029+0000","last_peered":"2024-09-12T02:59:47.974029+0000","last_clean":"2024-09-12T02:59:47.974029+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:47.974029+0000","last_undegraded":"2024-09-12T02:59:47.974029+0000","last_fullsized":"2024-09-12T02:59:47.974029+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.987743+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:04.424759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987757+0000","last_change":"2024-09-12T02:59:45.721685+0000","last_active":"2024-09-12T02:59:47.987757+0000","last_peered":"2024-09-12T02:59:47.987757+0000","last_clean":"2024-09-12T02:59:47.987757+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:47.987757+0000","last_undegraded":"2024-09-12T02:59:47.987757+0000","last_fullsized":"2024-09-12T02:59:47.987757+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.721444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.143614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970794+0000","last_change":"2024-09-12T02:59:46.669010+0000","last_active":"2024-09-12T02:59:47.970794+0000","last_peered":"2024-09-12T02:59:47.970794+0000","last_clean":"2024-09-12T02:59:47.970794+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:47.970794+0000","last_undegraded":"2024-09-12T02:59:47.970794+0000","last_fullsized":"2024-09-12T02:59:47.970794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.668894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:22.826170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975134+0000","last_change":"2024-09-12T02:59:41.077595+0000","last_active":"2024-09-12T02:59:47.975134+0000","last_peered":"2024-09-12T02:59:47.975134+0000","last_clean":"2024-09-12T02:59:47.975134+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:47.975134+0000","last_undegraded":"2024-09-12T02:59:47.975134+0000","last_fullsized":"2024-09-12T02:59:47.975134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.077484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:52.294457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967726+0000","last_change":"2024-09-12T02:59:41.841470+0000","last_active":"2024-09-12T02:59:47.967726+0000","last_peered":"2024-09-12T02:59:47.967726+0000","last_clean":"2024-09-12T02:59:47.967726+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:47.967726+0000","last_undegraded":"2024-09-12T02:59:47.967726+0000","last_fullsized":"2024-09-12T02:59:47.967726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.841333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.069789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":61,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.131581+0000","last_change":"2024-09-12T02:59:51.131633+0000","last_active":"2024-09-12T02:59:51.131581+0000","last_peered":"2024-09-12T02:59:51.131581+0000","last_clean":"2024-09-12T02:59:51.131581+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:51.131581+0000","last_undegraded":"2024-09-12T02:59:51.131581+0000","last_fullsized":"2024-09-12T02:59:51.131581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.131397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:19.953861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987223+0000","last_change":"2024-09-12T02:59:46.767895+0000","last_active":"2024-09-12T02:59:47.987223+0000","last_peered":"2024-09-12T02:59:47.987223+0000","last_clean":"2024-09-12T02:59:47.987223+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:47.987223+0000","last_undegraded":"2024-09-12T02:59:47.987223+0000","last_fullsized":"2024-09-12T02:59:47.987223+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.767560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.939911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971399+0000","last_change":"2024-09-12T02:59:39.674943+0000","last_active":"2024-09-12T02:59:47.971399+0000","last_peered":"2024-09-12T02:59:47.971399+0000","last_clean":"2024-09-12T02:59:47.971399+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:47.971399+0000","last_undegraded":"2024-09-12T02:59:47.971399+0000","last_fullsized":"2024-09-12T02:59:47.971399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.674831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:28.379028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970981+0000","last_change":"2024-09-12T02:59:37.660153+0000","last_active":"2024-09-12T02:59:47.970981+0000","last_peered":"2024-09-12T02:59:47.970981+0000","last_clean":"2024-09-12T02:59:47.970981+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:47.970981+0000","last_undegraded":"2024-09-12T02:59:47.970981+0000","last_fullsized":"2024-09-12T02:59:47.970981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.660048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:32.261376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987111+0000","last_change":"2024-09-12T02:59:34.716068+0000","last_active":"2024-09-12T02:59:47.987111+0000","last_peered":"2024-09-12T02:59:47.987111+0000","last_clean":"2024-09-12T02:59:47.987111+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:47.987111+0000","last_undegraded":"2024-09-12T02:59:47.987111+0000","last_fullsized":"2024-09-12T02:59:47.987111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.715793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:43.456130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975476+0000","last_change":"2024-09-12T02:59:38.162584+0000","last_active":"2024-09-12T02:59:47.975476+0000","last_peered":"2024-09-12T02:59:47.975476+0000","last_clean":"2024-09-12T02:59:47.975476+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:47.975476+0000","last_undegraded":"2024-09-12T02:59:47.975476+0000","last_fullsized":"2024-09-12T02:59:47.975476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.162461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:51.207333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972265+0000","last_change":"2024-09-12T02:59:34.845414+0000","last_active":"2024-09-12T02:59:47.972265+0000","last_peered":"2024-09-12T02:59:47.972265+0000","last_clean":"2024-09-12T02:59:47.972265+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:47.972265+0000","last_undegraded":"2024-09-12T02:59:47.972265+0000","last_fullsized":"2024-09-12T02:59:47.972265+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.845313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:49.084952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971084+0000","last_change":"2024-09-12T02:59:38.676599+0000","last_active":"2024-09-12T02:59:47.971084+0000","last_peered":"2024-09-12T02:59:47.971084+0000","last_clean":"2024-09-12T02:59:47.971084+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:47.971084+0000","last_undegraded":"2024-09-12T02:59:47.971084+0000","last_fullsized":"2024-09-12T02:59:47.971084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.676453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:08.813287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971443+0000","last_change":"2024-09-12T02:59:32.676152+0000","last_active":"2024-09-12T02:59:47.971443+0000","last_peered":"2024-09-12T02:59:47.971443+0000","last_clean":"2024-09-12T02:59:47.971443+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:47.971443+0000","last_undegraded":"2024-09-12T02:59:47.971443+0000","last_fullsized":"2024-09-12T02:59:47.971443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.675897+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971857+0000","last_change":"2024-09-12T02:59:32.600836+0000","last_active":"2024-09-12T02:59:47.971857+0000","last_peered":"2024-09-12T02:59:47.971857+0000","last_clean":"2024-09-12T02:59:47.971857+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:47.971857+0000","last_undegraded":"2024-09-12T02:59:47.971857+0000","last_fullsized":"2024-09-12T02:59:47.971857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.600751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:36.409439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986975+0000","last_change":"2024-09-12T02:59:36.720562+0000","last_active":"2024-09-12T02:59:47.986975+0000","last_peered":"2024-09-12T02:59:47.986975+0000","last_clean":"2024-09-12T02:59:47.986975+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:47.986975+0000","last_undegraded":"2024-09-12T02:59:47.986975+0000","last_fullsized":"2024-09-12T02:59:47.986975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.720181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.336802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971697+0000","last_change":"2024-09-12T02:59:33.813763+0000","last_active":"2024-09-12T02:59:47.971697+0000","last_peered":"2024-09-12T02:59:47.971697+0000","last_clean":"2024-09-12T02:59:47.971697+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:47.971697+0000","last_undegraded":"2024-09-12T02:59:47.971697+0000","last_fullsized":"2024-09-12T02:59:47.971697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.813677+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:54.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971306+0000","last_change":"2024-09-12T02:59:43.020950+0000","last_active":"2024-09-12T02:59:47.971306+0000","last_peered":"2024-09-12T02:59:47.971306+0000","last_clean":"2024-09-12T02:59:47.971306+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:47.971306+0000","last_undegraded":"2024-09-12T02:59:47.971306+0000","last_fullsized":"2024-09-12T02:59:47.971306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.020633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:20.020956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975501+0000","last_change":"2024-09-12T02:59:35.065915+0000","last_active":"2024-09-12T02:59:47.975501+0000","last_peered":"2024-09-12T02:59:47.975501+0000","last_clean":"2024-09-12T02:59:47.975501+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:47.975501+0000","last_undegraded":"2024-09-12T02:59:47.975501+0000","last_fullsized":"2024-09-12T02:59:47.975501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.065802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:51.998513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971305+0000","last_change":"2024-09-12T02:59:33.570266+0000","last_active":"2024-09-12T02:59:47.971305+0000","last_peered":"2024-09-12T02:59:47.971305+0000","last_clean":"2024-09-12T02:59:47.971305+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:47.971305+0000","last_undegraded":"2024-09-12T02:59:47.971305+0000","last_fullsized":"2024-09-12T02:59:47.971305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.570177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:57.992347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968334+0000","last_change":"2024-09-12T02:59:30.749318+0000","last_active":"2024-09-12T02:59:47.968334+0000","last_peered":"2024-09-12T02:59:47.968334+0000","last_clean":"2024-09-12T02:59:47.968334+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:47.968334+0000","last_undegraded":"2024-09-12T02:59:47.968334+0000","last_fullsized":"2024-09-12T02:59:47.968334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.749228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:31.541524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987453+0000","last_change":"2024-09-12T02:59:38.651039+0000","last_active":"2024-09-12T02:59:47.987453+0000","last_peered":"2024-09-12T02:59:47.987453+0000","last_clean":"2024-09-12T02:59:47.987453+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:47.987453+0000","last_undegraded":"2024-09-12T02:59:47.987453+0000","last_fullsized":"2024-09-12T02:59:47.987453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.650631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.137855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972409+0000","last_change":"2024-09-12T02:59:42.663691+0000","last_active":"2024-09-12T02:59:47.972409+0000","last_peered":"2024-09-12T02:59:47.972409+0000","last_clean":"2024-09-12T02:59:47.972409+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:47.972409+0000","last_undegraded":"2024-09-12T02:59:47.972409+0000","last_fullsized":"2024-09-12T02:59:47.972409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.663586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:23.083624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.118661+0000","last_change":"2024-09-12T02:59:50.118766+0000","last_active":"2024-09-12T02:59:50.118661+0000","last_peered":"2024-09-12T02:59:50.118661+0000","last_clean":"2024-09-12T02:59:50.118661+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:50.118661+0000","last_undegraded":"2024-09-12T02:59:50.118661+0000","last_fullsized":"2024-09-12T02:59:50.118661+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.118459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:39.693765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970603+0000","last_change":"2024-09-12T02:59:31.642639+0000","last_active":"2024-09-12T02:59:47.970603+0000","last_peered":"2024-09-12T02:59:47.970603+0000","last_clean":"2024-09-12T02:59:47.970603+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:47.970603+0000","last_undegraded":"2024-09-12T02:59:47.970603+0000","last_fullsized":"2024-09-12T02:59:47.970603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.642539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:45.910007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970879+0000","last_change":"2024-09-12T02:59:42.020010+0000","last_active":"2024-09-12T02:59:47.970879+0000","last_peered":"2024-09-12T02:59:47.970879+0000","last_clean":"2024-09-12T02:59:47.970879+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:47.970879+0000","last_undegraded":"2024-09-12T02:59:47.970879+0000","last_fullsized":"2024-09-12T02:59:47.970879+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.019770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:02.627789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975198+0000","last_change":"2024-09-12T02:59:37.126601+0000","last_active":"2024-09-12T02:59:47.975198+0000","last_peered":"2024-09-12T02:59:47.975198+0000","last_clean":"2024-09-12T02:59:47.975198+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:47.975198+0000","last_undegraded":"2024-09-12T02:59:47.975198+0000","last_fullsized":"2024-09-12T02:59:47.975198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.126497+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:41.431052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987704+0000","last_change":"2024-09-12T02:59:40.644873+0000","last_active":"2024-09-12T02:59:47.987704+0000","last_peered":"2024-09-12T02:59:47.987704+0000","last_clean":"2024-09-12T02:59:47.987704+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:47.987704+0000","last_undegraded":"2024-09-12T02:59:47.987704+0000","last_fullsized":"2024-09-12T02:59:47.987704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.644626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:27.019990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989535+0000","last_change":"2024-09-12T02:59:42.787927+0000","last_active":"2024-09-12T02:59:47.989535+0000","last_peered":"2024-09-12T02:59:47.989535+0000","last_clean":"2024-09-12T02:59:47.989535+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:47.989535+0000","last_undegraded":"2024-09-12T02:59:47.989535+0000","last_fullsized":"2024-09-12T02:59:47.989535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.787542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.015998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972705+0000","last_change":"2024-09-12T02:59:32.823831+0000","last_active":"2024-09-12T02:59:47.972705+0000","last_peered":"2024-09-12T02:59:47.972705+0000","last_clean":"2024-09-12T02:59:47.972705+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:47.972705+0000","last_undegraded":"2024-09-12T02:59:47.972705+0000","last_fullsized":"2024-09-12T02:59:47.972705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.823742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:34.576078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974455+0000","last_change":"2024-09-12T02:59:47.049456+0000","last_active":"2024-09-12T02:59:47.974455+0000","last_peered":"2024-09-12T02:59:47.974455+0000","last_clean":"2024-09-12T02:59:47.974455+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:47.974455+0000","last_undegraded":"2024-09-12T02:59:47.974455+0000","last_fullsized":"2024-09-12T02:59:47.974455+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.049206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:32.900134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971264+0000","last_change":"2024-09-12T02:59:37.007470+0000","last_active":"2024-09-12T02:59:47.971264+0000","last_peered":"2024-09-12T02:59:47.971264+0000","last_clean":"2024-09-12T02:59:47.971264+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:47.971264+0000","last_undegraded":"2024-09-12T02:59:47.971264+0000","last_fullsized":"2024-09-12T02:59:47.971264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.007224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:18.542924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967806+0000","last_change":"2024-09-12T02:59:40.838979+0000","last_active":"2024-09-12T02:59:47.967806+0000","last_peered":"2024-09-12T02:59:47.967806+0000","last_clean":"2024-09-12T02:59:47.967806+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:47.967806+0000","last_undegraded":"2024-09-12T02:59:47.967806+0000","last_fullsized":"2024-09-12T02:59:47.967806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.838843+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:09.885421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975113+0000","last_change":"2024-09-12T02:59:34.019995+0000","last_active":"2024-09-12T02:59:47.975113+0000","last_peered":"2024-09-12T02:59:47.975113+0000","last_clean":"2024-09-12T02:59:47.975113+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:47.975113+0000","last_undegraded":"2024-09-12T02:59:47.975113+0000","last_fullsized":"2024-09-12T02:59:47.975113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.019910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.828598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970779+0000","last_change":"2024-09-12T02:59:35.597391+0000","last_active":"2024-09-12T02:59:47.970779+0000","last_peered":"2024-09-12T02:59:47.970779+0000","last_clean":"2024-09-12T02:59:47.970779+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:47.970779+0000","last_undegraded":"2024-09-12T02:59:47.970779+0000","last_fullsized":"2024-09-12T02:59:47.970779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.597291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:38.185412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973797+0000","last_change":"2024-09-12T02:59:36.682299+0000","last_active":"2024-09-12T02:59:47.973797+0000","last_peered":"2024-09-12T02:59:47.973797+0000","last_clean":"2024-09-12T02:59:47.973797+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:47.973797+0000","last_undegraded":"2024-09-12T02:59:47.973797+0000","last_fullsized":"2024-09-12T02:59:47.973797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.682064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:10.673981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986906+0000","last_change":"2024-09-12T02:59:44.683736+0000","last_active":"2024-09-12T02:59:47.986906+0000","last_peered":"2024-09-12T02:59:47.986906+0000","last_clean":"2024-09-12T02:59:47.986906+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:47.986906+0000","last_undegraded":"2024-09-12T02:59:47.986906+0000","last_fullsized":"2024-09-12T02:59:47.986906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.683432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.492120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987167+0000","last_change":"2024-09-12T02:59:43.695797+0000","last_active":"2024-09-12T02:59:47.987167+0000","last_peered":"2024-09-12T02:59:47.987167+0000","last_clean":"2024-09-12T02:59:47.987167+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:47.987167+0000","last_undegraded":"2024-09-12T02:59:47.987167+0000","last_fullsized":"2024-09-12T02:59:47.987167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'16","last_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_deep_scrub":"79'16","last_deep_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.695424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:57.962892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.814119+0000","last_change":"2024-09-12T02:59:48.814183+0000","last_active":"2024-09-12T02:59:48.814119+0000","last_peered":"2024-09-12T02:59:48.814119+0000","last_clean":"2024-09-12T02:59:48.814119+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:48.814119+0000","last_undegraded":"2024-09-12T02:59:48.814119+0000","last_fullsized":"2024-09-12T02:59:48.814119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.813942+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:41.235405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.652380+0000","last_change":"2024-09-12T02:59:48.652404+0000","last_active":"2024-09-12T02:59:48.652380+0000","last_peered":"2024-09-12T02:59:48.652380+0000","last_clean":"2024-09-12T02:59:48.652380+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:48.652380+0000","last_undegraded":"2024-09-12T02:59:48.652380+0000","last_fullsized":"2024-09-12T02:59:48.652380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.652295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:24.469845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986239+0000","last_change":"2024-09-12T02:59:40.773384+0000","last_active":"2024-09-12T02:59:47.986239+0000","last_peered":"2024-09-12T02:59:47.986239+0000","last_clean":"2024-09-12T02:59:47.986239+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:47.986239+0000","last_undegraded":"2024-09-12T02:59:47.986239+0000","last_fullsized":"2024-09-12T02:59:47.986239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.773129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.980310+0000","last_change":"2024-09-12T02:59:47.977081+0000","last_active":"2024-09-12T02:59:47.980310+0000","last_peered":"2024-09-12T02:59:47.980310+0000","last_clean":"2024-09-12T02:59:47.980310+0000","last_became_active":"2024-09-12T02:59:47.976687+0000","last_became_peered":"2024-09-12T02:59:47.976687+0000","last_unstale":"2024-09-12T02:59:47.980310+0000","last_undegraded":"2024-09-12T02:59:47.980310+0000","last_fullsized":"2024-09-12T02:59:47.980310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988297+0000","last_change":"2024-09-12T02:59:39.769618+0000","last_active":"2024-09-12T02:59:47.988297+0000","last_peered":"2024-09-12T02:59:47.988297+0000","last_clean":"2024-09-12T02:59:47.988297+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:47.988297+0000","last_undegraded":"2024-09-12T02:59:47.988297+0000","last_fullsized":"2024-09-12T02:59:47.988297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.769355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:44.299798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973139+0000","last_change":"2024-09-12T02:59:46.045977+0000","last_active":"2024-09-12T02:59:47.973139+0000","last_peered":"2024-09-12T02:59:47.973139+0000","last_clean":"2024-09-12T02:59:47.973139+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:47.973139+0000","last_undegraded":"2024-09-12T02:59:47.973139+0000","last_fullsized":"2024-09-12T02:59:47.973139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.045725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:00.846357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974947+0000","last_change":"2024-09-12T02:59:33.045189+0000","last_active":"2024-09-12T02:59:47.974947+0000","last_peered":"2024-09-12T02:59:47.974947+0000","last_clean":"2024-09-12T02:59:47.974947+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:47.974947+0000","last_undegraded":"2024-09-12T02:59:47.974947+0000","last_fullsized":"2024-09-12T02:59:47.974947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.045042+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:47.312510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969223+0000","last_change":"2024-09-12T02:59:38.788525+0000","last_active":"2024-09-12T02:59:47.969223+0000","last_peered":"2024-09-12T02:59:47.969223+0000","last_clean":"2024-09-12T02:59:47.969223+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:47.969223+0000","last_undegraded":"2024-09-12T02:59:47.969223+0000","last_fullsized":"2024-09-12T02:59:47.969223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.788431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:20.633132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988967+0000","last_change":"2024-09-12T02:59:33.741380+0000","last_active":"2024-09-12T02:59:47.988967+0000","last_peered":"2024-09-12T02:59:47.988967+0000","last_clean":"2024-09-12T02:59:47.988967+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:47.988967+0000","last_undegraded":"2024-09-12T02:59:47.988967+0000","last_fullsized":"2024-09-12T02:59:47.988967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.741253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:51.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":530298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1552384,"data_stored":1083143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542202,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1544192,"data_stored":1083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":995328,"data_stored":529987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906971,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":928,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":950272,"data_stored":492227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":492263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":492297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:01:15.613 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T03:01:15.613 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T03:01:34.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:01:34.064 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:01:35.614 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:01:35.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f2451c00640 1 Processor -- start 2024-09-12T03:01:35.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f2451c00640 1 -- start start 2024-09-12T03:01:35.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f2451c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f244c151a80 0x7f244c072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:35.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f2451c00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f244c074070 0x7f244c073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:35.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f2451c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f244c1580c0 con 0x7f244c0c2380 2024-09-12T03:01:35.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f2451c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f244c0c8500 con 0x7f244c151a80 2024-09-12T03:01:35.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f2451c00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f244c1583a0 con 0x7f244c074070 2024-09-12T03:01:35.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f244aa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f244c151a80 0x7f244c072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:35.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f244aa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f244c151a80 0x7f244c072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36666/0 (socket says 172.21.15.63:36666) 2024-09-12T03:01:35.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f244aa00640 1 -- 172.21.15.63:0/2321498083 learned_addr learned my addr 172.21.15.63:0/2321498083 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:01:35.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f2443e00640 1 --2- 172.21.15.63:0/2321498083 >> v2:172.21.15.119:3300/0 conn(0x7f244c074070 0x7f244c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:35.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f244aa00640 1 -- 172.21.15.63:0/2321498083 >> v2:172.21.15.119:3300/0 conn(0x7f244c074070 msgr2=0x7f244c073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:35.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f244aa00640 1 --2- 172.21.15.63:0/2321498083 >> v2:172.21.15.119:3300/0 conn(0x7f244c074070 0x7f244c073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f244aa00640 1 -- 172.21.15.63:0/2321498083 >> v1:172.21.15.63:6789/0 conn(0x7f244c0c2380 legacy=0x7f244c0c2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:35.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f244aa00640 1 -- 172.21.15.63:0/2321498083 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244c0cbf00 con 0x7f244c151a80 2024-09-12T03:01:35.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.767+0000 7f2443e00640 1 --2- 172.21.15.63:0/2321498083 >> v2:172.21.15.119:3300/0 conn(0x7f244c074070 0x7f244c073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:01:35.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f244aa00640 1 --2- 172.21.15.63:0/2321498083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c151a80 0x7f244c072e50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f244c155160 tx=0x7f243c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464814fdb3951877 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:35.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f244a000640 1 -- 172.21.15.63:0/2321498083 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0b5070 con 0x7f244c151a80 2024-09-12T03:01:35.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f244a000640 1 -- 172.21.15.63:0/2321498083 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c0a8a10 con 0x7f244c151a80 2024-09-12T03:01:35.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f244a000640 1 -- 172.21.15.63:0/2321498083 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0a8de0 con 0x7f244c151a80 2024-09-12T03:01:35.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f2451c00640 1 -- 172.21.15.63:0/2321498083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c151a80 msgr2=0x7f244c072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:35.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f2451c00640 1 --2- 172.21.15.63:0/2321498083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c151a80 0x7f244c072e50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f244c155160 tx=0x7f243c01ed10 comp rx=0 tx=0).stop 2024-09-12T03:01:35.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f2451c00640 1 -- 172.21.15.63:0/2321498083 shutdown_connections 2024-09-12T03:01:35.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f2451c00640 1 --2- 172.21.15.63:0/2321498083 >> v2:172.21.15.119:3300/0 conn(0x7f244c074070 0x7f244c073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f2451c00640 1 --2- 172.21.15.63:0/2321498083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c151a80 0x7f244c072e50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f2451c00640 1 -- 172.21.15.63:0/2321498083 >> 172.21.15.63:0/2321498083 conn(0x7f244c06f3d0 msgr2=0x7f244c06f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:35.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f2451c00640 1 -- 172.21.15.63:0/2321498083 shutdown_connections 2024-09-12T03:01:35.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.771+0000 7f2451c00640 1 -- 172.21.15.63:0/2321498083 wait complete. 2024-09-12T03:01:35.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 Processor -- start 2024-09-12T03:01:35.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 -- start start 2024-09-12T03:01:35.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f244c074070 0x7f244c0c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:35.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c0c2380 0x7f244c0c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f244c151a80 0x7f244c13fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f244c0c81f0 con 0x7f244c0c2380 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f244c0cc4c0 con 0x7f244c151a80 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f244c0c7cf0 con 0x7f244c074070 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2443e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c0c2380 0x7f244c0c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2443e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c0c2380 0x7f244c0c2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36674/0 (socket says 172.21.15.63:36674) 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2443e00640 1 -- 172.21.15.63:0/863057527 learned_addr learned my addr 172.21.15.63:0/863057527 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f244b400640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f244c151a80 0x7f244c13fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f244aa00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f244c074070 0x7f244c0c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2443e00640 1 -- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f244c074070 msgr2=0x7f244c0c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:35.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2443e00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f244c074070 0x7f244c0c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2443e00640 1 -- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f244c151a80 msgr2=0x7f244c13fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:35.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2443e00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f244c151a80 0x7f244c13fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2443e00640 1 -- 172.21.15.63:0/863057527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244c0c4dd0 con 0x7f244c0c2380 2024-09-12T03:01:35.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2443e00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c0c2380 0x7f244c0c2a50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f243400e810 tx=0x7f243400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:35.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2442a00640 1 -- 172.21.15.63:0/863057527 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434017070 con 0x7f244c0c2380 2024-09-12T03:01:35.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2442a00640 1 -- 172.21.15.63:0/863057527 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243400c8d0 con 0x7f244c0c2380 2024-09-12T03:01:35.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2442a00640 1 -- 172.21.15.63:0/863057527 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243400f040 con 0x7f244c0c2380 2024-09-12T03:01:35.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244c13f000 con 0x7f244c0c2380 2024-09-12T03:01:35.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.775+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f244c13f5c0 con 0x7f244c0c2380 2024-09-12T03:01:35.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.779+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f244c06fef0 con 0x7f244c0c2380 2024-09-12T03:01:35.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.779+0000 7f2442a00640 1 -- 172.21.15.63:0/863057527 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f243401a070 con 0x7f244c0c2380 2024-09-12T03:01:35.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.779+0000 7f2442a00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f24280678c0 0x7f2428069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:35.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.779+0000 7f2442a00640 1 -- 172.21.15.63:0/863057527 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f2434085ca0 con 0x7f244c0c2380 2024-09-12T03:01:35.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.779+0000 7f244aa00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f24280678c0 0x7f2428069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:35.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.779+0000 7f244aa00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f24280678c0 0x7f2428069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f243c0b2000 tx=0x7f243c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:35.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.783+0000 7f2442a00640 1 -- 172.21.15.63:0/863057527 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f24340563b0 con 0x7f244c0c2380 2024-09-12T03:01:35.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.947+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f244c14ed40 con 0x7f24280678c0 2024-09-12T03:01:35.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.971+0000 7f2442a00640 1 -- 172.21.15.63:0/863057527 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332999 (secure 0 0 0) 0x7f244c14ed40 con 0x7f24280678c0 2024-09-12T03:01:35.976 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:01:35.978 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T03:01:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f24280678c0 msgr2=0x7f2428069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f24280678c0 0x7f2428069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f243c0b2000 tx=0x7f243c008040 comp rx=0 tx=0).stop 2024-09-12T03:01:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c0c2380 msgr2=0x7f244c0c2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:35.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c0c2380 0x7f244c0c2a50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f243400e810 tx=0x7f243400ecd0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 shutdown_connections 2024-09-12T03:01:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f244c151a80 0x7f244c13fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f244c0c2380 0x7f244c0c2a50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f24280678c0 0x7f2428069d80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 --2- 172.21.15.63:0/863057527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f244c074070 0x7f244c0c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 >> 172.21.15.63:0/863057527 conn(0x7f244c06f3d0 msgr2=0x7f244c150230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 shutdown_connections 2024-09-12T03:01:35.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:35.975+0000 7f2451c00640 1 -- 172.21.15.63:0/863057527 wait complete. 2024-09-12T03:01:35.996 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-09-12T03:01:35.854249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238480,"kb_used_data":8696,"kb_used_omap":15,"kb_used_meta":229616,"kb_avail":754736240,"statfs":{"total":773094113280,"available":772849909760,"internally_reserved":0,"allocated":8904704,"data_stored":5195750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":235127470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005693"},"pg_stats":[{"pgid":"2.1f","version":"79'6","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975859+0000","last_change":"2024-09-12T02:59:32.000879+0000","last_active":"2024-09-12T02:59:47.975859+0000","last_peered":"2024-09-12T02:59:47.975859+0000","last_clean":"2024-09-12T02:59:47.975859+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:47.975859+0000","last_undegraded":"2024-09-12T02:59:47.975859+0000","last_fullsized":"2024-09-12T02:59:47.975859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.000756+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.073437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971629+0000","last_change":"2024-09-12T02:59:43.632597+0000","last_active":"2024-09-12T02:59:47.971629+0000","last_peered":"2024-09-12T02:59:47.971629+0000","last_clean":"2024-09-12T02:59:47.971629+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:47.971629+0000","last_undegraded":"2024-09-12T02:59:47.971629+0000","last_fullsized":"2024-09-12T02:59:47.971629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.632456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:01.396201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970626+0000","last_change":"2024-09-12T02:59:45.690062+0000","last_active":"2024-09-12T02:59:47.970626+0000","last_peered":"2024-09-12T02:59:47.970626+0000","last_clean":"2024-09-12T02:59:47.970626+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:47.970626+0000","last_undegraded":"2024-09-12T02:59:47.970626+0000","last_fullsized":"2024-09-12T02:59:47.970626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.689949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:02.009111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971812+0000","last_change":"2024-09-12T02:59:36.630496+0000","last_active":"2024-09-12T02:59:47.971812+0000","last_peered":"2024-09-12T02:59:47.971812+0000","last_clean":"2024-09-12T02:59:47.971812+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:47.971812+0000","last_undegraded":"2024-09-12T02:59:47.971812+0000","last_fullsized":"2024-09-12T02:59:47.971812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.630383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:49.675255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975738+0000","last_change":"2024-09-12T02:59:44.081098+0000","last_active":"2024-09-12T02:59:47.975738+0000","last_peered":"2024-09-12T02:59:47.975738+0000","last_clean":"2024-09-12T02:59:47.975738+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:47.975738+0000","last_undegraded":"2024-09-12T02:59:47.975738+0000","last_fullsized":"2024-09-12T02:59:47.975738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.080989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:55.266943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970430+0000","last_change":"2024-09-12T02:59:41.662320+0000","last_active":"2024-09-12T02:59:47.970430+0000","last_peered":"2024-09-12T02:59:47.970430+0000","last_clean":"2024-09-12T02:59:47.970430+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:47.970430+0000","last_undegraded":"2024-09-12T02:59:47.970430+0000","last_fullsized":"2024-09-12T02:59:47.970430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.662088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:28.169111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989531+0000","last_change":"2024-09-12T02:59:37.757533+0000","last_active":"2024-09-12T02:59:47.989531+0000","last_peered":"2024-09-12T02:59:47.989531+0000","last_clean":"2024-09-12T02:59:47.989531+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:47.989531+0000","last_undegraded":"2024-09-12T02:59:47.989531+0000","last_fullsized":"2024-09-12T02:59:47.989531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.757250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:10.370609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972898+0000","last_change":"2024-09-12T02:59:35.959195+0000","last_active":"2024-09-12T02:59:47.972898+0000","last_peered":"2024-09-12T02:59:47.972898+0000","last_clean":"2024-09-12T02:59:47.972898+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:47.972898+0000","last_undegraded":"2024-09-12T02:59:47.972898+0000","last_fullsized":"2024-09-12T02:59:47.972898+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.958975+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.932192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972153+0000","last_change":"2024-09-12T02:59:43.619841+0000","last_active":"2024-09-12T02:59:47.972153+0000","last_peered":"2024-09-12T02:59:47.972153+0000","last_clean":"2024-09-12T02:59:47.972153+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:47.972153+0000","last_undegraded":"2024-09-12T02:59:47.972153+0000","last_fullsized":"2024-09-12T02:59:47.972153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.619594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:49.784818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'3","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989105+0000","last_change":"2024-09-12T02:59:47.847154+0000","last_active":"2024-09-12T02:59:47.989105+0000","last_peered":"2024-09-12T02:59:47.989105+0000","last_clean":"2024-09-12T02:59:47.989105+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:47.989105+0000","last_undegraded":"2024-09-12T02:59:47.989105+0000","last_fullsized":"2024-09-12T02:59:47.989105+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.846797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.835241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973874+0000","last_change":"2024-09-12T02:59:44.041049+0000","last_active":"2024-09-12T02:59:47.973874+0000","last_peered":"2024-09-12T02:59:47.973874+0000","last_clean":"2024-09-12T02:59:47.973874+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:47.973874+0000","last_undegraded":"2024-09-12T02:59:47.973874+0000","last_fullsized":"2024-09-12T02:59:47.973874+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.040815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.885096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970873+0000","last_change":"2024-09-12T02:59:40.700614+0000","last_active":"2024-09-12T02:59:47.970873+0000","last_peered":"2024-09-12T02:59:47.970873+0000","last_clean":"2024-09-12T02:59:47.970873+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:47.970873+0000","last_undegraded":"2024-09-12T02:59:47.970873+0000","last_fullsized":"2024-09-12T02:59:47.970873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.700368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:48.928824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986772+0000","last_change":"2024-09-12T02:59:39.629343+0000","last_active":"2024-09-12T02:59:47.986772+0000","last_peered":"2024-09-12T02:59:47.986772+0000","last_clean":"2024-09-12T02:59:47.986772+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:47.986772+0000","last_undegraded":"2024-09-12T02:59:47.986772+0000","last_fullsized":"2024-09-12T02:59:47.986772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.629058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:43.299464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988945+0000","last_change":"2024-09-12T02:59:36.789441+0000","last_active":"2024-09-12T02:59:47.988945+0000","last_peered":"2024-09-12T02:59:47.988945+0000","last_clean":"2024-09-12T02:59:47.988945+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:47.988945+0000","last_undegraded":"2024-09-12T02:59:47.988945+0000","last_fullsized":"2024-09-12T02:59:47.988945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.789151+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:41.135081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974912+0000","last_change":"2024-09-12T02:59:37.711523+0000","last_active":"2024-09-12T02:59:47.974912+0000","last_peered":"2024-09-12T02:59:47.974912+0000","last_clean":"2024-09-12T02:59:47.974912+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:47.974912+0000","last_undegraded":"2024-09-12T02:59:47.974912+0000","last_fullsized":"2024-09-12T02:59:47.974912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.711188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.241632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971004+0000","last_change":"2024-09-12T02:59:40.677307+0000","last_active":"2024-09-12T02:59:47.971004+0000","last_peered":"2024-09-12T02:59:47.971004+0000","last_clean":"2024-09-12T02:59:47.971004+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:47.971004+0000","last_undegraded":"2024-09-12T02:59:47.971004+0000","last_fullsized":"2024-09-12T02:59:47.971004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.677196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:18.992896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967822+0000","last_change":"2024-09-12T02:59:42.816275+0000","last_active":"2024-09-12T02:59:47.967822+0000","last_peered":"2024-09-12T02:59:47.967822+0000","last_clean":"2024-09-12T02:59:47.967822+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:47.967822+0000","last_undegraded":"2024-09-12T02:59:47.967822+0000","last_fullsized":"2024-09-12T02:59:47.967822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.816152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:29.323176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973221+0000","last_change":"2024-09-12T02:59:38.719352+0000","last_active":"2024-09-12T02:59:47.973221+0000","last_peered":"2024-09-12T02:59:47.973221+0000","last_clean":"2024-09-12T02:59:47.973221+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:47.973221+0000","last_undegraded":"2024-09-12T02:59:47.973221+0000","last_fullsized":"2024-09-12T02:59:47.973221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.719131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.333596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.642733+0000","last_change":"2024-09-12T02:59:50.642733+0000","last_active":"2024-09-12T02:59:50.642733+0000","last_peered":"2024-09-12T02:59:50.642733+0000","last_clean":"2024-09-12T02:59:50.642733+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:50.642733+0000","last_undegraded":"2024-09-12T02:59:50.642733+0000","last_fullsized":"2024-09-12T02:59:50.642733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.642614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967915+0000","last_change":"2024-09-12T02:59:32.776350+0000","last_active":"2024-09-12T02:59:47.967915+0000","last_peered":"2024-09-12T02:59:47.967915+0000","last_clean":"2024-09-12T02:59:47.967915+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:47.967915+0000","last_undegraded":"2024-09-12T02:59:47.967915+0000","last_fullsized":"2024-09-12T02:59:47.967915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.776267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:58.890222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968625+0000","last_change":"2024-09-12T02:59:34.789313+0000","last_active":"2024-09-12T02:59:47.968625+0000","last_peered":"2024-09-12T02:59:47.968625+0000","last_clean":"2024-09-12T02:59:47.968625+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:47.968625+0000","last_undegraded":"2024-09-12T02:59:47.968625+0000","last_fullsized":"2024-09-12T02:59:47.968625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.789214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.790935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971845+0000","last_change":"2024-09-12T02:59:34.632579+0000","last_active":"2024-09-12T02:59:47.971845+0000","last_peered":"2024-09-12T02:59:47.971845+0000","last_clean":"2024-09-12T02:59:47.971845+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:47.971845+0000","last_undegraded":"2024-09-12T02:59:47.971845+0000","last_fullsized":"2024-09-12T02:59:47.971845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.632350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.978281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987536+0000","last_change":"2024-09-12T02:59:35.785814+0000","last_active":"2024-09-12T02:59:47.987536+0000","last_peered":"2024-09-12T02:59:47.987536+0000","last_clean":"2024-09-12T02:59:47.987536+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:47.987536+0000","last_undegraded":"2024-09-12T02:59:47.987536+0000","last_fullsized":"2024-09-12T02:59:47.987536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.785459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.907074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975052+0000","last_change":"2024-09-12T02:59:44.644342+0000","last_active":"2024-09-12T02:59:47.975052+0000","last_peered":"2024-09-12T02:59:47.975052+0000","last_clean":"2024-09-12T02:59:47.975052+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:47.975052+0000","last_undegraded":"2024-09-12T02:59:47.975052+0000","last_fullsized":"2024-09-12T02:59:47.975052+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.644026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:49.273561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975474+0000","last_change":"2024-09-12T02:59:46.131647+0000","last_active":"2024-09-12T02:59:47.975474+0000","last_peered":"2024-09-12T02:59:47.975474+0000","last_clean":"2024-09-12T02:59:47.975474+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:47.975474+0000","last_undegraded":"2024-09-12T02:59:47.975474+0000","last_fullsized":"2024-09-12T02:59:47.975474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.131533+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:06.802576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988089+0000","last_change":"2024-09-12T02:59:35.721123+0000","last_active":"2024-09-12T02:59:47.988089+0000","last_peered":"2024-09-12T02:59:47.988089+0000","last_clean":"2024-09-12T02:59:47.988089+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:47.988089+0000","last_undegraded":"2024-09-12T02:59:47.988089+0000","last_fullsized":"2024-09-12T02:59:47.988089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.720761+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:17.277216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971181+0000","last_change":"2024-09-12T02:59:39.707123+0000","last_active":"2024-09-12T02:59:47.971181+0000","last_peered":"2024-09-12T02:59:47.971181+0000","last_clean":"2024-09-12T02:59:47.971181+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:47.971181+0000","last_undegraded":"2024-09-12T02:59:47.971181+0000","last_fullsized":"2024-09-12T02:59:47.971181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.706899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:08.753477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972514+0000","last_change":"2024-09-12T02:59:41.667809+0000","last_active":"2024-09-12T02:59:47.972514+0000","last_peered":"2024-09-12T02:59:47.972514+0000","last_clean":"2024-09-12T02:59:47.972514+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:47.972514+0000","last_undegraded":"2024-09-12T02:59:47.972514+0000","last_fullsized":"2024-09-12T02:59:47.972514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.667707+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:52.853661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969018+0000","last_change":"2024-09-12T02:59:45.841193+0000","last_active":"2024-09-12T02:59:47.969018+0000","last_peered":"2024-09-12T02:59:47.969018+0000","last_clean":"2024-09-12T02:59:47.969018+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:47.969018+0000","last_undegraded":"2024-09-12T02:59:47.969018+0000","last_fullsized":"2024-09-12T02:59:47.969018+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.841069+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:50.470604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.993328+0000","last_change":"2024-09-12T02:59:47.991190+0000","last_active":"2024-09-12T02:59:47.993328+0000","last_peered":"2024-09-12T02:59:47.993328+0000","last_clean":"2024-09-12T02:59:47.993328+0000","last_became_active":"2024-09-12T02:59:47.990629+0000","last_became_peered":"2024-09-12T02:59:47.990629+0000","last_unstale":"2024-09-12T02:59:47.993328+0000","last_undegraded":"2024-09-12T02:59:47.993328+0000","last_fullsized":"2024-09-12T02:59:47.993328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.643595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.689482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968300+0000","last_change":"2024-09-12T02:59:36.821336+0000","last_active":"2024-09-12T02:59:47.968300+0000","last_peered":"2024-09-12T02:59:47.968300+0000","last_clean":"2024-09-12T02:59:47.968300+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:47.968300+0000","last_undegraded":"2024-09-12T02:59:47.968300+0000","last_fullsized":"2024-09-12T02:59:47.968300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.821234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.321748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989889+0000","last_change":"2024-09-12T02:59:38.763406+0000","last_active":"2024-09-12T02:59:47.989889+0000","last_peered":"2024-09-12T02:59:47.989889+0000","last_clean":"2024-09-12T02:59:47.989889+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:47.989889+0000","last_undegraded":"2024-09-12T02:59:47.989889+0000","last_fullsized":"2024-09-12T02:59:47.989889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.763178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.755095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975134+0000","last_change":"2024-09-12T02:59:42.071495+0000","last_active":"2024-09-12T02:59:47.975134+0000","last_peered":"2024-09-12T02:59:47.975134+0000","last_clean":"2024-09-12T02:59:47.975134+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:47.975134+0000","last_undegraded":"2024-09-12T02:59:47.975134+0000","last_fullsized":"2024-09-12T02:59:47.975134+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.071362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:30.775559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973454+0000","last_change":"2024-09-12T02:59:39.026655+0000","last_active":"2024-09-12T02:59:47.973454+0000","last_peered":"2024-09-12T02:59:47.973454+0000","last_clean":"2024-09-12T02:59:47.973454+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:47.973454+0000","last_undegraded":"2024-09-12T02:59:47.973454+0000","last_fullsized":"2024-09-12T02:59:47.973454+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.026365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:52.426930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968353+0000","last_change":"2024-09-12T02:59:37.791375+0000","last_active":"2024-09-12T02:59:47.968353+0000","last_peered":"2024-09-12T02:59:47.968353+0000","last_clean":"2024-09-12T02:59:47.968353+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:47.968353+0000","last_undegraded":"2024-09-12T02:59:47.968353+0000","last_fullsized":"2024-09-12T02:59:47.968353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.791278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:11.783194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967824+0000","last_change":"2024-09-12T02:59:43.858969+0000","last_active":"2024-09-12T02:59:47.967824+0000","last_peered":"2024-09-12T02:59:47.967824+0000","last_clean":"2024-09-12T02:59:47.967824+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:47.967824+0000","last_undegraded":"2024-09-12T02:59:47.967824+0000","last_fullsized":"2024-09-12T02:59:47.967824+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.858860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972781+0000","last_change":"2024-09-12T02:59:35.662731+0000","last_active":"2024-09-12T02:59:47.972781+0000","last_peered":"2024-09-12T02:59:47.972781+0000","last_clean":"2024-09-12T02:59:47.972781+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:47.972781+0000","last_undegraded":"2024-09-12T02:59:47.972781+0000","last_fullsized":"2024-09-12T02:59:47.972781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.662469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:08.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971714+0000","last_change":"2024-09-12T02:59:32.999842+0000","last_active":"2024-09-12T02:59:47.971714+0000","last_peered":"2024-09-12T02:59:47.971714+0000","last_clean":"2024-09-12T02:59:47.971714+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:47.971714+0000","last_undegraded":"2024-09-12T02:59:47.971714+0000","last_fullsized":"2024-09-12T02:59:47.971714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.999508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:43.870533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.055261+0000","last_change":"2024-09-12T02:59:48.055261+0000","last_active":"2024-09-12T02:59:48.055261+0000","last_peered":"2024-09-12T02:59:48.055261+0000","last_clean":"2024-09-12T02:59:48.055261+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:48.055261+0000","last_undegraded":"2024-09-12T02:59:48.055261+0000","last_fullsized":"2024-09-12T02:59:48.055261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.055039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.593082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967982+0000","last_change":"2024-09-12T02:59:33.818250+0000","last_active":"2024-09-12T02:59:47.967982+0000","last_peered":"2024-09-12T02:59:47.967982+0000","last_clean":"2024-09-12T02:59:47.967982+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:47.967982+0000","last_undegraded":"2024-09-12T02:59:47.967982+0000","last_fullsized":"2024-09-12T02:59:47.967982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.818171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:46.646434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"79'3","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971922+0000","last_change":"2024-09-12T02:59:31.836989+0000","last_active":"2024-09-12T02:59:47.971922+0000","last_peered":"2024-09-12T02:59:47.971922+0000","last_clean":"2024-09-12T02:59:47.971922+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:47.971922+0000","last_undegraded":"2024-09-12T02:59:47.971922+0000","last_fullsized":"2024-09-12T02:59:47.971922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.836905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:53.031692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968392+0000","last_change":"2024-09-12T02:59:39.791877+0000","last_active":"2024-09-12T02:59:47.968392+0000","last_peered":"2024-09-12T02:59:47.968392+0000","last_clean":"2024-09-12T02:59:47.968392+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:47.968392+0000","last_undegraded":"2024-09-12T02:59:47.968392+0000","last_fullsized":"2024-09-12T02:59:47.968392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.791761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:25.406226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974736+0000","last_change":"2024-09-12T02:59:30.045775+0000","last_active":"2024-09-12T02:59:47.974736+0000","last_peered":"2024-09-12T02:59:47.974736+0000","last_clean":"2024-09-12T02:59:47.974736+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:47.974736+0000","last_undegraded":"2024-09-12T02:59:47.974736+0000","last_fullsized":"2024-09-12T02:59:47.974736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.045690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:33.716096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.861935+0000","last_change":"2024-09-12T02:59:49.861935+0000","last_active":"2024-09-12T02:59:49.861935+0000","last_peered":"2024-09-12T02:59:49.861935+0000","last_clean":"2024-09-12T02:59:49.861935+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:49.861935+0000","last_undegraded":"2024-09-12T02:59:49.861935+0000","last_fullsized":"2024-09-12T02:59:49.861935+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.861705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:39.315077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975303+0000","last_change":"2024-09-12T02:59:40.118829+0000","last_active":"2024-09-12T02:59:47.975303+0000","last_peered":"2024-09-12T02:59:47.975303+0000","last_clean":"2024-09-12T02:59:47.975303+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:47.975303+0000","last_undegraded":"2024-09-12T02:59:47.975303+0000","last_fullsized":"2024-09-12T02:59:47.975303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.118699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:10.405280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970932+0000","last_change":"2024-09-12T02:59:47.676864+0000","last_active":"2024-09-12T02:59:47.970932+0000","last_peered":"2024-09-12T02:59:47.970932+0000","last_clean":"2024-09-12T02:59:47.970932+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:47.970932+0000","last_undegraded":"2024-09-12T02:59:47.970932+0000","last_fullsized":"2024-09-12T02:59:47.970932+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.676747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.675367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972045+0000","last_change":"2024-09-12T02:59:40.971763+0000","last_active":"2024-09-12T02:59:47.972045+0000","last_peered":"2024-09-12T02:59:47.972045+0000","last_clean":"2024-09-12T02:59:47.972045+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:47.972045+0000","last_undegraded":"2024-09-12T02:59:47.972045+0000","last_fullsized":"2024-09-12T02:59:47.972045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.971535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:04.999865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"79'119","reported_seq":299,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988085+0000","last_change":"2024-09-12T02:59:34.803297+0000","last_active":"2024-09-12T02:59:47.988085+0000","last_peered":"2024-09-12T02:59:47.988085+0000","last_clean":"2024-09-12T02:59:47.988085+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:47.988085+0000","last_undegraded":"2024-09-12T02:59:47.988085+0000","last_fullsized":"2024-09-12T02:59:47.988085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.802947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:59.161855+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986575+0000","last_change":"2024-09-12T02:59:42.682806+0000","last_active":"2024-09-12T02:59:47.986575+0000","last_peered":"2024-09-12T02:59:47.986575+0000","last_clean":"2024-09-12T02:59:47.986575+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:47.986575+0000","last_undegraded":"2024-09-12T02:59:47.986575+0000","last_fullsized":"2024-09-12T02:59:47.986575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.682574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:22.933579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968536+0000","last_change":"2024-09-12T02:59:35.830230+0000","last_active":"2024-09-12T02:59:47.968536+0000","last_peered":"2024-09-12T02:59:47.968536+0000","last_clean":"2024-09-12T02:59:47.968536+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:47.968536+0000","last_undegraded":"2024-09-12T02:59:47.968536+0000","last_fullsized":"2024-09-12T02:59:47.968536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.830121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.993178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972484+0000","last_change":"2024-09-12T02:59:35.842501+0000","last_active":"2024-09-12T02:59:47.972484+0000","last_peered":"2024-09-12T02:59:47.972484+0000","last_clean":"2024-09-12T02:59:47.972484+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:47.972484+0000","last_undegraded":"2024-09-12T02:59:47.972484+0000","last_fullsized":"2024-09-12T02:59:47.972484+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.842396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:47.840469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986481+0000","last_change":"2024-09-12T02:59:41.651678+0000","last_active":"2024-09-12T02:59:47.986481+0000","last_peered":"2024-09-12T02:59:47.986481+0000","last_clean":"2024-09-12T02:59:47.986481+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:47.986481+0000","last_undegraded":"2024-09-12T02:59:47.986481+0000","last_fullsized":"2024-09-12T02:59:47.986481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.651443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:40.919631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973428+0000","last_change":"2024-09-12T02:59:34.986788+0000","last_active":"2024-09-12T02:59:47.973428+0000","last_peered":"2024-09-12T02:59:47.973428+0000","last_clean":"2024-09-12T02:59:47.973428+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:47.973428+0000","last_undegraded":"2024-09-12T02:59:47.973428+0000","last_fullsized":"2024-09-12T02:59:47.973428+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.986542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:35.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"79'2","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968801+0000","last_change":"2024-09-12T02:59:31.772320+0000","last_active":"2024-09-12T02:59:47.968801+0000","last_peered":"2024-09-12T02:59:47.968801+0000","last_clean":"2024-09-12T02:59:47.968801+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:47.968801+0000","last_undegraded":"2024-09-12T02:59:47.968801+0000","last_fullsized":"2024-09-12T02:59:47.968801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.772236+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:19.909174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975370+0000","last_change":"2024-09-12T02:59:43.053479+0000","last_active":"2024-09-12T02:59:47.975370+0000","last_peered":"2024-09-12T02:59:47.975370+0000","last_clean":"2024-09-12T02:59:47.975370+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:47.975370+0000","last_undegraded":"2024-09-12T02:59:47.975370+0000","last_fullsized":"2024-09-12T02:59:47.975370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.053377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:21.369077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989656+0000","last_change":"2024-09-12T02:59:46.862199+0000","last_active":"2024-09-12T02:59:47.989656+0000","last_peered":"2024-09-12T02:59:47.989656+0000","last_clean":"2024-09-12T02:59:47.989656+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:47.989656+0000","last_undegraded":"2024-09-12T02:59:47.989656+0000","last_fullsized":"2024-09-12T02:59:47.989656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.861972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:51.491507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972773+0000","last_change":"2024-09-12T02:59:30.860535+0000","last_active":"2024-09-12T02:59:47.972773+0000","last_peered":"2024-09-12T02:59:47.972773+0000","last_clean":"2024-09-12T02:59:47.972773+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:47.972773+0000","last_undegraded":"2024-09-12T02:59:47.972773+0000","last_fullsized":"2024-09-12T02:59:47.972773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.860444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:23.065975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.093650+0000","last_change":"2024-09-12T02:59:49.093650+0000","last_active":"2024-09-12T02:59:49.093650+0000","last_peered":"2024-09-12T02:59:49.093650+0000","last_clean":"2024-09-12T02:59:49.093650+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:49.093650+0000","last_undegraded":"2024-09-12T02:59:49.093650+0000","last_fullsized":"2024-09-12T02:59:49.093650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.093403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.133030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989405+0000","last_change":"2024-09-12T02:59:44.860343+0000","last_active":"2024-09-12T02:59:47.989405+0000","last_peered":"2024-09-12T02:59:47.989405+0000","last_clean":"2024-09-12T02:59:47.989405+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:47.989405+0000","last_undegraded":"2024-09-12T02:59:47.989405+0000","last_fullsized":"2024-09-12T02:59:47.989405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.860002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:03.716731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975493+0000","last_change":"2024-09-12T02:59:31.636304+0000","last_active":"2024-09-12T02:59:47.975493+0000","last_peered":"2024-09-12T02:59:47.975493+0000","last_clean":"2024-09-12T02:59:47.975493+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:47.975493+0000","last_undegraded":"2024-09-12T02:59:47.975493+0000","last_fullsized":"2024-09-12T02:59:47.975493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.636071+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:48.966306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974649+0000","last_change":"2024-09-12T02:59:42.661415+0000","last_active":"2024-09-12T02:59:47.974649+0000","last_peered":"2024-09-12T02:59:47.974649+0000","last_clean":"2024-09-12T02:59:47.974649+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:47.974649+0000","last_undegraded":"2024-09-12T02:59:47.974649+0000","last_fullsized":"2024-09-12T02:59:47.974649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.661146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986300+0000","last_change":"2024-09-12T02:59:45.832208+0000","last_active":"2024-09-12T02:59:47.986300+0000","last_peered":"2024-09-12T02:59:47.986300+0000","last_clean":"2024-09-12T02:59:47.986300+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:47.986300+0000","last_undegraded":"2024-09-12T02:59:47.986300+0000","last_fullsized":"2024-09-12T02:59:47.986300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.831975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'12","reported_seq":184,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971562+0000","last_change":"2024-09-12T02:59:36.886312+0000","last_active":"2024-09-12T02:59:47.971562+0000","last_peered":"2024-09-12T02:59:47.971562+0000","last_clean":"2024-09-12T02:59:47.971562+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:47.971562+0000","last_undegraded":"2024-09-12T02:59:47.971562+0000","last_fullsized":"2024-09-12T02:59:47.971562+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.886179+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:45.626516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975159+0000","last_change":"2024-09-12T02:59:39.156656+0000","last_active":"2024-09-12T02:59:47.975159+0000","last_peered":"2024-09-12T02:59:47.975159+0000","last_clean":"2024-09-12T02:59:47.975159+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:47.975159+0000","last_undegraded":"2024-09-12T02:59:47.975159+0000","last_fullsized":"2024-09-12T02:59:47.975159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.156542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:34.954291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987400+0000","last_change":"2024-09-12T02:59:37.673643+0000","last_active":"2024-09-12T02:59:47.987400+0000","last_peered":"2024-09-12T02:59:47.987400+0000","last_clean":"2024-09-12T02:59:47.987400+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:47.987400+0000","last_undegraded":"2024-09-12T02:59:47.987400+0000","last_fullsized":"2024-09-12T02:59:47.987400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.673292+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.523545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988581+0000","last_change":"2024-09-12T02:59:33.671444+0000","last_active":"2024-09-12T02:59:47.988581+0000","last_peered":"2024-09-12T02:59:47.988581+0000","last_clean":"2024-09-12T02:59:47.988581+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:47.988581+0000","last_undegraded":"2024-09-12T02:59:47.988581+0000","last_fullsized":"2024-09-12T02:59:47.988581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.671212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:45.669284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972298+0000","last_change":"2024-09-12T02:59:34.590629+0000","last_active":"2024-09-12T02:59:47.972298+0000","last_peered":"2024-09-12T02:59:47.972298+0000","last_clean":"2024-09-12T02:59:47.972298+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:47.972298+0000","last_undegraded":"2024-09-12T02:59:47.972298+0000","last_fullsized":"2024-09-12T02:59:47.972298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.590531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.762881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988612+0000","last_change":"2024-09-12T02:59:43.837261+0000","last_active":"2024-09-12T02:59:47.988612+0000","last_peered":"2024-09-12T02:59:47.988612+0000","last_clean":"2024-09-12T02:59:47.988612+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:47.988612+0000","last_undegraded":"2024-09-12T02:59:47.988612+0000","last_fullsized":"2024-09-12T02:59:47.988612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.836980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.344004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970625+0000","last_change":"2024-09-12T02:59:45.048563+0000","last_active":"2024-09-12T02:59:47.970625+0000","last_peered":"2024-09-12T02:59:47.970625+0000","last_clean":"2024-09-12T02:59:47.970625+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:47.970625+0000","last_undegraded":"2024-09-12T02:59:47.970625+0000","last_fullsized":"2024-09-12T02:59:47.970625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.048315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:20.692033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.611665+0000","last_change":"2024-09-12T02:59:49.611694+0000","last_active":"2024-09-12T02:59:49.611665+0000","last_peered":"2024-09-12T02:59:49.611665+0000","last_clean":"2024-09-12T02:59:49.611665+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:49.611665+0000","last_undegraded":"2024-09-12T02:59:49.611665+0000","last_fullsized":"2024-09-12T02:59:49.611665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.611569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:05.308212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975259+0000","last_change":"2024-09-12T02:59:36.076892+0000","last_active":"2024-09-12T02:59:47.975259+0000","last_peered":"2024-09-12T02:59:47.975259+0000","last_clean":"2024-09-12T02:59:47.975259+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:47.975259+0000","last_undegraded":"2024-09-12T02:59:47.975259+0000","last_fullsized":"2024-09-12T02:59:47.975259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.076727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:26.666775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975590+0000","last_change":"2024-09-12T02:59:30.999792+0000","last_active":"2024-09-12T02:59:47.975590+0000","last_peered":"2024-09-12T02:59:47.975590+0000","last_clean":"2024-09-12T02:59:47.975590+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:47.975590+0000","last_undegraded":"2024-09-12T02:59:47.975590+0000","last_fullsized":"2024-09-12T02:59:47.975590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.999703+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:17.375066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973992+0000","last_change":"2024-09-12T02:59:34.015485+0000","last_active":"2024-09-12T02:59:47.973992+0000","last_peered":"2024-09-12T02:59:47.973992+0000","last_clean":"2024-09-12T02:59:47.973992+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:47.973992+0000","last_undegraded":"2024-09-12T02:59:47.973992+0000","last_fullsized":"2024-09-12T02:59:47.973992+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.015247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:05.065563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989055+0000","last_change":"2024-09-12T02:59:41.793529+0000","last_active":"2024-09-12T02:59:47.989055+0000","last_peered":"2024-09-12T02:59:47.989055+0000","last_clean":"2024-09-12T02:59:47.989055+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:47.989055+0000","last_undegraded":"2024-09-12T02:59:47.989055+0000","last_fullsized":"2024-09-12T02:59:47.989055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.793303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.839881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":167,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987810+0000","last_change":"2024-09-12T02:59:32.647074+0000","last_active":"2024-09-12T02:59:47.987810+0000","last_peered":"2024-09-12T02:59:47.987810+0000","last_clean":"2024-09-12T02:59:47.987810+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:47.987810+0000","last_undegraded":"2024-09-12T02:59:47.987810+0000","last_fullsized":"2024-09-12T02:59:47.987810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'28","last_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_deep_scrub":"79'28","last_deep_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.646844+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:46.886484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968112+0000","last_change":"2024-09-12T02:59:46.857630+0000","last_active":"2024-09-12T02:59:47.968112+0000","last_peered":"2024-09-12T02:59:47.968112+0000","last_clean":"2024-09-12T02:59:47.968112+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:47.968112+0000","last_undegraded":"2024-09-12T02:59:47.968112+0000","last_fullsized":"2024-09-12T02:59:47.968112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.857527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.845970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974062+0000","last_change":"2024-09-12T02:59:33.680657+0000","last_active":"2024-09-12T02:59:47.974062+0000","last_peered":"2024-09-12T02:59:47.974062+0000","last_clean":"2024-09-12T02:59:47.974062+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:47.974062+0000","last_undegraded":"2024-09-12T02:59:47.974062+0000","last_fullsized":"2024-09-12T02:59:47.974062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.680411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:15.802027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'7","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968736+0000","last_change":"2024-09-12T02:59:44.852192+0000","last_active":"2024-09-12T02:59:47.968736+0000","last_peered":"2024-09-12T02:59:47.968736+0000","last_clean":"2024-09-12T02:59:47.968736+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:47.968736+0000","last_undegraded":"2024-09-12T02:59:47.968736+0000","last_fullsized":"2024-09-12T02:59:47.968736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.852086+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.017309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":166,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971894+0000","last_change":"2024-09-12T02:59:45.664653+0000","last_active":"2024-09-12T02:59:47.971894+0000","last_peered":"2024-09-12T02:59:47.971894+0000","last_clean":"2024-09-12T02:59:47.971894+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:47.971894+0000","last_undegraded":"2024-09-12T02:59:47.971894+0000","last_fullsized":"2024-09-12T02:59:47.971894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.664314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.652758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975774+0000","last_change":"2024-09-12T02:59:45.129108+0000","last_active":"2024-09-12T02:59:47.975774+0000","last_peered":"2024-09-12T02:59:47.975774+0000","last_clean":"2024-09-12T02:59:47.975774+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:47.975774+0000","last_undegraded":"2024-09-12T02:59:47.975774+0000","last_fullsized":"2024-09-12T02:59:47.975774+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.128965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.549002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974003+0000","last_change":"2024-09-12T02:59:37.986005+0000","last_active":"2024-09-12T02:59:47.974003+0000","last_peered":"2024-09-12T02:59:47.974003+0000","last_clean":"2024-09-12T02:59:47.974003+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:47.974003+0000","last_undegraded":"2024-09-12T02:59:47.974003+0000","last_fullsized":"2024-09-12T02:59:47.974003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.985746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:14.181632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.639758+0000","last_change":"2024-09-12T02:59:51.639783+0000","last_active":"2024-09-12T02:59:51.639758+0000","last_peered":"2024-09-12T02:59:51.639758+0000","last_clean":"2024-09-12T02:59:51.639758+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:51.639758+0000","last_undegraded":"2024-09-12T02:59:51.639758+0000","last_fullsized":"2024-09-12T02:59:51.639758+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.639668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.759727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974118+0000","last_change":"2024-09-12T02:59:39.987993+0000","last_active":"2024-09-12T02:59:47.974118+0000","last_peered":"2024-09-12T02:59:47.974118+0000","last_clean":"2024-09-12T02:59:47.974118+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:47.974118+0000","last_undegraded":"2024-09-12T02:59:47.974118+0000","last_fullsized":"2024-09-12T02:59:47.974118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.987743+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:04.424759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987757+0000","last_change":"2024-09-12T02:59:45.721685+0000","last_active":"2024-09-12T02:59:47.987757+0000","last_peered":"2024-09-12T02:59:47.987757+0000","last_clean":"2024-09-12T02:59:47.987757+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:47.987757+0000","last_undegraded":"2024-09-12T02:59:47.987757+0000","last_fullsized":"2024-09-12T02:59:47.987757+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.721444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.143614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970794+0000","last_change":"2024-09-12T02:59:46.669010+0000","last_active":"2024-09-12T02:59:47.970794+0000","last_peered":"2024-09-12T02:59:47.970794+0000","last_clean":"2024-09-12T02:59:47.970794+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:47.970794+0000","last_undegraded":"2024-09-12T02:59:47.970794+0000","last_fullsized":"2024-09-12T02:59:47.970794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.668894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:22.826170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975134+0000","last_change":"2024-09-12T02:59:41.077595+0000","last_active":"2024-09-12T02:59:47.975134+0000","last_peered":"2024-09-12T02:59:47.975134+0000","last_clean":"2024-09-12T02:59:47.975134+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:47.975134+0000","last_undegraded":"2024-09-12T02:59:47.975134+0000","last_fullsized":"2024-09-12T02:59:47.975134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.077484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:52.294457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967794+0000","last_change":"2024-09-12T02:59:41.841470+0000","last_active":"2024-09-12T02:59:47.967794+0000","last_peered":"2024-09-12T02:59:47.967794+0000","last_clean":"2024-09-12T02:59:47.967794+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:47.967794+0000","last_undegraded":"2024-09-12T02:59:47.967794+0000","last_fullsized":"2024-09-12T02:59:47.967794+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.841333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.069789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.131633+0000","last_change":"2024-09-12T02:59:51.131633+0000","last_active":"2024-09-12T02:59:51.131633+0000","last_peered":"2024-09-12T02:59:51.131633+0000","last_clean":"2024-09-12T02:59:51.131633+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:51.131633+0000","last_undegraded":"2024-09-12T02:59:51.131633+0000","last_fullsized":"2024-09-12T02:59:51.131633+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.131397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:19.953861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987377+0000","last_change":"2024-09-12T02:59:46.767895+0000","last_active":"2024-09-12T02:59:47.987377+0000","last_peered":"2024-09-12T02:59:47.987377+0000","last_clean":"2024-09-12T02:59:47.987377+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:47.987377+0000","last_undegraded":"2024-09-12T02:59:47.987377+0000","last_fullsized":"2024-09-12T02:59:47.987377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.767560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.939911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971399+0000","last_change":"2024-09-12T02:59:39.674943+0000","last_active":"2024-09-12T02:59:47.971399+0000","last_peered":"2024-09-12T02:59:47.971399+0000","last_clean":"2024-09-12T02:59:47.971399+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:47.971399+0000","last_undegraded":"2024-09-12T02:59:47.971399+0000","last_fullsized":"2024-09-12T02:59:47.971399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.674831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:28.379028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970981+0000","last_change":"2024-09-12T02:59:37.660153+0000","last_active":"2024-09-12T02:59:47.970981+0000","last_peered":"2024-09-12T02:59:47.970981+0000","last_clean":"2024-09-12T02:59:47.970981+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:47.970981+0000","last_undegraded":"2024-09-12T02:59:47.970981+0000","last_fullsized":"2024-09-12T02:59:47.970981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.660048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:32.261376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987111+0000","last_change":"2024-09-12T02:59:34.716068+0000","last_active":"2024-09-12T02:59:47.987111+0000","last_peered":"2024-09-12T02:59:47.987111+0000","last_clean":"2024-09-12T02:59:47.987111+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:47.987111+0000","last_undegraded":"2024-09-12T02:59:47.987111+0000","last_fullsized":"2024-09-12T02:59:47.987111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.715793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:43.456130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975476+0000","last_change":"2024-09-12T02:59:38.162584+0000","last_active":"2024-09-12T02:59:47.975476+0000","last_peered":"2024-09-12T02:59:47.975476+0000","last_clean":"2024-09-12T02:59:47.975476+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:47.975476+0000","last_undegraded":"2024-09-12T02:59:47.975476+0000","last_fullsized":"2024-09-12T02:59:47.975476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.162461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:51.207333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972265+0000","last_change":"2024-09-12T02:59:34.845414+0000","last_active":"2024-09-12T02:59:47.972265+0000","last_peered":"2024-09-12T02:59:47.972265+0000","last_clean":"2024-09-12T02:59:47.972265+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:47.972265+0000","last_undegraded":"2024-09-12T02:59:47.972265+0000","last_fullsized":"2024-09-12T02:59:47.972265+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.845313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:49.084952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971084+0000","last_change":"2024-09-12T02:59:38.676599+0000","last_active":"2024-09-12T02:59:47.971084+0000","last_peered":"2024-09-12T02:59:47.971084+0000","last_clean":"2024-09-12T02:59:47.971084+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:47.971084+0000","last_undegraded":"2024-09-12T02:59:47.971084+0000","last_fullsized":"2024-09-12T02:59:47.971084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.676453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:08.813287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971443+0000","last_change":"2024-09-12T02:59:32.676152+0000","last_active":"2024-09-12T02:59:47.971443+0000","last_peered":"2024-09-12T02:59:47.971443+0000","last_clean":"2024-09-12T02:59:47.971443+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:47.971443+0000","last_undegraded":"2024-09-12T02:59:47.971443+0000","last_fullsized":"2024-09-12T02:59:47.971443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.675897+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971857+0000","last_change":"2024-09-12T02:59:32.600836+0000","last_active":"2024-09-12T02:59:47.971857+0000","last_peered":"2024-09-12T02:59:47.971857+0000","last_clean":"2024-09-12T02:59:47.971857+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:47.971857+0000","last_undegraded":"2024-09-12T02:59:47.971857+0000","last_fullsized":"2024-09-12T02:59:47.971857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.600751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:36.409439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988055+0000","last_change":"2024-09-12T02:59:36.720562+0000","last_active":"2024-09-12T02:59:47.988055+0000","last_peered":"2024-09-12T02:59:47.988055+0000","last_clean":"2024-09-12T02:59:47.988055+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:47.988055+0000","last_undegraded":"2024-09-12T02:59:47.988055+0000","last_fullsized":"2024-09-12T02:59:47.988055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.720181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.336802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":160,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971753+0000","last_change":"2024-09-12T02:59:33.813763+0000","last_active":"2024-09-12T02:59:47.971753+0000","last_peered":"2024-09-12T02:59:47.971753+0000","last_clean":"2024-09-12T02:59:47.971753+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:47.971753+0000","last_undegraded":"2024-09-12T02:59:47.971753+0000","last_fullsized":"2024-09-12T02:59:47.971753+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.813677+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:54.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971306+0000","last_change":"2024-09-12T02:59:43.020950+0000","last_active":"2024-09-12T02:59:47.971306+0000","last_peered":"2024-09-12T02:59:47.971306+0000","last_clean":"2024-09-12T02:59:47.971306+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:47.971306+0000","last_undegraded":"2024-09-12T02:59:47.971306+0000","last_fullsized":"2024-09-12T02:59:47.971306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.020633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:20.020956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975562+0000","last_change":"2024-09-12T02:59:35.065915+0000","last_active":"2024-09-12T02:59:47.975562+0000","last_peered":"2024-09-12T02:59:47.975562+0000","last_clean":"2024-09-12T02:59:47.975562+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:47.975562+0000","last_undegraded":"2024-09-12T02:59:47.975562+0000","last_fullsized":"2024-09-12T02:59:47.975562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.065802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:51.998513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971356+0000","last_change":"2024-09-12T02:59:33.570266+0000","last_active":"2024-09-12T02:59:47.971356+0000","last_peered":"2024-09-12T02:59:47.971356+0000","last_clean":"2024-09-12T02:59:47.971356+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:47.971356+0000","last_undegraded":"2024-09-12T02:59:47.971356+0000","last_fullsized":"2024-09-12T02:59:47.971356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.570177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:57.992347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968402+0000","last_change":"2024-09-12T02:59:30.749318+0000","last_active":"2024-09-12T02:59:47.968402+0000","last_peered":"2024-09-12T02:59:47.968402+0000","last_clean":"2024-09-12T02:59:47.968402+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:47.968402+0000","last_undegraded":"2024-09-12T02:59:47.968402+0000","last_fullsized":"2024-09-12T02:59:47.968402+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.749228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:31.541524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987586+0000","last_change":"2024-09-12T02:59:38.651039+0000","last_active":"2024-09-12T02:59:47.987586+0000","last_peered":"2024-09-12T02:59:47.987586+0000","last_clean":"2024-09-12T02:59:47.987586+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:47.987586+0000","last_undegraded":"2024-09-12T02:59:47.987586+0000","last_fullsized":"2024-09-12T02:59:47.987586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.650631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.137855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972462+0000","last_change":"2024-09-12T02:59:42.663691+0000","last_active":"2024-09-12T02:59:47.972462+0000","last_peered":"2024-09-12T02:59:47.972462+0000","last_clean":"2024-09-12T02:59:47.972462+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:47.972462+0000","last_undegraded":"2024-09-12T02:59:47.972462+0000","last_fullsized":"2024-09-12T02:59:47.972462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.663586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:23.083624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.118766+0000","last_change":"2024-09-12T02:59:50.118766+0000","last_active":"2024-09-12T02:59:50.118766+0000","last_peered":"2024-09-12T02:59:50.118766+0000","last_clean":"2024-09-12T02:59:50.118766+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:50.118766+0000","last_undegraded":"2024-09-12T02:59:50.118766+0000","last_fullsized":"2024-09-12T02:59:50.118766+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.118459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:39.693765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970671+0000","last_change":"2024-09-12T02:59:31.642639+0000","last_active":"2024-09-12T02:59:47.970671+0000","last_peered":"2024-09-12T02:59:47.970671+0000","last_clean":"2024-09-12T02:59:47.970671+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:47.970671+0000","last_undegraded":"2024-09-12T02:59:47.970671+0000","last_fullsized":"2024-09-12T02:59:47.970671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.642539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:45.910007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971028+0000","last_change":"2024-09-12T02:59:42.020010+0000","last_active":"2024-09-12T02:59:47.971028+0000","last_peered":"2024-09-12T02:59:47.971028+0000","last_clean":"2024-09-12T02:59:47.971028+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:47.971028+0000","last_undegraded":"2024-09-12T02:59:47.971028+0000","last_fullsized":"2024-09-12T02:59:47.971028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.019770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:02.627789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975254+0000","last_change":"2024-09-12T02:59:37.126601+0000","last_active":"2024-09-12T02:59:47.975254+0000","last_peered":"2024-09-12T02:59:47.975254+0000","last_clean":"2024-09-12T02:59:47.975254+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:47.975254+0000","last_undegraded":"2024-09-12T02:59:47.975254+0000","last_fullsized":"2024-09-12T02:59:47.975254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.126497+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:41.431052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987704+0000","last_change":"2024-09-12T02:59:40.644873+0000","last_active":"2024-09-12T02:59:47.987704+0000","last_peered":"2024-09-12T02:59:47.987704+0000","last_clean":"2024-09-12T02:59:47.987704+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:47.987704+0000","last_undegraded":"2024-09-12T02:59:47.987704+0000","last_fullsized":"2024-09-12T02:59:47.987704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.644626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:27.019990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989535+0000","last_change":"2024-09-12T02:59:42.787927+0000","last_active":"2024-09-12T02:59:47.989535+0000","last_peered":"2024-09-12T02:59:47.989535+0000","last_clean":"2024-09-12T02:59:47.989535+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:47.989535+0000","last_undegraded":"2024-09-12T02:59:47.989535+0000","last_fullsized":"2024-09-12T02:59:47.989535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.787542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.015998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972705+0000","last_change":"2024-09-12T02:59:32.823831+0000","last_active":"2024-09-12T02:59:47.972705+0000","last_peered":"2024-09-12T02:59:47.972705+0000","last_clean":"2024-09-12T02:59:47.972705+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:47.972705+0000","last_undegraded":"2024-09-12T02:59:47.972705+0000","last_fullsized":"2024-09-12T02:59:47.972705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.823742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:34.576078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974580+0000","last_change":"2024-09-12T02:59:47.049456+0000","last_active":"2024-09-12T02:59:47.974580+0000","last_peered":"2024-09-12T02:59:47.974580+0000","last_clean":"2024-09-12T02:59:47.974580+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:47.974580+0000","last_undegraded":"2024-09-12T02:59:47.974580+0000","last_fullsized":"2024-09-12T02:59:47.974580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.049206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:32.900134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971380+0000","last_change":"2024-09-12T02:59:37.007470+0000","last_active":"2024-09-12T02:59:47.971380+0000","last_peered":"2024-09-12T02:59:47.971380+0000","last_clean":"2024-09-12T02:59:47.971380+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:47.971380+0000","last_undegraded":"2024-09-12T02:59:47.971380+0000","last_fullsized":"2024-09-12T02:59:47.971380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.007224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:18.542924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967872+0000","last_change":"2024-09-12T02:59:40.838979+0000","last_active":"2024-09-12T02:59:47.967872+0000","last_peered":"2024-09-12T02:59:47.967872+0000","last_clean":"2024-09-12T02:59:47.967872+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:47.967872+0000","last_undegraded":"2024-09-12T02:59:47.967872+0000","last_fullsized":"2024-09-12T02:59:47.967872+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.838843+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:09.885421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975113+0000","last_change":"2024-09-12T02:59:34.019995+0000","last_active":"2024-09-12T02:59:47.975113+0000","last_peered":"2024-09-12T02:59:47.975113+0000","last_clean":"2024-09-12T02:59:47.975113+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:47.975113+0000","last_undegraded":"2024-09-12T02:59:47.975113+0000","last_fullsized":"2024-09-12T02:59:47.975113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.019910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.828598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970779+0000","last_change":"2024-09-12T02:59:35.597391+0000","last_active":"2024-09-12T02:59:47.970779+0000","last_peered":"2024-09-12T02:59:47.970779+0000","last_clean":"2024-09-12T02:59:47.970779+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:47.970779+0000","last_undegraded":"2024-09-12T02:59:47.970779+0000","last_fullsized":"2024-09-12T02:59:47.970779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.597291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:38.185412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973797+0000","last_change":"2024-09-12T02:59:36.682299+0000","last_active":"2024-09-12T02:59:47.973797+0000","last_peered":"2024-09-12T02:59:47.973797+0000","last_clean":"2024-09-12T02:59:47.973797+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:47.973797+0000","last_undegraded":"2024-09-12T02:59:47.973797+0000","last_fullsized":"2024-09-12T02:59:47.973797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.682064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:10.673981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986906+0000","last_change":"2024-09-12T02:59:44.683736+0000","last_active":"2024-09-12T02:59:47.986906+0000","last_peered":"2024-09-12T02:59:47.986906+0000","last_clean":"2024-09-12T02:59:47.986906+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:47.986906+0000","last_undegraded":"2024-09-12T02:59:47.986906+0000","last_fullsized":"2024-09-12T02:59:47.986906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.683432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.492120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987167+0000","last_change":"2024-09-12T02:59:43.695797+0000","last_active":"2024-09-12T02:59:47.987167+0000","last_peered":"2024-09-12T02:59:47.987167+0000","last_clean":"2024-09-12T02:59:47.987167+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:47.987167+0000","last_undegraded":"2024-09-12T02:59:47.987167+0000","last_fullsized":"2024-09-12T02:59:47.987167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'16","last_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_deep_scrub":"79'16","last_deep_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.695424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:57.962892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.814119+0000","last_change":"2024-09-12T02:59:48.814183+0000","last_active":"2024-09-12T02:59:48.814119+0000","last_peered":"2024-09-12T02:59:48.814119+0000","last_clean":"2024-09-12T02:59:48.814119+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:48.814119+0000","last_undegraded":"2024-09-12T02:59:48.814119+0000","last_fullsized":"2024-09-12T02:59:48.814119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.813942+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:41.235405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.652380+0000","last_change":"2024-09-12T02:59:48.652404+0000","last_active":"2024-09-12T02:59:48.652380+0000","last_peered":"2024-09-12T02:59:48.652380+0000","last_clean":"2024-09-12T02:59:48.652380+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:48.652380+0000","last_undegraded":"2024-09-12T02:59:48.652380+0000","last_fullsized":"2024-09-12T02:59:48.652380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.652295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:24.469845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986239+0000","last_change":"2024-09-12T02:59:40.773384+0000","last_active":"2024-09-12T02:59:47.986239+0000","last_peered":"2024-09-12T02:59:47.986239+0000","last_clean":"2024-09-12T02:59:47.986239+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:47.986239+0000","last_undegraded":"2024-09-12T02:59:47.986239+0000","last_fullsized":"2024-09-12T02:59:47.986239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.773129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.980310+0000","last_change":"2024-09-12T02:59:47.977081+0000","last_active":"2024-09-12T02:59:47.980310+0000","last_peered":"2024-09-12T02:59:47.980310+0000","last_clean":"2024-09-12T02:59:47.980310+0000","last_became_active":"2024-09-12T02:59:47.976687+0000","last_became_peered":"2024-09-12T02:59:47.976687+0000","last_unstale":"2024-09-12T02:59:47.980310+0000","last_undegraded":"2024-09-12T02:59:47.980310+0000","last_fullsized":"2024-09-12T02:59:47.980310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988297+0000","last_change":"2024-09-12T02:59:39.769618+0000","last_active":"2024-09-12T02:59:47.988297+0000","last_peered":"2024-09-12T02:59:47.988297+0000","last_clean":"2024-09-12T02:59:47.988297+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:47.988297+0000","last_undegraded":"2024-09-12T02:59:47.988297+0000","last_fullsized":"2024-09-12T02:59:47.988297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.769355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:44.299798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973139+0000","last_change":"2024-09-12T02:59:46.045977+0000","last_active":"2024-09-12T02:59:47.973139+0000","last_peered":"2024-09-12T02:59:47.973139+0000","last_clean":"2024-09-12T02:59:47.973139+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:47.973139+0000","last_undegraded":"2024-09-12T02:59:47.973139+0000","last_fullsized":"2024-09-12T02:59:47.973139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.045725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:00.846357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975037+0000","last_change":"2024-09-12T02:59:33.045189+0000","last_active":"2024-09-12T02:59:47.975037+0000","last_peered":"2024-09-12T02:59:47.975037+0000","last_clean":"2024-09-12T02:59:47.975037+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:47.975037+0000","last_undegraded":"2024-09-12T02:59:47.975037+0000","last_fullsized":"2024-09-12T02:59:47.975037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.045042+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:47.312510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969223+0000","last_change":"2024-09-12T02:59:38.788525+0000","last_active":"2024-09-12T02:59:47.969223+0000","last_peered":"2024-09-12T02:59:47.969223+0000","last_clean":"2024-09-12T02:59:47.969223+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:47.969223+0000","last_undegraded":"2024-09-12T02:59:47.969223+0000","last_fullsized":"2024-09-12T02:59:47.969223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.788431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:20.633132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989121+0000","last_change":"2024-09-12T02:59:33.741380+0000","last_active":"2024-09-12T02:59:47.989121+0000","last_peered":"2024-09-12T02:59:47.989121+0000","last_clean":"2024-09-12T02:59:47.989121+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:47.989121+0000","last_undegraded":"2024-09-12T02:59:47.989121+0000","last_fullsized":"2024-09-12T02:59:47.989121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.741253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:51.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":530298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509502,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1552384,"data_stored":1083143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542206,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1544192,"data_stored":1083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542204,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":995328,"data_stored":529987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906976,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":928,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":950272,"data_stored":492227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542204,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":492263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":492297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:01:36.003 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T03:01:36.004 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T03:01:56.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:01:56.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.159+0000 7fadc6a00640 1 Processor -- start 2024-09-12T03:01:56.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.159+0000 7fadc6a00640 1 -- start start 2024-09-12T03:01:56.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc6a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fadc0070c00 0x7fadc0163f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc6a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc00c5440 con 0x7fadc0152910 2024-09-12T03:01:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc6a00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc0070460 con 0x7fadc00b0b90 2024-09-12T03:01:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc6a00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fadc00c3440 con 0x7fadc0070c00 2024-09-12T03:01:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc5600640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fadc0152910 0x7fadc0158620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45130/0 (socket says 172.21.15.63:45130) 2024-09-12T03:01:56.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc5600640 1 -- 172.21.15.63:0/523329011 learned_addr learned my addr 172.21.15.63:0/523329011 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T03:01:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc6000640 1 --2- 172.21.15.63:0/523329011 >> v2:172.21.15.119:3300/0 conn(0x7fadc0070c00 0x7fadc0163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753160649 0 0) 0x7fadc00c5440 con 0x7fadc0152910 2024-09-12T03:01:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada8003530 con 0x7fadc0152910 2024-09-12T03:01:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381464148 0 0) 0x7fadc0070460 con 0x7fadc00b0b90 2024-09-12T03:01:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc00c5440 con 0x7fadc00b0b90 2024-09-12T03:01:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1810047315 0 0) 0x7fada8003530 con 0x7fadc0152910 2024-09-12T03:01:56.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 >> v2:172.21.15.119:3300/0 conn(0x7fadc0070c00 msgr2=0x7fadc0163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 --2- 172.21.15.63:0/523329011 >> v2:172.21.15.119:3300/0 conn(0x7fadc0070c00 0x7fadc0163f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 >> v1:172.21.15.119:6789/0 conn(0x7fadc00b0b90 legacy=0x7fadc00ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc00c4f60 con 0x7fadc0152910 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7fadb4001680 con 0x7fadc0152910 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 >> v1:172.21.15.63:6789/0 conn(0x7fadc0152910 legacy=0x7fadc0158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fada8003c10 0x7fada8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fada8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fada8005290 0x7fada800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fadc00c3440 con 0x7fada8004810 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fada800c1a0 con 0x7fada8005290 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fada800c3a0 con 0x7fada8003c10 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc4c00640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fada8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:56.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc5600640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fada8003c10 0x7fada8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:56.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc6000640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fada8005290 0x7fada800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:56.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc4c00640 1 -- 172.21.15.63:0/523329011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fada8003c10 msgr2=0x7fada8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:56.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc4c00640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fada8003c10 0x7fada8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc4c00640 1 -- 172.21.15.63:0/523329011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fada8005290 msgr2=0x7fada800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:01:56.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc4c00640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fada8005290 0x7fada800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc4c00640 1 -- 172.21.15.63:0/523329011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada8003530 con 0x7fada8004810 2024-09-12T03:01:56.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc6000640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fada8005290 0x7fada800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:01:56.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.163+0000 7fadc6000640 1 -- 172.21.15.63:0/523329011 reap_dead start 2024-09-12T03:01:56.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadc4c00640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fada8004c90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fadac0018d0 tx=0x7fadac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf9bab3c0bd341a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:56.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac0b0070 con 0x7fada8004810 2024-09-12T03:01:56.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac0052f0 con 0x7fada8004810 2024-09-12T03:01:56.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadbfe00640 1 -- 172.21.15.63:0/523329011 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac001520 con 0x7fada8004810 2024-09-12T03:01:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadc6a00640 1 -- 172.21.15.63:0/523329011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 msgr2=0x7fada8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadc6a00640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fada8004c90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fadac0018d0 tx=0x7fadac01c4f0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadc6a00640 1 -- 172.21.15.63:0/523329011 shutdown_connections 2024-09-12T03:01:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadc6a00640 1 --2- 172.21.15.63:0/523329011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fada8004c90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadc6a00640 1 -- 172.21.15.63:0/523329011 >> 172.21.15.63:0/523329011 conn(0x7fadc0067a00 msgr2=0x7fadc0067e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadc6a00640 1 -- 172.21.15.63:0/523329011 shutdown_connections 2024-09-12T03:01:56.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.167+0000 7fadc6a00640 1 -- 172.21.15.63:0/523329011 wait complete. 2024-09-12T03:01:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 Processor -- start 2024-09-12T03:01:56.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 -- start start 2024-09-12T03:01:56.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fadc00c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:56.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadc00c5df0 0x7fadc00b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:56.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadc01f3330 0x7fadc015bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:56.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fadc00706d0 con 0x7fada8004810 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fadc0152cf0 con 0x7fadc00c5df0 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fadc0070fe0 con 0x7fadc01f3330 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc5600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fadc00c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc5600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fadc00c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40310/0 (socket says 172.21.15.63:40310) 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc5600640 1 -- 172.21.15.63:0/842218569 learned_addr learned my addr 172.21.15.63:0/842218569 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc4c00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadc00c5df0 0x7fadc00b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6000640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadc01f3330 0x7fadc015bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc5600640 1 -- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadc01f3330 msgr2=0x7fadc015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc5600640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadc01f3330 0x7fadc015bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc5600640 1 -- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadc00c5df0 msgr2=0x7fadc00b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc5600640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadc00c5df0 0x7fadc00b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc5600640 1 -- 172.21.15.63:0/842218569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc01f7330 con 0x7fada8004810 2024-09-12T03:01:56.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc4c00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadc00c5df0 0x7fadc00b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:01:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc5600640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fadc00c83e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fadb400e5b0 tx=0x7fadb400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadbd600640 1 -- 172.21.15.63:0/842218569 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4012590 con 0x7fada8004810 2024-09-12T03:01:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadbd600640 1 -- 172.21.15.63:0/842218569 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb4018070 con 0x7fada8004810 2024-09-12T03:01:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadbd600640 1 -- 172.21.15.63:0/842218569 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4012990 con 0x7fada8004810 2024-09-12T03:01:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc00c6570 con 0x7fada8004810 2024-09-12T03:01:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc01f75f0 con 0x7fada8004810 2024-09-12T03:01:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.171+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc0154d70 con 0x7fada8004810 2024-09-12T03:01:56.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.175+0000 7fadbd600640 1 -- 172.21.15.63:0/842218569 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fadb4012b30 con 0x7fada8004810 2024-09-12T03:01:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.175+0000 7fadbd600640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fada00678c0 0x7fada0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:01:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.175+0000 7fadbd600640 1 -- 172.21.15.63:0/842218569 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7fadb4085ef0 con 0x7fada8004810 2024-09-12T03:01:56.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.175+0000 7fadc4c00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fada00678c0 0x7fada0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:01:56.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.175+0000 7fadc4c00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fada00678c0 0x7fada0069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fadac0ad000 tx=0x7fadac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:01:56.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.179+0000 7fadbd600640 1 -- 172.21.15.63:0/842218569 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fadc0154d70 con 0x7fada8004810 2024-09-12T03:01:56.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.343+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadc01f77f0 con 0x7fada00678c0 2024-09-12T03:01:56.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.367+0000 7fadbd600640 1 -- 172.21.15.63:0/842218569 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332999 (secure 0 0 0) 0x7fadc01f77f0 con 0x7fada00678c0 2024-09-12T03:01:56.372 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:01:56.374 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T03:01:56.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fada00678c0 msgr2=0x7fada0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:56.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fada00678c0 0x7fada0069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fadac0ad000 tx=0x7fadac009040 comp rx=0 tx=0).stop 2024-09-12T03:01:56.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 msgr2=0x7fadc00c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:01:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fadc00c83e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fadb400e5b0 tx=0x7fadb400ea70 comp rx=0 tx=0).stop 2024-09-12T03:01:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 shutdown_connections 2024-09-12T03:01:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fada00678c0 0x7fada0069d80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fadc01f3330 0x7fadc015bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fadc00c5df0 0x7fadc00b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 --2- 172.21.15.63:0/842218569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fada8004810 0x7fadc00c83e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:01:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 >> 172.21.15.63:0/842218569 conn(0x7fadc0067a00 msgr2=0x7fadc00c9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:01:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 shutdown_connections 2024-09-12T03:01:56.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:01:56.371+0000 7fadc6a00640 1 -- 172.21.15.63:0/842218569 wait complete. 2024-09-12T03:01:56.392 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-09-12T03:01:55.862796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238480,"kb_used_data":8696,"kb_used_omap":15,"kb_used_meta":229616,"kb_avail":754736240,"statfs":{"total":773094113280,"available":772849909760,"internally_reserved":0,"allocated":8904704,"data_stored":5195750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":235127470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004970"},"pg_stats":[{"pgid":"2.1f","version":"79'6","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975859+0000","last_change":"2024-09-12T02:59:32.000879+0000","last_active":"2024-09-12T02:59:47.975859+0000","last_peered":"2024-09-12T02:59:47.975859+0000","last_clean":"2024-09-12T02:59:47.975859+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:47.975859+0000","last_undegraded":"2024-09-12T02:59:47.975859+0000","last_fullsized":"2024-09-12T02:59:47.975859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.000756+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.073437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971629+0000","last_change":"2024-09-12T02:59:43.632597+0000","last_active":"2024-09-12T02:59:47.971629+0000","last_peered":"2024-09-12T02:59:47.971629+0000","last_clean":"2024-09-12T02:59:47.971629+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:47.971629+0000","last_undegraded":"2024-09-12T02:59:47.971629+0000","last_fullsized":"2024-09-12T02:59:47.971629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.632456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:01.396201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970626+0000","last_change":"2024-09-12T02:59:45.690062+0000","last_active":"2024-09-12T02:59:47.970626+0000","last_peered":"2024-09-12T02:59:47.970626+0000","last_clean":"2024-09-12T02:59:47.970626+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:47.970626+0000","last_undegraded":"2024-09-12T02:59:47.970626+0000","last_fullsized":"2024-09-12T02:59:47.970626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.689949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:02.009111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971812+0000","last_change":"2024-09-12T02:59:36.630496+0000","last_active":"2024-09-12T02:59:47.971812+0000","last_peered":"2024-09-12T02:59:47.971812+0000","last_clean":"2024-09-12T02:59:47.971812+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:47.971812+0000","last_undegraded":"2024-09-12T02:59:47.971812+0000","last_fullsized":"2024-09-12T02:59:47.971812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.630383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:49.675255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975738+0000","last_change":"2024-09-12T02:59:44.081098+0000","last_active":"2024-09-12T02:59:47.975738+0000","last_peered":"2024-09-12T02:59:47.975738+0000","last_clean":"2024-09-12T02:59:47.975738+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:47.975738+0000","last_undegraded":"2024-09-12T02:59:47.975738+0000","last_fullsized":"2024-09-12T02:59:47.975738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.080989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:55.266943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970430+0000","last_change":"2024-09-12T02:59:41.662320+0000","last_active":"2024-09-12T02:59:47.970430+0000","last_peered":"2024-09-12T02:59:47.970430+0000","last_clean":"2024-09-12T02:59:47.970430+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:47.970430+0000","last_undegraded":"2024-09-12T02:59:47.970430+0000","last_fullsized":"2024-09-12T02:59:47.970430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.662088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:28.169111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989531+0000","last_change":"2024-09-12T02:59:37.757533+0000","last_active":"2024-09-12T02:59:47.989531+0000","last_peered":"2024-09-12T02:59:47.989531+0000","last_clean":"2024-09-12T02:59:47.989531+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:47.989531+0000","last_undegraded":"2024-09-12T02:59:47.989531+0000","last_fullsized":"2024-09-12T02:59:47.989531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.757250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:10.370609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972898+0000","last_change":"2024-09-12T02:59:35.959195+0000","last_active":"2024-09-12T02:59:47.972898+0000","last_peered":"2024-09-12T02:59:47.972898+0000","last_clean":"2024-09-12T02:59:47.972898+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:47.972898+0000","last_undegraded":"2024-09-12T02:59:47.972898+0000","last_fullsized":"2024-09-12T02:59:47.972898+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.958975+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.932192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972153+0000","last_change":"2024-09-12T02:59:43.619841+0000","last_active":"2024-09-12T02:59:47.972153+0000","last_peered":"2024-09-12T02:59:47.972153+0000","last_clean":"2024-09-12T02:59:47.972153+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:47.972153+0000","last_undegraded":"2024-09-12T02:59:47.972153+0000","last_fullsized":"2024-09-12T02:59:47.972153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.619594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:49.784818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'3","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989105+0000","last_change":"2024-09-12T02:59:47.847154+0000","last_active":"2024-09-12T02:59:47.989105+0000","last_peered":"2024-09-12T02:59:47.989105+0000","last_clean":"2024-09-12T02:59:47.989105+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:47.989105+0000","last_undegraded":"2024-09-12T02:59:47.989105+0000","last_fullsized":"2024-09-12T02:59:47.989105+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.846797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.835241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973874+0000","last_change":"2024-09-12T02:59:44.041049+0000","last_active":"2024-09-12T02:59:47.973874+0000","last_peered":"2024-09-12T02:59:47.973874+0000","last_clean":"2024-09-12T02:59:47.973874+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:47.973874+0000","last_undegraded":"2024-09-12T02:59:47.973874+0000","last_fullsized":"2024-09-12T02:59:47.973874+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.040815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.885096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970873+0000","last_change":"2024-09-12T02:59:40.700614+0000","last_active":"2024-09-12T02:59:47.970873+0000","last_peered":"2024-09-12T02:59:47.970873+0000","last_clean":"2024-09-12T02:59:47.970873+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:47.970873+0000","last_undegraded":"2024-09-12T02:59:47.970873+0000","last_fullsized":"2024-09-12T02:59:47.970873+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.700368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:48.928824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986772+0000","last_change":"2024-09-12T02:59:39.629343+0000","last_active":"2024-09-12T02:59:47.986772+0000","last_peered":"2024-09-12T02:59:47.986772+0000","last_clean":"2024-09-12T02:59:47.986772+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:47.986772+0000","last_undegraded":"2024-09-12T02:59:47.986772+0000","last_fullsized":"2024-09-12T02:59:47.986772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.629058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:43.299464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988945+0000","last_change":"2024-09-12T02:59:36.789441+0000","last_active":"2024-09-12T02:59:47.988945+0000","last_peered":"2024-09-12T02:59:47.988945+0000","last_clean":"2024-09-12T02:59:47.988945+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:47.988945+0000","last_undegraded":"2024-09-12T02:59:47.988945+0000","last_fullsized":"2024-09-12T02:59:47.988945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.789151+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:41.135081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975060+0000","last_change":"2024-09-12T02:59:37.711523+0000","last_active":"2024-09-12T02:59:47.975060+0000","last_peered":"2024-09-12T02:59:47.975060+0000","last_clean":"2024-09-12T02:59:47.975060+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:47.975060+0000","last_undegraded":"2024-09-12T02:59:47.975060+0000","last_fullsized":"2024-09-12T02:59:47.975060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.711188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.241632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971004+0000","last_change":"2024-09-12T02:59:40.677307+0000","last_active":"2024-09-12T02:59:47.971004+0000","last_peered":"2024-09-12T02:59:47.971004+0000","last_clean":"2024-09-12T02:59:47.971004+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:47.971004+0000","last_undegraded":"2024-09-12T02:59:47.971004+0000","last_fullsized":"2024-09-12T02:59:47.971004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.677196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:18.992896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967822+0000","last_change":"2024-09-12T02:59:42.816275+0000","last_active":"2024-09-12T02:59:47.967822+0000","last_peered":"2024-09-12T02:59:47.967822+0000","last_clean":"2024-09-12T02:59:47.967822+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:47.967822+0000","last_undegraded":"2024-09-12T02:59:47.967822+0000","last_fullsized":"2024-09-12T02:59:47.967822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.816152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:29.323176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973341+0000","last_change":"2024-09-12T02:59:38.719352+0000","last_active":"2024-09-12T02:59:47.973341+0000","last_peered":"2024-09-12T02:59:47.973341+0000","last_clean":"2024-09-12T02:59:47.973341+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:47.973341+0000","last_undegraded":"2024-09-12T02:59:47.973341+0000","last_fullsized":"2024-09-12T02:59:47.973341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.719131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.333596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.642733+0000","last_change":"2024-09-12T02:59:50.642733+0000","last_active":"2024-09-12T02:59:50.642733+0000","last_peered":"2024-09-12T02:59:50.642733+0000","last_clean":"2024-09-12T02:59:50.642733+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:50.642733+0000","last_undegraded":"2024-09-12T02:59:50.642733+0000","last_fullsized":"2024-09-12T02:59:50.642733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.642614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967915+0000","last_change":"2024-09-12T02:59:32.776350+0000","last_active":"2024-09-12T02:59:47.967915+0000","last_peered":"2024-09-12T02:59:47.967915+0000","last_clean":"2024-09-12T02:59:47.967915+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:47.967915+0000","last_undegraded":"2024-09-12T02:59:47.967915+0000","last_fullsized":"2024-09-12T02:59:47.967915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.776267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:58.890222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968676+0000","last_change":"2024-09-12T02:59:34.789313+0000","last_active":"2024-09-12T02:59:47.968676+0000","last_peered":"2024-09-12T02:59:47.968676+0000","last_clean":"2024-09-12T02:59:47.968676+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:47.968676+0000","last_undegraded":"2024-09-12T02:59:47.968676+0000","last_fullsized":"2024-09-12T02:59:47.968676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.789214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.790935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971845+0000","last_change":"2024-09-12T02:59:34.632579+0000","last_active":"2024-09-12T02:59:47.971845+0000","last_peered":"2024-09-12T02:59:47.971845+0000","last_clean":"2024-09-12T02:59:47.971845+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:47.971845+0000","last_undegraded":"2024-09-12T02:59:47.971845+0000","last_fullsized":"2024-09-12T02:59:47.971845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.632350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.978281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987536+0000","last_change":"2024-09-12T02:59:35.785814+0000","last_active":"2024-09-12T02:59:47.987536+0000","last_peered":"2024-09-12T02:59:47.987536+0000","last_clean":"2024-09-12T02:59:47.987536+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:47.987536+0000","last_undegraded":"2024-09-12T02:59:47.987536+0000","last_fullsized":"2024-09-12T02:59:47.987536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.785459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.907074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":160,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975184+0000","last_change":"2024-09-12T02:59:44.644342+0000","last_active":"2024-09-12T02:59:47.975184+0000","last_peered":"2024-09-12T02:59:47.975184+0000","last_clean":"2024-09-12T02:59:47.975184+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:47.975184+0000","last_undegraded":"2024-09-12T02:59:47.975184+0000","last_fullsized":"2024-09-12T02:59:47.975184+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.644026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:49.273561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975474+0000","last_change":"2024-09-12T02:59:46.131647+0000","last_active":"2024-09-12T02:59:47.975474+0000","last_peered":"2024-09-12T02:59:47.975474+0000","last_clean":"2024-09-12T02:59:47.975474+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:47.975474+0000","last_undegraded":"2024-09-12T02:59:47.975474+0000","last_fullsized":"2024-09-12T02:59:47.975474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.131533+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:06.802576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988089+0000","last_change":"2024-09-12T02:59:35.721123+0000","last_active":"2024-09-12T02:59:47.988089+0000","last_peered":"2024-09-12T02:59:47.988089+0000","last_clean":"2024-09-12T02:59:47.988089+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:47.988089+0000","last_undegraded":"2024-09-12T02:59:47.988089+0000","last_fullsized":"2024-09-12T02:59:47.988089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.720761+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:17.277216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971181+0000","last_change":"2024-09-12T02:59:39.707123+0000","last_active":"2024-09-12T02:59:47.971181+0000","last_peered":"2024-09-12T02:59:47.971181+0000","last_clean":"2024-09-12T02:59:47.971181+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:47.971181+0000","last_undegraded":"2024-09-12T02:59:47.971181+0000","last_fullsized":"2024-09-12T02:59:47.971181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.706899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:08.753477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972514+0000","last_change":"2024-09-12T02:59:41.667809+0000","last_active":"2024-09-12T02:59:47.972514+0000","last_peered":"2024-09-12T02:59:47.972514+0000","last_clean":"2024-09-12T02:59:47.972514+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:47.972514+0000","last_undegraded":"2024-09-12T02:59:47.972514+0000","last_fullsized":"2024-09-12T02:59:47.972514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.667707+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:52.853661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969018+0000","last_change":"2024-09-12T02:59:45.841193+0000","last_active":"2024-09-12T02:59:47.969018+0000","last_peered":"2024-09-12T02:59:47.969018+0000","last_clean":"2024-09-12T02:59:47.969018+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:47.969018+0000","last_undegraded":"2024-09-12T02:59:47.969018+0000","last_fullsized":"2024-09-12T02:59:47.969018+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.841069+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:50.470604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.993328+0000","last_change":"2024-09-12T02:59:47.991190+0000","last_active":"2024-09-12T02:59:47.993328+0000","last_peered":"2024-09-12T02:59:47.993328+0000","last_clean":"2024-09-12T02:59:47.993328+0000","last_became_active":"2024-09-12T02:59:47.990629+0000","last_became_peered":"2024-09-12T02:59:47.990629+0000","last_unstale":"2024-09-12T02:59:47.993328+0000","last_undegraded":"2024-09-12T02:59:47.993328+0000","last_fullsized":"2024-09-12T02:59:47.993328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.643595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.689482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968300+0000","last_change":"2024-09-12T02:59:36.821336+0000","last_active":"2024-09-12T02:59:47.968300+0000","last_peered":"2024-09-12T02:59:47.968300+0000","last_clean":"2024-09-12T02:59:47.968300+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:47.968300+0000","last_undegraded":"2024-09-12T02:59:47.968300+0000","last_fullsized":"2024-09-12T02:59:47.968300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.821234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.321748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989889+0000","last_change":"2024-09-12T02:59:38.763406+0000","last_active":"2024-09-12T02:59:47.989889+0000","last_peered":"2024-09-12T02:59:47.989889+0000","last_clean":"2024-09-12T02:59:47.989889+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:47.989889+0000","last_undegraded":"2024-09-12T02:59:47.989889+0000","last_fullsized":"2024-09-12T02:59:47.989889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.763178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.755095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975134+0000","last_change":"2024-09-12T02:59:42.071495+0000","last_active":"2024-09-12T02:59:47.975134+0000","last_peered":"2024-09-12T02:59:47.975134+0000","last_clean":"2024-09-12T02:59:47.975134+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:47.975134+0000","last_undegraded":"2024-09-12T02:59:47.975134+0000","last_fullsized":"2024-09-12T02:59:47.975134+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.071362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:30.775559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973454+0000","last_change":"2024-09-12T02:59:39.026655+0000","last_active":"2024-09-12T02:59:47.973454+0000","last_peered":"2024-09-12T02:59:47.973454+0000","last_clean":"2024-09-12T02:59:47.973454+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:47.973454+0000","last_undegraded":"2024-09-12T02:59:47.973454+0000","last_fullsized":"2024-09-12T02:59:47.973454+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.026365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:52.426930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968353+0000","last_change":"2024-09-12T02:59:37.791375+0000","last_active":"2024-09-12T02:59:47.968353+0000","last_peered":"2024-09-12T02:59:47.968353+0000","last_clean":"2024-09-12T02:59:47.968353+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:47.968353+0000","last_undegraded":"2024-09-12T02:59:47.968353+0000","last_fullsized":"2024-09-12T02:59:47.968353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.791278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:11.783194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967824+0000","last_change":"2024-09-12T02:59:43.858969+0000","last_active":"2024-09-12T02:59:47.967824+0000","last_peered":"2024-09-12T02:59:47.967824+0000","last_clean":"2024-09-12T02:59:47.967824+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:47.967824+0000","last_undegraded":"2024-09-12T02:59:47.967824+0000","last_fullsized":"2024-09-12T02:59:47.967824+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.858860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972781+0000","last_change":"2024-09-12T02:59:35.662731+0000","last_active":"2024-09-12T02:59:47.972781+0000","last_peered":"2024-09-12T02:59:47.972781+0000","last_clean":"2024-09-12T02:59:47.972781+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:47.972781+0000","last_undegraded":"2024-09-12T02:59:47.972781+0000","last_fullsized":"2024-09-12T02:59:47.972781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.662469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:08.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971714+0000","last_change":"2024-09-12T02:59:32.999842+0000","last_active":"2024-09-12T02:59:47.971714+0000","last_peered":"2024-09-12T02:59:47.971714+0000","last_clean":"2024-09-12T02:59:47.971714+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:47.971714+0000","last_undegraded":"2024-09-12T02:59:47.971714+0000","last_fullsized":"2024-09-12T02:59:47.971714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.999508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:43.870533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.055261+0000","last_change":"2024-09-12T02:59:48.055261+0000","last_active":"2024-09-12T02:59:48.055261+0000","last_peered":"2024-09-12T02:59:48.055261+0000","last_clean":"2024-09-12T02:59:48.055261+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:48.055261+0000","last_undegraded":"2024-09-12T02:59:48.055261+0000","last_fullsized":"2024-09-12T02:59:48.055261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.055039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.593082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967982+0000","last_change":"2024-09-12T02:59:33.818250+0000","last_active":"2024-09-12T02:59:47.967982+0000","last_peered":"2024-09-12T02:59:47.967982+0000","last_clean":"2024-09-12T02:59:47.967982+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:47.967982+0000","last_undegraded":"2024-09-12T02:59:47.967982+0000","last_fullsized":"2024-09-12T02:59:47.967982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.818171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:46.646434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"79'3","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971922+0000","last_change":"2024-09-12T02:59:31.836989+0000","last_active":"2024-09-12T02:59:47.971922+0000","last_peered":"2024-09-12T02:59:47.971922+0000","last_clean":"2024-09-12T02:59:47.971922+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:47.971922+0000","last_undegraded":"2024-09-12T02:59:47.971922+0000","last_fullsized":"2024-09-12T02:59:47.971922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.836905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:53.031692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968392+0000","last_change":"2024-09-12T02:59:39.791877+0000","last_active":"2024-09-12T02:59:47.968392+0000","last_peered":"2024-09-12T02:59:47.968392+0000","last_clean":"2024-09-12T02:59:47.968392+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:47.968392+0000","last_undegraded":"2024-09-12T02:59:47.968392+0000","last_fullsized":"2024-09-12T02:59:47.968392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.791761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:25.406226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974736+0000","last_change":"2024-09-12T02:59:30.045775+0000","last_active":"2024-09-12T02:59:47.974736+0000","last_peered":"2024-09-12T02:59:47.974736+0000","last_clean":"2024-09-12T02:59:47.974736+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:47.974736+0000","last_undegraded":"2024-09-12T02:59:47.974736+0000","last_fullsized":"2024-09-12T02:59:47.974736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.045690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:33.716096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.861935+0000","last_change":"2024-09-12T02:59:49.861935+0000","last_active":"2024-09-12T02:59:49.861935+0000","last_peered":"2024-09-12T02:59:49.861935+0000","last_clean":"2024-09-12T02:59:49.861935+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:49.861935+0000","last_undegraded":"2024-09-12T02:59:49.861935+0000","last_fullsized":"2024-09-12T02:59:49.861935+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.861705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:39.315077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975303+0000","last_change":"2024-09-12T02:59:40.118829+0000","last_active":"2024-09-12T02:59:47.975303+0000","last_peered":"2024-09-12T02:59:47.975303+0000","last_clean":"2024-09-12T02:59:47.975303+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:47.975303+0000","last_undegraded":"2024-09-12T02:59:47.975303+0000","last_fullsized":"2024-09-12T02:59:47.975303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.118699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:10.405280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970932+0000","last_change":"2024-09-12T02:59:47.676864+0000","last_active":"2024-09-12T02:59:47.970932+0000","last_peered":"2024-09-12T02:59:47.970932+0000","last_clean":"2024-09-12T02:59:47.970932+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:47.970932+0000","last_undegraded":"2024-09-12T02:59:47.970932+0000","last_fullsized":"2024-09-12T02:59:47.970932+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.676747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.675367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972045+0000","last_change":"2024-09-12T02:59:40.971763+0000","last_active":"2024-09-12T02:59:47.972045+0000","last_peered":"2024-09-12T02:59:47.972045+0000","last_clean":"2024-09-12T02:59:47.972045+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:47.972045+0000","last_undegraded":"2024-09-12T02:59:47.972045+0000","last_fullsized":"2024-09-12T02:59:47.972045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.971535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:04.999865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"79'119","reported_seq":299,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988085+0000","last_change":"2024-09-12T02:59:34.803297+0000","last_active":"2024-09-12T02:59:47.988085+0000","last_peered":"2024-09-12T02:59:47.988085+0000","last_clean":"2024-09-12T02:59:47.988085+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:47.988085+0000","last_undegraded":"2024-09-12T02:59:47.988085+0000","last_fullsized":"2024-09-12T02:59:47.988085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.802947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:59.161855+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986575+0000","last_change":"2024-09-12T02:59:42.682806+0000","last_active":"2024-09-12T02:59:47.986575+0000","last_peered":"2024-09-12T02:59:47.986575+0000","last_clean":"2024-09-12T02:59:47.986575+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:47.986575+0000","last_undegraded":"2024-09-12T02:59:47.986575+0000","last_fullsized":"2024-09-12T02:59:47.986575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.682574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:22.933579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968536+0000","last_change":"2024-09-12T02:59:35.830230+0000","last_active":"2024-09-12T02:59:47.968536+0000","last_peered":"2024-09-12T02:59:47.968536+0000","last_clean":"2024-09-12T02:59:47.968536+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:47.968536+0000","last_undegraded":"2024-09-12T02:59:47.968536+0000","last_fullsized":"2024-09-12T02:59:47.968536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.830121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.993178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972484+0000","last_change":"2024-09-12T02:59:35.842501+0000","last_active":"2024-09-12T02:59:47.972484+0000","last_peered":"2024-09-12T02:59:47.972484+0000","last_clean":"2024-09-12T02:59:47.972484+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:47.972484+0000","last_undegraded":"2024-09-12T02:59:47.972484+0000","last_fullsized":"2024-09-12T02:59:47.972484+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.842396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:47.840469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986481+0000","last_change":"2024-09-12T02:59:41.651678+0000","last_active":"2024-09-12T02:59:47.986481+0000","last_peered":"2024-09-12T02:59:47.986481+0000","last_clean":"2024-09-12T02:59:47.986481+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:47.986481+0000","last_undegraded":"2024-09-12T02:59:47.986481+0000","last_fullsized":"2024-09-12T02:59:47.986481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.651443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:40.919631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973428+0000","last_change":"2024-09-12T02:59:34.986788+0000","last_active":"2024-09-12T02:59:47.973428+0000","last_peered":"2024-09-12T02:59:47.973428+0000","last_clean":"2024-09-12T02:59:47.973428+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:47.973428+0000","last_undegraded":"2024-09-12T02:59:47.973428+0000","last_fullsized":"2024-09-12T02:59:47.973428+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.986542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:35.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"79'2","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968858+0000","last_change":"2024-09-12T02:59:31.772320+0000","last_active":"2024-09-12T02:59:47.968858+0000","last_peered":"2024-09-12T02:59:47.968858+0000","last_clean":"2024-09-12T02:59:47.968858+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:47.968858+0000","last_undegraded":"2024-09-12T02:59:47.968858+0000","last_fullsized":"2024-09-12T02:59:47.968858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.772236+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:19.909174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975370+0000","last_change":"2024-09-12T02:59:43.053479+0000","last_active":"2024-09-12T02:59:47.975370+0000","last_peered":"2024-09-12T02:59:47.975370+0000","last_clean":"2024-09-12T02:59:47.975370+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:47.975370+0000","last_undegraded":"2024-09-12T02:59:47.975370+0000","last_fullsized":"2024-09-12T02:59:47.975370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.053377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:21.369077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989776+0000","last_change":"2024-09-12T02:59:46.862199+0000","last_active":"2024-09-12T02:59:47.989776+0000","last_peered":"2024-09-12T02:59:47.989776+0000","last_clean":"2024-09-12T02:59:47.989776+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:47.989776+0000","last_undegraded":"2024-09-12T02:59:47.989776+0000","last_fullsized":"2024-09-12T02:59:47.989776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.861972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:51.491507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972773+0000","last_change":"2024-09-12T02:59:30.860535+0000","last_active":"2024-09-12T02:59:47.972773+0000","last_peered":"2024-09-12T02:59:47.972773+0000","last_clean":"2024-09-12T02:59:47.972773+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:47.972773+0000","last_undegraded":"2024-09-12T02:59:47.972773+0000","last_fullsized":"2024-09-12T02:59:47.972773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.860444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:23.065975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.093650+0000","last_change":"2024-09-12T02:59:49.093650+0000","last_active":"2024-09-12T02:59:49.093650+0000","last_peered":"2024-09-12T02:59:49.093650+0000","last_clean":"2024-09-12T02:59:49.093650+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:49.093650+0000","last_undegraded":"2024-09-12T02:59:49.093650+0000","last_fullsized":"2024-09-12T02:59:49.093650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.093403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.133030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989482+0000","last_change":"2024-09-12T02:59:44.860343+0000","last_active":"2024-09-12T02:59:47.989482+0000","last_peered":"2024-09-12T02:59:47.989482+0000","last_clean":"2024-09-12T02:59:47.989482+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:47.989482+0000","last_undegraded":"2024-09-12T02:59:47.989482+0000","last_fullsized":"2024-09-12T02:59:47.989482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.860002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:03.716731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975493+0000","last_change":"2024-09-12T02:59:31.636304+0000","last_active":"2024-09-12T02:59:47.975493+0000","last_peered":"2024-09-12T02:59:47.975493+0000","last_clean":"2024-09-12T02:59:47.975493+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:47.975493+0000","last_undegraded":"2024-09-12T02:59:47.975493+0000","last_fullsized":"2024-09-12T02:59:47.975493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.636071+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:48.966306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974649+0000","last_change":"2024-09-12T02:59:42.661415+0000","last_active":"2024-09-12T02:59:47.974649+0000","last_peered":"2024-09-12T02:59:47.974649+0000","last_clean":"2024-09-12T02:59:47.974649+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:47.974649+0000","last_undegraded":"2024-09-12T02:59:47.974649+0000","last_fullsized":"2024-09-12T02:59:47.974649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.661146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986421+0000","last_change":"2024-09-12T02:59:45.832208+0000","last_active":"2024-09-12T02:59:47.986421+0000","last_peered":"2024-09-12T02:59:47.986421+0000","last_clean":"2024-09-12T02:59:47.986421+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:47.986421+0000","last_undegraded":"2024-09-12T02:59:47.986421+0000","last_fullsized":"2024-09-12T02:59:47.986421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.831975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'12","reported_seq":185,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971629+0000","last_change":"2024-09-12T02:59:36.886312+0000","last_active":"2024-09-12T02:59:47.971629+0000","last_peered":"2024-09-12T02:59:47.971629+0000","last_clean":"2024-09-12T02:59:47.971629+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:47.971629+0000","last_undegraded":"2024-09-12T02:59:47.971629+0000","last_fullsized":"2024-09-12T02:59:47.971629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.886179+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:45.626516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975159+0000","last_change":"2024-09-12T02:59:39.156656+0000","last_active":"2024-09-12T02:59:47.975159+0000","last_peered":"2024-09-12T02:59:47.975159+0000","last_clean":"2024-09-12T02:59:47.975159+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:47.975159+0000","last_undegraded":"2024-09-12T02:59:47.975159+0000","last_fullsized":"2024-09-12T02:59:47.975159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.156542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:34.954291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987537+0000","last_change":"2024-09-12T02:59:37.673643+0000","last_active":"2024-09-12T02:59:47.987537+0000","last_peered":"2024-09-12T02:59:47.987537+0000","last_clean":"2024-09-12T02:59:47.987537+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:47.987537+0000","last_undegraded":"2024-09-12T02:59:47.987537+0000","last_fullsized":"2024-09-12T02:59:47.987537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.673292+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.523545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988693+0000","last_change":"2024-09-12T02:59:33.671444+0000","last_active":"2024-09-12T02:59:47.988693+0000","last_peered":"2024-09-12T02:59:47.988693+0000","last_clean":"2024-09-12T02:59:47.988693+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:47.988693+0000","last_undegraded":"2024-09-12T02:59:47.988693+0000","last_fullsized":"2024-09-12T02:59:47.988693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.671212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:45.669284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972298+0000","last_change":"2024-09-12T02:59:34.590629+0000","last_active":"2024-09-12T02:59:47.972298+0000","last_peered":"2024-09-12T02:59:47.972298+0000","last_clean":"2024-09-12T02:59:47.972298+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:47.972298+0000","last_undegraded":"2024-09-12T02:59:47.972298+0000","last_fullsized":"2024-09-12T02:59:47.972298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.590531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.762881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988763+0000","last_change":"2024-09-12T02:59:43.837261+0000","last_active":"2024-09-12T02:59:47.988763+0000","last_peered":"2024-09-12T02:59:47.988763+0000","last_clean":"2024-09-12T02:59:47.988763+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:47.988763+0000","last_undegraded":"2024-09-12T02:59:47.988763+0000","last_fullsized":"2024-09-12T02:59:47.988763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.836980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.344004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970625+0000","last_change":"2024-09-12T02:59:45.048563+0000","last_active":"2024-09-12T02:59:47.970625+0000","last_peered":"2024-09-12T02:59:47.970625+0000","last_clean":"2024-09-12T02:59:47.970625+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:47.970625+0000","last_undegraded":"2024-09-12T02:59:47.970625+0000","last_fullsized":"2024-09-12T02:59:47.970625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.048315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:20.692033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.611694+0000","last_change":"2024-09-12T02:59:49.611694+0000","last_active":"2024-09-12T02:59:49.611694+0000","last_peered":"2024-09-12T02:59:49.611694+0000","last_clean":"2024-09-12T02:59:49.611694+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:49.611694+0000","last_undegraded":"2024-09-12T02:59:49.611694+0000","last_fullsized":"2024-09-12T02:59:49.611694+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.611569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:05.308212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975313+0000","last_change":"2024-09-12T02:59:36.076892+0000","last_active":"2024-09-12T02:59:47.975313+0000","last_peered":"2024-09-12T02:59:47.975313+0000","last_clean":"2024-09-12T02:59:47.975313+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:47.975313+0000","last_undegraded":"2024-09-12T02:59:47.975313+0000","last_fullsized":"2024-09-12T02:59:47.975313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.076727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:26.666775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975650+0000","last_change":"2024-09-12T02:59:30.999792+0000","last_active":"2024-09-12T02:59:47.975650+0000","last_peered":"2024-09-12T02:59:47.975650+0000","last_clean":"2024-09-12T02:59:47.975650+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:47.975650+0000","last_undegraded":"2024-09-12T02:59:47.975650+0000","last_fullsized":"2024-09-12T02:59:47.975650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.999703+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:17.375066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973992+0000","last_change":"2024-09-12T02:59:34.015485+0000","last_active":"2024-09-12T02:59:47.973992+0000","last_peered":"2024-09-12T02:59:47.973992+0000","last_clean":"2024-09-12T02:59:47.973992+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:47.973992+0000","last_undegraded":"2024-09-12T02:59:47.973992+0000","last_fullsized":"2024-09-12T02:59:47.973992+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.015247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:05.065563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989055+0000","last_change":"2024-09-12T02:59:41.793529+0000","last_active":"2024-09-12T02:59:47.989055+0000","last_peered":"2024-09-12T02:59:47.989055+0000","last_clean":"2024-09-12T02:59:47.989055+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:47.989055+0000","last_undegraded":"2024-09-12T02:59:47.989055+0000","last_fullsized":"2024-09-12T02:59:47.989055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.793303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.839881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":168,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987950+0000","last_change":"2024-09-12T02:59:32.647074+0000","last_active":"2024-09-12T02:59:47.987950+0000","last_peered":"2024-09-12T02:59:47.987950+0000","last_clean":"2024-09-12T02:59:47.987950+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:47.987950+0000","last_undegraded":"2024-09-12T02:59:47.987950+0000","last_fullsized":"2024-09-12T02:59:47.987950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'28","last_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_deep_scrub":"79'28","last_deep_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.646844+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:46.886484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968112+0000","last_change":"2024-09-12T02:59:46.857630+0000","last_active":"2024-09-12T02:59:47.968112+0000","last_peered":"2024-09-12T02:59:47.968112+0000","last_clean":"2024-09-12T02:59:47.968112+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:47.968112+0000","last_undegraded":"2024-09-12T02:59:47.968112+0000","last_fullsized":"2024-09-12T02:59:47.968112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.857527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.845970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974181+0000","last_change":"2024-09-12T02:59:33.680657+0000","last_active":"2024-09-12T02:59:47.974181+0000","last_peered":"2024-09-12T02:59:47.974181+0000","last_clean":"2024-09-12T02:59:47.974181+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:47.974181+0000","last_undegraded":"2024-09-12T02:59:47.974181+0000","last_fullsized":"2024-09-12T02:59:47.974181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.680411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:15.802027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'7","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968736+0000","last_change":"2024-09-12T02:59:44.852192+0000","last_active":"2024-09-12T02:59:47.968736+0000","last_peered":"2024-09-12T02:59:47.968736+0000","last_clean":"2024-09-12T02:59:47.968736+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:47.968736+0000","last_undegraded":"2024-09-12T02:59:47.968736+0000","last_fullsized":"2024-09-12T02:59:47.968736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.852086+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.017309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":167,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971975+0000","last_change":"2024-09-12T02:59:45.664653+0000","last_active":"2024-09-12T02:59:47.971975+0000","last_peered":"2024-09-12T02:59:47.971975+0000","last_clean":"2024-09-12T02:59:47.971975+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:47.971975+0000","last_undegraded":"2024-09-12T02:59:47.971975+0000","last_fullsized":"2024-09-12T02:59:47.971975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.664314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.652758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975834+0000","last_change":"2024-09-12T02:59:45.129108+0000","last_active":"2024-09-12T02:59:47.975834+0000","last_peered":"2024-09-12T02:59:47.975834+0000","last_clean":"2024-09-12T02:59:47.975834+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:47.975834+0000","last_undegraded":"2024-09-12T02:59:47.975834+0000","last_fullsized":"2024-09-12T02:59:47.975834+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.128965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.549002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974003+0000","last_change":"2024-09-12T02:59:37.986005+0000","last_active":"2024-09-12T02:59:47.974003+0000","last_peered":"2024-09-12T02:59:47.974003+0000","last_clean":"2024-09-12T02:59:47.974003+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:47.974003+0000","last_undegraded":"2024-09-12T02:59:47.974003+0000","last_fullsized":"2024-09-12T02:59:47.974003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.985746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:14.181632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.639783+0000","last_change":"2024-09-12T02:59:51.639783+0000","last_active":"2024-09-12T02:59:51.639783+0000","last_peered":"2024-09-12T02:59:51.639783+0000","last_clean":"2024-09-12T02:59:51.639783+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:51.639783+0000","last_undegraded":"2024-09-12T02:59:51.639783+0000","last_fullsized":"2024-09-12T02:59:51.639783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.639668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.759727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974118+0000","last_change":"2024-09-12T02:59:39.987993+0000","last_active":"2024-09-12T02:59:47.974118+0000","last_peered":"2024-09-12T02:59:47.974118+0000","last_clean":"2024-09-12T02:59:47.974118+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:47.974118+0000","last_undegraded":"2024-09-12T02:59:47.974118+0000","last_fullsized":"2024-09-12T02:59:47.974118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.987743+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:04.424759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987908+0000","last_change":"2024-09-12T02:59:45.721685+0000","last_active":"2024-09-12T02:59:47.987908+0000","last_peered":"2024-09-12T02:59:47.987908+0000","last_clean":"2024-09-12T02:59:47.987908+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:47.987908+0000","last_undegraded":"2024-09-12T02:59:47.987908+0000","last_fullsized":"2024-09-12T02:59:47.987908+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.721444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.143614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970853+0000","last_change":"2024-09-12T02:59:46.669010+0000","last_active":"2024-09-12T02:59:47.970853+0000","last_peered":"2024-09-12T02:59:47.970853+0000","last_clean":"2024-09-12T02:59:47.970853+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:47.970853+0000","last_undegraded":"2024-09-12T02:59:47.970853+0000","last_fullsized":"2024-09-12T02:59:47.970853+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.668894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:22.826170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975134+0000","last_change":"2024-09-12T02:59:41.077595+0000","last_active":"2024-09-12T02:59:47.975134+0000","last_peered":"2024-09-12T02:59:47.975134+0000","last_clean":"2024-09-12T02:59:47.975134+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:47.975134+0000","last_undegraded":"2024-09-12T02:59:47.975134+0000","last_fullsized":"2024-09-12T02:59:47.975134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.077484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:52.294457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967794+0000","last_change":"2024-09-12T02:59:41.841470+0000","last_active":"2024-09-12T02:59:47.967794+0000","last_peered":"2024-09-12T02:59:47.967794+0000","last_clean":"2024-09-12T02:59:47.967794+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:47.967794+0000","last_undegraded":"2024-09-12T02:59:47.967794+0000","last_fullsized":"2024-09-12T02:59:47.967794+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.841333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.069789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.131633+0000","last_change":"2024-09-12T02:59:51.131633+0000","last_active":"2024-09-12T02:59:51.131633+0000","last_peered":"2024-09-12T02:59:51.131633+0000","last_clean":"2024-09-12T02:59:51.131633+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:51.131633+0000","last_undegraded":"2024-09-12T02:59:51.131633+0000","last_fullsized":"2024-09-12T02:59:51.131633+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.131397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:19.953861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987377+0000","last_change":"2024-09-12T02:59:46.767895+0000","last_active":"2024-09-12T02:59:47.987377+0000","last_peered":"2024-09-12T02:59:47.987377+0000","last_clean":"2024-09-12T02:59:47.987377+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:47.987377+0000","last_undegraded":"2024-09-12T02:59:47.987377+0000","last_fullsized":"2024-09-12T02:59:47.987377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.767560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.939911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971481+0000","last_change":"2024-09-12T02:59:39.674943+0000","last_active":"2024-09-12T02:59:47.971481+0000","last_peered":"2024-09-12T02:59:47.971481+0000","last_clean":"2024-09-12T02:59:47.971481+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:47.971481+0000","last_undegraded":"2024-09-12T02:59:47.971481+0000","last_fullsized":"2024-09-12T02:59:47.971481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.674831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:28.379028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971031+0000","last_change":"2024-09-12T02:59:37.660153+0000","last_active":"2024-09-12T02:59:47.971031+0000","last_peered":"2024-09-12T02:59:47.971031+0000","last_clean":"2024-09-12T02:59:47.971031+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:47.971031+0000","last_undegraded":"2024-09-12T02:59:47.971031+0000","last_fullsized":"2024-09-12T02:59:47.971031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.660048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:32.261376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987111+0000","last_change":"2024-09-12T02:59:34.716068+0000","last_active":"2024-09-12T02:59:47.987111+0000","last_peered":"2024-09-12T02:59:47.987111+0000","last_clean":"2024-09-12T02:59:47.987111+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:47.987111+0000","last_undegraded":"2024-09-12T02:59:47.987111+0000","last_fullsized":"2024-09-12T02:59:47.987111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.715793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:43.456130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975476+0000","last_change":"2024-09-12T02:59:38.162584+0000","last_active":"2024-09-12T02:59:47.975476+0000","last_peered":"2024-09-12T02:59:47.975476+0000","last_clean":"2024-09-12T02:59:47.975476+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:47.975476+0000","last_undegraded":"2024-09-12T02:59:47.975476+0000","last_fullsized":"2024-09-12T02:59:47.975476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.162461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:51.207333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972265+0000","last_change":"2024-09-12T02:59:34.845414+0000","last_active":"2024-09-12T02:59:47.972265+0000","last_peered":"2024-09-12T02:59:47.972265+0000","last_clean":"2024-09-12T02:59:47.972265+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:47.972265+0000","last_undegraded":"2024-09-12T02:59:47.972265+0000","last_fullsized":"2024-09-12T02:59:47.972265+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.845313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:49.084952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971084+0000","last_change":"2024-09-12T02:59:38.676599+0000","last_active":"2024-09-12T02:59:47.971084+0000","last_peered":"2024-09-12T02:59:47.971084+0000","last_clean":"2024-09-12T02:59:47.971084+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:47.971084+0000","last_undegraded":"2024-09-12T02:59:47.971084+0000","last_fullsized":"2024-09-12T02:59:47.971084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.676453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:08.813287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971443+0000","last_change":"2024-09-12T02:59:32.676152+0000","last_active":"2024-09-12T02:59:47.971443+0000","last_peered":"2024-09-12T02:59:47.971443+0000","last_clean":"2024-09-12T02:59:47.971443+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:47.971443+0000","last_undegraded":"2024-09-12T02:59:47.971443+0000","last_fullsized":"2024-09-12T02:59:47.971443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.675897+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971857+0000","last_change":"2024-09-12T02:59:32.600836+0000","last_active":"2024-09-12T02:59:47.971857+0000","last_peered":"2024-09-12T02:59:47.971857+0000","last_clean":"2024-09-12T02:59:47.971857+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:47.971857+0000","last_undegraded":"2024-09-12T02:59:47.971857+0000","last_fullsized":"2024-09-12T02:59:47.971857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.600751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:36.409439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988055+0000","last_change":"2024-09-12T02:59:36.720562+0000","last_active":"2024-09-12T02:59:47.988055+0000","last_peered":"2024-09-12T02:59:47.988055+0000","last_clean":"2024-09-12T02:59:47.988055+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:47.988055+0000","last_undegraded":"2024-09-12T02:59:47.988055+0000","last_fullsized":"2024-09-12T02:59:47.988055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.720181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.336802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":160,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971753+0000","last_change":"2024-09-12T02:59:33.813763+0000","last_active":"2024-09-12T02:59:47.971753+0000","last_peered":"2024-09-12T02:59:47.971753+0000","last_clean":"2024-09-12T02:59:47.971753+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:47.971753+0000","last_undegraded":"2024-09-12T02:59:47.971753+0000","last_fullsized":"2024-09-12T02:59:47.971753+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.813677+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:54.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971306+0000","last_change":"2024-09-12T02:59:43.020950+0000","last_active":"2024-09-12T02:59:47.971306+0000","last_peered":"2024-09-12T02:59:47.971306+0000","last_clean":"2024-09-12T02:59:47.971306+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:47.971306+0000","last_undegraded":"2024-09-12T02:59:47.971306+0000","last_fullsized":"2024-09-12T02:59:47.971306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.020633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:20.020956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975562+0000","last_change":"2024-09-12T02:59:35.065915+0000","last_active":"2024-09-12T02:59:47.975562+0000","last_peered":"2024-09-12T02:59:47.975562+0000","last_clean":"2024-09-12T02:59:47.975562+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:47.975562+0000","last_undegraded":"2024-09-12T02:59:47.975562+0000","last_fullsized":"2024-09-12T02:59:47.975562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.065802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:51.998513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971356+0000","last_change":"2024-09-12T02:59:33.570266+0000","last_active":"2024-09-12T02:59:47.971356+0000","last_peered":"2024-09-12T02:59:47.971356+0000","last_clean":"2024-09-12T02:59:47.971356+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:47.971356+0000","last_undegraded":"2024-09-12T02:59:47.971356+0000","last_fullsized":"2024-09-12T02:59:47.971356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.570177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:57.992347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968402+0000","last_change":"2024-09-12T02:59:30.749318+0000","last_active":"2024-09-12T02:59:47.968402+0000","last_peered":"2024-09-12T02:59:47.968402+0000","last_clean":"2024-09-12T02:59:47.968402+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:47.968402+0000","last_undegraded":"2024-09-12T02:59:47.968402+0000","last_fullsized":"2024-09-12T02:59:47.968402+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.749228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:31.541524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987586+0000","last_change":"2024-09-12T02:59:38.651039+0000","last_active":"2024-09-12T02:59:47.987586+0000","last_peered":"2024-09-12T02:59:47.987586+0000","last_clean":"2024-09-12T02:59:47.987586+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:47.987586+0000","last_undegraded":"2024-09-12T02:59:47.987586+0000","last_fullsized":"2024-09-12T02:59:47.987586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.650631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.137855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972462+0000","last_change":"2024-09-12T02:59:42.663691+0000","last_active":"2024-09-12T02:59:47.972462+0000","last_peered":"2024-09-12T02:59:47.972462+0000","last_clean":"2024-09-12T02:59:47.972462+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:47.972462+0000","last_undegraded":"2024-09-12T02:59:47.972462+0000","last_fullsized":"2024-09-12T02:59:47.972462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.663586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:23.083624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.118766+0000","last_change":"2024-09-12T02:59:50.118766+0000","last_active":"2024-09-12T02:59:50.118766+0000","last_peered":"2024-09-12T02:59:50.118766+0000","last_clean":"2024-09-12T02:59:50.118766+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:50.118766+0000","last_undegraded":"2024-09-12T02:59:50.118766+0000","last_fullsized":"2024-09-12T02:59:50.118766+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.118459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:39.693765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970671+0000","last_change":"2024-09-12T02:59:31.642639+0000","last_active":"2024-09-12T02:59:47.970671+0000","last_peered":"2024-09-12T02:59:47.970671+0000","last_clean":"2024-09-12T02:59:47.970671+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:47.970671+0000","last_undegraded":"2024-09-12T02:59:47.970671+0000","last_fullsized":"2024-09-12T02:59:47.970671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.642539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:45.910007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971028+0000","last_change":"2024-09-12T02:59:42.020010+0000","last_active":"2024-09-12T02:59:47.971028+0000","last_peered":"2024-09-12T02:59:47.971028+0000","last_clean":"2024-09-12T02:59:47.971028+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:47.971028+0000","last_undegraded":"2024-09-12T02:59:47.971028+0000","last_fullsized":"2024-09-12T02:59:47.971028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.019770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:02.627789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975254+0000","last_change":"2024-09-12T02:59:37.126601+0000","last_active":"2024-09-12T02:59:47.975254+0000","last_peered":"2024-09-12T02:59:47.975254+0000","last_clean":"2024-09-12T02:59:47.975254+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:47.975254+0000","last_undegraded":"2024-09-12T02:59:47.975254+0000","last_fullsized":"2024-09-12T02:59:47.975254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.126497+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:41.431052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987834+0000","last_change":"2024-09-12T02:59:40.644873+0000","last_active":"2024-09-12T02:59:47.987834+0000","last_peered":"2024-09-12T02:59:47.987834+0000","last_clean":"2024-09-12T02:59:47.987834+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:47.987834+0000","last_undegraded":"2024-09-12T02:59:47.987834+0000","last_fullsized":"2024-09-12T02:59:47.987834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.644626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:27.019990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989691+0000","last_change":"2024-09-12T02:59:42.787927+0000","last_active":"2024-09-12T02:59:47.989691+0000","last_peered":"2024-09-12T02:59:47.989691+0000","last_clean":"2024-09-12T02:59:47.989691+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:47.989691+0000","last_undegraded":"2024-09-12T02:59:47.989691+0000","last_fullsized":"2024-09-12T02:59:47.989691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.787542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.015998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972737+0000","last_change":"2024-09-12T02:59:32.823831+0000","last_active":"2024-09-12T02:59:47.972737+0000","last_peered":"2024-09-12T02:59:47.972737+0000","last_clean":"2024-09-12T02:59:47.972737+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:47.972737+0000","last_undegraded":"2024-09-12T02:59:47.972737+0000","last_fullsized":"2024-09-12T02:59:47.972737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.823742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:34.576078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974580+0000","last_change":"2024-09-12T02:59:47.049456+0000","last_active":"2024-09-12T02:59:47.974580+0000","last_peered":"2024-09-12T02:59:47.974580+0000","last_clean":"2024-09-12T02:59:47.974580+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:47.974580+0000","last_undegraded":"2024-09-12T02:59:47.974580+0000","last_fullsized":"2024-09-12T02:59:47.974580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.049206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:32.900134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971380+0000","last_change":"2024-09-12T02:59:37.007470+0000","last_active":"2024-09-12T02:59:47.971380+0000","last_peered":"2024-09-12T02:59:47.971380+0000","last_clean":"2024-09-12T02:59:47.971380+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:47.971380+0000","last_undegraded":"2024-09-12T02:59:47.971380+0000","last_fullsized":"2024-09-12T02:59:47.971380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.007224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:18.542924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967872+0000","last_change":"2024-09-12T02:59:40.838979+0000","last_active":"2024-09-12T02:59:47.967872+0000","last_peered":"2024-09-12T02:59:47.967872+0000","last_clean":"2024-09-12T02:59:47.967872+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:47.967872+0000","last_undegraded":"2024-09-12T02:59:47.967872+0000","last_fullsized":"2024-09-12T02:59:47.967872+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.838843+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:09.885421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975181+0000","last_change":"2024-09-12T02:59:34.019995+0000","last_active":"2024-09-12T02:59:47.975181+0000","last_peered":"2024-09-12T02:59:47.975181+0000","last_clean":"2024-09-12T02:59:47.975181+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:47.975181+0000","last_undegraded":"2024-09-12T02:59:47.975181+0000","last_fullsized":"2024-09-12T02:59:47.975181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.019910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.828598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970840+0000","last_change":"2024-09-12T02:59:35.597391+0000","last_active":"2024-09-12T02:59:47.970840+0000","last_peered":"2024-09-12T02:59:47.970840+0000","last_clean":"2024-09-12T02:59:47.970840+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:47.970840+0000","last_undegraded":"2024-09-12T02:59:47.970840+0000","last_fullsized":"2024-09-12T02:59:47.970840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.597291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:38.185412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973797+0000","last_change":"2024-09-12T02:59:36.682299+0000","last_active":"2024-09-12T02:59:47.973797+0000","last_peered":"2024-09-12T02:59:47.973797+0000","last_clean":"2024-09-12T02:59:47.973797+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:47.973797+0000","last_undegraded":"2024-09-12T02:59:47.973797+0000","last_fullsized":"2024-09-12T02:59:47.973797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.682064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:10.673981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986906+0000","last_change":"2024-09-12T02:59:44.683736+0000","last_active":"2024-09-12T02:59:47.986906+0000","last_peered":"2024-09-12T02:59:47.986906+0000","last_clean":"2024-09-12T02:59:47.986906+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:47.986906+0000","last_undegraded":"2024-09-12T02:59:47.986906+0000","last_fullsized":"2024-09-12T02:59:47.986906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.683432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.492120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987167+0000","last_change":"2024-09-12T02:59:43.695797+0000","last_active":"2024-09-12T02:59:47.987167+0000","last_peered":"2024-09-12T02:59:47.987167+0000","last_clean":"2024-09-12T02:59:47.987167+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:47.987167+0000","last_undegraded":"2024-09-12T02:59:47.987167+0000","last_fullsized":"2024-09-12T02:59:47.987167+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'16","last_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_deep_scrub":"79'16","last_deep_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.695424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:57.962892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.814119+0000","last_change":"2024-09-12T02:59:48.814183+0000","last_active":"2024-09-12T02:59:48.814119+0000","last_peered":"2024-09-12T02:59:48.814119+0000","last_clean":"2024-09-12T02:59:48.814119+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:48.814119+0000","last_undegraded":"2024-09-12T02:59:48.814119+0000","last_fullsized":"2024-09-12T02:59:48.814119+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.813942+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:41.235405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.652380+0000","last_change":"2024-09-12T02:59:48.652404+0000","last_active":"2024-09-12T02:59:48.652380+0000","last_peered":"2024-09-12T02:59:48.652380+0000","last_clean":"2024-09-12T02:59:48.652380+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:48.652380+0000","last_undegraded":"2024-09-12T02:59:48.652380+0000","last_fullsized":"2024-09-12T02:59:48.652380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.652295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:24.469845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986239+0000","last_change":"2024-09-12T02:59:40.773384+0000","last_active":"2024-09-12T02:59:47.986239+0000","last_peered":"2024-09-12T02:59:47.986239+0000","last_clean":"2024-09-12T02:59:47.986239+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:47.986239+0000","last_undegraded":"2024-09-12T02:59:47.986239+0000","last_fullsized":"2024-09-12T02:59:47.986239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.773129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.980310+0000","last_change":"2024-09-12T02:59:47.977081+0000","last_active":"2024-09-12T02:59:47.980310+0000","last_peered":"2024-09-12T02:59:47.980310+0000","last_clean":"2024-09-12T02:59:47.980310+0000","last_became_active":"2024-09-12T02:59:47.976687+0000","last_became_peered":"2024-09-12T02:59:47.976687+0000","last_unstale":"2024-09-12T02:59:47.980310+0000","last_undegraded":"2024-09-12T02:59:47.980310+0000","last_fullsized":"2024-09-12T02:59:47.980310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988297+0000","last_change":"2024-09-12T02:59:39.769618+0000","last_active":"2024-09-12T02:59:47.988297+0000","last_peered":"2024-09-12T02:59:47.988297+0000","last_clean":"2024-09-12T02:59:47.988297+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:47.988297+0000","last_undegraded":"2024-09-12T02:59:47.988297+0000","last_fullsized":"2024-09-12T02:59:47.988297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.769355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:44.299798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973139+0000","last_change":"2024-09-12T02:59:46.045977+0000","last_active":"2024-09-12T02:59:47.973139+0000","last_peered":"2024-09-12T02:59:47.973139+0000","last_clean":"2024-09-12T02:59:47.973139+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:47.973139+0000","last_undegraded":"2024-09-12T02:59:47.973139+0000","last_fullsized":"2024-09-12T02:59:47.973139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.045725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:00.846357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975037+0000","last_change":"2024-09-12T02:59:33.045189+0000","last_active":"2024-09-12T02:59:47.975037+0000","last_peered":"2024-09-12T02:59:47.975037+0000","last_clean":"2024-09-12T02:59:47.975037+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:47.975037+0000","last_undegraded":"2024-09-12T02:59:47.975037+0000","last_fullsized":"2024-09-12T02:59:47.975037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.045042+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:47.312510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969223+0000","last_change":"2024-09-12T02:59:38.788525+0000","last_active":"2024-09-12T02:59:47.969223+0000","last_peered":"2024-09-12T02:59:47.969223+0000","last_clean":"2024-09-12T02:59:47.969223+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:47.969223+0000","last_undegraded":"2024-09-12T02:59:47.969223+0000","last_fullsized":"2024-09-12T02:59:47.969223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.788431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:20.633132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989121+0000","last_change":"2024-09-12T02:59:33.741380+0000","last_active":"2024-09-12T02:59:47.989121+0000","last_peered":"2024-09-12T02:59:47.989121+0000","last_clean":"2024-09-12T02:59:47.989121+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:47.989121+0000","last_undegraded":"2024-09-12T02:59:47.989121+0000","last_fullsized":"2024-09-12T02:59:47.989121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.741253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:51.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509504,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":530298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509506,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1552384,"data_stored":1083143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542210,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1544192,"data_stored":1083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542208,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":995328,"data_stored":529987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906980,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":928,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":950272,"data_stored":492227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542208,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":492263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":492297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:01:56.402 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T03:01:56.403 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T03:02:04.108 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:02:04.112 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:02:16.403 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:02:16.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.554+0000 7f88dbc00640 1 Processor -- start 2024-09-12T03:02:16.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.554+0000 7f88dbc00640 1 -- start start 2024-09-12T03:02:16.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.554+0000 7f88dbc00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f88d406dd10 0x7f88d40c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88dbc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d40ccb20 0x7f88d40cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88dbc00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d40c7210 con 0x7f88d406cec0 2024-09-12T03:02:16.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88dbc00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f88d406e0f0 con 0x7f88d406dd10 2024-09-12T03:02:16.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88dbc00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f88d40c7790 con 0x7f88d40ccb20 2024-09-12T03:02:16.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d9200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f88d406dd10 0x7f88d40c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d9200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f88d406dd10 0x7f88d40c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32874/0 (socket says 172.21.15.63:32874) 2024-09-12T03:02:16.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d9200640 1 -- 172.21.15.63:0/1949044367 learned_addr learned my addr 172.21.15.63:0/1949044367 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:16.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88cbe00640 1 --1- 172.21.15.63:0/1949044367 >> v1:172.21.15.63:6789/0 conn(0x7f88d406cec0 0x7f88d415b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40954/0 (socket says 172.21.15.63:40954) 2024-09-12T03:02:16.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d9c00640 1 --2- 172.21.15.63:0/1949044367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d40ccb20 0x7f88d40cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d9200640 1 -- 172.21.15.63:0/1949044367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d40ccb20 msgr2=0x7f88d40cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:16.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d9200640 1 --2- 172.21.15.63:0/1949044367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d40ccb20 0x7f88d40cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d9200640 1 -- 172.21.15.63:0/1949044367 >> v1:172.21.15.63:6789/0 conn(0x7f88d406cec0 legacy=0x7f88d415b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d9200640 1 -- 172.21.15.63:0/1949044367 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d40c74b0 con 0x7f88d406dd10 2024-09-12T03:02:16.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d9200640 1 --2- 172.21.15.63:0/1949044367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 0x7f88d40c84b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009870 tx=0x7f88c401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab8097e0610f4ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:16.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.558+0000 7f88d3e00640 1 -- 172.21.15.63:0/1949044367 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c40b5070 con 0x7f88d406dd10 2024-09-12T03:02:16.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88d3e00640 1 -- 172.21.15.63:0/1949044367 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c40a8a50 con 0x7f88d406dd10 2024-09-12T03:02:16.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88d3e00640 1 -- 172.21.15.63:0/1949044367 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c40a8e20 con 0x7f88d406dd10 2024-09-12T03:02:16.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 -- 172.21.15.63:0/1949044367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 msgr2=0x7f88d40c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 --2- 172.21.15.63:0/1949044367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 0x7f88d40c84b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009870 tx=0x7f88c401ed50 comp rx=0 tx=0).stop 2024-09-12T03:02:16.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 -- 172.21.15.63:0/1949044367 shutdown_connections 2024-09-12T03:02:16.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 --2- 172.21.15.63:0/1949044367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d40ccb20 0x7f88d40cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 --2- 172.21.15.63:0/1949044367 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 0x7f88d40c84b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 -- 172.21.15.63:0/1949044367 >> 172.21.15.63:0/1949044367 conn(0x7f88d406f3d0 msgr2=0x7f88d406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:16.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 -- 172.21.15.63:0/1949044367 shutdown_connections 2024-09-12T03:02:16.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 -- 172.21.15.63:0/1949044367 wait complete. 2024-09-12T03:02:16.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 Processor -- start 2024-09-12T03:02:16.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 -- start start 2024-09-12T03:02:16.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d406cec0 0x7f88d41f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 0x7f88d41e6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88d40ccb20 0x7f88d41f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f88d40741f0 con 0x7f88d406dd10 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f88d415ae40 con 0x7f88d40ccb20 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88dbc00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f88d40c6cd0 con 0x7f88d406cec0 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88cbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 0x7f88d41e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88cbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 0x7f88d41e6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32880/0 (socket says 172.21.15.63:32880) 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88cbe00640 1 -- 172.21.15.63:0/2166449192 learned_addr learned my addr 172.21.15.63:0/2166449192 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88d9200640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d406cec0 0x7f88d41f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.562+0000 7f88d9c00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88d40ccb20 0x7f88d41f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88cbe00640 1 -- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d406cec0 msgr2=0x7f88d41f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88cbe00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d406cec0 0x7f88d41f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88cbe00640 1 -- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88d40ccb20 msgr2=0x7f88d41f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88cbe00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88d40ccb20 0x7f88d41f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88cbe00640 1 -- 172.21.15.63:0/2166449192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d40b05f0 con 0x7f88d406dd10 2024-09-12T03:02:16.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88cbe00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 0x7f88d41e6270 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00c420 tx=0x7f88bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:16.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88d1600640 1 -- 172.21.15.63:0/2166449192 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc0074e0 con 0x7f88d406dd10 2024-09-12T03:02:16.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88d1600640 1 -- 172.21.15.63:0/2166449192 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88bc007680 con 0x7f88d406dd10 2024-09-12T03:02:16.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88d1600640 1 -- 172.21.15.63:0/2166449192 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc004a30 con 0x7f88d406dd10 2024-09-12T03:02:16.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d40c38e0 con 0x7f88d406dd10 2024-09-12T03:02:16.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d40b0b70 con 0x7f88d406dd10 2024-09-12T03:02:16.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d40c6970 con 0x7f88d406dd10 2024-09-12T03:02:16.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88d1600640 1 -- 172.21.15.63:0/2166449192 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88bc01a020 con 0x7f88d406dd10 2024-09-12T03:02:16.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88d1600640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f88b00678c0 0x7f88b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.566+0000 7f88d1600640 1 -- 172.21.15.63:0/2166449192 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f88bc0858f0 con 0x7f88d406dd10 2024-09-12T03:02:16.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.570+0000 7f88d9200640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f88b00678c0 0x7f88b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.570+0000 7f88d9200640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f88b00678c0 0x7f88b0069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f88c40b2000 tx=0x7f88c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:16.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.570+0000 7f88d1600640 1 -- 172.21.15.63:0/2166449192 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f88bc055f60 con 0x7f88d406dd10 2024-09-12T03:02:16.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.734+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88d40c6f50 con 0x7f88b00678c0 2024-09-12T03:02:16.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.758+0000 7f88d1600640 1 -- 172.21.15.63:0/2166449192 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332999 (secure 0 0 0) 0x7f88d40c6f50 con 0x7f88b00678c0 2024-09-12T03:02:16.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:02:16.765 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f88b00678c0 msgr2=0x7f88b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f88b00678c0 0x7f88b0069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f88c40b2000 tx=0x7f88c4009040 comp rx=0 tx=0).stop 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 msgr2=0x7f88d41e6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 0x7f88d41e6270 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00c420 tx=0x7f88bc00c8e0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 shutdown_connections 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88d40ccb20 0x7f88d41f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88d406dd10 0x7f88d41e6270 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f88b00678c0 0x7f88b0069d80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 --2- 172.21.15.63:0/2166449192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88d406cec0 0x7f88d41f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 >> 172.21.15.63:0/2166449192 conn(0x7f88d406f3d0 msgr2=0x7f88d40cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 shutdown_connections 2024-09-12T03:02:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.762+0000 7f88dbc00640 1 -- 172.21.15.63:0/2166449192 wait complete. 2024-09-12T03:02:16.783 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-12T03:02:15.871201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238480,"kb_used_data":8696,"kb_used_omap":15,"kb_used_meta":229616,"kb_avail":754736240,"statfs":{"total":773094113280,"available":772849909760,"internally_reserved":0,"allocated":8904704,"data_stored":5195750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":235127470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005109"},"pg_stats":[{"pgid":"2.1f","version":"79'6","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975859+0000","last_change":"2024-09-12T02:59:32.000879+0000","last_active":"2024-09-12T02:59:47.975859+0000","last_peered":"2024-09-12T02:59:47.975859+0000","last_clean":"2024-09-12T02:59:47.975859+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:47.975859+0000","last_undegraded":"2024-09-12T02:59:47.975859+0000","last_fullsized":"2024-09-12T02:59:47.975859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.000756+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.073437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971629+0000","last_change":"2024-09-12T02:59:43.632597+0000","last_active":"2024-09-12T02:59:47.971629+0000","last_peered":"2024-09-12T02:59:47.971629+0000","last_clean":"2024-09-12T02:59:47.971629+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:47.971629+0000","last_undegraded":"2024-09-12T02:59:47.971629+0000","last_fullsized":"2024-09-12T02:59:47.971629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.632456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:01.396201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970686+0000","last_change":"2024-09-12T02:59:45.690062+0000","last_active":"2024-09-12T02:59:47.970686+0000","last_peered":"2024-09-12T02:59:47.970686+0000","last_clean":"2024-09-12T02:59:47.970686+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:47.970686+0000","last_undegraded":"2024-09-12T02:59:47.970686+0000","last_fullsized":"2024-09-12T02:59:47.970686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.689949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:02.009111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971812+0000","last_change":"2024-09-12T02:59:36.630496+0000","last_active":"2024-09-12T02:59:47.971812+0000","last_peered":"2024-09-12T02:59:47.971812+0000","last_clean":"2024-09-12T02:59:47.971812+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:47.971812+0000","last_undegraded":"2024-09-12T02:59:47.971812+0000","last_fullsized":"2024-09-12T02:59:47.971812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.630383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:49.675255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975738+0000","last_change":"2024-09-12T02:59:44.081098+0000","last_active":"2024-09-12T02:59:47.975738+0000","last_peered":"2024-09-12T02:59:47.975738+0000","last_clean":"2024-09-12T02:59:47.975738+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:47.975738+0000","last_undegraded":"2024-09-12T02:59:47.975738+0000","last_fullsized":"2024-09-12T02:59:47.975738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.080989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:55.266943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970569+0000","last_change":"2024-09-12T02:59:41.662320+0000","last_active":"2024-09-12T02:59:47.970569+0000","last_peered":"2024-09-12T02:59:47.970569+0000","last_clean":"2024-09-12T02:59:47.970569+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:47.970569+0000","last_undegraded":"2024-09-12T02:59:47.970569+0000","last_fullsized":"2024-09-12T02:59:47.970569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.662088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:28.169111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989673+0000","last_change":"2024-09-12T02:59:37.757533+0000","last_active":"2024-09-12T02:59:47.989673+0000","last_peered":"2024-09-12T02:59:47.989673+0000","last_clean":"2024-09-12T02:59:47.989673+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:47.989673+0000","last_undegraded":"2024-09-12T02:59:47.989673+0000","last_fullsized":"2024-09-12T02:59:47.989673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.757250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:10.370609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972898+0000","last_change":"2024-09-12T02:59:35.959195+0000","last_active":"2024-09-12T02:59:47.972898+0000","last_peered":"2024-09-12T02:59:47.972898+0000","last_clean":"2024-09-12T02:59:47.972898+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:47.972898+0000","last_undegraded":"2024-09-12T02:59:47.972898+0000","last_fullsized":"2024-09-12T02:59:47.972898+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.958975+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.932192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972268+0000","last_change":"2024-09-12T02:59:43.619841+0000","last_active":"2024-09-12T02:59:47.972268+0000","last_peered":"2024-09-12T02:59:47.972268+0000","last_clean":"2024-09-12T02:59:47.972268+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:47.972268+0000","last_undegraded":"2024-09-12T02:59:47.972268+0000","last_fullsized":"2024-09-12T02:59:47.972268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.619594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:49.784818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'3","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989275+0000","last_change":"2024-09-12T02:59:47.847154+0000","last_active":"2024-09-12T02:59:47.989275+0000","last_peered":"2024-09-12T02:59:47.989275+0000","last_clean":"2024-09-12T02:59:47.989275+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:47.989275+0000","last_undegraded":"2024-09-12T02:59:47.989275+0000","last_fullsized":"2024-09-12T02:59:47.989275+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.846797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.835241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973874+0000","last_change":"2024-09-12T02:59:44.041049+0000","last_active":"2024-09-12T02:59:47.973874+0000","last_peered":"2024-09-12T02:59:47.973874+0000","last_clean":"2024-09-12T02:59:47.973874+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:47.973874+0000","last_undegraded":"2024-09-12T02:59:47.973874+0000","last_fullsized":"2024-09-12T02:59:47.973874+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.040815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.885096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971006+0000","last_change":"2024-09-12T02:59:40.700614+0000","last_active":"2024-09-12T02:59:47.971006+0000","last_peered":"2024-09-12T02:59:47.971006+0000","last_clean":"2024-09-12T02:59:47.971006+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:47.971006+0000","last_undegraded":"2024-09-12T02:59:47.971006+0000","last_fullsized":"2024-09-12T02:59:47.971006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.700368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:48.928824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986772+0000","last_change":"2024-09-12T02:59:39.629343+0000","last_active":"2024-09-12T02:59:47.986772+0000","last_peered":"2024-09-12T02:59:47.986772+0000","last_clean":"2024-09-12T02:59:47.986772+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:47.986772+0000","last_undegraded":"2024-09-12T02:59:47.986772+0000","last_fullsized":"2024-09-12T02:59:47.986772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.629058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:43.299464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988945+0000","last_change":"2024-09-12T02:59:36.789441+0000","last_active":"2024-09-12T02:59:47.988945+0000","last_peered":"2024-09-12T02:59:47.988945+0000","last_clean":"2024-09-12T02:59:47.988945+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:47.988945+0000","last_undegraded":"2024-09-12T02:59:47.988945+0000","last_fullsized":"2024-09-12T02:59:47.988945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.789151+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:41.135081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975060+0000","last_change":"2024-09-12T02:59:37.711523+0000","last_active":"2024-09-12T02:59:47.975060+0000","last_peered":"2024-09-12T02:59:47.975060+0000","last_clean":"2024-09-12T02:59:47.975060+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:47.975060+0000","last_undegraded":"2024-09-12T02:59:47.975060+0000","last_fullsized":"2024-09-12T02:59:47.975060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.711188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.241632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971004+0000","last_change":"2024-09-12T02:59:40.677307+0000","last_active":"2024-09-12T02:59:47.971004+0000","last_peered":"2024-09-12T02:59:47.971004+0000","last_clean":"2024-09-12T02:59:47.971004+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:47.971004+0000","last_undegraded":"2024-09-12T02:59:47.971004+0000","last_fullsized":"2024-09-12T02:59:47.971004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.677196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:18.992896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967822+0000","last_change":"2024-09-12T02:59:42.816275+0000","last_active":"2024-09-12T02:59:47.967822+0000","last_peered":"2024-09-12T02:59:47.967822+0000","last_clean":"2024-09-12T02:59:47.967822+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:47.967822+0000","last_undegraded":"2024-09-12T02:59:47.967822+0000","last_fullsized":"2024-09-12T02:59:47.967822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.816152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:29.323176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973341+0000","last_change":"2024-09-12T02:59:38.719352+0000","last_active":"2024-09-12T02:59:47.973341+0000","last_peered":"2024-09-12T02:59:47.973341+0000","last_clean":"2024-09-12T02:59:47.973341+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:47.973341+0000","last_undegraded":"2024-09-12T02:59:47.973341+0000","last_fullsized":"2024-09-12T02:59:47.973341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.719131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.333596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.642733+0000","last_change":"2024-09-12T02:59:50.642733+0000","last_active":"2024-09-12T02:59:50.642733+0000","last_peered":"2024-09-12T02:59:50.642733+0000","last_clean":"2024-09-12T02:59:50.642733+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:50.642733+0000","last_undegraded":"2024-09-12T02:59:50.642733+0000","last_fullsized":"2024-09-12T02:59:50.642733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.642614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967915+0000","last_change":"2024-09-12T02:59:32.776350+0000","last_active":"2024-09-12T02:59:47.967915+0000","last_peered":"2024-09-12T02:59:47.967915+0000","last_clean":"2024-09-12T02:59:47.967915+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:47.967915+0000","last_undegraded":"2024-09-12T02:59:47.967915+0000","last_fullsized":"2024-09-12T02:59:47.967915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.776267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:58.890222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968676+0000","last_change":"2024-09-12T02:59:34.789313+0000","last_active":"2024-09-12T02:59:47.968676+0000","last_peered":"2024-09-12T02:59:47.968676+0000","last_clean":"2024-09-12T02:59:47.968676+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:47.968676+0000","last_undegraded":"2024-09-12T02:59:47.968676+0000","last_fullsized":"2024-09-12T02:59:47.968676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.789214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.790935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971845+0000","last_change":"2024-09-12T02:59:34.632579+0000","last_active":"2024-09-12T02:59:47.971845+0000","last_peered":"2024-09-12T02:59:47.971845+0000","last_clean":"2024-09-12T02:59:47.971845+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:47.971845+0000","last_undegraded":"2024-09-12T02:59:47.971845+0000","last_fullsized":"2024-09-12T02:59:47.971845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.632350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.978281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987536+0000","last_change":"2024-09-12T02:59:35.785814+0000","last_active":"2024-09-12T02:59:47.987536+0000","last_peered":"2024-09-12T02:59:47.987536+0000","last_clean":"2024-09-12T02:59:47.987536+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:47.987536+0000","last_undegraded":"2024-09-12T02:59:47.987536+0000","last_fullsized":"2024-09-12T02:59:47.987536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.785459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.907074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":160,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975184+0000","last_change":"2024-09-12T02:59:44.644342+0000","last_active":"2024-09-12T02:59:47.975184+0000","last_peered":"2024-09-12T02:59:47.975184+0000","last_clean":"2024-09-12T02:59:47.975184+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:47.975184+0000","last_undegraded":"2024-09-12T02:59:47.975184+0000","last_fullsized":"2024-09-12T02:59:47.975184+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.644026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:49.273561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975474+0000","last_change":"2024-09-12T02:59:46.131647+0000","last_active":"2024-09-12T02:59:47.975474+0000","last_peered":"2024-09-12T02:59:47.975474+0000","last_clean":"2024-09-12T02:59:47.975474+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:47.975474+0000","last_undegraded":"2024-09-12T02:59:47.975474+0000","last_fullsized":"2024-09-12T02:59:47.975474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.131533+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:06.802576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988089+0000","last_change":"2024-09-12T02:59:35.721123+0000","last_active":"2024-09-12T02:59:47.988089+0000","last_peered":"2024-09-12T02:59:47.988089+0000","last_clean":"2024-09-12T02:59:47.988089+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:47.988089+0000","last_undegraded":"2024-09-12T02:59:47.988089+0000","last_fullsized":"2024-09-12T02:59:47.988089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.720761+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:17.277216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971181+0000","last_change":"2024-09-12T02:59:39.707123+0000","last_active":"2024-09-12T02:59:47.971181+0000","last_peered":"2024-09-12T02:59:47.971181+0000","last_clean":"2024-09-12T02:59:47.971181+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:47.971181+0000","last_undegraded":"2024-09-12T02:59:47.971181+0000","last_fullsized":"2024-09-12T02:59:47.971181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.706899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:08.753477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972514+0000","last_change":"2024-09-12T02:59:41.667809+0000","last_active":"2024-09-12T02:59:47.972514+0000","last_peered":"2024-09-12T02:59:47.972514+0000","last_clean":"2024-09-12T02:59:47.972514+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:47.972514+0000","last_undegraded":"2024-09-12T02:59:47.972514+0000","last_fullsized":"2024-09-12T02:59:47.972514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.667707+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:52.853661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969018+0000","last_change":"2024-09-12T02:59:45.841193+0000","last_active":"2024-09-12T02:59:47.969018+0000","last_peered":"2024-09-12T02:59:47.969018+0000","last_clean":"2024-09-12T02:59:47.969018+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:47.969018+0000","last_undegraded":"2024-09-12T02:59:47.969018+0000","last_fullsized":"2024-09-12T02:59:47.969018+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.841069+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:50.470604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.993328+0000","last_change":"2024-09-12T02:59:47.991190+0000","last_active":"2024-09-12T02:59:47.993328+0000","last_peered":"2024-09-12T02:59:47.993328+0000","last_clean":"2024-09-12T02:59:47.993328+0000","last_became_active":"2024-09-12T02:59:47.990629+0000","last_became_peered":"2024-09-12T02:59:47.990629+0000","last_unstale":"2024-09-12T02:59:47.993328+0000","last_undegraded":"2024-09-12T02:59:47.993328+0000","last_fullsized":"2024-09-12T02:59:47.993328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.643595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.689482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968300+0000","last_change":"2024-09-12T02:59:36.821336+0000","last_active":"2024-09-12T02:59:47.968300+0000","last_peered":"2024-09-12T02:59:47.968300+0000","last_clean":"2024-09-12T02:59:47.968300+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:47.968300+0000","last_undegraded":"2024-09-12T02:59:47.968300+0000","last_fullsized":"2024-09-12T02:59:47.968300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.821234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.321748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989889+0000","last_change":"2024-09-12T02:59:38.763406+0000","last_active":"2024-09-12T02:59:47.989889+0000","last_peered":"2024-09-12T02:59:47.989889+0000","last_clean":"2024-09-12T02:59:47.989889+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:47.989889+0000","last_undegraded":"2024-09-12T02:59:47.989889+0000","last_fullsized":"2024-09-12T02:59:47.989889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.763178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.755095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975134+0000","last_change":"2024-09-12T02:59:42.071495+0000","last_active":"2024-09-12T02:59:47.975134+0000","last_peered":"2024-09-12T02:59:47.975134+0000","last_clean":"2024-09-12T02:59:47.975134+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:47.975134+0000","last_undegraded":"2024-09-12T02:59:47.975134+0000","last_fullsized":"2024-09-12T02:59:47.975134+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.071362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:30.775559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973454+0000","last_change":"2024-09-12T02:59:39.026655+0000","last_active":"2024-09-12T02:59:47.973454+0000","last_peered":"2024-09-12T02:59:47.973454+0000","last_clean":"2024-09-12T02:59:47.973454+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:47.973454+0000","last_undegraded":"2024-09-12T02:59:47.973454+0000","last_fullsized":"2024-09-12T02:59:47.973454+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.026365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:52.426930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968353+0000","last_change":"2024-09-12T02:59:37.791375+0000","last_active":"2024-09-12T02:59:47.968353+0000","last_peered":"2024-09-12T02:59:47.968353+0000","last_clean":"2024-09-12T02:59:47.968353+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:47.968353+0000","last_undegraded":"2024-09-12T02:59:47.968353+0000","last_fullsized":"2024-09-12T02:59:47.968353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.791278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:11.783194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967824+0000","last_change":"2024-09-12T02:59:43.858969+0000","last_active":"2024-09-12T02:59:47.967824+0000","last_peered":"2024-09-12T02:59:47.967824+0000","last_clean":"2024-09-12T02:59:47.967824+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:47.967824+0000","last_undegraded":"2024-09-12T02:59:47.967824+0000","last_fullsized":"2024-09-12T02:59:47.967824+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.858860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972781+0000","last_change":"2024-09-12T02:59:35.662731+0000","last_active":"2024-09-12T02:59:47.972781+0000","last_peered":"2024-09-12T02:59:47.972781+0000","last_clean":"2024-09-12T02:59:47.972781+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:47.972781+0000","last_undegraded":"2024-09-12T02:59:47.972781+0000","last_fullsized":"2024-09-12T02:59:47.972781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.662469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:08.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971714+0000","last_change":"2024-09-12T02:59:32.999842+0000","last_active":"2024-09-12T02:59:47.971714+0000","last_peered":"2024-09-12T02:59:47.971714+0000","last_clean":"2024-09-12T02:59:47.971714+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:47.971714+0000","last_undegraded":"2024-09-12T02:59:47.971714+0000","last_fullsized":"2024-09-12T02:59:47.971714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.999508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:43.870533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.055261+0000","last_change":"2024-09-12T02:59:48.055261+0000","last_active":"2024-09-12T02:59:48.055261+0000","last_peered":"2024-09-12T02:59:48.055261+0000","last_clean":"2024-09-12T02:59:48.055261+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:48.055261+0000","last_undegraded":"2024-09-12T02:59:48.055261+0000","last_fullsized":"2024-09-12T02:59:48.055261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.055039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.593082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967982+0000","last_change":"2024-09-12T02:59:33.818250+0000","last_active":"2024-09-12T02:59:47.967982+0000","last_peered":"2024-09-12T02:59:47.967982+0000","last_clean":"2024-09-12T02:59:47.967982+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:47.967982+0000","last_undegraded":"2024-09-12T02:59:47.967982+0000","last_fullsized":"2024-09-12T02:59:47.967982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.818171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:46.646434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"79'3","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971922+0000","last_change":"2024-09-12T02:59:31.836989+0000","last_active":"2024-09-12T02:59:47.971922+0000","last_peered":"2024-09-12T02:59:47.971922+0000","last_clean":"2024-09-12T02:59:47.971922+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:47.971922+0000","last_undegraded":"2024-09-12T02:59:47.971922+0000","last_fullsized":"2024-09-12T02:59:47.971922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.836905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:53.031692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968392+0000","last_change":"2024-09-12T02:59:39.791877+0000","last_active":"2024-09-12T02:59:47.968392+0000","last_peered":"2024-09-12T02:59:47.968392+0000","last_clean":"2024-09-12T02:59:47.968392+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:47.968392+0000","last_undegraded":"2024-09-12T02:59:47.968392+0000","last_fullsized":"2024-09-12T02:59:47.968392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.791761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:25.406226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974736+0000","last_change":"2024-09-12T02:59:30.045775+0000","last_active":"2024-09-12T02:59:47.974736+0000","last_peered":"2024-09-12T02:59:47.974736+0000","last_clean":"2024-09-12T02:59:47.974736+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:47.974736+0000","last_undegraded":"2024-09-12T02:59:47.974736+0000","last_fullsized":"2024-09-12T02:59:47.974736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.045690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:33.716096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.861935+0000","last_change":"2024-09-12T02:59:49.861935+0000","last_active":"2024-09-12T02:59:49.861935+0000","last_peered":"2024-09-12T02:59:49.861935+0000","last_clean":"2024-09-12T02:59:49.861935+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:49.861935+0000","last_undegraded":"2024-09-12T02:59:49.861935+0000","last_fullsized":"2024-09-12T02:59:49.861935+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.861705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:39.315077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975303+0000","last_change":"2024-09-12T02:59:40.118829+0000","last_active":"2024-09-12T02:59:47.975303+0000","last_peered":"2024-09-12T02:59:47.975303+0000","last_clean":"2024-09-12T02:59:47.975303+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:47.975303+0000","last_undegraded":"2024-09-12T02:59:47.975303+0000","last_fullsized":"2024-09-12T02:59:47.975303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.118699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:10.405280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970932+0000","last_change":"2024-09-12T02:59:47.676864+0000","last_active":"2024-09-12T02:59:47.970932+0000","last_peered":"2024-09-12T02:59:47.970932+0000","last_clean":"2024-09-12T02:59:47.970932+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:47.970932+0000","last_undegraded":"2024-09-12T02:59:47.970932+0000","last_fullsized":"2024-09-12T02:59:47.970932+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.676747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.675367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972045+0000","last_change":"2024-09-12T02:59:40.971763+0000","last_active":"2024-09-12T02:59:47.972045+0000","last_peered":"2024-09-12T02:59:47.972045+0000","last_clean":"2024-09-12T02:59:47.972045+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:47.972045+0000","last_undegraded":"2024-09-12T02:59:47.972045+0000","last_fullsized":"2024-09-12T02:59:47.972045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.971535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:04.999865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"79'119","reported_seq":299,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988085+0000","last_change":"2024-09-12T02:59:34.803297+0000","last_active":"2024-09-12T02:59:47.988085+0000","last_peered":"2024-09-12T02:59:47.988085+0000","last_clean":"2024-09-12T02:59:47.988085+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:47.988085+0000","last_undegraded":"2024-09-12T02:59:47.988085+0000","last_fullsized":"2024-09-12T02:59:47.988085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.802947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:59.161855+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986575+0000","last_change":"2024-09-12T02:59:42.682806+0000","last_active":"2024-09-12T02:59:47.986575+0000","last_peered":"2024-09-12T02:59:47.986575+0000","last_clean":"2024-09-12T02:59:47.986575+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:47.986575+0000","last_undegraded":"2024-09-12T02:59:47.986575+0000","last_fullsized":"2024-09-12T02:59:47.986575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.682574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:22.933579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968536+0000","last_change":"2024-09-12T02:59:35.830230+0000","last_active":"2024-09-12T02:59:47.968536+0000","last_peered":"2024-09-12T02:59:47.968536+0000","last_clean":"2024-09-12T02:59:47.968536+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T02:59:47.968536+0000","last_undegraded":"2024-09-12T02:59:47.968536+0000","last_fullsized":"2024-09-12T02:59:47.968536+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.830121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.993178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972484+0000","last_change":"2024-09-12T02:59:35.842501+0000","last_active":"2024-09-12T02:59:47.972484+0000","last_peered":"2024-09-12T02:59:47.972484+0000","last_clean":"2024-09-12T02:59:47.972484+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:47.972484+0000","last_undegraded":"2024-09-12T02:59:47.972484+0000","last_fullsized":"2024-09-12T02:59:47.972484+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.842396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:47.840469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986481+0000","last_change":"2024-09-12T02:59:41.651678+0000","last_active":"2024-09-12T02:59:47.986481+0000","last_peered":"2024-09-12T02:59:47.986481+0000","last_clean":"2024-09-12T02:59:47.986481+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:47.986481+0000","last_undegraded":"2024-09-12T02:59:47.986481+0000","last_fullsized":"2024-09-12T02:59:47.986481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.651443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:40.919631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973428+0000","last_change":"2024-09-12T02:59:34.986788+0000","last_active":"2024-09-12T02:59:47.973428+0000","last_peered":"2024-09-12T02:59:47.973428+0000","last_clean":"2024-09-12T02:59:47.973428+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:47.973428+0000","last_undegraded":"2024-09-12T02:59:47.973428+0000","last_fullsized":"2024-09-12T02:59:47.973428+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.986542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:35.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"79'2","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968858+0000","last_change":"2024-09-12T02:59:31.772320+0000","last_active":"2024-09-12T02:59:47.968858+0000","last_peered":"2024-09-12T02:59:47.968858+0000","last_clean":"2024-09-12T02:59:47.968858+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:47.968858+0000","last_undegraded":"2024-09-12T02:59:47.968858+0000","last_fullsized":"2024-09-12T02:59:47.968858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.772236+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:19.909174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975370+0000","last_change":"2024-09-12T02:59:43.053479+0000","last_active":"2024-09-12T02:59:47.975370+0000","last_peered":"2024-09-12T02:59:47.975370+0000","last_clean":"2024-09-12T02:59:47.975370+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:47.975370+0000","last_undegraded":"2024-09-12T02:59:47.975370+0000","last_fullsized":"2024-09-12T02:59:47.975370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.053377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:21.369077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989776+0000","last_change":"2024-09-12T02:59:46.862199+0000","last_active":"2024-09-12T02:59:47.989776+0000","last_peered":"2024-09-12T02:59:47.989776+0000","last_clean":"2024-09-12T02:59:47.989776+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:47.989776+0000","last_undegraded":"2024-09-12T02:59:47.989776+0000","last_fullsized":"2024-09-12T02:59:47.989776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.861972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:51.491507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972773+0000","last_change":"2024-09-12T02:59:30.860535+0000","last_active":"2024-09-12T02:59:47.972773+0000","last_peered":"2024-09-12T02:59:47.972773+0000","last_clean":"2024-09-12T02:59:47.972773+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:47.972773+0000","last_undegraded":"2024-09-12T02:59:47.972773+0000","last_fullsized":"2024-09-12T02:59:47.972773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.860444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:23.065975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.093650+0000","last_change":"2024-09-12T02:59:49.093650+0000","last_active":"2024-09-12T02:59:49.093650+0000","last_peered":"2024-09-12T02:59:49.093650+0000","last_clean":"2024-09-12T02:59:49.093650+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:49.093650+0000","last_undegraded":"2024-09-12T02:59:49.093650+0000","last_fullsized":"2024-09-12T02:59:49.093650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.093403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.133030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989482+0000","last_change":"2024-09-12T02:59:44.860343+0000","last_active":"2024-09-12T02:59:47.989482+0000","last_peered":"2024-09-12T02:59:47.989482+0000","last_clean":"2024-09-12T02:59:47.989482+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:47.989482+0000","last_undegraded":"2024-09-12T02:59:47.989482+0000","last_fullsized":"2024-09-12T02:59:47.989482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.860002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:03.716731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975493+0000","last_change":"2024-09-12T02:59:31.636304+0000","last_active":"2024-09-12T02:59:47.975493+0000","last_peered":"2024-09-12T02:59:47.975493+0000","last_clean":"2024-09-12T02:59:47.975493+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:47.975493+0000","last_undegraded":"2024-09-12T02:59:47.975493+0000","last_fullsized":"2024-09-12T02:59:47.975493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.636071+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:48.966306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974649+0000","last_change":"2024-09-12T02:59:42.661415+0000","last_active":"2024-09-12T02:59:47.974649+0000","last_peered":"2024-09-12T02:59:47.974649+0000","last_clean":"2024-09-12T02:59:47.974649+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:47.974649+0000","last_undegraded":"2024-09-12T02:59:47.974649+0000","last_fullsized":"2024-09-12T02:59:47.974649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.661146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986421+0000","last_change":"2024-09-12T02:59:45.832208+0000","last_active":"2024-09-12T02:59:47.986421+0000","last_peered":"2024-09-12T02:59:47.986421+0000","last_clean":"2024-09-12T02:59:47.986421+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:47.986421+0000","last_undegraded":"2024-09-12T02:59:47.986421+0000","last_fullsized":"2024-09-12T02:59:47.986421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.831975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'12","reported_seq":185,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971629+0000","last_change":"2024-09-12T02:59:36.886312+0000","last_active":"2024-09-12T02:59:47.971629+0000","last_peered":"2024-09-12T02:59:47.971629+0000","last_clean":"2024-09-12T02:59:47.971629+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:47.971629+0000","last_undegraded":"2024-09-12T02:59:47.971629+0000","last_fullsized":"2024-09-12T02:59:47.971629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.886179+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:45.626516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975220+0000","last_change":"2024-09-12T02:59:39.156656+0000","last_active":"2024-09-12T02:59:47.975220+0000","last_peered":"2024-09-12T02:59:47.975220+0000","last_clean":"2024-09-12T02:59:47.975220+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:47.975220+0000","last_undegraded":"2024-09-12T02:59:47.975220+0000","last_fullsized":"2024-09-12T02:59:47.975220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.156542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:34.954291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987537+0000","last_change":"2024-09-12T02:59:37.673643+0000","last_active":"2024-09-12T02:59:47.987537+0000","last_peered":"2024-09-12T02:59:47.987537+0000","last_clean":"2024-09-12T02:59:47.987537+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:47.987537+0000","last_undegraded":"2024-09-12T02:59:47.987537+0000","last_fullsized":"2024-09-12T02:59:47.987537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.673292+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.523545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988693+0000","last_change":"2024-09-12T02:59:33.671444+0000","last_active":"2024-09-12T02:59:47.988693+0000","last_peered":"2024-09-12T02:59:47.988693+0000","last_clean":"2024-09-12T02:59:47.988693+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:47.988693+0000","last_undegraded":"2024-09-12T02:59:47.988693+0000","last_fullsized":"2024-09-12T02:59:47.988693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.671212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:45.669284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972347+0000","last_change":"2024-09-12T02:59:34.590629+0000","last_active":"2024-09-12T02:59:47.972347+0000","last_peered":"2024-09-12T02:59:47.972347+0000","last_clean":"2024-09-12T02:59:47.972347+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:47.972347+0000","last_undegraded":"2024-09-12T02:59:47.972347+0000","last_fullsized":"2024-09-12T02:59:47.972347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.590531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.762881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988763+0000","last_change":"2024-09-12T02:59:43.837261+0000","last_active":"2024-09-12T02:59:47.988763+0000","last_peered":"2024-09-12T02:59:47.988763+0000","last_clean":"2024-09-12T02:59:47.988763+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:47.988763+0000","last_undegraded":"2024-09-12T02:59:47.988763+0000","last_fullsized":"2024-09-12T02:59:47.988763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.836980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.344004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970625+0000","last_change":"2024-09-12T02:59:45.048563+0000","last_active":"2024-09-12T02:59:47.970625+0000","last_peered":"2024-09-12T02:59:47.970625+0000","last_clean":"2024-09-12T02:59:47.970625+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:47.970625+0000","last_undegraded":"2024-09-12T02:59:47.970625+0000","last_fullsized":"2024-09-12T02:59:47.970625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.048315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:20.692033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.611694+0000","last_change":"2024-09-12T02:59:49.611694+0000","last_active":"2024-09-12T02:59:49.611694+0000","last_peered":"2024-09-12T02:59:49.611694+0000","last_clean":"2024-09-12T02:59:49.611694+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:49.611694+0000","last_undegraded":"2024-09-12T02:59:49.611694+0000","last_fullsized":"2024-09-12T02:59:49.611694+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.611569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:05.308212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975313+0000","last_change":"2024-09-12T02:59:36.076892+0000","last_active":"2024-09-12T02:59:47.975313+0000","last_peered":"2024-09-12T02:59:47.975313+0000","last_clean":"2024-09-12T02:59:47.975313+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:47.975313+0000","last_undegraded":"2024-09-12T02:59:47.975313+0000","last_fullsized":"2024-09-12T02:59:47.975313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.076727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:26.666775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975650+0000","last_change":"2024-09-12T02:59:30.999792+0000","last_active":"2024-09-12T02:59:47.975650+0000","last_peered":"2024-09-12T02:59:47.975650+0000","last_clean":"2024-09-12T02:59:47.975650+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:47.975650+0000","last_undegraded":"2024-09-12T02:59:47.975650+0000","last_fullsized":"2024-09-12T02:59:47.975650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.999703+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:17.375066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973992+0000","last_change":"2024-09-12T02:59:34.015485+0000","last_active":"2024-09-12T02:59:47.973992+0000","last_peered":"2024-09-12T02:59:47.973992+0000","last_clean":"2024-09-12T02:59:47.973992+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:47.973992+0000","last_undegraded":"2024-09-12T02:59:47.973992+0000","last_fullsized":"2024-09-12T02:59:47.973992+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.015247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:05.065563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989204+0000","last_change":"2024-09-12T02:59:41.793529+0000","last_active":"2024-09-12T02:59:47.989204+0000","last_peered":"2024-09-12T02:59:47.989204+0000","last_clean":"2024-09-12T02:59:47.989204+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:47.989204+0000","last_undegraded":"2024-09-12T02:59:47.989204+0000","last_fullsized":"2024-09-12T02:59:47.989204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.793303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.839881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":168,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987950+0000","last_change":"2024-09-12T02:59:32.647074+0000","last_active":"2024-09-12T02:59:47.987950+0000","last_peered":"2024-09-12T02:59:47.987950+0000","last_clean":"2024-09-12T02:59:47.987950+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:47.987950+0000","last_undegraded":"2024-09-12T02:59:47.987950+0000","last_fullsized":"2024-09-12T02:59:47.987950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'28","last_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_deep_scrub":"79'28","last_deep_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.646844+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:46.886484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968112+0000","last_change":"2024-09-12T02:59:46.857630+0000","last_active":"2024-09-12T02:59:47.968112+0000","last_peered":"2024-09-12T02:59:47.968112+0000","last_clean":"2024-09-12T02:59:47.968112+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:47.968112+0000","last_undegraded":"2024-09-12T02:59:47.968112+0000","last_fullsized":"2024-09-12T02:59:47.968112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.857527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.845970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974181+0000","last_change":"2024-09-12T02:59:33.680657+0000","last_active":"2024-09-12T02:59:47.974181+0000","last_peered":"2024-09-12T02:59:47.974181+0000","last_clean":"2024-09-12T02:59:47.974181+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:47.974181+0000","last_undegraded":"2024-09-12T02:59:47.974181+0000","last_fullsized":"2024-09-12T02:59:47.974181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.680411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:15.802027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'7","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968736+0000","last_change":"2024-09-12T02:59:44.852192+0000","last_active":"2024-09-12T02:59:47.968736+0000","last_peered":"2024-09-12T02:59:47.968736+0000","last_clean":"2024-09-12T02:59:47.968736+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:47.968736+0000","last_undegraded":"2024-09-12T02:59:47.968736+0000","last_fullsized":"2024-09-12T02:59:47.968736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.852086+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.017309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":167,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971975+0000","last_change":"2024-09-12T02:59:45.664653+0000","last_active":"2024-09-12T02:59:47.971975+0000","last_peered":"2024-09-12T02:59:47.971975+0000","last_clean":"2024-09-12T02:59:47.971975+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:47.971975+0000","last_undegraded":"2024-09-12T02:59:47.971975+0000","last_fullsized":"2024-09-12T02:59:47.971975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.664314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.652758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975834+0000","last_change":"2024-09-12T02:59:45.129108+0000","last_active":"2024-09-12T02:59:47.975834+0000","last_peered":"2024-09-12T02:59:47.975834+0000","last_clean":"2024-09-12T02:59:47.975834+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:47.975834+0000","last_undegraded":"2024-09-12T02:59:47.975834+0000","last_fullsized":"2024-09-12T02:59:47.975834+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.128965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.549002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974003+0000","last_change":"2024-09-12T02:59:37.986005+0000","last_active":"2024-09-12T02:59:47.974003+0000","last_peered":"2024-09-12T02:59:47.974003+0000","last_clean":"2024-09-12T02:59:47.974003+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:47.974003+0000","last_undegraded":"2024-09-12T02:59:47.974003+0000","last_fullsized":"2024-09-12T02:59:47.974003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.985746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:14.181632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.639783+0000","last_change":"2024-09-12T02:59:51.639783+0000","last_active":"2024-09-12T02:59:51.639783+0000","last_peered":"2024-09-12T02:59:51.639783+0000","last_clean":"2024-09-12T02:59:51.639783+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:51.639783+0000","last_undegraded":"2024-09-12T02:59:51.639783+0000","last_fullsized":"2024-09-12T02:59:51.639783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.639668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.759727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974118+0000","last_change":"2024-09-12T02:59:39.987993+0000","last_active":"2024-09-12T02:59:47.974118+0000","last_peered":"2024-09-12T02:59:47.974118+0000","last_clean":"2024-09-12T02:59:47.974118+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:47.974118+0000","last_undegraded":"2024-09-12T02:59:47.974118+0000","last_fullsized":"2024-09-12T02:59:47.974118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.987743+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:04.424759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987908+0000","last_change":"2024-09-12T02:59:45.721685+0000","last_active":"2024-09-12T02:59:47.987908+0000","last_peered":"2024-09-12T02:59:47.987908+0000","last_clean":"2024-09-12T02:59:47.987908+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:47.987908+0000","last_undegraded":"2024-09-12T02:59:47.987908+0000","last_fullsized":"2024-09-12T02:59:47.987908+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.721444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.143614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970853+0000","last_change":"2024-09-12T02:59:46.669010+0000","last_active":"2024-09-12T02:59:47.970853+0000","last_peered":"2024-09-12T02:59:47.970853+0000","last_clean":"2024-09-12T02:59:47.970853+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:47.970853+0000","last_undegraded":"2024-09-12T02:59:47.970853+0000","last_fullsized":"2024-09-12T02:59:47.970853+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.668894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:22.826170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975134+0000","last_change":"2024-09-12T02:59:41.077595+0000","last_active":"2024-09-12T02:59:47.975134+0000","last_peered":"2024-09-12T02:59:47.975134+0000","last_clean":"2024-09-12T02:59:47.975134+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:47.975134+0000","last_undegraded":"2024-09-12T02:59:47.975134+0000","last_fullsized":"2024-09-12T02:59:47.975134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.077484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:52.294457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967794+0000","last_change":"2024-09-12T02:59:41.841470+0000","last_active":"2024-09-12T02:59:47.967794+0000","last_peered":"2024-09-12T02:59:47.967794+0000","last_clean":"2024-09-12T02:59:47.967794+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:47.967794+0000","last_undegraded":"2024-09-12T02:59:47.967794+0000","last_fullsized":"2024-09-12T02:59:47.967794+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.841333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.069789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.131633+0000","last_change":"2024-09-12T02:59:51.131633+0000","last_active":"2024-09-12T02:59:51.131633+0000","last_peered":"2024-09-12T02:59:51.131633+0000","last_clean":"2024-09-12T02:59:51.131633+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:51.131633+0000","last_undegraded":"2024-09-12T02:59:51.131633+0000","last_fullsized":"2024-09-12T02:59:51.131633+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.131397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:19.953861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987377+0000","last_change":"2024-09-12T02:59:46.767895+0000","last_active":"2024-09-12T02:59:47.987377+0000","last_peered":"2024-09-12T02:59:47.987377+0000","last_clean":"2024-09-12T02:59:47.987377+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:47.987377+0000","last_undegraded":"2024-09-12T02:59:47.987377+0000","last_fullsized":"2024-09-12T02:59:47.987377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.767560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.939911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971481+0000","last_change":"2024-09-12T02:59:39.674943+0000","last_active":"2024-09-12T02:59:47.971481+0000","last_peered":"2024-09-12T02:59:47.971481+0000","last_clean":"2024-09-12T02:59:47.971481+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:47.971481+0000","last_undegraded":"2024-09-12T02:59:47.971481+0000","last_fullsized":"2024-09-12T02:59:47.971481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.674831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:28.379028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971031+0000","last_change":"2024-09-12T02:59:37.660153+0000","last_active":"2024-09-12T02:59:47.971031+0000","last_peered":"2024-09-12T02:59:47.971031+0000","last_clean":"2024-09-12T02:59:47.971031+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:47.971031+0000","last_undegraded":"2024-09-12T02:59:47.971031+0000","last_fullsized":"2024-09-12T02:59:47.971031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.660048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:32.261376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987245+0000","last_change":"2024-09-12T02:59:34.716068+0000","last_active":"2024-09-12T02:59:47.987245+0000","last_peered":"2024-09-12T02:59:47.987245+0000","last_clean":"2024-09-12T02:59:47.987245+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:47.987245+0000","last_undegraded":"2024-09-12T02:59:47.987245+0000","last_fullsized":"2024-09-12T02:59:47.987245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.715793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:43.456130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975534+0000","last_change":"2024-09-12T02:59:38.162584+0000","last_active":"2024-09-12T02:59:47.975534+0000","last_peered":"2024-09-12T02:59:47.975534+0000","last_clean":"2024-09-12T02:59:47.975534+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:47.975534+0000","last_undegraded":"2024-09-12T02:59:47.975534+0000","last_fullsized":"2024-09-12T02:59:47.975534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.162461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:51.207333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972336+0000","last_change":"2024-09-12T02:59:34.845414+0000","last_active":"2024-09-12T02:59:47.972336+0000","last_peered":"2024-09-12T02:59:47.972336+0000","last_clean":"2024-09-12T02:59:47.972336+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:47.972336+0000","last_undegraded":"2024-09-12T02:59:47.972336+0000","last_fullsized":"2024-09-12T02:59:47.972336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.845313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:49.084952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971138+0000","last_change":"2024-09-12T02:59:38.676599+0000","last_active":"2024-09-12T02:59:47.971138+0000","last_peered":"2024-09-12T02:59:47.971138+0000","last_clean":"2024-09-12T02:59:47.971138+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:47.971138+0000","last_undegraded":"2024-09-12T02:59:47.971138+0000","last_fullsized":"2024-09-12T02:59:47.971138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.676453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:08.813287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971567+0000","last_change":"2024-09-12T02:59:32.676152+0000","last_active":"2024-09-12T02:59:47.971567+0000","last_peered":"2024-09-12T02:59:47.971567+0000","last_clean":"2024-09-12T02:59:47.971567+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:47.971567+0000","last_undegraded":"2024-09-12T02:59:47.971567+0000","last_fullsized":"2024-09-12T02:59:47.971567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.675897+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971908+0000","last_change":"2024-09-12T02:59:32.600836+0000","last_active":"2024-09-12T02:59:47.971908+0000","last_peered":"2024-09-12T02:59:47.971908+0000","last_clean":"2024-09-12T02:59:47.971908+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:47.971908+0000","last_undegraded":"2024-09-12T02:59:47.971908+0000","last_fullsized":"2024-09-12T02:59:47.971908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.600751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:36.409439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988055+0000","last_change":"2024-09-12T02:59:36.720562+0000","last_active":"2024-09-12T02:59:47.988055+0000","last_peered":"2024-09-12T02:59:47.988055+0000","last_clean":"2024-09-12T02:59:47.988055+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:47.988055+0000","last_undegraded":"2024-09-12T02:59:47.988055+0000","last_fullsized":"2024-09-12T02:59:47.988055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.720181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.336802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":160,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971753+0000","last_change":"2024-09-12T02:59:33.813763+0000","last_active":"2024-09-12T02:59:47.971753+0000","last_peered":"2024-09-12T02:59:47.971753+0000","last_clean":"2024-09-12T02:59:47.971753+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:47.971753+0000","last_undegraded":"2024-09-12T02:59:47.971753+0000","last_fullsized":"2024-09-12T02:59:47.971753+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.813677+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:54.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971306+0000","last_change":"2024-09-12T02:59:43.020950+0000","last_active":"2024-09-12T02:59:47.971306+0000","last_peered":"2024-09-12T02:59:47.971306+0000","last_clean":"2024-09-12T02:59:47.971306+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:47.971306+0000","last_undegraded":"2024-09-12T02:59:47.971306+0000","last_fullsized":"2024-09-12T02:59:47.971306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.020633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:20.020956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975562+0000","last_change":"2024-09-12T02:59:35.065915+0000","last_active":"2024-09-12T02:59:47.975562+0000","last_peered":"2024-09-12T02:59:47.975562+0000","last_clean":"2024-09-12T02:59:47.975562+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:47.975562+0000","last_undegraded":"2024-09-12T02:59:47.975562+0000","last_fullsized":"2024-09-12T02:59:47.975562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.065802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:51.998513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971356+0000","last_change":"2024-09-12T02:59:33.570266+0000","last_active":"2024-09-12T02:59:47.971356+0000","last_peered":"2024-09-12T02:59:47.971356+0000","last_clean":"2024-09-12T02:59:47.971356+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:47.971356+0000","last_undegraded":"2024-09-12T02:59:47.971356+0000","last_fullsized":"2024-09-12T02:59:47.971356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.570177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:57.992347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968402+0000","last_change":"2024-09-12T02:59:30.749318+0000","last_active":"2024-09-12T02:59:47.968402+0000","last_peered":"2024-09-12T02:59:47.968402+0000","last_clean":"2024-09-12T02:59:47.968402+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:47.968402+0000","last_undegraded":"2024-09-12T02:59:47.968402+0000","last_fullsized":"2024-09-12T02:59:47.968402+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.749228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:31.541524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987586+0000","last_change":"2024-09-12T02:59:38.651039+0000","last_active":"2024-09-12T02:59:47.987586+0000","last_peered":"2024-09-12T02:59:47.987586+0000","last_clean":"2024-09-12T02:59:47.987586+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:47.987586+0000","last_undegraded":"2024-09-12T02:59:47.987586+0000","last_fullsized":"2024-09-12T02:59:47.987586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.650631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.137855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972462+0000","last_change":"2024-09-12T02:59:42.663691+0000","last_active":"2024-09-12T02:59:47.972462+0000","last_peered":"2024-09-12T02:59:47.972462+0000","last_clean":"2024-09-12T02:59:47.972462+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:47.972462+0000","last_undegraded":"2024-09-12T02:59:47.972462+0000","last_fullsized":"2024-09-12T02:59:47.972462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.663586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:23.083624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.118766+0000","last_change":"2024-09-12T02:59:50.118766+0000","last_active":"2024-09-12T02:59:50.118766+0000","last_peered":"2024-09-12T02:59:50.118766+0000","last_clean":"2024-09-12T02:59:50.118766+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:50.118766+0000","last_undegraded":"2024-09-12T02:59:50.118766+0000","last_fullsized":"2024-09-12T02:59:50.118766+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.118459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:39.693765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970671+0000","last_change":"2024-09-12T02:59:31.642639+0000","last_active":"2024-09-12T02:59:47.970671+0000","last_peered":"2024-09-12T02:59:47.970671+0000","last_clean":"2024-09-12T02:59:47.970671+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:47.970671+0000","last_undegraded":"2024-09-12T02:59:47.970671+0000","last_fullsized":"2024-09-12T02:59:47.970671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.642539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:45.910007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971028+0000","last_change":"2024-09-12T02:59:42.020010+0000","last_active":"2024-09-12T02:59:47.971028+0000","last_peered":"2024-09-12T02:59:47.971028+0000","last_clean":"2024-09-12T02:59:47.971028+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:47.971028+0000","last_undegraded":"2024-09-12T02:59:47.971028+0000","last_fullsized":"2024-09-12T02:59:47.971028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.019770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:02.627789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975254+0000","last_change":"2024-09-12T02:59:37.126601+0000","last_active":"2024-09-12T02:59:47.975254+0000","last_peered":"2024-09-12T02:59:47.975254+0000","last_clean":"2024-09-12T02:59:47.975254+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:47.975254+0000","last_undegraded":"2024-09-12T02:59:47.975254+0000","last_fullsized":"2024-09-12T02:59:47.975254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.126497+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:41.431052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987834+0000","last_change":"2024-09-12T02:59:40.644873+0000","last_active":"2024-09-12T02:59:47.987834+0000","last_peered":"2024-09-12T02:59:47.987834+0000","last_clean":"2024-09-12T02:59:47.987834+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:47.987834+0000","last_undegraded":"2024-09-12T02:59:47.987834+0000","last_fullsized":"2024-09-12T02:59:47.987834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.644626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:27.019990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989691+0000","last_change":"2024-09-12T02:59:42.787927+0000","last_active":"2024-09-12T02:59:47.989691+0000","last_peered":"2024-09-12T02:59:47.989691+0000","last_clean":"2024-09-12T02:59:47.989691+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:47.989691+0000","last_undegraded":"2024-09-12T02:59:47.989691+0000","last_fullsized":"2024-09-12T02:59:47.989691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.787542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.015998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972737+0000","last_change":"2024-09-12T02:59:32.823831+0000","last_active":"2024-09-12T02:59:47.972737+0000","last_peered":"2024-09-12T02:59:47.972737+0000","last_clean":"2024-09-12T02:59:47.972737+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:47.972737+0000","last_undegraded":"2024-09-12T02:59:47.972737+0000","last_fullsized":"2024-09-12T02:59:47.972737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.823742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:34.576078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974580+0000","last_change":"2024-09-12T02:59:47.049456+0000","last_active":"2024-09-12T02:59:47.974580+0000","last_peered":"2024-09-12T02:59:47.974580+0000","last_clean":"2024-09-12T02:59:47.974580+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:47.974580+0000","last_undegraded":"2024-09-12T02:59:47.974580+0000","last_fullsized":"2024-09-12T02:59:47.974580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.049206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:32.900134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971380+0000","last_change":"2024-09-12T02:59:37.007470+0000","last_active":"2024-09-12T02:59:47.971380+0000","last_peered":"2024-09-12T02:59:47.971380+0000","last_clean":"2024-09-12T02:59:47.971380+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:47.971380+0000","last_undegraded":"2024-09-12T02:59:47.971380+0000","last_fullsized":"2024-09-12T02:59:47.971380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.007224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:18.542924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967872+0000","last_change":"2024-09-12T02:59:40.838979+0000","last_active":"2024-09-12T02:59:47.967872+0000","last_peered":"2024-09-12T02:59:47.967872+0000","last_clean":"2024-09-12T02:59:47.967872+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:47.967872+0000","last_undegraded":"2024-09-12T02:59:47.967872+0000","last_fullsized":"2024-09-12T02:59:47.967872+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.838843+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:09.885421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975181+0000","last_change":"2024-09-12T02:59:34.019995+0000","last_active":"2024-09-12T02:59:47.975181+0000","last_peered":"2024-09-12T02:59:47.975181+0000","last_clean":"2024-09-12T02:59:47.975181+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:47.975181+0000","last_undegraded":"2024-09-12T02:59:47.975181+0000","last_fullsized":"2024-09-12T02:59:47.975181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.019910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.828598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970840+0000","last_change":"2024-09-12T02:59:35.597391+0000","last_active":"2024-09-12T02:59:47.970840+0000","last_peered":"2024-09-12T02:59:47.970840+0000","last_clean":"2024-09-12T02:59:47.970840+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:47.970840+0000","last_undegraded":"2024-09-12T02:59:47.970840+0000","last_fullsized":"2024-09-12T02:59:47.970840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.597291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:38.185412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973925+0000","last_change":"2024-09-12T02:59:36.682299+0000","last_active":"2024-09-12T02:59:47.973925+0000","last_peered":"2024-09-12T02:59:47.973925+0000","last_clean":"2024-09-12T02:59:47.973925+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:47.973925+0000","last_undegraded":"2024-09-12T02:59:47.973925+0000","last_fullsized":"2024-09-12T02:59:47.973925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.682064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:10.673981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987033+0000","last_change":"2024-09-12T02:59:44.683736+0000","last_active":"2024-09-12T02:59:47.987033+0000","last_peered":"2024-09-12T02:59:47.987033+0000","last_clean":"2024-09-12T02:59:47.987033+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:47.987033+0000","last_undegraded":"2024-09-12T02:59:47.987033+0000","last_fullsized":"2024-09-12T02:59:47.987033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.683432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.492120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987307+0000","last_change":"2024-09-12T02:59:43.695797+0000","last_active":"2024-09-12T02:59:47.987307+0000","last_peered":"2024-09-12T02:59:47.987307+0000","last_clean":"2024-09-12T02:59:47.987307+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:47.987307+0000","last_undegraded":"2024-09-12T02:59:47.987307+0000","last_fullsized":"2024-09-12T02:59:47.987307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'16","last_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_deep_scrub":"79'16","last_deep_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.695424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:57.962892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.814183+0000","last_change":"2024-09-12T02:59:48.814183+0000","last_active":"2024-09-12T02:59:48.814183+0000","last_peered":"2024-09-12T02:59:48.814183+0000","last_clean":"2024-09-12T02:59:48.814183+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:48.814183+0000","last_undegraded":"2024-09-12T02:59:48.814183+0000","last_fullsized":"2024-09-12T02:59:48.814183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.813942+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:41.235405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.652404+0000","last_change":"2024-09-12T02:59:48.652404+0000","last_active":"2024-09-12T02:59:48.652404+0000","last_peered":"2024-09-12T02:59:48.652404+0000","last_clean":"2024-09-12T02:59:48.652404+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:48.652404+0000","last_undegraded":"2024-09-12T02:59:48.652404+0000","last_fullsized":"2024-09-12T02:59:48.652404+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.652295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:24.469845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986379+0000","last_change":"2024-09-12T02:59:40.773384+0000","last_active":"2024-09-12T02:59:47.986379+0000","last_peered":"2024-09-12T02:59:47.986379+0000","last_clean":"2024-09-12T02:59:47.986379+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:47.986379+0000","last_undegraded":"2024-09-12T02:59:47.986379+0000","last_fullsized":"2024-09-12T02:59:47.986379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.773129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.980310+0000","last_change":"2024-09-12T02:59:47.977081+0000","last_active":"2024-09-12T02:59:47.980310+0000","last_peered":"2024-09-12T02:59:47.980310+0000","last_clean":"2024-09-12T02:59:47.980310+0000","last_became_active":"2024-09-12T02:59:47.976687+0000","last_became_peered":"2024-09-12T02:59:47.976687+0000","last_unstale":"2024-09-12T02:59:47.980310+0000","last_undegraded":"2024-09-12T02:59:47.980310+0000","last_fullsized":"2024-09-12T02:59:47.980310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:57:03.767531+0000","last_clean_scrub_stamp":"2024-09-12T02:57:03.767531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.944169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988454+0000","last_change":"2024-09-12T02:59:39.769618+0000","last_active":"2024-09-12T02:59:47.988454+0000","last_peered":"2024-09-12T02:59:47.988454+0000","last_clean":"2024-09-12T02:59:47.988454+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:47.988454+0000","last_undegraded":"2024-09-12T02:59:47.988454+0000","last_fullsized":"2024-09-12T02:59:47.988454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.769355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:44.299798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973139+0000","last_change":"2024-09-12T02:59:46.045977+0000","last_active":"2024-09-12T02:59:47.973139+0000","last_peered":"2024-09-12T02:59:47.973139+0000","last_clean":"2024-09-12T02:59:47.973139+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:47.973139+0000","last_undegraded":"2024-09-12T02:59:47.973139+0000","last_fullsized":"2024-09-12T02:59:47.973139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.045725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:00.846357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975037+0000","last_change":"2024-09-12T02:59:33.045189+0000","last_active":"2024-09-12T02:59:47.975037+0000","last_peered":"2024-09-12T02:59:47.975037+0000","last_clean":"2024-09-12T02:59:47.975037+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:47.975037+0000","last_undegraded":"2024-09-12T02:59:47.975037+0000","last_fullsized":"2024-09-12T02:59:47.975037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.045042+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:47.312510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969223+0000","last_change":"2024-09-12T02:59:38.788525+0000","last_active":"2024-09-12T02:59:47.969223+0000","last_peered":"2024-09-12T02:59:47.969223+0000","last_clean":"2024-09-12T02:59:47.969223+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:47.969223+0000","last_undegraded":"2024-09-12T02:59:47.969223+0000","last_fullsized":"2024-09-12T02:59:47.969223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.788431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:20.633132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989121+0000","last_change":"2024-09-12T02:59:33.741380+0000","last_active":"2024-09-12T02:59:47.989121+0000","last_peered":"2024-09-12T02:59:47.989121+0000","last_clean":"2024-09-12T02:59:47.989121+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:47.989121+0000","last_undegraded":"2024-09-12T02:59:47.989121+0000","last_fullsized":"2024-09-12T02:59:47.989121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.741253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:51.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":530298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509510,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":950272,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509510,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1552384,"data_stored":1083143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542214,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1544192,"data_stored":1083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542212,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":995328,"data_stored":529987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906984,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":928,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":950272,"data_stored":492227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542212,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":492263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":492297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:02:16.791 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T02:57:03.767531+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=57, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=2, tm_min=59, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T03:02:16.791 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3a 2024-09-12T03:02:16.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.966+0000 7fcdba400640 1 Processor -- start 2024-09-12T03:02:16.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.966+0000 7fcdba400640 1 -- start start 2024-09-12T03:02:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.966+0000 7fcdba400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcdb41590b0 0x7fcdb40c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdba400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb40c8f40 0x7fcdb40c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdba400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb40c6970 con 0x7fcdb4152640 2024-09-12T03:02:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdba400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb4071f60 con 0x7fcdb41590b0 2024-09-12T03:02:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdba400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb40c8160 con 0x7fcdb40c8f40 2024-09-12T03:02:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdaaa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcdb41590b0 0x7fcdb40c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdb3e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb40c8f40 0x7fcdb40c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdaaa00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcdb41590b0 0x7fcdb40c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.63:36190/0 (socket says 172.21.15.63:36190) 2024-09-12T03:02:16.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdb3e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb40c8f40 0x7fcdb40c9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:57714/0 (socket says 172.21.15.63:57714) 2024-09-12T03:02:16.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdaaa00640 1 -- 172.21.15.63:0/3402392424 learned_addr learned my addr 172.21.15.63:0/3402392424 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:16.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdb3400640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fcdb4152640 0x7fcdb4071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:57358/0 (socket says 172.21.15.63:57358) 2024-09-12T03:02:16.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdaaa00640 1 -- 172.21.15.63:0/3402392424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb40c8f40 msgr2=0x7fcdb40c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:16.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdaaa00640 1 --2- 172.21.15.63:0/3402392424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb40c8f40 0x7fcdb40c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdaaa00640 1 -- 172.21.15.63:0/3402392424 >> v1:172.21.15.119:6789/0 conn(0x7fcdb4152640 legacy=0x7fcdb4071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdaaa00640 1 -- 172.21.15.63:0/3402392424 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb4159500 con 0x7fcdb41590b0 2024-09-12T03:02:16.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.970+0000 7fcdb3e00640 1 --2- 172.21.15.63:0/3402392424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb40c8f40 0x7fcdb40c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:02:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdaaa00640 1 --2- 172.21.15.63:0/3402392424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdb41590b0 0x7fcdb40c8a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d8a93edb3c355d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdb2a00640 1 -- 172.21.15.63:0/3402392424 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0ab650 con 0x7fcdb41590b0 2024-09-12T03:02:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdb2a00640 1 -- 172.21.15.63:0/3402392424 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0b0070 con 0x7fcdb41590b0 2024-09-12T03:02:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdb2a00640 1 -- 172.21.15.63:0/3402392424 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0aba10 con 0x7fcdb41590b0 2024-09-12T03:02:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 -- 172.21.15.63:0/3402392424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdb41590b0 msgr2=0x7fcdb40c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 --2- 172.21.15.63:0/3402392424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdb41590b0 0x7fcdb40c8a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009870 tx=0x7fcd9c01c560 comp rx=0 tx=0).stop 2024-09-12T03:02:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 -- 172.21.15.63:0/3402392424 shutdown_connections 2024-09-12T03:02:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 --2- 172.21.15.63:0/3402392424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb40c8f40 0x7fcdb40c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 --2- 172.21.15.63:0/3402392424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdb41590b0 0x7fcdb40c8a00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 -- 172.21.15.63:0/3402392424 >> 172.21.15.63:0/3402392424 conn(0x7fcdb406f3d0 msgr2=0x7fcdb406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 -- 172.21.15.63:0/3402392424 shutdown_connections 2024-09-12T03:02:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 -- 172.21.15.63:0/3402392424 wait complete. 2024-09-12T03:02:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 Processor -- start 2024-09-12T03:02:16.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 -- start start 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdb40c8f40 0x7fcdb40cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdb4152640 0x7fcdb4148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb41590b0 0x7fcdb41488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb4074290 con 0x7fcdb4152640 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb40c7df0 con 0x7fcdb40c8f40 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdba400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb4152a20 con 0x7fcdb41590b0 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdaaa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdb4152640 0x7fcdb4148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdaaa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdb4152640 0x7fcdb4148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32890/0 (socket says 172.21.15.63:32890) 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdaaa00640 1 -- 172.21.15.63:0/1510102423 learned_addr learned my addr 172.21.15.63:0/1510102423 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:16.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdb3400640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdb40c8f40 0x7fcdb40cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.974+0000 7fcdb3e00640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb41590b0 0x7fcdb41488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdaaa00640 1 -- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb41590b0 msgr2=0x7fcdb41488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdaaa00640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb41590b0 0x7fcdb41488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdaaa00640 1 -- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdb40c8f40 msgr2=0x7fcdb40cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdaaa00640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdb40c8f40 0x7fcdb40cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdaaa00640 1 -- 172.21.15.63:0/1510102423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb4148f30 con 0x7fcdb4152640 2024-09-12T03:02:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdaaa00640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdb4152640 0x7fcdb4148360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0ad040 tx=0x7fcd9c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdabe00640 1 -- 172.21.15.63:0/1510102423 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0be630 con 0x7fcdb4152640 2024-09-12T03:02:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdabe00640 1 -- 172.21.15.63:0/1510102423 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0be810 con 0x7fcdb4152640 2024-09-12T03:02:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb4149210 con 0x7fcdb4152640 2024-09-12T03:02:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdabe00640 1 -- 172.21.15.63:0/1510102423 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0bec00 con 0x7fcdb4152640 2024-09-12T03:02:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb4147b60 con 0x7fcdb4152640 2024-09-12T03:02:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb40c85d0 con 0x7fcdb4152640 2024-09-12T03:02:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdabe00640 1 -- 172.21.15.63:0/1510102423 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd9c0c73f0 con 0x7fcdb4152640 2024-09-12T03:02:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdabe00640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcd900678c0 0x7fcd90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdabe00640 1 -- 172.21.15.63:0/1510102423 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7fcd9c120640 con 0x7fcdb4152640 2024-09-12T03:02:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.978+0000 7fcdb3400640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcd900678c0 0x7fcd90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.982+0000 7fcdb3400640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcd900678c0 0x7fcd90069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcda4000f70 tx=0x7fcda4007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:16.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:16.982+0000 7fcdabe00640 1 -- 172.21.15.63:0/1510102423 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcd9c016150 con 0x7fcdb4152640 2024-09-12T03:02:17.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.146+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg deep-scrub", "pgid": "3.3a", "target": ["mon-mgr", ""]}) -- 0x7fcdb414fd80 con 0x7fcd900678c0 2024-09-12T03:02:17.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.146+0000 7fcdabe00640 1 -- 172.21.15.63:0/1510102423 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 instructing pg 3.3a on osd.2 to deep-scrub) ==== 50+0+0 (secure 0 0 0) 0x7fcdb414fd80 con 0x7fcd900678c0 2024-09-12T03:02:17.149 INFO:teuthology.orchestra.run.smithi063.stderr:instructing pg 3.3a on osd.2 to deep-scrub 2024-09-12T03:02:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcd900678c0 msgr2=0x7fcd90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcd900678c0 0x7fcd90069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcda4000f70 tx=0x7fcda4007e90 comp rx=0 tx=0).stop 2024-09-12T03:02:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdb4152640 msgr2=0x7fcdb4148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdb4152640 0x7fcdb4148360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0ad040 tx=0x7fcd9c01ada0 comp rx=0 tx=0).stop 2024-09-12T03:02:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 shutdown_connections 2024-09-12T03:02:17.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7fcd900678c0 0x7fcd90069d80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdb41590b0 0x7fcdb41488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdb4152640 0x7fcdb4148360 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 --2- 172.21.15.63:0/1510102423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdb40c8f40 0x7fcdb40cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 >> 172.21.15.63:0/1510102423 conn(0x7fcdb406f3d0 msgr2=0x7fcdb406f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 shutdown_connections 2024-09-12T03:02:17.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:17.150+0000 7fcdba400640 1 -- 172.21.15.63:0/1510102423 wait complete. 2024-09-12T03:02:17.172 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T03:02:34.201 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:02:34.205 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:02:37.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:02:37.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.322+0000 7f1208200640 1 Processor -- start 2024-09-12T03:02:37.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.322+0000 7f1208200640 1 -- start start 2024-09-12T03:02:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.322+0000 7f1208200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f12000c61e0 0x7f1200163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.322+0000 7f1208200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1200159520 con 0x7f12001527e0 2024-09-12T03:02:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.322+0000 7f1208200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12001589a0 con 0x7f12000c7a00 2024-09-12T03:02:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1208200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f1200158c80 con 0x7f12000c61e0 2024-09-12T03:02:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1205800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f12001527e0 0x7f12000c6970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52858/0 (socket says 172.21.15.63:52858) 2024-09-12T03:02:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1205800640 1 -- 172.21.15.63:0/3960213778 learned_addr learned my addr 172.21.15.63:0/3960213778 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T03:02:37.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1206200640 1 --2- 172.21.15.63:0/3960213778 >> v2:172.21.15.119:3300/0 conn(0x7f12000c61e0 0x7f1200163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054688771 0 0) 0x7f1200159520 con 0x7f12001527e0 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11e8003530 con 0x7f12001527e0 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1518157664 0 0) 0x7f11e8003530 con 0x7f12001527e0 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 >> v2:172.21.15.119:3300/0 conn(0x7f12000c61e0 msgr2=0x7f1200163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 --2- 172.21.15.63:0/3960213778 >> v2:172.21.15.119:3300/0 conn(0x7f12000c61e0 0x7f1200163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 >> v1:172.21.15.119:6789/0 conn(0x7f12000c7a00 legacy=0x7f12000cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1200158f60 con 0x7f12001527e0 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7f11f4001680 con 0x7f12001527e0 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 >> v1:172.21.15.63:6789/0 conn(0x7f12001527e0 legacy=0x7f12000c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11e80039c0 0x7f11e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e8004810 0x7f11e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e80051d0 0x7f11e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1200158c80 con 0x7f11e80039c0 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f11e800c070 con 0x7f11e80051d0 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f11e800c270 con 0x7f11e8004810 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1205800640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11e80039c0 0x7f11e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1206200640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e80051d0 0x7f11e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1204e00640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e8004810 0x7f11e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1205800640 1 -- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e8004810 msgr2=0x7f11e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1205800640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e8004810 0x7f11e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1205800640 1 -- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e80051d0 msgr2=0x7f11e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1205800640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e80051d0 0x7f11e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1205800640 1 -- 172.21.15.63:0/3960213778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e8003530 con 0x7f11e80039c0 2024-09-12T03:02:37.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1206200640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11e80051d0 0x7f11e800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1206200640 1 -- 172.21.15.63:0/3960213778 reap_dead start 2024-09-12T03:02:37.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.326+0000 7f1204e00640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e8004810 0x7f11e8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:02:37.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1205800640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11e80039c0 0x7f11e8003de0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c1c0 tx=0x7f11f401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f00782f13a528d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:37.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f4007d00 con 0x7f11e80039c0 2024-09-12T03:02:37.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f40a9020 con 0x7f11e80039c0 2024-09-12T03:02:37.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f11ffe00640 1 -- 172.21.15.63:0/3960213778 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f4005ae0 con 0x7f11e80039c0 2024-09-12T03:02:37.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1208200640 1 -- 172.21.15.63:0/3960213778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11e80039c0 msgr2=0x7f11e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1208200640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11e80039c0 0x7f11e8003de0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c1c0 tx=0x7f11f401cbf0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1208200640 1 -- 172.21.15.63:0/3960213778 shutdown_connections 2024-09-12T03:02:37.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1208200640 1 --2- 172.21.15.63:0/3960213778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f11e80039c0 0x7f11e8003de0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1208200640 1 -- 172.21.15.63:0/3960213778 >> 172.21.15.63:0/3960213778 conn(0x7f120006f3d0 msgr2=0x7f120006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:37.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1208200640 1 -- 172.21.15.63:0/3960213778 shutdown_connections 2024-09-12T03:02:37.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1208200640 1 -- 172.21.15.63:0/3960213778 wait complete. 2024-09-12T03:02:37.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1208200640 1 Processor -- start 2024-09-12T03:02:37.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.330+0000 7f1208200640 1 -- start start 2024-09-12T03:02:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1208200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e80039c0 0x7f12000c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1208200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1200156c80 0x7f12001f3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1208200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12001570c0 0x7f12001f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1208200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f12001586e0 con 0x7f1200156c80 2024-09-12T03:02:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1208200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1200158560 con 0x7f12001570c0 2024-09-12T03:02:37.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1208200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f12000cc550 con 0x7f11e80039c0 2024-09-12T03:02:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1204e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1200156c80 0x7f12001f3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1204e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1200156c80 0x7f12001f3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43576/0 (socket says 172.21.15.63:43576) 2024-09-12T03:02:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1204e00640 1 -- 172.21.15.63:0/1426956716 learned_addr learned my addr 172.21.15.63:0/1426956716 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1205800640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e80039c0 0x7f12000c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1206200640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12001570c0 0x7f12001f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1204e00640 1 -- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e80039c0 msgr2=0x7f12000c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1204e00640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e80039c0 0x7f12000c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1204e00640 1 -- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12001570c0 msgr2=0x7f12001f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1204e00640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12001570c0 0x7f12001f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1204e00640 1 -- 172.21.15.63:0/1426956716 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12001f7a20 con 0x7f1200156c80 2024-09-12T03:02:37.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1204e00640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1200156c80 0x7f12001f3e70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00d400 tx=0x7f11ec00d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:37.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f11fd600640 1 -- 172.21.15.63:0/1426956716 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec018070 con 0x7f1200156c80 2024-09-12T03:02:37.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f11fd600640 1 -- 172.21.15.63:0/1426956716 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11ec003620 con 0x7f1200156c80 2024-09-12T03:02:37.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12000c5130 con 0x7f1200156c80 2024-09-12T03:02:37.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f11fd600640 1 -- 172.21.15.63:0/1426956716 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec003a10 con 0x7f1200156c80 2024-09-12T03:02:37.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12000c56f0 con 0x7f1200156c80 2024-09-12T03:02:37.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.334+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12000cc8e0 con 0x7f1200156c80 2024-09-12T03:02:37.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.338+0000 7f11fd600640 1 -- 172.21.15.63:0/1426956716 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f11ec01b070 con 0x7f1200156c80 2024-09-12T03:02:37.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.338+0000 7f11fd600640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f11e00678f0 0x7f11e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.338+0000 7f11fd600640 1 -- 172.21.15.63:0/1426956716 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f11ec085840 con 0x7f1200156c80 2024-09-12T03:02:37.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.338+0000 7f1205800640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f11e00678f0 0x7f11e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.338+0000 7f1205800640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f11e00678f0 0x7f11e0069db0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f11f40aa000 tx=0x7f12000c7920 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:37.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.342+0000 7f11fd600640 1 -- 172.21.15.63:0/1426956716 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f11ec055860 con 0x7f1200156c80 2024-09-12T03:02:37.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.506+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 --> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f120014fbc0 con 0x7f11e00678f0 2024-09-12T03:02:37.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.530+0000 7f11fd600640 1 -- 172.21.15.63:0/1426956716 <== mgr.4106 v2:172.21.15.119:6832/57260755 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333001 (secure 0 0 0) 0x7f120014fbc0 con 0x7f11e00678f0 2024-09-12T03:02:37.534 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:02:37.536 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-12T03:02:37.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f11e00678f0 msgr2=0x7f11e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f11e00678f0 0x7f11e0069db0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f11f40aa000 tx=0x7f12000c7920 comp rx=0 tx=0).stop 2024-09-12T03:02:37.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1200156c80 msgr2=0x7f12001f3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1200156c80 0x7f12001f3e70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00d400 tx=0x7f11ec00d8c0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 shutdown_connections 2024-09-12T03:02:37.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12001570c0 0x7f12001f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1200156c80 0x7f12001f3e70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f11e00678f0 0x7f11e0069db0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 --2- 172.21.15.63:0/1426956716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11e80039c0 0x7f12000c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 >> 172.21.15.63:0/1426956716 conn(0x7f120006f3d0 msgr2=0x7f12000b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:37.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 shutdown_connections 2024-09-12T03:02:37.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.534+0000 7f1208200640 1 -- 172.21.15.63:0/1426956716 wait complete. 2024-09-12T03:02:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-09-12T03:02:35.879792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":629327,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":249,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":721,"ondisk_log_size":721,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238472,"kb_used_data":8696,"kb_used_omap":15,"kb_used_meta":229616,"kb_avail":754736248,"statfs":{"total":773094113280,"available":772849917952,"internally_reserved":0,"allocated":8904704,"data_stored":5195750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15698,"internal_metadata":235127470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005025"},"pg_stats":[{"pgid":"2.1f","version":"79'6","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975859+0000","last_change":"2024-09-12T02:59:32.000879+0000","last_active":"2024-09-12T02:59:47.975859+0000","last_peered":"2024-09-12T02:59:47.975859+0000","last_clean":"2024-09-12T02:59:47.975859+0000","last_became_active":"2024-09-12T02:57:03.822149+0000","last_became_peered":"2024-09-12T02:57:03.822149+0000","last_unstale":"2024-09-12T02:59:47.975859+0000","last_undegraded":"2024-09-12T02:59:47.975859+0000","last_fullsized":"2024-09-12T02:59:47.975859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:32.000756+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.000756+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:25.073437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971629+0000","last_change":"2024-09-12T02:59:43.632597+0000","last_active":"2024-09-12T02:59:47.971629+0000","last_peered":"2024-09-12T02:59:47.971629+0000","last_clean":"2024-09-12T02:59:47.971629+0000","last_became_active":"2024-09-12T02:57:04.857662+0000","last_became_peered":"2024-09-12T02:57:04.857662+0000","last_unstale":"2024-09-12T02:59:47.971629+0000","last_undegraded":"2024-09-12T02:59:47.971629+0000","last_fullsized":"2024-09-12T02:59:47.971629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:43.632456+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.632456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:01.396201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970686+0000","last_change":"2024-09-12T02:59:45.690062+0000","last_active":"2024-09-12T02:59:47.970686+0000","last_peered":"2024-09-12T02:59:47.970686+0000","last_clean":"2024-09-12T02:59:47.970686+0000","last_became_active":"2024-09-12T02:57:09.034746+0000","last_became_peered":"2024-09-12T02:57:09.034746+0000","last_unstale":"2024-09-12T02:59:47.970686+0000","last_undegraded":"2024-09-12T02:59:47.970686+0000","last_fullsized":"2024-09-12T02:59:47.970686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.689949+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.689949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:02.009111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971812+0000","last_change":"2024-09-12T02:59:36.630496+0000","last_active":"2024-09-12T02:59:47.971812+0000","last_peered":"2024-09-12T02:59:47.971812+0000","last_clean":"2024-09-12T02:59:47.971812+0000","last_became_active":"2024-09-12T02:57:03.798053+0000","last_became_peered":"2024-09-12T02:57:03.798053+0000","last_unstale":"2024-09-12T02:59:47.971812+0000","last_undegraded":"2024-09-12T02:59:47.971812+0000","last_fullsized":"2024-09-12T02:59:47.971812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:36.630383+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.630383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:49.675255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975738+0000","last_change":"2024-09-12T02:59:44.081098+0000","last_active":"2024-09-12T02:59:47.975738+0000","last_peered":"2024-09-12T02:59:47.975738+0000","last_clean":"2024-09-12T02:59:47.975738+0000","last_became_active":"2024-09-12T02:59:06.040413+0000","last_became_peered":"2024-09-12T02:59:06.040413+0000","last_unstale":"2024-09-12T02:59:47.975738+0000","last_undegraded":"2024-09-12T02:59:47.975738+0000","last_fullsized":"2024-09-12T02:59:47.975738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.080989+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.080989+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:55.266943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970569+0000","last_change":"2024-09-12T02:59:41.662320+0000","last_active":"2024-09-12T02:59:47.970569+0000","last_peered":"2024-09-12T02:59:47.970569+0000","last_clean":"2024-09-12T02:59:47.970569+0000","last_became_active":"2024-09-12T02:59:08.063434+0000","last_became_peered":"2024-09-12T02:59:08.063434+0000","last_unstale":"2024-09-12T02:59:47.970569+0000","last_undegraded":"2024-09-12T02:59:47.970569+0000","last_fullsized":"2024-09-12T02:59:47.970569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.662088+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.662088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:28.169111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989673+0000","last_change":"2024-09-12T02:59:37.757533+0000","last_active":"2024-09-12T02:59:47.989673+0000","last_peered":"2024-09-12T02:59:47.989673+0000","last_clean":"2024-09-12T02:59:47.989673+0000","last_became_active":"2024-09-12T02:57:03.833380+0000","last_became_peered":"2024-09-12T02:57:03.833380+0000","last_unstale":"2024-09-12T02:59:47.989673+0000","last_undegraded":"2024-09-12T02:59:47.989673+0000","last_fullsized":"2024-09-12T02:59:47.989673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:37.757250+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.757250+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:10.370609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972898+0000","last_change":"2024-09-12T02:59:35.959195+0000","last_active":"2024-09-12T02:59:47.972898+0000","last_peered":"2024-09-12T02:59:47.972898+0000","last_clean":"2024-09-12T02:59:47.972898+0000","last_became_active":"2024-09-12T02:59:06.039193+0000","last_became_peered":"2024-09-12T02:59:06.039193+0000","last_unstale":"2024-09-12T02:59:47.972898+0000","last_undegraded":"2024-09-12T02:59:47.972898+0000","last_fullsized":"2024-09-12T02:59:47.972898+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:35.958975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.958975+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.932192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972268+0000","last_change":"2024-09-12T02:59:43.619841+0000","last_active":"2024-09-12T02:59:47.972268+0000","last_peered":"2024-09-12T02:59:47.972268+0000","last_clean":"2024-09-12T02:59:47.972268+0000","last_became_active":"2024-09-12T02:59:08.064498+0000","last_became_peered":"2024-09-12T02:59:08.064498+0000","last_unstale":"2024-09-12T02:59:47.972268+0000","last_undegraded":"2024-09-12T02:59:47.972268+0000","last_fullsized":"2024-09-12T02:59:47.972268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.619594+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.619594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:49.784818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'3","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989275+0000","last_change":"2024-09-12T02:59:47.847154+0000","last_active":"2024-09-12T02:59:47.989275+0000","last_peered":"2024-09-12T02:59:47.989275+0000","last_clean":"2024-09-12T02:59:47.989275+0000","last_became_active":"2024-09-12T02:59:06.052633+0000","last_became_peered":"2024-09-12T02:59:06.052633+0000","last_unstale":"2024-09-12T02:59:47.989275+0000","last_undegraded":"2024-09-12T02:59:47.989275+0000","last_fullsized":"2024-09-12T02:59:47.989275+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'3","last_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_deep_scrub":"80'3","last_deep_scrub_stamp":"2024-09-12T02:59:47.846797+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.846797+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.835241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973874+0000","last_change":"2024-09-12T02:59:44.041049+0000","last_active":"2024-09-12T02:59:47.973874+0000","last_peered":"2024-09-12T02:59:47.973874+0000","last_clean":"2024-09-12T02:59:47.973874+0000","last_became_active":"2024-09-12T02:59:06.038541+0000","last_became_peered":"2024-09-12T02:59:06.038541+0000","last_unstale":"2024-09-12T02:59:47.973874+0000","last_undegraded":"2024-09-12T02:59:47.973874+0000","last_fullsized":"2024-09-12T02:59:47.973874+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:44.040815+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.040815+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:05.885096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971006+0000","last_change":"2024-09-12T02:59:40.700614+0000","last_active":"2024-09-12T02:59:47.971006+0000","last_peered":"2024-09-12T02:59:47.971006+0000","last_clean":"2024-09-12T02:59:47.971006+0000","last_became_active":"2024-09-12T02:59:06.057823+0000","last_became_peered":"2024-09-12T02:59:06.057823+0000","last_unstale":"2024-09-12T02:59:47.971006+0000","last_undegraded":"2024-09-12T02:59:47.971006+0000","last_fullsized":"2024-09-12T02:59:47.971006+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.700368+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.700368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:48.928824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986772+0000","last_change":"2024-09-12T02:59:39.629343+0000","last_active":"2024-09-12T02:59:47.986772+0000","last_peered":"2024-09-12T02:59:47.986772+0000","last_clean":"2024-09-12T02:59:47.986772+0000","last_became_active":"2024-09-12T02:57:04.870152+0000","last_became_peered":"2024-09-12T02:57:04.870152+0000","last_unstale":"2024-09-12T02:59:47.986772+0000","last_undegraded":"2024-09-12T02:59:47.986772+0000","last_fullsized":"2024-09-12T02:59:47.986772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.629058+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.629058+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:43.299464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988945+0000","last_change":"2024-09-12T02:59:36.789441+0000","last_active":"2024-09-12T02:59:47.988945+0000","last_peered":"2024-09-12T02:59:47.988945+0000","last_clean":"2024-09-12T02:59:47.988945+0000","last_became_active":"2024-09-12T02:57:03.828598+0000","last_became_peered":"2024-09-12T02:57:03.828598+0000","last_unstale":"2024-09-12T02:59:47.988945+0000","last_undegraded":"2024-09-12T02:59:47.988945+0000","last_fullsized":"2024-09-12T02:59:47.988945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:36.789151+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.789151+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:41.135081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975060+0000","last_change":"2024-09-12T02:59:37.711523+0000","last_active":"2024-09-12T02:59:47.975060+0000","last_peered":"2024-09-12T02:59:47.975060+0000","last_clean":"2024-09-12T02:59:47.975060+0000","last_became_active":"2024-09-12T02:57:08.874226+0000","last_became_peered":"2024-09-12T02:57:08.874226+0000","last_unstale":"2024-09-12T02:59:47.975060+0000","last_undegraded":"2024-09-12T02:59:47.975060+0000","last_fullsized":"2024-09-12T02:59:47.975060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.711188+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.711188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:42.241632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971004+0000","last_change":"2024-09-12T02:59:40.677307+0000","last_active":"2024-09-12T02:59:47.971004+0000","last_peered":"2024-09-12T02:59:47.971004+0000","last_clean":"2024-09-12T02:59:47.971004+0000","last_became_active":"2024-09-12T02:57:04.843680+0000","last_became_peered":"2024-09-12T02:57:04.843680+0000","last_unstale":"2024-09-12T02:59:47.971004+0000","last_undegraded":"2024-09-12T02:59:47.971004+0000","last_fullsized":"2024-09-12T02:59:47.971004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.677196+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.677196+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:18.992896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967822+0000","last_change":"2024-09-12T02:59:42.816275+0000","last_active":"2024-09-12T02:59:47.967822+0000","last_peered":"2024-09-12T02:59:47.967822+0000","last_clean":"2024-09-12T02:59:47.967822+0000","last_became_active":"2024-09-12T02:59:08.058023+0000","last_became_peered":"2024-09-12T02:59:08.058023+0000","last_unstale":"2024-09-12T02:59:47.967822+0000","last_undegraded":"2024-09-12T02:59:47.967822+0000","last_fullsized":"2024-09-12T02:59:47.967822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.816152+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.816152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:29.323176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973341+0000","last_change":"2024-09-12T02:59:38.719352+0000","last_active":"2024-09-12T02:59:47.973341+0000","last_peered":"2024-09-12T02:59:47.973341+0000","last_clean":"2024-09-12T02:59:47.973341+0000","last_became_active":"2024-09-12T02:57:08.880398+0000","last_became_peered":"2024-09-12T02:57:08.880398+0000","last_unstale":"2024-09-12T02:59:47.973341+0000","last_undegraded":"2024-09-12T02:59:47.973341+0000","last_fullsized":"2024-09-12T02:59:47.973341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.719131+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.719131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:24.333596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.642733+0000","last_change":"2024-09-12T02:59:50.642733+0000","last_active":"2024-09-12T02:59:50.642733+0000","last_peered":"2024-09-12T02:59:50.642733+0000","last_clean":"2024-09-12T02:59:50.642733+0000","last_became_active":"2024-09-12T02:59:08.063107+0000","last_became_peered":"2024-09-12T02:59:08.063107+0000","last_unstale":"2024-09-12T02:59:50.642733+0000","last_undegraded":"2024-09-12T02:59:50.642733+0000","last_fullsized":"2024-09-12T02:59:50.642733+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:50.642614+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.642614+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:36.625838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967915+0000","last_change":"2024-09-12T02:59:32.776350+0000","last_active":"2024-09-12T02:59:47.967915+0000","last_peered":"2024-09-12T02:59:47.967915+0000","last_clean":"2024-09-12T02:59:47.967915+0000","last_became_active":"2024-09-12T02:57:03.818706+0000","last_became_peered":"2024-09-12T02:57:03.818706+0000","last_unstale":"2024-09-12T02:59:47.967915+0000","last_undegraded":"2024-09-12T02:59:47.967915+0000","last_fullsized":"2024-09-12T02:59:47.967915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.776267+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.776267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:58.890222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968676+0000","last_change":"2024-09-12T02:59:34.789313+0000","last_active":"2024-09-12T02:59:47.968676+0000","last_peered":"2024-09-12T02:59:47.968676+0000","last_clean":"2024-09-12T02:59:47.968676+0000","last_became_active":"2024-09-12T02:57:09.034244+0000","last_became_peered":"2024-09-12T02:57:09.034244+0000","last_unstale":"2024-09-12T02:59:47.968676+0000","last_undegraded":"2024-09-12T02:59:47.968676+0000","last_fullsized":"2024-09-12T02:59:47.968676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.789214+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.789214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:17.790935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971845+0000","last_change":"2024-09-12T02:59:34.632579+0000","last_active":"2024-09-12T02:59:47.971845+0000","last_peered":"2024-09-12T02:59:47.971845+0000","last_clean":"2024-09-12T02:59:47.971845+0000","last_became_active":"2024-09-12T02:57:04.843847+0000","last_became_peered":"2024-09-12T02:57:04.843847+0000","last_unstale":"2024-09-12T02:59:47.971845+0000","last_undegraded":"2024-09-12T02:59:47.971845+0000","last_fullsized":"2024-09-12T02:59:47.971845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:34.632350+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.632350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.978281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987536+0000","last_change":"2024-09-12T02:59:35.785814+0000","last_active":"2024-09-12T02:59:47.987536+0000","last_peered":"2024-09-12T02:59:47.987536+0000","last_clean":"2024-09-12T02:59:47.987536+0000","last_became_active":"2024-09-12T02:57:03.827134+0000","last_became_peered":"2024-09-12T02:57:03.827134+0000","last_unstale":"2024-09-12T02:59:47.987536+0000","last_undegraded":"2024-09-12T02:59:47.987536+0000","last_fullsized":"2024-09-12T02:59:47.987536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.785459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.785459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.907074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":160,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975184+0000","last_change":"2024-09-12T02:59:44.644342+0000","last_active":"2024-09-12T02:59:47.975184+0000","last_peered":"2024-09-12T02:59:47.975184+0000","last_clean":"2024-09-12T02:59:47.975184+0000","last_became_active":"2024-09-12T02:59:08.074132+0000","last_became_peered":"2024-09-12T02:59:08.074132+0000","last_unstale":"2024-09-12T02:59:47.975184+0000","last_undegraded":"2024-09-12T02:59:47.975184+0000","last_fullsized":"2024-09-12T02:59:47.975184+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.644026+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.644026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:49.273561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":156,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975474+0000","last_change":"2024-09-12T02:59:46.131647+0000","last_active":"2024-09-12T02:59:47.975474+0000","last_peered":"2024-09-12T02:59:47.975474+0000","last_clean":"2024-09-12T02:59:47.975474+0000","last_became_active":"2024-09-12T02:59:08.061552+0000","last_became_peered":"2024-09-12T02:59:08.061552+0000","last_unstale":"2024-09-12T02:59:47.975474+0000","last_undegraded":"2024-09-12T02:59:47.975474+0000","last_fullsized":"2024-09-12T02:59:47.975474+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:46.131533+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.131533+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:06.802576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988089+0000","last_change":"2024-09-12T02:59:35.721123+0000","last_active":"2024-09-12T02:59:47.988089+0000","last_peered":"2024-09-12T02:59:47.988089+0000","last_clean":"2024-09-12T02:59:47.988089+0000","last_became_active":"2024-09-12T02:57:03.829036+0000","last_became_peered":"2024-09-12T02:57:03.829036+0000","last_unstale":"2024-09-12T02:59:47.988089+0000","last_undegraded":"2024-09-12T02:59:47.988089+0000","last_fullsized":"2024-09-12T02:59:47.988089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:35.720761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.720761+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:17.277216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971181+0000","last_change":"2024-09-12T02:59:39.707123+0000","last_active":"2024-09-12T02:59:47.971181+0000","last_peered":"2024-09-12T02:59:47.971181+0000","last_clean":"2024-09-12T02:59:47.971181+0000","last_became_active":"2024-09-12T02:59:06.041227+0000","last_became_peered":"2024-09-12T02:59:06.041227+0000","last_unstale":"2024-09-12T02:59:47.971181+0000","last_undegraded":"2024-09-12T02:59:47.971181+0000","last_fullsized":"2024-09-12T02:59:47.971181+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.706899+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.706899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:08.753477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972514+0000","last_change":"2024-09-12T02:59:41.667809+0000","last_active":"2024-09-12T02:59:47.972514+0000","last_peered":"2024-09-12T02:59:47.972514+0000","last_clean":"2024-09-12T02:59:47.972514+0000","last_became_active":"2024-09-12T02:57:04.850111+0000","last_became_peered":"2024-09-12T02:57:04.850111+0000","last_unstale":"2024-09-12T02:59:47.972514+0000","last_undegraded":"2024-09-12T02:59:47.972514+0000","last_fullsized":"2024-09-12T02:59:47.972514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:41.667707+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.667707+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:52.853661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969018+0000","last_change":"2024-09-12T02:59:45.841193+0000","last_active":"2024-09-12T02:59:47.969018+0000","last_peered":"2024-09-12T02:59:47.969018+0000","last_clean":"2024-09-12T02:59:47.969018+0000","last_became_active":"2024-09-12T02:59:08.052924+0000","last_became_peered":"2024-09-12T02:59:08.052924+0000","last_unstale":"2024-09-12T02:59:47.969018+0000","last_undegraded":"2024-09-12T02:59:47.969018+0000","last_fullsized":"2024-09-12T02:59:47.969018+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:45.841069+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.841069+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:50.470604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.993328+0000","last_change":"2024-09-12T02:59:47.991190+0000","last_active":"2024-09-12T02:59:47.993328+0000","last_peered":"2024-09-12T02:59:47.993328+0000","last_clean":"2024-09-12T02:59:47.993328+0000","last_became_active":"2024-09-12T02:59:47.990629+0000","last_became_peered":"2024-09-12T02:59:47.990629+0000","last_unstale":"2024-09-12T02:59:47.993328+0000","last_undegraded":"2024-09-12T02:59:47.993328+0000","last_fullsized":"2024-09-12T02:59:47.993328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:44.643595+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.643595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.689482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968300+0000","last_change":"2024-09-12T02:59:36.821336+0000","last_active":"2024-09-12T02:59:47.968300+0000","last_peered":"2024-09-12T02:59:47.968300+0000","last_clean":"2024-09-12T02:59:47.968300+0000","last_became_active":"2024-09-12T02:59:08.052106+0000","last_became_peered":"2024-09-12T02:59:08.052106+0000","last_unstale":"2024-09-12T02:59:47.968300+0000","last_undegraded":"2024-09-12T02:59:47.968300+0000","last_fullsized":"2024-09-12T02:59:47.968300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.821234+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.821234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:12.321748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989889+0000","last_change":"2024-09-12T02:59:38.763406+0000","last_active":"2024-09-12T02:59:47.989889+0000","last_peered":"2024-09-12T02:59:47.989889+0000","last_clean":"2024-09-12T02:59:47.989889+0000","last_became_active":"2024-09-12T02:57:03.834206+0000","last_became_peered":"2024-09-12T02:57:03.834206+0000","last_unstale":"2024-09-12T02:59:47.989889+0000","last_undegraded":"2024-09-12T02:59:47.989889+0000","last_fullsized":"2024-09-12T02:59:47.989889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:38.763178+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.763178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:12.755095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":152,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975134+0000","last_change":"2024-09-12T02:59:42.071495+0000","last_active":"2024-09-12T02:59:47.975134+0000","last_peered":"2024-09-12T02:59:47.975134+0000","last_clean":"2024-09-12T02:59:47.975134+0000","last_became_active":"2024-09-12T02:59:06.033696+0000","last_became_peered":"2024-09-12T02:59:06.033696+0000","last_unstale":"2024-09-12T02:59:47.975134+0000","last_undegraded":"2024-09-12T02:59:47.975134+0000","last_fullsized":"2024-09-12T02:59:47.975134+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.071362+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.071362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:30.775559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973454+0000","last_change":"2024-09-12T02:59:39.026655+0000","last_active":"2024-09-12T02:59:47.973454+0000","last_peered":"2024-09-12T02:59:47.973454+0000","last_clean":"2024-09-12T02:59:47.973454+0000","last_became_active":"2024-09-12T02:59:06.034029+0000","last_became_peered":"2024-09-12T02:59:06.034029+0000","last_unstale":"2024-09-12T02:59:47.973454+0000","last_undegraded":"2024-09-12T02:59:47.973454+0000","last_fullsized":"2024-09-12T02:59:47.973454+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:39.026365+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.026365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:52.426930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968353+0000","last_change":"2024-09-12T02:59:37.791375+0000","last_active":"2024-09-12T02:59:47.968353+0000","last_peered":"2024-09-12T02:59:47.968353+0000","last_clean":"2024-09-12T02:59:47.968353+0000","last_became_active":"2024-09-12T02:59:08.054082+0000","last_became_peered":"2024-09-12T02:59:08.054082+0000","last_unstale":"2024-09-12T02:59:47.968353+0000","last_undegraded":"2024-09-12T02:59:47.968353+0000","last_fullsized":"2024-09-12T02:59:47.968353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.791278+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.791278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:11.783194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967824+0000","last_change":"2024-09-12T02:59:43.858969+0000","last_active":"2024-09-12T02:59:47.967824+0000","last_peered":"2024-09-12T02:59:47.967824+0000","last_clean":"2024-09-12T02:59:47.967824+0000","last_became_active":"2024-09-12T02:59:08.060886+0000","last_became_peered":"2024-09-12T02:59:08.060886+0000","last_unstale":"2024-09-12T02:59:47.967824+0000","last_undegraded":"2024-09-12T02:59:47.967824+0000","last_fullsized":"2024-09-12T02:59:47.967824+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.858860+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.858860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972781+0000","last_change":"2024-09-12T02:59:35.662731+0000","last_active":"2024-09-12T02:59:47.972781+0000","last_peered":"2024-09-12T02:59:47.972781+0000","last_clean":"2024-09-12T02:59:47.972781+0000","last_became_active":"2024-09-12T02:57:04.854801+0000","last_became_peered":"2024-09-12T02:57:04.854801+0000","last_unstale":"2024-09-12T02:59:47.972781+0000","last_undegraded":"2024-09-12T02:59:47.972781+0000","last_fullsized":"2024-09-12T02:59:47.972781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.662469+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.662469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:08.275827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971714+0000","last_change":"2024-09-12T02:59:32.999842+0000","last_active":"2024-09-12T02:59:47.971714+0000","last_peered":"2024-09-12T02:59:47.971714+0000","last_clean":"2024-09-12T02:59:47.971714+0000","last_became_active":"2024-09-12T02:59:06.035365+0000","last_became_peered":"2024-09-12T02:59:06.035365+0000","last_unstale":"2024-09-12T02:59:47.971714+0000","last_undegraded":"2024-09-12T02:59:47.971714+0000","last_fullsized":"2024-09-12T02:59:47.971714+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.999508+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.999508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:43.870533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.055261+0000","last_change":"2024-09-12T02:59:48.055261+0000","last_active":"2024-09-12T02:59:48.055261+0000","last_peered":"2024-09-12T02:59:48.055261+0000","last_clean":"2024-09-12T02:59:48.055261+0000","last_became_active":"2024-09-12T02:59:06.055960+0000","last_became_peered":"2024-09-12T02:59:06.055960+0000","last_unstale":"2024-09-12T02:59:48.055261+0000","last_undegraded":"2024-09-12T02:59:48.055261+0000","last_fullsized":"2024-09-12T02:59:48.055261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:48.055039+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.055039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.593082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967982+0000","last_change":"2024-09-12T02:59:33.818250+0000","last_active":"2024-09-12T02:59:47.967982+0000","last_peered":"2024-09-12T02:59:47.967982+0000","last_clean":"2024-09-12T02:59:47.967982+0000","last_became_active":"2024-09-12T02:57:04.836789+0000","last_became_peered":"2024-09-12T02:57:04.836789+0000","last_unstale":"2024-09-12T02:59:47.967982+0000","last_undegraded":"2024-09-12T02:59:47.967982+0000","last_fullsized":"2024-09-12T02:59:47.967982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.818171+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.818171+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:46.646434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"79'3","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971922+0000","last_change":"2024-09-12T02:59:31.836989+0000","last_active":"2024-09-12T02:59:47.971922+0000","last_peered":"2024-09-12T02:59:47.971922+0000","last_clean":"2024-09-12T02:59:47.971922+0000","last_became_active":"2024-09-12T02:57:03.797896+0000","last_became_peered":"2024-09-12T02:57:03.797896+0000","last_unstale":"2024-09-12T02:59:47.971922+0000","last_undegraded":"2024-09-12T02:59:47.971922+0000","last_fullsized":"2024-09-12T02:59:47.971922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:31.836905+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.836905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:53.031692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968392+0000","last_change":"2024-09-12T02:59:39.791877+0000","last_active":"2024-09-12T02:59:47.968392+0000","last_peered":"2024-09-12T02:59:47.968392+0000","last_clean":"2024-09-12T02:59:47.968392+0000","last_became_active":"2024-09-12T02:59:08.056957+0000","last_became_peered":"2024-09-12T02:59:08.056957+0000","last_unstale":"2024-09-12T02:59:47.968392+0000","last_undegraded":"2024-09-12T02:59:47.968392+0000","last_fullsized":"2024-09-12T02:59:47.968392+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.791761+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.791761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:25.406226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974736+0000","last_change":"2024-09-12T02:59:30.045775+0000","last_active":"2024-09-12T02:59:47.974736+0000","last_peered":"2024-09-12T02:59:47.974736+0000","last_clean":"2024-09-12T02:59:47.974736+0000","last_became_active":"2024-09-12T02:57:04.870290+0000","last_became_peered":"2024-09-12T02:57:04.870290+0000","last_unstale":"2024-09-12T02:59:47.974736+0000","last_undegraded":"2024-09-12T02:59:47.974736+0000","last_fullsized":"2024-09-12T02:59:47.974736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:30.045690+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.045690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:33.716096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.861935+0000","last_change":"2024-09-12T02:59:49.861935+0000","last_active":"2024-09-12T02:59:49.861935+0000","last_peered":"2024-09-12T02:59:49.861935+0000","last_clean":"2024-09-12T02:59:49.861935+0000","last_became_active":"2024-09-12T02:59:08.068865+0000","last_became_peered":"2024-09-12T02:59:08.068865+0000","last_unstale":"2024-09-12T02:59:49.861935+0000","last_undegraded":"2024-09-12T02:59:49.861935+0000","last_fullsized":"2024-09-12T02:59:49.861935+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.861705+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.861705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:39.315077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975303+0000","last_change":"2024-09-12T02:59:40.118829+0000","last_active":"2024-09-12T02:59:47.975303+0000","last_peered":"2024-09-12T02:59:47.975303+0000","last_clean":"2024-09-12T02:59:47.975303+0000","last_became_active":"2024-09-12T02:57:09.029084+0000","last_became_peered":"2024-09-12T02:57:09.029084+0000","last_unstale":"2024-09-12T02:59:47.975303+0000","last_undegraded":"2024-09-12T02:59:47.975303+0000","last_fullsized":"2024-09-12T02:59:47.975303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.118699+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.118699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:10.405280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970932+0000","last_change":"2024-09-12T02:59:47.676864+0000","last_active":"2024-09-12T02:59:47.970932+0000","last_peered":"2024-09-12T02:59:47.970932+0000","last_clean":"2024-09-12T02:59:47.970932+0000","last_became_active":"2024-09-12T02:59:06.063005+0000","last_became_peered":"2024-09-12T02:59:06.063005+0000","last_unstale":"2024-09-12T02:59:47.970932+0000","last_undegraded":"2024-09-12T02:59:47.970932+0000","last_fullsized":"2024-09-12T02:59:47.970932+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.676747+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.676747+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.675367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972045+0000","last_change":"2024-09-12T02:59:40.971763+0000","last_active":"2024-09-12T02:59:47.972045+0000","last_peered":"2024-09-12T02:59:47.972045+0000","last_clean":"2024-09-12T02:59:47.972045+0000","last_became_active":"2024-09-12T02:59:06.033610+0000","last_became_peered":"2024-09-12T02:59:06.033610+0000","last_unstale":"2024-09-12T02:59:47.972045+0000","last_undegraded":"2024-09-12T02:59:47.972045+0000","last_fullsized":"2024-09-12T02:59:47.972045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:40.971535+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.971535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:04.999865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"79'119","reported_seq":299,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988085+0000","last_change":"2024-09-12T02:59:34.803297+0000","last_active":"2024-09-12T02:59:47.988085+0000","last_peered":"2024-09-12T02:59:47.988085+0000","last_clean":"2024-09-12T02:59:47.988085+0000","last_became_active":"2024-09-12T02:56:55.843993+0000","last_became_peered":"2024-09-12T02:56:55.843993+0000","last_unstale":"2024-09-12T02:59:47.988085+0000","last_undegraded":"2024-09-12T02:59:47.988085+0000","last_fullsized":"2024-09-12T02:59:47.988085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2024-09-12T02:59:34.802947+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.802947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:59.161855+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986575+0000","last_change":"2024-09-12T02:59:42.682806+0000","last_active":"2024-09-12T02:59:47.986575+0000","last_peered":"2024-09-12T02:59:47.986575+0000","last_clean":"2024-09-12T02:59:47.986575+0000","last_became_active":"2024-09-12T02:57:09.034522+0000","last_became_peered":"2024-09-12T02:57:09.034522+0000","last_unstale":"2024-09-12T02:59:47.986575+0000","last_undegraded":"2024-09-12T02:59:47.986575+0000","last_fullsized":"2024-09-12T02:59:47.986575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.682574+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.682574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:22.933579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T03:00:02.110284+0000","last_change":"2024-09-12T02:59:35.830230+0000","last_active":"2024-09-12T03:00:02.110284+0000","last_peered":"2024-09-12T03:00:02.110284+0000","last_clean":"2024-09-12T03:00:02.110284+0000","last_became_active":"2024-09-12T02:59:06.040618+0000","last_became_peered":"2024-09-12T02:59:06.040618+0000","last_unstale":"2024-09-12T03:00:02.110284+0000","last_undegraded":"2024-09-12T03:00:02.110284+0000","last_fullsized":"2024-09-12T03:00:02.110284+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.830121+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.830121+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.993178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972484+0000","last_change":"2024-09-12T02:59:35.842501+0000","last_active":"2024-09-12T02:59:47.972484+0000","last_peered":"2024-09-12T02:59:47.972484+0000","last_clean":"2024-09-12T02:59:47.972484+0000","last_became_active":"2024-09-12T02:59:06.052790+0000","last_became_peered":"2024-09-12T02:59:06.052790+0000","last_unstale":"2024-09-12T02:59:47.972484+0000","last_undegraded":"2024-09-12T02:59:47.972484+0000","last_fullsized":"2024-09-12T02:59:47.972484+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:35.842396+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.842396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:47.840469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986481+0000","last_change":"2024-09-12T02:59:41.651678+0000","last_active":"2024-09-12T02:59:47.986481+0000","last_peered":"2024-09-12T02:59:47.986481+0000","last_clean":"2024-09-12T02:59:47.986481+0000","last_became_active":"2024-09-12T02:57:09.025288+0000","last_became_peered":"2024-09-12T02:57:09.025288+0000","last_unstale":"2024-09-12T02:59:47.986481+0000","last_undegraded":"2024-09-12T02:59:47.986481+0000","last_fullsized":"2024-09-12T02:59:47.986481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.651443+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.651443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:40.919631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"79'6","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973428+0000","last_change":"2024-09-12T02:59:34.986788+0000","last_active":"2024-09-12T02:59:47.973428+0000","last_peered":"2024-09-12T02:59:47.973428+0000","last_clean":"2024-09-12T02:59:47.973428+0000","last_became_active":"2024-09-12T02:59:06.046732+0000","last_became_peered":"2024-09-12T02:59:06.046732+0000","last_unstale":"2024-09-12T02:59:47.973428+0000","last_undegraded":"2024-09-12T02:59:47.973428+0000","last_fullsized":"2024-09-12T02:59:47.973428+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:34.986542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.986542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:35.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"79'2","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968858+0000","last_change":"2024-09-12T02:59:31.772320+0000","last_active":"2024-09-12T02:59:47.968858+0000","last_peered":"2024-09-12T02:59:47.968858+0000","last_clean":"2024-09-12T02:59:47.968858+0000","last_became_active":"2024-09-12T02:57:03.799844+0000","last_became_peered":"2024-09-12T02:57:03.799844+0000","last_unstale":"2024-09-12T02:59:47.968858+0000","last_undegraded":"2024-09-12T02:59:47.968858+0000","last_fullsized":"2024-09-12T02:59:47.968858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.772236+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.772236+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:19.909174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975370+0000","last_change":"2024-09-12T02:59:43.053479+0000","last_active":"2024-09-12T02:59:47.975370+0000","last_peered":"2024-09-12T02:59:47.975370+0000","last_clean":"2024-09-12T02:59:47.975370+0000","last_became_active":"2024-09-12T02:59:06.034241+0000","last_became_peered":"2024-09-12T02:59:06.034241+0000","last_unstale":"2024-09-12T02:59:47.975370+0000","last_undegraded":"2024-09-12T02:59:47.975370+0000","last_fullsized":"2024-09-12T02:59:47.975370+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:43.053377+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.053377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:21.369077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989776+0000","last_change":"2024-09-12T02:59:46.862199+0000","last_active":"2024-09-12T02:59:47.989776+0000","last_peered":"2024-09-12T02:59:47.989776+0000","last_clean":"2024-09-12T02:59:47.989776+0000","last_became_active":"2024-09-12T02:57:04.874470+0000","last_became_peered":"2024-09-12T02:57:04.874470+0000","last_unstale":"2024-09-12T02:59:47.989776+0000","last_undegraded":"2024-09-12T02:59:47.989776+0000","last_fullsized":"2024-09-12T02:59:47.989776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:46.861972+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.861972+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:51.491507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'3","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972773+0000","last_change":"2024-09-12T02:59:30.860535+0000","last_active":"2024-09-12T02:59:47.972773+0000","last_peered":"2024-09-12T02:59:47.972773+0000","last_clean":"2024-09-12T02:59:47.972773+0000","last_became_active":"2024-09-12T02:57:03.792398+0000","last_became_peered":"2024-09-12T02:57:03.792398+0000","last_unstale":"2024-09-12T02:59:47.972773+0000","last_undegraded":"2024-09-12T02:59:47.972773+0000","last_fullsized":"2024-09-12T02:59:47.972773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-09-12T02:59:30.860444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.860444+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:23.065975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.093650+0000","last_change":"2024-09-12T02:59:49.093650+0000","last_active":"2024-09-12T02:59:49.093650+0000","last_peered":"2024-09-12T02:59:49.093650+0000","last_clean":"2024-09-12T02:59:49.093650+0000","last_became_active":"2024-09-12T02:59:06.057919+0000","last_became_peered":"2024-09-12T02:59:06.057919+0000","last_unstale":"2024-09-12T02:59:49.093650+0000","last_undegraded":"2024-09-12T02:59:49.093650+0000","last_fullsized":"2024-09-12T02:59:49.093650+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.093403+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.093403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:57.133030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989482+0000","last_change":"2024-09-12T02:59:44.860343+0000","last_active":"2024-09-12T02:59:47.989482+0000","last_peered":"2024-09-12T02:59:47.989482+0000","last_clean":"2024-09-12T02:59:47.989482+0000","last_became_active":"2024-09-12T02:57:04.871980+0000","last_became_peered":"2024-09-12T02:57:04.871980+0000","last_unstale":"2024-09-12T02:59:47.989482+0000","last_undegraded":"2024-09-12T02:59:47.989482+0000","last_fullsized":"2024-09-12T02:59:47.989482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:44.860002+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.860002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:03.716731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975493+0000","last_change":"2024-09-12T02:59:31.636304+0000","last_active":"2024-09-12T02:59:47.975493+0000","last_peered":"2024-09-12T02:59:47.975493+0000","last_clean":"2024-09-12T02:59:47.975493+0000","last_became_active":"2024-09-12T02:57:03.797624+0000","last_became_peered":"2024-09-12T02:57:03.797624+0000","last_unstale":"2024-09-12T02:59:47.975493+0000","last_undegraded":"2024-09-12T02:59:47.975493+0000","last_fullsized":"2024-09-12T02:59:47.975493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:31.636071+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.636071+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:48.966306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974649+0000","last_change":"2024-09-12T02:59:42.661415+0000","last_active":"2024-09-12T02:59:47.974649+0000","last_peered":"2024-09-12T02:59:47.974649+0000","last_clean":"2024-09-12T02:59:47.974649+0000","last_became_active":"2024-09-12T02:59:08.063912+0000","last_became_peered":"2024-09-12T02:59:08.063912+0000","last_unstale":"2024-09-12T02:59:47.974649+0000","last_undegraded":"2024-09-12T02:59:47.974649+0000","last_fullsized":"2024-09-12T02:59:47.974649+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:42.661146+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.661146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.517876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986421+0000","last_change":"2024-09-12T02:59:45.832208+0000","last_active":"2024-09-12T02:59:47.986421+0000","last_peered":"2024-09-12T02:59:47.986421+0000","last_clean":"2024-09-12T02:59:47.986421+0000","last_became_active":"2024-09-12T02:57:04.873767+0000","last_became_peered":"2024-09-12T02:57:04.873767+0000","last_unstale":"2024-09-12T02:59:47.986421+0000","last_undegraded":"2024-09-12T02:59:47.986421+0000","last_fullsized":"2024-09-12T02:59:47.986421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:45.831975+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.831975+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.997199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'12","reported_seq":185,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971629+0000","last_change":"2024-09-12T02:59:36.886312+0000","last_active":"2024-09-12T02:59:47.971629+0000","last_peered":"2024-09-12T02:59:47.971629+0000","last_clean":"2024-09-12T02:59:47.971629+0000","last_became_active":"2024-09-12T02:59:08.063336+0000","last_became_peered":"2024-09-12T02:59:08.063336+0000","last_unstale":"2024-09-12T02:59:47.971629+0000","last_undegraded":"2024-09-12T02:59:47.971629+0000","last_fullsized":"2024-09-12T02:59:47.971629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:36.886179+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.886179+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:45.626516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975220+0000","last_change":"2024-09-12T02:59:39.156656+0000","last_active":"2024-09-12T02:59:47.975220+0000","last_peered":"2024-09-12T02:59:47.975220+0000","last_clean":"2024-09-12T02:59:47.975220+0000","last_became_active":"2024-09-12T02:57:08.877816+0000","last_became_peered":"2024-09-12T02:57:08.877816+0000","last_unstale":"2024-09-12T02:59:47.975220+0000","last_undegraded":"2024-09-12T02:59:47.975220+0000","last_fullsized":"2024-09-12T02:59:47.975220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:39.156542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.156542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:34.954291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987537+0000","last_change":"2024-09-12T02:59:37.673643+0000","last_active":"2024-09-12T02:59:47.987537+0000","last_peered":"2024-09-12T02:59:47.987537+0000","last_clean":"2024-09-12T02:59:47.987537+0000","last_became_active":"2024-09-12T02:57:04.849696+0000","last_became_peered":"2024-09-12T02:57:04.849696+0000","last_unstale":"2024-09-12T02:59:47.987537+0000","last_undegraded":"2024-09-12T02:59:47.987537+0000","last_fullsized":"2024-09-12T02:59:47.987537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:37.673292+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.673292+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:37.523545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988693+0000","last_change":"2024-09-12T02:59:33.671444+0000","last_active":"2024-09-12T02:59:47.988693+0000","last_peered":"2024-09-12T02:59:47.988693+0000","last_clean":"2024-09-12T02:59:47.988693+0000","last_became_active":"2024-09-12T02:57:03.808868+0000","last_became_peered":"2024-09-12T02:57:03.808868+0000","last_unstale":"2024-09-12T02:59:47.988693+0000","last_undegraded":"2024-09-12T02:59:47.988693+0000","last_fullsized":"2024-09-12T02:59:47.988693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:33.671212+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.671212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:45.669284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972347+0000","last_change":"2024-09-12T02:59:34.590629+0000","last_active":"2024-09-12T02:59:47.972347+0000","last_peered":"2024-09-12T02:59:47.972347+0000","last_clean":"2024-09-12T02:59:47.972347+0000","last_became_active":"2024-09-12T02:57:09.024839+0000","last_became_peered":"2024-09-12T02:57:09.024839+0000","last_unstale":"2024-09-12T02:59:47.972347+0000","last_undegraded":"2024-09-12T02:59:47.972347+0000","last_fullsized":"2024-09-12T02:59:47.972347+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.590531+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.590531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.762881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988763+0000","last_change":"2024-09-12T02:59:43.837261+0000","last_active":"2024-09-12T02:59:47.988763+0000","last_peered":"2024-09-12T02:59:47.988763+0000","last_clean":"2024-09-12T02:59:47.988763+0000","last_became_active":"2024-09-12T02:57:04.871277+0000","last_became_peered":"2024-09-12T02:57:04.871277+0000","last_unstale":"2024-09-12T02:59:47.988763+0000","last_undegraded":"2024-09-12T02:59:47.988763+0000","last_fullsized":"2024-09-12T02:59:47.988763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:43.836980+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.836980+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.344004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"60'1","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970625+0000","last_change":"2024-09-12T02:59:45.048563+0000","last_active":"2024-09-12T02:59:47.970625+0000","last_peered":"2024-09-12T02:59:47.970625+0000","last_clean":"2024-09-12T02:59:47.970625+0000","last_became_active":"2024-09-12T02:59:06.033464+0000","last_became_peered":"2024-09-12T02:59:06.033464+0000","last_unstale":"2024-09-12T02:59:47.970625+0000","last_undegraded":"2024-09-12T02:59:47.970625+0000","last_fullsized":"2024-09-12T02:59:47.970625+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.048315+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.048315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:20.692033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:49.611694+0000","last_change":"2024-09-12T02:59:49.611694+0000","last_active":"2024-09-12T02:59:49.611694+0000","last_peered":"2024-09-12T02:59:49.611694+0000","last_clean":"2024-09-12T02:59:49.611694+0000","last_became_active":"2024-09-12T02:59:08.060741+0000","last_became_peered":"2024-09-12T02:59:08.060741+0000","last_unstale":"2024-09-12T02:59:49.611694+0000","last_undegraded":"2024-09-12T02:59:49.611694+0000","last_fullsized":"2024-09-12T02:59:49.611694+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:49.611569+0000","last_clean_scrub_stamp":"2024-09-12T02:59:49.611569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:05.308212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975313+0000","last_change":"2024-09-12T02:59:36.076892+0000","last_active":"2024-09-12T02:59:47.975313+0000","last_peered":"2024-09-12T02:59:47.975313+0000","last_clean":"2024-09-12T02:59:47.975313+0000","last_became_active":"2024-09-12T02:57:04.852461+0000","last_became_peered":"2024-09-12T02:57:04.852461+0000","last_unstale":"2024-09-12T02:59:47.975313+0000","last_undegraded":"2024-09-12T02:59:47.975313+0000","last_fullsized":"2024-09-12T02:59:47.975313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.076727+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.076727+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:26.666775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975650+0000","last_change":"2024-09-12T02:59:30.999792+0000","last_active":"2024-09-12T02:59:47.975650+0000","last_peered":"2024-09-12T02:59:47.975650+0000","last_clean":"2024-09-12T02:59:47.975650+0000","last_became_active":"2024-09-12T02:57:03.802063+0000","last_became_peered":"2024-09-12T02:57:03.802063+0000","last_unstale":"2024-09-12T02:59:47.975650+0000","last_undegraded":"2024-09-12T02:59:47.975650+0000","last_fullsized":"2024-09-12T02:59:47.975650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:30.999703+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.999703+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:17.375066+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973992+0000","last_change":"2024-09-12T02:59:34.015485+0000","last_active":"2024-09-12T02:59:47.973992+0000","last_peered":"2024-09-12T02:59:47.973992+0000","last_clean":"2024-09-12T02:59:47.973992+0000","last_became_active":"2024-09-12T02:59:06.039785+0000","last_became_peered":"2024-09-12T02:59:06.039785+0000","last_unstale":"2024-09-12T02:59:47.973992+0000","last_undegraded":"2024-09-12T02:59:47.973992+0000","last_fullsized":"2024-09-12T02:59:47.973992+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.015247+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.015247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:05.065563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":145,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989204+0000","last_change":"2024-09-12T02:59:41.793529+0000","last_active":"2024-09-12T02:59:47.989204+0000","last_peered":"2024-09-12T02:59:47.989204+0000","last_clean":"2024-09-12T02:59:47.989204+0000","last_became_active":"2024-09-12T02:57:04.847914+0000","last_became_peered":"2024-09-12T02:57:04.847914+0000","last_unstale":"2024-09-12T02:59:47.989204+0000","last_undegraded":"2024-09-12T02:59:47.989204+0000","last_fullsized":"2024-09-12T02:59:47.989204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:41.793303+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.793303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:10.839881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":168,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987950+0000","last_change":"2024-09-12T02:59:32.647074+0000","last_active":"2024-09-12T02:59:47.987950+0000","last_peered":"2024-09-12T02:59:47.987950+0000","last_clean":"2024-09-12T02:59:47.987950+0000","last_became_active":"2024-09-12T02:57:03.808532+0000","last_became_peered":"2024-09-12T02:57:03.808532+0000","last_unstale":"2024-09-12T02:59:47.987950+0000","last_undegraded":"2024-09-12T02:59:47.987950+0000","last_fullsized":"2024-09-12T02:59:47.987950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'28","last_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_deep_scrub":"79'28","last_deep_scrub_stamp":"2024-09-12T02:59:32.646844+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.646844+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:46.886484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37850,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'3","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968112+0000","last_change":"2024-09-12T02:59:46.857630+0000","last_active":"2024-09-12T02:59:47.968112+0000","last_peered":"2024-09-12T02:59:47.968112+0000","last_clean":"2024-09-12T02:59:47.968112+0000","last_became_active":"2024-09-12T02:59:08.061637+0000","last_became_peered":"2024-09-12T02:59:08.061637+0000","last_unstale":"2024-09-12T02:59:47.968112+0000","last_undegraded":"2024-09-12T02:59:47.968112+0000","last_fullsized":"2024-09-12T02:59:47.968112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'3","last_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_deep_scrub":"60'3","last_deep_scrub_stamp":"2024-09-12T02:59:46.857527+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.857527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.845970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974181+0000","last_change":"2024-09-12T02:59:33.680657+0000","last_active":"2024-09-12T02:59:47.974181+0000","last_peered":"2024-09-12T02:59:47.974181+0000","last_clean":"2024-09-12T02:59:47.974181+0000","last_became_active":"2024-09-12T02:57:04.840188+0000","last_became_peered":"2024-09-12T02:57:04.840188+0000","last_unstale":"2024-09-12T02:59:47.974181+0000","last_undegraded":"2024-09-12T02:59:47.974181+0000","last_fullsized":"2024-09-12T02:59:47.974181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:33.680411+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.680411+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:15.802027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"79'7","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968736+0000","last_change":"2024-09-12T02:59:44.852192+0000","last_active":"2024-09-12T02:59:47.968736+0000","last_peered":"2024-09-12T02:59:47.968736+0000","last_clean":"2024-09-12T02:59:47.968736+0000","last_became_active":"2024-09-12T02:59:08.054527+0000","last_became_peered":"2024-09-12T02:59:08.054527+0000","last_unstale":"2024-09-12T02:59:47.968736+0000","last_undegraded":"2024-09-12T02:59:47.968736+0000","last_fullsized":"2024-09-12T02:59:47.968736+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:44.852086+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.852086+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:51.017309+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":167,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971975+0000","last_change":"2024-09-12T02:59:45.664653+0000","last_active":"2024-09-12T02:59:47.971975+0000","last_peered":"2024-09-12T02:59:47.971975+0000","last_clean":"2024-09-12T02:59:47.971975+0000","last_became_active":"2024-09-12T02:59:08.074408+0000","last_became_peered":"2024-09-12T02:59:08.074408+0000","last_unstale":"2024-09-12T02:59:47.971975+0000","last_undegraded":"2024-09-12T02:59:47.971975+0000","last_fullsized":"2024-09-12T02:59:47.971975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:45.664314+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.664314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.652758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":155,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975834+0000","last_change":"2024-09-12T02:59:45.129108+0000","last_active":"2024-09-12T02:59:47.975834+0000","last_peered":"2024-09-12T02:59:47.975834+0000","last_clean":"2024-09-12T02:59:47.975834+0000","last_became_active":"2024-09-12T02:59:06.040504+0000","last_became_peered":"2024-09-12T02:59:06.040504+0000","last_unstale":"2024-09-12T02:59:47.975834+0000","last_undegraded":"2024-09-12T02:59:47.975834+0000","last_fullsized":"2024-09-12T02:59:47.975834+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:45.128965+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.128965+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.549002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974003+0000","last_change":"2024-09-12T02:59:37.986005+0000","last_active":"2024-09-12T02:59:47.974003+0000","last_peered":"2024-09-12T02:59:47.974003+0000","last_clean":"2024-09-12T02:59:47.974003+0000","last_became_active":"2024-09-12T02:59:06.032533+0000","last_became_peered":"2024-09-12T02:59:06.032533+0000","last_unstale":"2024-09-12T02:59:47.974003+0000","last_undegraded":"2024-09-12T02:59:47.974003+0000","last_fullsized":"2024-09-12T02:59:47.974003+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.985746+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.985746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:14.181632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.639783+0000","last_change":"2024-09-12T02:59:51.639783+0000","last_active":"2024-09-12T02:59:51.639783+0000","last_peered":"2024-09-12T02:59:51.639783+0000","last_clean":"2024-09-12T02:59:51.639783+0000","last_became_active":"2024-09-12T02:59:08.073898+0000","last_became_peered":"2024-09-12T02:59:08.073898+0000","last_unstale":"2024-09-12T02:59:51.639783+0000","last_undegraded":"2024-09-12T02:59:51.639783+0000","last_fullsized":"2024-09-12T02:59:51.639783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.639668+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.639668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:07.759727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974118+0000","last_change":"2024-09-12T02:59:39.987993+0000","last_active":"2024-09-12T02:59:47.974118+0000","last_peered":"2024-09-12T02:59:47.974118+0000","last_clean":"2024-09-12T02:59:47.974118+0000","last_became_active":"2024-09-12T02:59:06.034363+0000","last_became_peered":"2024-09-12T02:59:06.034363+0000","last_unstale":"2024-09-12T02:59:47.974118+0000","last_undegraded":"2024-09-12T02:59:47.974118+0000","last_fullsized":"2024-09-12T02:59:47.974118+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:39.987743+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.987743+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:54:04.424759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"60'1","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987908+0000","last_change":"2024-09-12T02:59:45.721685+0000","last_active":"2024-09-12T02:59:47.987908+0000","last_peered":"2024-09-12T02:59:47.987908+0000","last_clean":"2024-09-12T02:59:47.987908+0000","last_became_active":"2024-09-12T02:59:06.054737+0000","last_became_peered":"2024-09-12T02:59:06.054737+0000","last_unstale":"2024-09-12T02:59:47.987908+0000","last_undegraded":"2024-09-12T02:59:47.987908+0000","last_fullsized":"2024-09-12T02:59:47.987908+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'1","last_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_deep_scrub":"60'1","last_deep_scrub_stamp":"2024-09-12T02:59:45.721444+0000","last_clean_scrub_stamp":"2024-09-12T02:59:45.721444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.143614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970853+0000","last_change":"2024-09-12T02:59:46.669010+0000","last_active":"2024-09-12T02:59:47.970853+0000","last_peered":"2024-09-12T02:59:47.970853+0000","last_clean":"2024-09-12T02:59:47.970853+0000","last_became_active":"2024-09-12T02:59:06.038153+0000","last_became_peered":"2024-09-12T02:59:06.038153+0000","last_unstale":"2024-09-12T02:59:47.970853+0000","last_undegraded":"2024-09-12T02:59:47.970853+0000","last_fullsized":"2024-09-12T02:59:47.970853+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.668894+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.668894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:22.826170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975134+0000","last_change":"2024-09-12T02:59:41.077595+0000","last_active":"2024-09-12T02:59:47.975134+0000","last_peered":"2024-09-12T02:59:47.975134+0000","last_clean":"2024-09-12T02:59:47.975134+0000","last_became_active":"2024-09-12T02:57:09.029237+0000","last_became_peered":"2024-09-12T02:57:09.029237+0000","last_unstale":"2024-09-12T02:59:47.975134+0000","last_undegraded":"2024-09-12T02:59:47.975134+0000","last_fullsized":"2024-09-12T02:59:47.975134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:41.077484+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.077484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:52.294457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967794+0000","last_change":"2024-09-12T02:59:41.841470+0000","last_active":"2024-09-12T02:59:47.967794+0000","last_peered":"2024-09-12T02:59:47.967794+0000","last_clean":"2024-09-12T02:59:47.967794+0000","last_became_active":"2024-09-12T02:59:08.057823+0000","last_became_peered":"2024-09-12T02:59:08.057823+0000","last_unstale":"2024-09-12T02:59:47.967794+0000","last_undegraded":"2024-09-12T02:59:47.967794+0000","last_fullsized":"2024-09-12T02:59:47.967794+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:41.841333+0000","last_clean_scrub_stamp":"2024-09-12T02:59:41.841333+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.069789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:51.131633+0000","last_change":"2024-09-12T02:59:51.131633+0000","last_active":"2024-09-12T02:59:51.131633+0000","last_peered":"2024-09-12T02:59:51.131633+0000","last_clean":"2024-09-12T02:59:51.131633+0000","last_became_active":"2024-09-12T02:59:06.052994+0000","last_became_peered":"2024-09-12T02:59:06.052994+0000","last_unstale":"2024-09-12T02:59:51.131633+0000","last_undegraded":"2024-09-12T02:59:51.131633+0000","last_fullsized":"2024-09-12T02:59:51.131633+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:51.131397+0000","last_clean_scrub_stamp":"2024-09-12T02:59:51.131397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:19.953861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987377+0000","last_change":"2024-09-12T02:59:46.767895+0000","last_active":"2024-09-12T02:59:47.987377+0000","last_peered":"2024-09-12T02:59:47.987377+0000","last_clean":"2024-09-12T02:59:47.987377+0000","last_became_active":"2024-09-12T02:59:06.056135+0000","last_became_peered":"2024-09-12T02:59:06.056135+0000","last_unstale":"2024-09-12T02:59:47.987377+0000","last_undegraded":"2024-09-12T02:59:47.987377+0000","last_fullsized":"2024-09-12T02:59:47.987377+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:46.767560+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.767560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:17.939911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971481+0000","last_change":"2024-09-12T02:59:39.674943+0000","last_active":"2024-09-12T02:59:47.971481+0000","last_peered":"2024-09-12T02:59:47.971481+0000","last_clean":"2024-09-12T02:59:47.971481+0000","last_became_active":"2024-09-12T02:57:04.835022+0000","last_became_peered":"2024-09-12T02:57:04.835022+0000","last_unstale":"2024-09-12T02:59:47.971481+0000","last_undegraded":"2024-09-12T02:59:47.971481+0000","last_fullsized":"2024-09-12T02:59:47.971481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:39.674831+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.674831+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:28.379028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971031+0000","last_change":"2024-09-12T02:59:37.660153+0000","last_active":"2024-09-12T02:59:47.971031+0000","last_peered":"2024-09-12T02:59:47.971031+0000","last_clean":"2024-09-12T02:59:47.971031+0000","last_became_active":"2024-09-12T02:57:03.804081+0000","last_became_peered":"2024-09-12T02:57:03.804081+0000","last_unstale":"2024-09-12T02:59:47.971031+0000","last_undegraded":"2024-09-12T02:59:47.971031+0000","last_fullsized":"2024-09-12T02:59:47.971031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:37.660048+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.660048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:32.261376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987245+0000","last_change":"2024-09-12T02:59:34.716068+0000","last_active":"2024-09-12T02:59:47.987245+0000","last_peered":"2024-09-12T02:59:47.987245+0000","last_clean":"2024-09-12T02:59:47.987245+0000","last_became_active":"2024-09-12T02:57:03.815388+0000","last_became_peered":"2024-09-12T02:57:03.815388+0000","last_unstale":"2024-09-12T02:59:47.987245+0000","last_undegraded":"2024-09-12T02:59:47.987245+0000","last_fullsized":"2024-09-12T02:59:47.987245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:34.715793+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.715793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:43.456130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975534+0000","last_change":"2024-09-12T02:59:38.162584+0000","last_active":"2024-09-12T02:59:47.975534+0000","last_peered":"2024-09-12T02:59:47.975534+0000","last_clean":"2024-09-12T02:59:47.975534+0000","last_became_active":"2024-09-12T02:57:04.868635+0000","last_became_peered":"2024-09-12T02:57:04.868635+0000","last_unstale":"2024-09-12T02:59:47.975534+0000","last_undegraded":"2024-09-12T02:59:47.975534+0000","last_fullsized":"2024-09-12T02:59:47.975534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:38.162461+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.162461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:51.207333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972336+0000","last_change":"2024-09-12T02:59:34.845414+0000","last_active":"2024-09-12T02:59:47.972336+0000","last_peered":"2024-09-12T02:59:47.972336+0000","last_clean":"2024-09-12T02:59:47.972336+0000","last_became_active":"2024-09-12T02:59:06.048625+0000","last_became_peered":"2024-09-12T02:59:06.048625+0000","last_unstale":"2024-09-12T02:59:47.972336+0000","last_undegraded":"2024-09-12T02:59:47.972336+0000","last_fullsized":"2024-09-12T02:59:47.972336+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:34.845313+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.845313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:49.084952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971138+0000","last_change":"2024-09-12T02:59:38.676599+0000","last_active":"2024-09-12T02:59:47.971138+0000","last_peered":"2024-09-12T02:59:47.971138+0000","last_clean":"2024-09-12T02:59:47.971138+0000","last_became_active":"2024-09-12T02:57:03.818796+0000","last_became_peered":"2024-09-12T02:57:03.818796+0000","last_unstale":"2024-09-12T02:59:47.971138+0000","last_undegraded":"2024-09-12T02:59:47.971138+0000","last_fullsized":"2024-09-12T02:59:47.971138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-09-12T02:59:38.676453+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.676453+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:08.813287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971567+0000","last_change":"2024-09-12T02:59:32.676152+0000","last_active":"2024-09-12T02:59:47.971567+0000","last_peered":"2024-09-12T02:59:47.971567+0000","last_clean":"2024-09-12T02:59:47.971567+0000","last_became_active":"2024-09-12T02:57:04.837106+0000","last_became_peered":"2024-09-12T02:57:04.837106+0000","last_unstale":"2024-09-12T02:59:47.971567+0000","last_undegraded":"2024-09-12T02:59:47.971567+0000","last_fullsized":"2024-09-12T02:59:47.971567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:32.675897+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.675897+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971908+0000","last_change":"2024-09-12T02:59:32.600836+0000","last_active":"2024-09-12T02:59:47.971908+0000","last_peered":"2024-09-12T02:59:47.971908+0000","last_clean":"2024-09-12T02:59:47.971908+0000","last_became_active":"2024-09-12T02:57:08.869549+0000","last_became_peered":"2024-09-12T02:57:08.869549+0000","last_unstale":"2024-09-12T02:59:47.971908+0000","last_undegraded":"2024-09-12T02:59:47.971908+0000","last_fullsized":"2024-09-12T02:59:47.971908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:59:32.600751+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.600751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:36.409439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988055+0000","last_change":"2024-09-12T02:59:36.720562+0000","last_active":"2024-09-12T02:59:47.988055+0000","last_peered":"2024-09-12T02:59:47.988055+0000","last_clean":"2024-09-12T02:59:47.988055+0000","last_became_active":"2024-09-12T02:57:04.847998+0000","last_became_peered":"2024-09-12T02:57:04.847998+0000","last_unstale":"2024-09-12T02:59:47.988055+0000","last_undegraded":"2024-09-12T02:59:47.988055+0000","last_fullsized":"2024-09-12T02:59:47.988055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:36.720181+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.720181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:09.336802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":160,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971753+0000","last_change":"2024-09-12T02:59:33.813763+0000","last_active":"2024-09-12T02:59:47.971753+0000","last_peered":"2024-09-12T02:59:47.971753+0000","last_clean":"2024-09-12T02:59:47.971753+0000","last_became_active":"2024-09-12T02:59:06.034904+0000","last_became_peered":"2024-09-12T02:59:06.034904+0000","last_unstale":"2024-09-12T02:59:47.971753+0000","last_undegraded":"2024-09-12T02:59:47.971753+0000","last_fullsized":"2024-09-12T02:59:47.971753+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-09-12T02:59:33.813677+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.813677+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:54.427179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971306+0000","last_change":"2024-09-12T02:59:43.020950+0000","last_active":"2024-09-12T02:59:47.971306+0000","last_peered":"2024-09-12T02:59:47.971306+0000","last_clean":"2024-09-12T02:59:47.971306+0000","last_became_active":"2024-09-12T02:59:06.034662+0000","last_became_peered":"2024-09-12T02:59:06.034662+0000","last_unstale":"2024-09-12T02:59:47.971306+0000","last_undegraded":"2024-09-12T02:59:47.971306+0000","last_fullsized":"2024-09-12T02:59:47.971306+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:43.020633+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.020633+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:20.020956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975562+0000","last_change":"2024-09-12T02:59:35.065915+0000","last_active":"2024-09-12T02:59:47.975562+0000","last_peered":"2024-09-12T02:59:47.975562+0000","last_clean":"2024-09-12T02:59:47.975562+0000","last_became_active":"2024-09-12T02:57:04.846797+0000","last_became_peered":"2024-09-12T02:57:04.846797+0000","last_unstale":"2024-09-12T02:59:47.975562+0000","last_undegraded":"2024-09-12T02:59:47.975562+0000","last_fullsized":"2024-09-12T02:59:47.975562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:35.065802+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.065802+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:51.998513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971356+0000","last_change":"2024-09-12T02:59:33.570266+0000","last_active":"2024-09-12T02:59:47.971356+0000","last_peered":"2024-09-12T02:59:47.971356+0000","last_clean":"2024-09-12T02:59:47.971356+0000","last_became_active":"2024-09-12T02:57:04.868555+0000","last_became_peered":"2024-09-12T02:57:04.868555+0000","last_unstale":"2024-09-12T02:59:47.971356+0000","last_undegraded":"2024-09-12T02:59:47.971356+0000","last_fullsized":"2024-09-12T02:59:47.971356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:33.570177+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.570177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:57.992347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.968402+0000","last_change":"2024-09-12T02:59:30.749318+0000","last_active":"2024-09-12T02:59:47.968402+0000","last_peered":"2024-09-12T02:59:47.968402+0000","last_clean":"2024-09-12T02:59:47.968402+0000","last_became_active":"2024-09-12T02:59:08.055479+0000","last_became_peered":"2024-09-12T02:59:08.055479+0000","last_unstale":"2024-09-12T02:59:47.968402+0000","last_undegraded":"2024-09-12T02:59:47.968402+0000","last_fullsized":"2024-09-12T02:59:47.968402+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:30.749228+0000","last_clean_scrub_stamp":"2024-09-12T02:59:30.749228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:31.541524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":153,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987586+0000","last_change":"2024-09-12T02:59:38.651039+0000","last_active":"2024-09-12T02:59:47.987586+0000","last_peered":"2024-09-12T02:59:47.987586+0000","last_clean":"2024-09-12T02:59:47.987586+0000","last_became_active":"2024-09-12T02:57:04.852795+0000","last_became_peered":"2024-09-12T02:57:04.852795+0000","last_unstale":"2024-09-12T02:59:47.987586+0000","last_undegraded":"2024-09-12T02:59:47.987586+0000","last_fullsized":"2024-09-12T02:59:47.987586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'15","last_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_deep_scrub":"79'15","last_deep_scrub_stamp":"2024-09-12T02:59:38.650631+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.650631+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:16.137855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972462+0000","last_change":"2024-09-12T02:59:42.663691+0000","last_active":"2024-09-12T02:59:47.972462+0000","last_peered":"2024-09-12T02:59:47.972462+0000","last_clean":"2024-09-12T02:59:47.972462+0000","last_became_active":"2024-09-12T02:57:04.856875+0000","last_became_peered":"2024-09-12T02:57:04.856875+0000","last_unstale":"2024-09-12T02:59:47.972462+0000","last_undegraded":"2024-09-12T02:59:47.972462+0000","last_fullsized":"2024-09-12T02:59:47.972462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-09-12T02:59:42.663586+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.663586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:23.083624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":67,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:50.118766+0000","last_change":"2024-09-12T02:59:50.118766+0000","last_active":"2024-09-12T02:59:50.118766+0000","last_peered":"2024-09-12T02:59:50.118766+0000","last_clean":"2024-09-12T02:59:50.118766+0000","last_became_active":"2024-09-12T02:59:06.060288+0000","last_became_peered":"2024-09-12T02:59:06.060288+0000","last_unstale":"2024-09-12T02:59:50.118766+0000","last_undegraded":"2024-09-12T02:59:50.118766+0000","last_fullsized":"2024-09-12T02:59:50.118766+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:50.118459+0000","last_clean_scrub_stamp":"2024-09-12T02:59:50.118459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:39.693765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970671+0000","last_change":"2024-09-12T02:59:31.642639+0000","last_active":"2024-09-12T02:59:47.970671+0000","last_peered":"2024-09-12T02:59:47.970671+0000","last_clean":"2024-09-12T02:59:47.970671+0000","last_became_active":"2024-09-12T02:57:04.870214+0000","last_became_peered":"2024-09-12T02:57:04.870214+0000","last_unstale":"2024-09-12T02:59:47.970671+0000","last_undegraded":"2024-09-12T02:59:47.970671+0000","last_fullsized":"2024-09-12T02:59:47.970671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:31.642539+0000","last_clean_scrub_stamp":"2024-09-12T02:59:31.642539+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:45.910007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971028+0000","last_change":"2024-09-12T02:59:42.020010+0000","last_active":"2024-09-12T02:59:47.971028+0000","last_peered":"2024-09-12T02:59:47.971028+0000","last_clean":"2024-09-12T02:59:47.971028+0000","last_became_active":"2024-09-12T02:59:06.033917+0000","last_became_peered":"2024-09-12T02:59:06.033917+0000","last_unstale":"2024-09-12T02:59:47.971028+0000","last_undegraded":"2024-09-12T02:59:47.971028+0000","last_fullsized":"2024-09-12T02:59:47.971028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:42.019770+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.019770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:02.627789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":150,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975254+0000","last_change":"2024-09-12T02:59:37.126601+0000","last_active":"2024-09-12T02:59:47.975254+0000","last_peered":"2024-09-12T02:59:47.975254+0000","last_clean":"2024-09-12T02:59:47.975254+0000","last_became_active":"2024-09-12T02:57:04.852508+0000","last_became_peered":"2024-09-12T02:57:04.852508+0000","last_unstale":"2024-09-12T02:59:47.975254+0000","last_undegraded":"2024-09-12T02:59:47.975254+0000","last_fullsized":"2024-09-12T02:59:47.975254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:37.126497+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.126497+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:41.431052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987834+0000","last_change":"2024-09-12T02:59:40.644873+0000","last_active":"2024-09-12T02:59:47.987834+0000","last_peered":"2024-09-12T02:59:47.987834+0000","last_clean":"2024-09-12T02:59:47.987834+0000","last_became_active":"2024-09-12T02:57:04.870205+0000","last_became_peered":"2024-09-12T02:57:04.870205+0000","last_unstale":"2024-09-12T02:59:47.987834+0000","last_undegraded":"2024-09-12T02:59:47.987834+0000","last_fullsized":"2024-09-12T02:59:47.987834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:40.644626+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.644626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:27.019990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989691+0000","last_change":"2024-09-12T02:59:42.787927+0000","last_active":"2024-09-12T02:59:47.989691+0000","last_peered":"2024-09-12T02:59:47.989691+0000","last_clean":"2024-09-12T02:59:47.989691+0000","last_became_active":"2024-09-12T02:57:04.852605+0000","last_became_peered":"2024-09-12T02:57:04.852605+0000","last_unstale":"2024-09-12T02:59:47.989691+0000","last_undegraded":"2024-09-12T02:59:47.989691+0000","last_fullsized":"2024-09-12T02:59:47.989691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:42.787542+0000","last_clean_scrub_stamp":"2024-09-12T02:59:42.787542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.015998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.972737+0000","last_change":"2024-09-12T02:59:32.823831+0000","last_active":"2024-09-12T02:59:47.972737+0000","last_peered":"2024-09-12T02:59:47.972737+0000","last_clean":"2024-09-12T02:59:47.972737+0000","last_became_active":"2024-09-12T02:57:04.857989+0000","last_became_peered":"2024-09-12T02:57:04.857989+0000","last_unstale":"2024-09-12T02:59:47.972737+0000","last_undegraded":"2024-09-12T02:59:47.972737+0000","last_fullsized":"2024-09-12T02:59:47.972737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:32.823742+0000","last_clean_scrub_stamp":"2024-09-12T02:59:32.823742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:34.576078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.974580+0000","last_change":"2024-09-12T02:59:47.049456+0000","last_active":"2024-09-12T02:59:47.974580+0000","last_peered":"2024-09-12T02:59:47.974580+0000","last_clean":"2024-09-12T02:59:47.974580+0000","last_became_active":"2024-09-12T02:59:06.046448+0000","last_became_peered":"2024-09-12T02:59:06.046448+0000","last_unstale":"2024-09-12T02:59:47.974580+0000","last_undegraded":"2024-09-12T02:59:47.974580+0000","last_fullsized":"2024-09-12T02:59:47.974580+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:47.049206+0000","last_clean_scrub_stamp":"2024-09-12T02:59:47.049206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:32.900134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.971380+0000","last_change":"2024-09-12T02:59:37.007470+0000","last_active":"2024-09-12T02:59:47.971380+0000","last_peered":"2024-09-12T02:59:47.971380+0000","last_clean":"2024-09-12T02:59:47.971380+0000","last_became_active":"2024-09-12T02:59:06.032506+0000","last_became_peered":"2024-09-12T02:59:06.032506+0000","last_unstale":"2024-09-12T02:59:47.971380+0000","last_undegraded":"2024-09-12T02:59:47.971380+0000","last_fullsized":"2024-09-12T02:59:47.971380+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:37.007224+0000","last_clean_scrub_stamp":"2024-09-12T02:59:37.007224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:18.542924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.967872+0000","last_change":"2024-09-12T02:59:40.838979+0000","last_active":"2024-09-12T02:59:47.967872+0000","last_peered":"2024-09-12T02:59:47.967872+0000","last_clean":"2024-09-12T02:59:47.967872+0000","last_became_active":"2024-09-12T02:59:08.057410+0000","last_became_peered":"2024-09-12T02:59:08.057410+0000","last_unstale":"2024-09-12T02:59:47.967872+0000","last_undegraded":"2024-09-12T02:59:47.967872+0000","last_fullsized":"2024-09-12T02:59:47.967872+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:40.838843+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.838843+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:09.885421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"79'8","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975181+0000","last_change":"2024-09-12T02:59:34.019995+0000","last_active":"2024-09-12T02:59:47.975181+0000","last_peered":"2024-09-12T02:59:47.975181+0000","last_clean":"2024-09-12T02:59:47.975181+0000","last_became_active":"2024-09-12T02:57:04.842340+0000","last_became_peered":"2024-09-12T02:57:04.842340+0000","last_unstale":"2024-09-12T02:59:47.975181+0000","last_undegraded":"2024-09-12T02:59:47.975181+0000","last_fullsized":"2024-09-12T02:59:47.975181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:34.019910+0000","last_clean_scrub_stamp":"2024-09-12T02:59:34.019910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:37.828598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":148,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.970840+0000","last_change":"2024-09-12T02:59:35.597391+0000","last_active":"2024-09-12T02:59:47.970840+0000","last_peered":"2024-09-12T02:59:47.970840+0000","last_clean":"2024-09-12T02:59:47.970840+0000","last_became_active":"2024-09-12T02:57:04.857743+0000","last_became_peered":"2024-09-12T02:57:04.857743+0000","last_unstale":"2024-09-12T02:59:47.970840+0000","last_undegraded":"2024-09-12T02:59:47.970840+0000","last_fullsized":"2024-09-12T02:59:47.970840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'10","last_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_deep_scrub":"79'10","last_deep_scrub_stamp":"2024-09-12T02:59:35.597291+0000","last_clean_scrub_stamp":"2024-09-12T02:59:35.597291+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:38.185412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973925+0000","last_change":"2024-09-12T02:59:36.682299+0000","last_active":"2024-09-12T02:59:47.973925+0000","last_peered":"2024-09-12T02:59:47.973925+0000","last_clean":"2024-09-12T02:59:47.973925+0000","last_became_active":"2024-09-12T02:57:04.855927+0000","last_became_peered":"2024-09-12T02:57:04.855927+0000","last_unstale":"2024-09-12T02:59:47.973925+0000","last_undegraded":"2024-09-12T02:59:47.973925+0000","last_fullsized":"2024-09-12T02:59:47.973925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:36.682064+0000","last_clean_scrub_stamp":"2024-09-12T02:59:36.682064+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:10.673981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":151,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987033+0000","last_change":"2024-09-12T02:59:44.683736+0000","last_active":"2024-09-12T02:59:47.987033+0000","last_peered":"2024-09-12T02:59:47.987033+0000","last_clean":"2024-09-12T02:59:47.987033+0000","last_became_active":"2024-09-12T02:59:06.052808+0000","last_became_peered":"2024-09-12T02:59:06.052808+0000","last_unstale":"2024-09-12T02:59:47.987033+0000","last_undegraded":"2024-09-12T02:59:47.987033+0000","last_fullsized":"2024-09-12T02:59:47.987033+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T02:59:44.683432+0000","last_clean_scrub_stamp":"2024-09-12T02:59:44.683432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.492120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":159,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.987307+0000","last_change":"2024-09-12T02:59:43.695797+0000","last_active":"2024-09-12T02:59:47.987307+0000","last_peered":"2024-09-12T02:59:47.987307+0000","last_clean":"2024-09-12T02:59:47.987307+0000","last_became_active":"2024-09-12T02:57:47.805460+0000","last_became_peered":"2024-09-12T02:57:47.805460+0000","last_unstale":"2024-09-12T02:59:47.987307+0000","last_undegraded":"2024-09-12T02:59:47.987307+0000","last_fullsized":"2024-09-12T02:59:47.987307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'16","last_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_deep_scrub":"79'16","last_deep_scrub_stamp":"2024-09-12T02:59:43.695424+0000","last_clean_scrub_stamp":"2024-09-12T02:59:43.695424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:57.962892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":157,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.814183+0000","last_change":"2024-09-12T02:59:48.814183+0000","last_active":"2024-09-12T02:59:48.814183+0000","last_peered":"2024-09-12T02:59:48.814183+0000","last_clean":"2024-09-12T02:59:48.814183+0000","last_became_active":"2024-09-12T02:59:06.058020+0000","last_became_peered":"2024-09-12T02:59:06.058020+0000","last_unstale":"2024-09-12T02:59:48.814183+0000","last_undegraded":"2024-09-12T02:59:48.814183+0000","last_fullsized":"2024-09-12T02:59:48.814183+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'11","last_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_deep_scrub":"79'11","last_deep_scrub_stamp":"2024-09-12T02:59:48.813942+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.813942+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:41.235405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":154,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:48.652404+0000","last_change":"2024-09-12T02:59:48.652404+0000","last_active":"2024-09-12T02:59:48.652404+0000","last_peered":"2024-09-12T02:59:48.652404+0000","last_clean":"2024-09-12T02:59:48.652404+0000","last_became_active":"2024-09-12T02:59:06.066613+0000","last_became_peered":"2024-09-12T02:59:06.066613+0000","last_unstale":"2024-09-12T02:59:48.652404+0000","last_undegraded":"2024-09-12T02:59:48.652404+0000","last_fullsized":"2024-09-12T02:59:48.652404+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-09-12T02:59:48.652295+0000","last_clean_scrub_stamp":"2024-09-12T02:59:48.652295+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:24.469845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":144,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.986379+0000","last_change":"2024-09-12T02:59:40.773384+0000","last_active":"2024-09-12T02:59:47.986379+0000","last_peered":"2024-09-12T02:59:47.986379+0000","last_clean":"2024-09-12T02:59:47.986379+0000","last_became_active":"2024-09-12T02:57:04.845751+0000","last_became_peered":"2024-09-12T02:57:04.845751+0000","last_unstale":"2024-09-12T02:59:47.986379+0000","last_undegraded":"2024-09-12T02:59:47.986379+0000","last_fullsized":"2024-09-12T02:59:47.986379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'5","last_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_deep_scrub":"79'5","last_deep_scrub_stamp":"2024-09-12T02:59:40.773129+0000","last_clean_scrub_stamp":"2024-09-12T02:59:40.773129+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.387594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T03:02:18.100502+0000","last_change":"2024-09-12T03:02:18.100502+0000","last_active":"2024-09-12T03:02:18.100502+0000","last_peered":"2024-09-12T03:02:18.100502+0000","last_clean":"2024-09-12T03:02:18.100502+0000","last_became_active":"2024-09-12T02:59:47.976687+0000","last_became_peered":"2024-09-12T02:59:47.976687+0000","last_unstale":"2024-09-12T03:02:18.100502+0000","last_undegraded":"2024-09-12T03:02:18.100502+0000","last_fullsized":"2024-09-12T03:02:18.100502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-09-12T03:02:18.100392+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-09-12T03:02:18.100392+0000","last_clean_scrub_stamp":"2024-09-12T03:02:18.100392+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:50:38.771435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.988454+0000","last_change":"2024-09-12T02:59:39.769618+0000","last_active":"2024-09-12T02:59:47.988454+0000","last_peered":"2024-09-12T02:59:47.988454+0000","last_clean":"2024-09-12T02:59:47.988454+0000","last_became_active":"2024-09-12T02:57:04.837140+0000","last_became_peered":"2024-09-12T02:57:04.837140+0000","last_unstale":"2024-09-12T02:59:47.988454+0000","last_undegraded":"2024-09-12T02:59:47.988454+0000","last_fullsized":"2024-09-12T02:59:47.988454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:39.769355+0000","last_clean_scrub_stamp":"2024-09-12T02:59:39.769355+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:44.299798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.973139+0000","last_change":"2024-09-12T02:59:46.045977+0000","last_active":"2024-09-12T02:59:47.973139+0000","last_peered":"2024-09-12T02:59:47.973139+0000","last_clean":"2024-09-12T02:59:47.973139+0000","last_became_active":"2024-09-12T02:59:06.046969+0000","last_became_peered":"2024-09-12T02:59:06.046969+0000","last_unstale":"2024-09-12T02:59:47.973139+0000","last_undegraded":"2024-09-12T02:59:47.973139+0000","last_fullsized":"2024-09-12T02:59:47.973139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:46.045725+0000","last_clean_scrub_stamp":"2024-09-12T02:59:46.045725+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:00.846357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.975037+0000","last_change":"2024-09-12T02:59:33.045189+0000","last_active":"2024-09-12T02:59:47.975037+0000","last_peered":"2024-09-12T02:59:47.975037+0000","last_clean":"2024-09-12T02:59:47.975037+0000","last_became_active":"2024-09-12T02:57:04.840692+0000","last_became_peered":"2024-09-12T02:57:04.840692+0000","last_unstale":"2024-09-12T02:59:47.975037+0000","last_undegraded":"2024-09-12T02:59:47.975037+0000","last_fullsized":"2024-09-12T02:59:47.975037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'7","last_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_deep_scrub":"79'7","last_deep_scrub_stamp":"2024-09-12T02:59:33.045042+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.045042+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:47.312510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.969223+0000","last_change":"2024-09-12T02:59:38.788525+0000","last_active":"2024-09-12T02:59:47.969223+0000","last_peered":"2024-09-12T02:59:47.969223+0000","last_clean":"2024-09-12T02:59:47.969223+0000","last_became_active":"2024-09-12T02:59:08.055262+0000","last_became_peered":"2024-09-12T02:59:08.055262+0000","last_unstale":"2024-09-12T02:59:47.969223+0000","last_undegraded":"2024-09-12T02:59:47.969223+0000","last_fullsized":"2024-09-12T02:59:47.969223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-09-12T02:59:38.788431+0000","last_clean_scrub_stamp":"2024-09-12T02:59:38.788431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:20.633132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"79'8","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-12T02:59:47.989121+0000","last_change":"2024-09-12T02:59:33.741380+0000","last_active":"2024-09-12T02:59:47.989121+0000","last_peered":"2024-09-12T02:59:47.989121+0000","last_clean":"2024-09-12T02:59:47.989121+0000","last_became_active":"2024-09-12T02:57:04.850378+0000","last_became_peered":"2024-09-12T02:57:04.850378+0000","last_unstale":"2024-09-12T02:59:47.989121+0000","last_undegraded":"2024-09-12T02:59:47.989121+0000","last_fullsized":"2024-09-12T02:59:47.989121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'8","last_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_deep_scrub":"79'8","last_deep_scrub_stamp":"2024-09-12T02:59:33.741253+0000","last_clean_scrub_stamp":"2024-09-12T02:59:33.741253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:51.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":38959,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":90,"num_keys_recovered":2,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":77918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509512,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":530298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":950272,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509514,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1552384,"data_stored":1083143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542218,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28532,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343308,"statfs":{"total":96636764160,"available":96607547392,"internally_reserved":0,"allocated":1544192,"data_stored":1083087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542216,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":995328,"data_stored":529987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":64,"seq":274877906988,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":928,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":950272,"data_stored":492227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":28765762},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542216,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":492263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":492297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2947,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":37850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:02:37.562 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T03:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.734+0000 7f471f200640 1 Processor -- start 2024-09-12T03:02:37.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.734+0000 7f471f200640 1 -- start start 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471f200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4720152640 0x7f4720159070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471f200640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f47200c8c10 0x7f47200c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471f200640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47200c4ec0 con 0x7f47200b0c50 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471f200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f47200c51a0 con 0x7f4720152640 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471f200640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f472015bd80 con 0x7f47200c8c10 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4720152640 0x7f4720159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4720152640 0x7f4720159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43588/0 (socket says 172.21.15.63:43588) 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471de00640 1 -- 172.21.15.63:0/3958934973 learned_addr learned my addr 172.21.15.63:0/3958934973 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471e800640 1 --2- 172.21.15.63:0/3958934973 >> v2:172.21.15.119:3300/0 conn(0x7f47200c8c10 0x7f47200c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471de00640 1 -- 172.21.15.63:0/3958934973 >> v2:172.21.15.119:3300/0 conn(0x7f47200c8c10 msgr2=0x7f47200c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471de00640 1 --2- 172.21.15.63:0/3958934973 >> v2:172.21.15.119:3300/0 conn(0x7f47200c8c10 0x7f47200c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471de00640 1 -- 172.21.15.63:0/3958934973 >> v1:172.21.15.119:6789/0 conn(0x7f47200b0c50 legacy=0x7f472015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:37.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.738+0000 7f471de00640 1 -- 172.21.15.63:0/3958934973 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4720152a20 con 0x7f4720152640 2024-09-12T03:02:37.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471de00640 1 --2- 172.21.15.63:0/3958934973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720152640 0x7f4720159070 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4720071250 tx=0x7f471001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dc350c4ece7720 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:37.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471d400640 1 -- 172.21.15.63:0/3958934973 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100b5070 con 0x7f4720152640 2024-09-12T03:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471d400640 1 -- 172.21.15.63:0/3958934973 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47100a8a10 con 0x7f4720152640 2024-09-12T03:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471d400640 1 -- 172.21.15.63:0/3958934973 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100a8de0 con 0x7f4720152640 2024-09-12T03:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 -- 172.21.15.63:0/3958934973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720152640 msgr2=0x7f4720159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 --2- 172.21.15.63:0/3958934973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720152640 0x7f4720159070 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4720071250 tx=0x7f471001ed10 comp rx=0 tx=0).stop 2024-09-12T03:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 -- 172.21.15.63:0/3958934973 shutdown_connections 2024-09-12T03:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 --2- 172.21.15.63:0/3958934973 >> v2:172.21.15.119:3300/0 conn(0x7f47200c8c10 0x7f47200c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 --2- 172.21.15.63:0/3958934973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4720152640 0x7f4720159070 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 -- 172.21.15.63:0/3958934973 >> 172.21.15.63:0/3958934973 conn(0x7f472006c2c0 msgr2=0x7f4720073930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:37.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 -- 172.21.15.63:0/3958934973 shutdown_connections 2024-09-12T03:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 -- 172.21.15.63:0/3958934973 wait complete. 2024-09-12T03:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 Processor -- start 2024-09-12T03:02:37.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 -- start start 2024-09-12T03:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47200b0c50 0x7f47200ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47200c8c10 0x7f4720157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4720152640 0x7f47201f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f472006fa90 con 0x7f47200c8c10 2024-09-12T03:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f472006f910 con 0x7f4720152640 2024-09-12T03:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471f200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f472006fc10 con 0x7f47200b0c50 2024-09-12T03:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f4717e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47200c8c10 0x7f4720157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f4717e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47200c8c10 0x7f4720157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43596/0 (socket says 172.21.15.63:43596) 2024-09-12T03:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f4717e00640 1 -- 172.21.15.63:0/1097775659 learned_addr learned my addr 172.21.15.63:0/1097775659 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471de00640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47200b0c50 0x7f47200ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.742+0000 7f471e800640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4720152640 0x7f47201f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4717e00640 1 -- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47200b0c50 msgr2=0x7f47200ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4717e00640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47200b0c50 0x7f47200ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4717e00640 1 -- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4720152640 msgr2=0x7f47201f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4717e00640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4720152640 0x7f47201f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4717e00640 1 -- 172.21.15.63:0/1097775659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47200aba80 con 0x7f47200c8c10 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f471de00640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47200b0c50 0x7f47200ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f471e800640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4720152640 0x7f47201f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4717e00640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47200c8c10 0x7f4720157530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f470800c420 tx=0x7f470800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4716000640 1 -- 172.21.15.63:0/1097775659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47080052d0 con 0x7f47200c8c10 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4716000640 1 -- 172.21.15.63:0/1097775659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4708005470 con 0x7f47200c8c10 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4716000640 1 -- 172.21.15.63:0/1097775659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708007260 con 0x7f47200c8c10 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47200aab40 con 0x7f47200c8c10 2024-09-12T03:02:37.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f472006dc90 con 0x7f47200c8c10 2024-09-12T03:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4720159070 con 0x7f47200c8c10 2024-09-12T03:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4716000640 1 -- 172.21.15.63:0/1097775659 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4708007400 con 0x7f47200c8c10 2024-09-12T03:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4716000640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f46fc0678f0 0x7f46fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.746+0000 7f4716000640 1 -- 172.21.15.63:0/1097775659 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f47080856b0 con 0x7f47200c8c10 2024-09-12T03:02:37.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.750+0000 7f471de00640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f46fc0678f0 0x7f46fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:37.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.750+0000 7f471de00640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f46fc0678f0 0x7f46fc069db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47100b2000 tx=0x7f4710008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:37.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.750+0000 7f4716000640 1 -- 172.21.15.63:0/1097775659 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4708055c90 con 0x7f47200c8c10 2024-09-12T03:02:37.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.918+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f47200c3340 con 0x7f47200c8c10 2024-09-12T03:02:37.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.922+0000 7f4716000640 1 -- 172.21.15.63:0/1097775659 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f4708055590 con 0x7f47200c8c10 2024-09-12T03:02:37.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.922+0000 7f4716000640 1 -- 172.21.15.63:0/1097775659 <== mon.0 v2:172.21.15.63:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4708059940 con 0x7f47200c8c10 2024-09-12T03:02:37.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f46fc0678f0 msgr2=0x7f46fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f46fc0678f0 0x7f46fc069db0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47100b2000 tx=0x7f4710008040 comp rx=0 tx=0).stop 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47200c8c10 msgr2=0x7f4720157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47200c8c10 0x7f4720157530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f470800c420 tx=0x7f470800c8e0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 shutdown_connections 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4720152640 0x7f47201f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f47200c8c10 0x7f4720157530 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f46fc0678f0 0x7f46fc069db0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 --2- 172.21.15.63:0/1097775659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47200b0c50 0x7f47200ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 >> 172.21.15.63:0/1097775659 conn(0x7f472006c2c0 msgr2=0x7f47201597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 shutdown_connections 2024-09-12T03:02:37.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:37.926+0000 7f471f200640 1 -- 172.21.15.63:0/1097775659 wait complete. 2024-09-12T03:02:37.946 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:02:37.946 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:02:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76aba00640 1 Processor -- start 2024-09-12T03:02:38.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76aba00640 1 -- start start 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76aba00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f76a4154c90 0x7f76a40c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76aba00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f76a415b5c0 0x7f76a406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76aba00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a4155070 con 0x7f76a406ec90 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76aba00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f76a415b130 con 0x7f76a4154c90 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76aba00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f76a40c36b0 con 0x7f76a415b5c0 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76a9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f76a4154c90 0x7f76a40c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f769be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f76a406ec90 0x7f76a40ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52860/0 (socket says 172.21.15.63:52860) 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76a9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f76a4154c90 0x7f76a40c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43598/0 (socket says 172.21.15.63:43598) 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f769be00640 1 -- 172.21.15.63:0/375332050 learned_addr learned my addr 172.21.15.63:0/375332050 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T03:02:38.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76a9a00640 1 --2- 172.21.15.63:0/375332050 >> v2:172.21.15.119:3300/0 conn(0x7f76a415b5c0 0x7f76a406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76a9000640 1 -- 172.21.15.63:0/375332050 >> v2:172.21.15.119:3300/0 conn(0x7f76a415b5c0 msgr2=0x7f76a406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:38.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76a9000640 1 --2- 172.21.15.63:0/375332050 >> v2:172.21.15.119:3300/0 conn(0x7f76a415b5c0 0x7f76a406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76a9000640 1 -- 172.21.15.63:0/375332050 >> v1:172.21.15.63:6789/0 conn(0x7f76a406ec90 legacy=0x7f76a40ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.086+0000 7f76a9000640 1 -- 172.21.15.63:0/375332050 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a40c8bf0 con 0x7f76a4154c90 2024-09-12T03:02:38.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76a9000640 1 --2- 172.21.15.63:0/375332050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a4154c90 0x7f76a40c3170 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f76a40c54b0 tx=0x7f769401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2456860ecaa69c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:38.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76a3e00640 1 -- 172.21.15.63:0/375332050 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940b5070 con 0x7f76a4154c90 2024-09-12T03:02:38.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76a3e00640 1 -- 172.21.15.63:0/375332050 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f76940a8970 con 0x7f76a4154c90 2024-09-12T03:02:38.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76a3e00640 1 -- 172.21.15.63:0/375332050 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940a8d60 con 0x7f76a4154c90 2024-09-12T03:02:38.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76aba00640 1 -- 172.21.15.63:0/375332050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a4154c90 msgr2=0x7f76a40c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76aba00640 1 --2- 172.21.15.63:0/375332050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a4154c90 0x7f76a40c3170 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f76a40c54b0 tx=0x7f769401ec70 comp rx=0 tx=0).stop 2024-09-12T03:02:38.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76aba00640 1 -- 172.21.15.63:0/375332050 shutdown_connections 2024-09-12T03:02:38.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76aba00640 1 --2- 172.21.15.63:0/375332050 >> v2:172.21.15.119:3300/0 conn(0x7f76a415b5c0 0x7f76a406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76aba00640 1 --2- 172.21.15.63:0/375332050 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a4154c90 0x7f76a40c3170 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76aba00640 1 -- 172.21.15.63:0/375332050 >> 172.21.15.63:0/375332050 conn(0x7f76a406bcc0 msgr2=0x7f76a406fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:38.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76aba00640 1 -- 172.21.15.63:0/375332050 shutdown_connections 2024-09-12T03:02:38.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.090+0000 7f76aba00640 1 -- 172.21.15.63:0/375332050 wait complete. 2024-09-12T03:02:38.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76aba00640 1 Processor -- start 2024-09-12T03:02:38.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76aba00640 1 -- start start 2024-09-12T03:02:38.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76aba00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a406ec90 0x7f76a415de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76aba00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76a4154c90 0x7f76a41f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76aba00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76a415b5c0 0x7f76a40cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76aba00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f76a415aae0 con 0x7f76a406ec90 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76aba00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40c91b0 con 0x7f76a415b5c0 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76aba00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f76a415adc0 con 0x7f76a4154c90 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a406ec90 0x7f76a415de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a406ec90 0x7f76a415de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43604/0 (socket says 172.21.15.63:43604) 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9000640 1 -- 172.21.15.63:0/2799365969 learned_addr learned my addr 172.21.15.63:0/2799365969 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9a00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76a415b5c0 0x7f76a40cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f769be00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76a4154c90 0x7f76a41f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9000640 1 -- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76a4154c90 msgr2=0x7f76a41f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9000640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76a4154c90 0x7f76a41f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9000640 1 -- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76a415b5c0 msgr2=0x7f76a40cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9000640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76a415b5c0 0x7f76a40cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9000640 1 -- 172.21.15.63:0/2799365969 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a40cb880 con 0x7f76a406ec90 2024-09-12T03:02:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9a00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76a415b5c0 0x7f76a40cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.094+0000 7f76a9000640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a406ec90 0x7f76a415de90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f769401c8a0 tx=0x7f769401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:38.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.098+0000 7f76a1600640 1 -- 172.21.15.63:0/2799365969 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940bf070 con 0x7f76a406ec90 2024-09-12T03:02:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.098+0000 7f76a1600640 1 -- 172.21.15.63:0/2799365969 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f76940b07c0 con 0x7f76a406ec90 2024-09-12T03:02:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.098+0000 7f76a1600640 1 -- 172.21.15.63:0/2799365969 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940b5040 con 0x7f76a406ec90 2024-09-12T03:02:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.098+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a41f4a10 con 0x7f76a406ec90 2024-09-12T03:02:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.098+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a41f09e0 con 0x7f76a406ec90 2024-09-12T03:02:38.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.098+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a406c6d0 con 0x7f76a406ec90 2024-09-12T03:02:38.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.098+0000 7f76a1600640 1 -- 172.21.15.63:0/2799365969 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f76940b0bd0 con 0x7f76a406ec90 2024-09-12T03:02:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.098+0000 7f76a1600640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f76800678c0 0x7f7680069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.098+0000 7f76a1600640 1 -- 172.21.15.63:0/2799365969 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f7694122ca0 con 0x7f76a406ec90 2024-09-12T03:02:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.102+0000 7f769be00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f76800678c0 0x7f7680069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.102+0000 7f769be00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f76800678c0 0x7f7680069d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f76a415aa30 tx=0x7f768c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:38.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.102+0000 7f76a1600640 1 -- 172.21.15.63:0/2799365969 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f76940187d0 con 0x7f76a406ec90 2024-09-12T03:02:38.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.302+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76a40cea80 con 0x7f76a406ec90 2024-09-12T03:02:38.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76a1600640 1 -- 172.21.15.63:0/2799365969 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6879 (secure 0 0 0) 0x7f76940f3280 con 0x7f76a406ec90 2024-09-12T03:02:38.306 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:02:38.307 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"btime":"2024-09-12T02:57:32:959110+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:32.355543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-12T03:02:38.307 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 10 2024-09-12T03:02:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f76800678c0 msgr2=0x7f7680069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f76800678c0 0x7f7680069d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f76a415aa30 tx=0x7f768c009040 comp rx=0 tx=0).stop 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a406ec90 msgr2=0x7f76a415de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a406ec90 0x7f76a415de90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f769401c8a0 tx=0x7f769401ba10 comp rx=0 tx=0).stop 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 shutdown_connections 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76a415b5c0 0x7f76a40cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f76800678c0 0x7f7680069d80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76a4154c90 0x7f76a41f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 --2- 172.21.15.63:0/2799365969 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f76a406ec90 0x7f76a415de90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 >> 172.21.15.63:0/2799365969 conn(0x7f76a406bcc0 msgr2=0x7f76a4071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 shutdown_connections 2024-09-12T03:02:38.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.306+0000 7f76aba00640 1 -- 172.21.15.63:0/2799365969 wait complete. 2024-09-12T03:02:38.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:02:38.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.466+0000 7f2c94e00640 1 Processor -- start 2024-09-12T03:02:38.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.466+0000 7f2c94e00640 1 -- start start 2024-09-12T03:02:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c94e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 0x7f2c900c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c94e00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c900cb600 0x7f2c90071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c94e00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9015ec80 con 0x7f2c90071990 2024-09-12T03:02:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c94e00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f2c900c9040 con 0x7f2c900cb600 2024-09-12T03:02:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c94e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9015e100 con 0x7f2c901549e0 2024-09-12T03:02:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c8f400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 0x7f2c900c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c86a00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c900cb600 0x7f2c90071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c8fe00640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2c90071990 0x7f2c9015ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.63:56970/0 (socket says 172.21.15.63:56970) 2024-09-12T03:02:38.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c8fe00640 1 -- 172.21.15.63:0/1567005290 learned_addr learned my addr 172.21.15.63:0/1567005290 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T03:02:38.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c86a00640 1 -- 172.21.15.63:0/1567005290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 msgr2=0x7f2c900c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:38.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c86a00640 1 --2- 172.21.15.63:0/1567005290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 0x7f2c900c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c86a00640 1 -- 172.21.15.63:0/1567005290 >> v1:172.21.15.119:6789/0 conn(0x7f2c90071990 legacy=0x7f2c9015ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c86a00640 1 -- 172.21.15.63:0/1567005290 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9015e3e0 con 0x7f2c900cb600 2024-09-12T03:02:38.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.470+0000 7f2c8ea00640 1 -- 172.21.15.63:0/1567005290 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149100586 0 0) 0x7f2c9015ec80 con 0x7f2c90071990 2024-09-12T03:02:38.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c86a00640 1 --2- 172.21.15.63:0/1567005290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c900cb600 0x7f2c90071450 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2c780097c0 tx=0x7f2c7801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa615bb11212d01f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:38.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c8ea00640 1 -- 172.21.15.63:0/1567005290 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c780b5070 con 0x7f2c900cb600 2024-09-12T03:02:38.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c8ea00640 1 -- 172.21.15.63:0/1567005290 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2c780a8990 con 0x7f2c900cb600 2024-09-12T03:02:38.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c8ea00640 1 -- 172.21.15.63:0/1567005290 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c780a8d80 con 0x7f2c900cb600 2024-09-12T03:02:38.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 -- 172.21.15.63:0/1567005290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c900cb600 msgr2=0x7f2c90071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 --2- 172.21.15.63:0/1567005290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c900cb600 0x7f2c90071450 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2c780097c0 tx=0x7f2c7801ec90 comp rx=0 tx=0).stop 2024-09-12T03:02:38.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 -- 172.21.15.63:0/1567005290 shutdown_connections 2024-09-12T03:02:38.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 --2- 172.21.15.63:0/1567005290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c900cb600 0x7f2c90071450 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 --2- 172.21.15.63:0/1567005290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 0x7f2c900c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 -- 172.21.15.63:0/1567005290 >> 172.21.15.63:0/1567005290 conn(0x7f2c9006f6e0 msgr2=0x7f2c9006faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:38.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 -- 172.21.15.63:0/1567005290 shutdown_connections 2024-09-12T03:02:38.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 -- 172.21.15.63:0/1567005290 wait complete. 2024-09-12T03:02:38.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 Processor -- start 2024-09-12T03:02:38.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.474+0000 7f2c94e00640 1 -- start start 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c94e00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c90071990 0x7f2c901585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c94e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c900cb600 0x7f2c901f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c94e00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 0x7f2c901f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c94e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9015a8e0 con 0x7f2c900cb600 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c94e00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9015e9a0 con 0x7f2c90071990 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c94e00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2c90154dc0 con 0x7f2c901549e0 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c86a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c900cb600 0x7f2c901f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c86a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c900cb600 0x7f2c901f04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43620/0 (socket says 172.21.15.63:43620) 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c86a00640 1 -- 172.21.15.63:0/3217230185 learned_addr learned my addr 172.21.15.63:0/3217230185 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c8f400640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c90071990 0x7f2c901585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c8fe00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 0x7f2c901f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c86a00640 1 -- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 msgr2=0x7f2c901f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c86a00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 0x7f2c901f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c86a00640 1 -- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c90071990 msgr2=0x7f2c901585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c86a00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c90071990 0x7f2c901585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c86a00640 1 -- 172.21.15.63:0/3217230185 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c90155cf0 con 0x7f2c900cb600 2024-09-12T03:02:38.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c8fe00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 0x7f2c901f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:38.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c86a00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c900cb600 0x7f2c901f04c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2c780b3040 tx=0x7f2c7801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:38.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c87e00640 1 -- 172.21.15.63:0/3217230185 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c780bf070 con 0x7f2c900cb600 2024-09-12T03:02:38.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c87e00640 1 -- 172.21.15.63:0/3217230185 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2c780b0820 con 0x7f2c900cb600 2024-09-12T03:02:38.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c87e00640 1 -- 172.21.15.63:0/3217230185 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c780b5040 con 0x7f2c900cb600 2024-09-12T03:02:38.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c90155fd0 con 0x7f2c900cb600 2024-09-12T03:02:38.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c90156590 con 0x7f2c900cb600 2024-09-12T03:02:38.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9015dd30 con 0x7f2c900cb600 2024-09-12T03:02:38.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.478+0000 7f2c87e00640 1 -- 172.21.15.63:0/3217230185 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c780b0c30 con 0x7f2c900cb600 2024-09-12T03:02:38.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.482+0000 7f2c87e00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2c6c0678f0 0x7f2c6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.482+0000 7f2c87e00640 1 -- 172.21.15.63:0/3217230185 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f2c78122b30 con 0x7f2c900cb600 2024-09-12T03:02:38.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.482+0000 7f2c8f400640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2c6c0678f0 0x7f2c6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.482+0000 7f2c8f400640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2c6c0678f0 0x7f2c6c069db0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009b60 tx=0x7f2c80009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:38.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.486+0000 7f2c87e00640 1 -- 172.21.15.63:0/3217230185 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2c780187f0 con 0x7f2c900cb600 2024-09-12T03:02:38.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.682+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c901e68b0 con 0x7f2c900cb600 2024-09-12T03:02:38.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c87e00640 1 -- 172.21.15.63:0/3217230185 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6879 (secure 0 0 0) 0x7f2c780f2ad0 con 0x7f2c900cb600 2024-09-12T03:02:38.686 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:02:38.686 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"btime":"2024-09-12T02:57:32:959110+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1651449056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1651449056},{"type":"v1","addr":"172.21.15.119:6836","nonce":1651449056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2497476813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2497476813},{"type":"v1","addr":"172.21.15.119:6837","nonce":2497476813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/1349830676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":1349830676},{"type":"v1","addr":"172.21.15.119:6839","nonce":1349830676}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1597812840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":1597812840},{"type":"v1","addr":"172.21.15.63:6835","nonce":1597812840}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/1099506730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":1099506730},{"type":"v1","addr":"172.21.15.63:6837","nonce":1099506730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:57:04.183250+0000","modified":"2024-09-12T02:57:32.355543+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.63:6836/2556723891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2556723891},{"type":"v1","addr":"172.21.15.63:6836","nonce":2556723891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-09-12T03:02:38.687 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 10 2024-09-12T03:02:38.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2c6c0678f0 msgr2=0x7f2c6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2c6c0678f0 0x7f2c6c069db0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2c80009b60 tx=0x7f2c80009190 comp rx=0 tx=0).stop 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c900cb600 msgr2=0x7f2c901f04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c900cb600 0x7f2c901f04c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2c780b3040 tx=0x7f2c7801ba30 comp rx=0 tx=0).stop 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 shutdown_connections 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f2c6c0678f0 0x7f2c6c069db0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c901549e0 0x7f2c901f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c900cb600 0x7f2c901f04c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 --2- 172.21.15.63:0/3217230185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c90071990 0x7f2c901585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 >> 172.21.15.63:0/3217230185 conn(0x7f2c9006f6e0 msgr2=0x7f2c900ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 shutdown_connections 2024-09-12T03:02:38.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.686+0000 7f2c94e00640 1 -- 172.21.15.63:0/3217230185 wait complete. 2024-09-12T03:02:38.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:02:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.846+0000 7f7f39800640 1 Processor -- start 2024-09-12T03:02:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.846+0000 7f7f39800640 1 -- start start 2024-09-12T03:02:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f39800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34151a80 0x7f7f34072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f39800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7f34074070 0x7f7f34073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f39800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f341580c0 con 0x7f7f340c2380 2024-09-12T03:02:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f39800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7f340c8500 con 0x7f7f34074070 2024-09-12T03:02:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f39800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7f341583a0 con 0x7f7f34151a80 2024-09-12T03:02:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f2a000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7f34074070 0x7f7f34073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f33400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7f340c2380 0x7f7f3415aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52868/0 (socket says 172.21.15.63:52868) 2024-09-12T03:02:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f33400640 1 -- 172.21.15.63:0/16259653 learned_addr learned my addr 172.21.15.63:0/16259653 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T03:02:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f2a000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7f34074070 0x7f7f34073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43634/0 (socket says 172.21.15.63:43634) 2024-09-12T03:02:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f32a00640 1 --2- 172.21.15.63:0/16259653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34151a80 0x7f7f34072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f2a000640 1 -- 172.21.15.63:0/16259653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34151a80 msgr2=0x7f7f34072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f2a000640 1 --2- 172.21.15.63:0/16259653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34151a80 0x7f7f34072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f2a000640 1 -- 172.21.15.63:0/16259653 >> v1:172.21.15.63:6789/0 conn(0x7f7f340c2380 legacy=0x7f7f3415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f2a000640 1 -- 172.21.15.63:0/16259653 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f340cbf00 con 0x7f7f34074070 2024-09-12T03:02:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f32a00640 1 --2- 172.21.15.63:0/16259653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34151a80 0x7f7f34072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f32000640 1 -- 172.21.15.63:0/16259653 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819611228 0 0) 0x7f7f341580c0 con 0x7f7f340c2380 2024-09-12T03:02:38.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f2a000640 1 --2- 172.21.15.63:0/16259653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f34074070 0x7f7f34073390 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00ba90 tx=0x7f7f1c021360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1f16667d76510c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:38.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.850+0000 7f7f32000640 1 -- 172.21.15.63:0/16259653 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0b6070 con 0x7f7f34074070 2024-09-12T03:02:38.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f32000640 1 -- 172.21.15.63:0/16259653 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7f1c0b1600 con 0x7f7f34074070 2024-09-12T03:02:38.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f32000640 1 -- 172.21.15.63:0/16259653 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0aae60 con 0x7f7f34074070 2024-09-12T03:02:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 -- 172.21.15.63:0/16259653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f34074070 msgr2=0x7f7f34073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 --2- 172.21.15.63:0/16259653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f34074070 0x7f7f34073390 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00ba90 tx=0x7f7f1c021360 comp rx=0 tx=0).stop 2024-09-12T03:02:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 -- 172.21.15.63:0/16259653 shutdown_connections 2024-09-12T03:02:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 --2- 172.21.15.63:0/16259653 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f34074070 0x7f7f34073390 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 --2- 172.21.15.63:0/16259653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34151a80 0x7f7f34072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 -- 172.21.15.63:0/16259653 >> 172.21.15.63:0/16259653 conn(0x7f7f3406f3d0 msgr2=0x7f7f3406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 -- 172.21.15.63:0/16259653 shutdown_connections 2024-09-12T03:02:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 -- 172.21.15.63:0/16259653 wait complete. 2024-09-12T03:02:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 Processor -- start 2024-09-12T03:02:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 -- start start 2024-09-12T03:02:38.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34074070 0x7f7f341e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f340c2380 0x7f7f341f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f34151a80 0x7f7f341477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7f340c81f0 con 0x7f7f340c2380 2024-09-12T03:02:38.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7f340cc4c0 con 0x7f7f34151a80 2024-09-12T03:02:38.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f39800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f7f340c7cf0 con 0x7f7f34074070 2024-09-12T03:02:38.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f2a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f340c2380 0x7f7f341f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f2a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f340c2380 0x7f7f341f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43650/0 (socket says 172.21.15.63:43650) 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f2a000640 1 -- 172.21.15.63:0/3750052570 learned_addr learned my addr 172.21.15.63:0/3750052570 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f32a00640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34074070 0x7f7f341e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f33400640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f34151a80 0x7f7f341477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f2a000640 1 -- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34074070 msgr2=0x7f7f341e2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f2a000640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34074070 0x7f7f341e2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f2a000640 1 -- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f34151a80 msgr2=0x7f7f341477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f2a000640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f34151a80 0x7f7f341477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.854+0000 7f7f2a000640 1 -- 172.21.15.63:0/3750052570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3414a460 con 0x7f7f340c2380 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f2a000640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f340c2380 0x7f7f341f3dc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0b4040 tx=0x7f7f1c01fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f2b400640 1 -- 172.21.15.63:0/3750052570 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0c1070 con 0x7f7f340c2380 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f2b400640 1 -- 172.21.15.63:0/3750052570 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7f1c0aae60 con 0x7f7f340c2380 2024-09-12T03:02:38.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f2b400640 1 -- 172.21.15.63:0/3750052570 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0b6040 con 0x7f7f340c2380 2024-09-12T03:02:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f340c2f60 con 0x7f7f340c2380 2024-09-12T03:02:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f3414a700 con 0x7f7f340c2380 2024-09-12T03:02:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f340c2830 con 0x7f7f340c2380 2024-09-12T03:02:38.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f2b400640 1 -- 172.21.15.63:0/3750052570 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f1c004230 con 0x7f7f340c2380 2024-09-12T03:02:38.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f2b400640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7f100678c0 0x7f7f10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:38.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f2b400640 1 -- 172.21.15.63:0/3750052570 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7f7f1c123b00 con 0x7f7f340c2380 2024-09-12T03:02:38.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.858+0000 7f7f32a00640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7f100678c0 0x7f7f10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:38.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.862+0000 7f7f32a00640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7f100678c0 0x7f7f10069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400ba10 tx=0x7f7f24008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:38.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:38.862+0000 7f7f2b400640 1 -- 172.21.15.63:0/3750052570 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7f1c01aec0 con 0x7f7f340c2380 2024-09-12T03:02:39.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.030+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f3406fef0 con 0x7f7f340c2380 2024-09-12T03:02:39.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f2b400640 1 -- 172.21.15.63:0/3750052570 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18974 (secure 0 0 0) 0x7f7f1c123e20 con 0x7f7f340c2380 2024-09-12T03:02:39.034 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-12T03:02:39.035 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":81,"fsid":"20b0bc3b-ca7e-4b63-a9bc-3526f84b65da","created":"2024-09-12T02:56:41.049401+0000","modified":"2024-09-12T02:59:47.957456+0000","last_up_change":"2024-09-12T02:59:04.984510+0000","last_in_change":"2024-09-12T02:56:43.361756+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:56:53.830004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:57:02.599829+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:57:03.211064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:57:06.889005+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5c33857f-3772-4c5f-9025-2157ac056da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6825","nonce":3662141659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6827","nonce":3662141659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6831","nonce":3662141659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3662141659},{"type":"v1","addr":"172.21.15.63:6829","nonce":3662141659}]},"public_addr":"172.21.15.63:6825/3662141659","cluster_addr":"172.21.15.63:6827/3662141659","heartbeat_back_addr":"172.21.15.63:6831/3662141659","heartbeat_front_addr":"172.21.15.63:6829/3662141659","state":["exists","up"]},{"osd":1,"uuid":"9a1b1d8b-fd3f-4b94-8135-941da7cb2797","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6801","nonce":866448188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6803","nonce":866448188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6807","nonce":866448188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":866448188},{"type":"v1","addr":"172.21.15.63:6805","nonce":866448188}]},"public_addr":"172.21.15.63:6801/866448188","cluster_addr":"172.21.15.63:6803/866448188","heartbeat_back_addr":"172.21.15.63:6807/866448188","heartbeat_front_addr":"172.21.15.63:6805/866448188","state":["exists","up"]},{"osd":2,"uuid":"f23c8af2-7fa2-4e43-99de-7bf2670b72ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6817","nonce":4130213561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6819","nonce":4130213561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6823","nonce":4130213561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":4130213561},{"type":"v1","addr":"172.21.15.63:6821","nonce":4130213561}]},"public_addr":"172.21.15.63:6817/4130213561","cluster_addr":"172.21.15.63:6819/4130213561","heartbeat_back_addr":"172.21.15.63:6823/4130213561","heartbeat_front_addr":"172.21.15.63:6821/4130213561","state":["exists","up"]},{"osd":3,"uuid":"0b6a2786-33e7-4286-92f4-e8d25573149a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6809","nonce":2574114576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6811","nonce":2574114576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6815","nonce":2574114576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2574114576},{"type":"v1","addr":"172.21.15.63:6813","nonce":2574114576}]},"public_addr":"172.21.15.63:6809/2574114576","cluster_addr":"172.21.15.63:6811/2574114576","heartbeat_back_addr":"172.21.15.63:6815/2574114576","heartbeat_front_addr":"172.21.15.63:6813/2574114576","state":["exists","up"]},{"osd":4,"uuid":"cdd5dfe1-3893-42ee-8706-50ef5c92ac9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6809","nonce":946317737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6811","nonce":946317737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6815","nonce":946317737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":946317737},{"type":"v1","addr":"172.21.15.119:6813","nonce":946317737}]},"public_addr":"172.21.15.119:6809/946317737","cluster_addr":"172.21.15.119:6811/946317737","heartbeat_back_addr":"172.21.15.119:6815/946317737","heartbeat_front_addr":"172.21.15.119:6813/946317737","state":["exists","up"]},{"osd":5,"uuid":"442157e7-0a20-45b7-a3b6-f4a930643516","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":51,"up_from":64,"up_thru":64,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6825","nonce":2412795190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6827","nonce":2412795190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6831","nonce":2412795190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2412795190},{"type":"v1","addr":"172.21.15.119:6829","nonce":2412795190}]},"public_addr":"172.21.15.119:6825/2412795190","cluster_addr":"172.21.15.119:6827/2412795190","heartbeat_back_addr":"172.21.15.119:6831/2412795190","heartbeat_front_addr":"172.21.15.119:6829/2412795190","state":["exists","up"]},{"osd":6,"uuid":"0f1cd9bc-aafa-4004-b7e5-6ea6e409d398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6817","nonce":2029574290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6819","nonce":2029574290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6823","nonce":2029574290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2029574290},{"type":"v1","addr":"172.21.15.119:6821","nonce":2029574290}]},"public_addr":"172.21.15.119:6817/2029574290","cluster_addr":"172.21.15.119:6819/2029574290","heartbeat_back_addr":"172.21.15.119:6823/2029574290","heartbeat_front_addr":"172.21.15.119:6821/2029574290","state":["exists","up"]},{"osd":7,"uuid":"ac41ac05-d082-43f8-93ec-ba27bf53fd08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6801","nonce":3494373582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6803","nonce":3494373582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6807","nonce":3494373582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":3494373582},{"type":"v1","addr":"172.21.15.119:6805","nonce":3494373582}]},"public_addr":"172.21.15.119:6801/3494373582","cluster_addr":"172.21.15.119:6803/3494373582","heartbeat_back_addr":"172.21.15.119:6807/3494373582","heartbeat_front_addr":"172.21.15.119:6805/3494373582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.481445+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.975485+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.719623+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.227734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.777737+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.183864+0000","dead_epoch":52},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:50.071981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:56:49.830810+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.4","osds":[5,7,4,6]}],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:02:39.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7f100678c0 msgr2=0x7f7f10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7f100678c0 0x7f7f10069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f2400ba10 tx=0x7f7f24008040 comp rx=0 tx=0).stop 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f340c2380 msgr2=0x7f7f341f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f340c2380 0x7f7f341f3dc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0b4040 tx=0x7f7f1c01fba0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 shutdown_connections 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f34151a80 0x7f7f341477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f340c2380 0x7f7f341f3dc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f7f100678c0 0x7f7f10069d80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 --2- 172.21.15.63:0/3750052570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f34074070 0x7f7f341e2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 >> 172.21.15.63:0/3750052570 conn(0x7f7f3406f3d0 msgr2=0x7f7f3414fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 shutdown_connections 2024-09-12T03:02:39.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.034+0000 7f7f39800640 1 -- 172.21.15.63:0/3750052570 wait complete. 2024-09-12T03:02:39.056 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T03:02:39.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff171600640 1 Processor -- start 2024-09-12T03:02:39.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff171600640 1 -- start start 2024-09-12T03:02:39.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff171600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff16c154ab0 0x7ff16c0c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff171600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff16c15a910 con 0x7ff16c154e90 2024-09-12T03:02:39.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff171600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff16c15ab90 con 0x7ff16c0c7fe0 2024-09-12T03:02:39.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff171600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7ff16c15ae70 con 0x7ff16c154ab0 2024-09-12T03:02:39.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16a000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff16c154e90 0x7ff16c0c8ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52870/0 (socket says 172.21.15.63:52870) 2024-09-12T03:02:39.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16a000640 1 -- 172.21.15.63:0/2456205558 learned_addr learned my addr 172.21.15.63:0/2456205558 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T03:02:39.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16aa00640 1 --2- 172.21.15.63:0/2456205558 >> v2:172.21.15.119:3300/0 conn(0x7ff16c154ab0 0x7ff16c0c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054238658 0 0) 0x7ff158001120 con 0x7ff16c154e90 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff150003530 con 0x7ff16c154e90 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 988169301 0 0) 0x7ff16c15ab90 con 0x7ff16c0c7fe0 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff158001120 con 0x7ff16c0c7fe0 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4052850432 0 0) 0x7ff150003530 con 0x7ff16c154e90 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 >> v2:172.21.15.119:3300/0 conn(0x7ff16c154ab0 msgr2=0x7ff16c0c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 --2- 172.21.15.63:0/2456205558 >> v2:172.21.15.119:3300/0 conn(0x7ff16c154ab0 0x7ff16c0c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 >> v1:172.21.15.119:6789/0 conn(0x7ff16c0c7fe0 legacy=0x7ff16c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16c15b150 con 0x7ff16c154e90 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3442195476 0 0) 0x7ff158001850 con 0x7ff16c154e90 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 >> v1:172.21.15.63:6789/0 conn(0x7ff16c154e90 legacy=0x7ff16c0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff150003b50 0x7ff150003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150004810 0x7ff150004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1500051d0 0x7ff15000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c15ae70 con 0x7ff150003b50 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff15000c050 con 0x7ff150004810 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff15000c250 con 0x7ff1500051d0 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16aa00640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff150003b50 0x7ff150003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16a000640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150004810 0x7ff150004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16b400640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1500051d0 0x7ff15000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16aa00640 1 -- 172.21.15.63:0/2456205558 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1500051d0 msgr2=0x7ff15000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16aa00640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1500051d0 0x7ff15000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16aa00640 1 -- 172.21.15.63:0/2456205558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150004810 msgr2=0x7ff150004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16aa00640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150004810 0x7ff150004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16aa00640 1 -- 172.21.15.63:0/2456205558 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff150003530 con 0x7ff150003b50 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16b400640 1 -- 172.21.15.63:0/2456205558 reap_dead start 2024-09-12T03:02:39.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.198+0000 7ff16a000640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150004810 0x7ff150004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:39.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff16aa00640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff150003b50 0x7ff150003f50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009ae0 tx=0x7ff15c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826879a12872dcd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:39.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0b2070 con 0x7ff150003b50 2024-09-12T03:02:39.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff15c0a5660 con 0x7ff150003b50 2024-09-12T03:02:39.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff169600640 1 -- 172.21.15.63:0/2456205558 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0096b0 con 0x7ff150003b50 2024-09-12T03:02:39.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff171600640 1 -- 172.21.15.63:0/2456205558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff150003b50 msgr2=0x7ff150003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff171600640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff150003b50 0x7ff150003f50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009ae0 tx=0x7ff15c01ca70 comp rx=0 tx=0).stop 2024-09-12T03:02:39.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff171600640 1 -- 172.21.15.63:0/2456205558 shutdown_connections 2024-09-12T03:02:39.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff171600640 1 --2- 172.21.15.63:0/2456205558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff150003b50 0x7ff150003f50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff171600640 1 -- 172.21.15.63:0/2456205558 >> 172.21.15.63:0/2456205558 conn(0x7ff16c06e460 msgr2=0x7ff16c06f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:39.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff171600640 1 -- 172.21.15.63:0/2456205558 shutdown_connections 2024-09-12T03:02:39.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.202+0000 7ff171600640 1 -- 172.21.15.63:0/2456205558 wait complete. 2024-09-12T03:02:39.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 Processor -- start 2024-09-12T03:02:39.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 -- start start 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150003b50 0x7ff16c1e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff16c1e8410 0x7ff16c1f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff16c1e8d10 0x7ff16c14d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c15e3c0 con 0x7ff16c1e8d10 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c15e240 con 0x7ff150003b50 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7ff16c15e540 con 0x7ff16c1e8410 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff16c1e8d10 0x7ff16c14d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff16c1e8d10 0x7ff16c14d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43680/0 (socket says 172.21.15.63:43680) 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16b400640 1 -- 172.21.15.63:0/2067076511 learned_addr learned my addr 172.21.15.63:0/2067076511 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16aa00640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150003b50 0x7ff16c1e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16a000640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff16c1e8410 0x7ff16c1f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16b400640 1 -- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff16c1e8410 msgr2=0x7ff16c1f56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16b400640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff16c1e8410 0x7ff16c1f56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16b400640 1 -- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150003b50 msgr2=0x7ff16c1e7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16b400640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150003b50 0x7ff16c1e7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16b400640 1 -- 172.21.15.63:0/2067076511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16c14eb90 con 0x7ff16c1e8d10 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff16b400640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff16c1e8d10 0x7ff16c14d870 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0c8490 tx=0x7ff16400eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff162a00640 1 -- 172.21.15.63:0/2067076511 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164003980 con 0x7ff16c1e8d10 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff162a00640 1 -- 172.21.15.63:0/2067076511 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff164018070 con 0x7ff16c1e8d10 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff162a00640 1 -- 172.21.15.63:0/2067076511 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164003da0 con 0x7ff16c1e8d10 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff16c1f5c20 con 0x7ff16c1e8d10 2024-09-12T03:02:39.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.206+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff16c1e6660 con 0x7ff16c1e8d10 2024-09-12T03:02:39.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.210+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff16c15e870 con 0x7ff16c1e8d10 2024-09-12T03:02:39.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.210+0000 7ff162a00640 1 -- 172.21.15.63:0/2067076511 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1640050d0 con 0x7ff16c1e8d10 2024-09-12T03:02:39.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.210+0000 7ff162a00640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff14c0678f0 0x7ff14c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.210+0000 7ff162a00640 1 -- 172.21.15.63:0/2067076511 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6775+0+0 (secure 0 0 0) 0x7ff164085eb0 con 0x7ff16c1e8d10 2024-09-12T03:02:39.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.210+0000 7ff16aa00640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff14c0678f0 0x7ff14c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.210+0000 7ff16aa00640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff14c0678f0 0x7ff14c069db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0af000 tx=0x7ff15c0046d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:39.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.214+0000 7ff162a00640 1 -- 172.21.15.63:0/2067076511 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff164056490 con 0x7ff16c1e8d10 2024-09-12T03:02:39.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.418+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff16c159320 con 0x7ff16c1e8d10 2024-09-12T03:02:39.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.418+0000 7ff162a00640 1 -- 172.21.15.63:0/2067076511 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) ==== 161+0+0 (secure 0 0 0) 0x7ff164055d90 con 0x7ff16c1e8d10 2024-09-12T03:02:39.421 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T03:02:39.423 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff14c0678f0 msgr2=0x7ff14c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff14c0678f0 0x7ff14c069db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff15c0af000 tx=0x7ff15c0046d0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff16c1e8d10 msgr2=0x7ff16c14d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff16c1e8d10 0x7ff16c14d870 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0c8490 tx=0x7ff16400eb40 comp rx=0 tx=0).stop 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 shutdown_connections 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff16c1e8d10 0x7ff16c14d870 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7ff14c0678f0 0x7ff14c069db0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff16c1e8410 0x7ff16c1f56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 --2- 172.21.15.63:0/2067076511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff150003b50 0x7ff16c1e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 >> 172.21.15.63:0/2067076511 conn(0x7ff16c06e460 msgr2=0x7ff16c159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 shutdown_connections 2024-09-12T03:02:39.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.422+0000 7ff171600640 1 -- 172.21.15.63:0/2067076511 wait complete. 2024-09-12T03:02:39.446 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T03:02:39.490 INFO:tasks.ceph.mds.e.smithi063.stdout:starting mds.e at 2024-09-12T03:02:39.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.590+0000 7f277a200640 1 Processor -- start 2024-09-12T03:02:39.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.590+0000 7f277a200640 1 -- start start 2024-09-12T03:02:39.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.590+0000 7f277a200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c7c20 0x7f27740c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.590+0000 7f277a200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f27740c6ee0 0x7f27740c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.590+0000 7f277a200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2774159740 con 0x7f2774156060 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.590+0000 7f277a200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f27740c8e50 con 0x7f27740c6ee0 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.590+0000 7f277a200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f2774158f20 con 0x7f27740c7c20 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2773400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2774156060 0x7f2774158810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52896/0 (socket says 172.21.15.63:52896) 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2773400640 1 -- 172.21.15.63:0/3499985328 learned_addr learned my addr 172.21.15.63:0/3499985328 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2773e00640 1 --2- 172.21.15.63:0/3499985328 >> v2:172.21.15.63:3300/0 conn(0x7f27740c6ee0 0x7f27740c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f276aa00640 1 --2- 172.21.15.63:0/3499985328 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c7c20 0x7f27740c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2772a00640 1 -- 172.21.15.63:0/3499985328 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192873961 0 0) 0x7f2774159740 con 0x7f2774156060 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2772a00640 1 -- 172.21.15.63:0/3499985328 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2758003530 con 0x7f2774156060 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2773e00640 1 -- 172.21.15.63:0/3499985328 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c7c20 msgr2=0x7f27740c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2773e00640 1 --2- 172.21.15.63:0/3499985328 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c7c20 0x7f27740c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2773e00640 1 -- 172.21.15.63:0/3499985328 >> v1:172.21.15.63:6789/0 conn(0x7f2774156060 legacy=0x7f2774158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2773e00640 1 -- 172.21.15.63:0/3499985328 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2774159180 con 0x7f27740c6ee0 2024-09-12T03:02:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2773e00640 1 --2- 172.21.15.63:0/3499985328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27740c6ee0 0x7f27740c7350 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f276c009d90 tx=0x7f276c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa88475a282847d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:39.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2772a00640 1 -- 172.21.15.63:0/3499985328 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c0b2070 con 0x7f27740c6ee0 2024-09-12T03:02:39.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2772a00640 1 -- 172.21.15.63:0/3499985328 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f276c0a5920 con 0x7f27740c6ee0 2024-09-12T03:02:39.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.594+0000 7f2772a00640 1 -- 172.21.15.63:0/3499985328 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c0a5cd0 con 0x7f27740c6ee0 2024-09-12T03:02:39.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 -- 172.21.15.63:0/3499985328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27740c6ee0 msgr2=0x7f27740c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 --2- 172.21.15.63:0/3499985328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27740c6ee0 0x7f27740c7350 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f276c009d90 tx=0x7f276c01c970 comp rx=0 tx=0).stop 2024-09-12T03:02:39.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 -- 172.21.15.63:0/3499985328 shutdown_connections 2024-09-12T03:02:39.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 --2- 172.21.15.63:0/3499985328 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27740c6ee0 0x7f27740c7350 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 --2- 172.21.15.63:0/3499985328 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c7c20 0x7f27740c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 -- 172.21.15.63:0/3499985328 >> 172.21.15.63:0/3499985328 conn(0x7f277406bcc0 msgr2=0x7f277406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:39.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 -- 172.21.15.63:0/3499985328 shutdown_connections 2024-09-12T03:02:39.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 -- 172.21.15.63:0/3499985328 wait complete. 2024-09-12T03:02:39.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 Processor -- start 2024-09-12T03:02:39.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 -- start start 2024-09-12T03:02:39.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c6ee0 0x7f2774155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27740c7c20 0x7f27741f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2774156060 0x7f27741f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2774071d10 con 0x7f2774156060 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f277406cb30 con 0x7f27740c7c20 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f277a200640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f27740c9820 con 0x7f27740c6ee0 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f2773e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2774156060 0x7f27741f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f2773e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2774156060 0x7f27741f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43724/0 (socket says 172.21.15.63:43724) 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f2773e00640 1 -- 172.21.15.63:0/4122195931 learned_addr learned my addr 172.21.15.63:0/4122195931 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f2773400640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c6ee0 0x7f2774155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f276aa00640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27740c7c20 0x7f27741f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f2773e00640 1 -- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c6ee0 msgr2=0x7f2774155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f2773e00640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c6ee0 0x7f2774155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f2773e00640 1 -- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27740c7c20 msgr2=0x7f27741f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f2773e00640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27740c7c20 0x7f27741f7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:39.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f2773e00640 1 -- 172.21.15.63:0/4122195931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27741f4ab0 con 0x7f2774156060 2024-09-12T03:02:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.598+0000 7f276aa00640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27740c7c20 0x7f27741f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f2773e00640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2774156060 0x7f27741f4570 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f276c0b0040 tx=0x7f276c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f276be00640 1 -- 172.21.15.63:0/4122195931 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c0b2050 con 0x7f2774156060 2024-09-12T03:02:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f276be00640 1 -- 172.21.15.63:0/4122195931 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f276c0be070 con 0x7f2774156060 2024-09-12T03:02:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f276be00640 1 -- 172.21.15.63:0/4122195931 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c0ada90 con 0x7f2774156060 2024-09-12T03:02:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277414f430 con 0x7f2774156060 2024-09-12T03:02:39.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2774154f10 con 0x7f2774156060 2024-09-12T03:02:39.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27740c92e0 con 0x7f2774156060 2024-09-12T03:02:39.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f276be00640 1 -- 172.21.15.63:0/4122195931 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f276c0adc30 con 0x7f2774156060 2024-09-12T03:02:39.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f276be00640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f27500678c0 0x7f2750069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:39.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f276be00640 1 -- 172.21.15.63:0/4122195931 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6861+0+0 (secure 0 0 0) 0x7f276c1212f0 con 0x7f2774156060 2024-09-12T03:02:39.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.602+0000 7f2773400640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f27500678c0 0x7f2750069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:39.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.606+0000 7f2773400640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f27500678c0 0x7f2750069d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2764007fd0 tx=0x7f2764009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:39.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.606+0000 7f276be00640 1 -- 172.21.15.63:0/4122195931 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f276c016560 con 0x7f2774156060 2024-09-12T03:02:39.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:39.810+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f27740718e0 con 0x7f2774156060 2024-09-12T03:02:40.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f276be00640 1 -- 172.21.15.63:0/4122195931 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) ==== 104+0+0 (secure 0 0 0) 0x7f276c0f1920 con 0x7f2774156060 2024-09-12T03:02:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f27500678c0 msgr2=0x7f2750069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f27500678c0 0x7f2750069d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2764007fd0 tx=0x7f2764009040 comp rx=0 tx=0).stop 2024-09-12T03:02:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2774156060 msgr2=0x7f27741f4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2774156060 0x7f27741f4570 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f276c0b0040 tx=0x7f276c019710 comp rx=0 tx=0).stop 2024-09-12T03:02:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 shutdown_connections 2024-09-12T03:02:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2774156060 0x7f27741f4570 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27740c7c20 0x7f27741f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f27500678c0 0x7f2750069d80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 --2- 172.21.15.63:0/4122195931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27740c6ee0 0x7f2774155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 >> 172.21.15.63:0/4122195931 conn(0x7f277406bcc0 msgr2=0x7f27740c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:40.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 shutdown_connections 2024-09-12T03:02:40.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.430+0000 7f277a200640 1 -- 172.21.15.63:0/4122195931 wait complete. 2024-09-12T03:02:40.453 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T03:02:40.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4eeb600640 1 Processor -- start 2024-09-12T03:02:40.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4eeb600640 1 -- start start 2024-09-12T03:02:40.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4eeb600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ee41515d0 0x7f4ee41519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:40.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4eeb600640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4ee415b850 0x7f4ee40c3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:40.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4eeb600640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee41584d0 con 0x7f4ee41576a0 2024-09-12T03:02:40.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4eeb600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee40c3bd0 con 0x7f4ee41515d0 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4eeb600640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee40c6d30 con 0x7f4ee415b850 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4ee8c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ee41515d0 0x7f4ee41519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4ee8c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ee41515d0 0x7f4ee41519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43734/0 (socket says 172.21.15.63:43734) 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4ee8c00640 1 -- 172.21.15.63:0/80066526 learned_addr learned my addr 172.21.15.63:0/80066526 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4ee3e00640 1 --2- 172.21.15.63:0/80066526 >> v2:172.21.15.119:3300/0 conn(0x7f4ee415b850 0x7f4ee40c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4ee8c00640 1 -- 172.21.15.63:0/80066526 >> v2:172.21.15.119:3300/0 conn(0x7f4ee415b850 msgr2=0x7f4ee40c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4ee8c00640 1 --2- 172.21.15.63:0/80066526 >> v2:172.21.15.119:3300/0 conn(0x7f4ee415b850 0x7f4ee40c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4ee8c00640 1 -- 172.21.15.63:0/80066526 >> v1:172.21.15.119:6789/0 conn(0x7f4ee41576a0 legacy=0x7f4ee40c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4ee8c00640 1 -- 172.21.15.63:0/80066526 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee40c7010 con 0x7f4ee41515d0 2024-09-12T03:02:40.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.646+0000 7f4ee3e00640 1 --2- 172.21.15.63:0/80066526 >> v2:172.21.15.119:3300/0 conn(0x7f4ee415b850 0x7f4ee40c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:02:40.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4ee8c00640 1 --2- 172.21.15.63:0/80066526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee41515d0 0x7f4ee41519b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40ca040 tx=0x7f4ed80211c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43b1496549fbd11 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:40.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4ee3400640 1 -- 172.21.15.63:0/80066526 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80b6070 con 0x7f4ee41515d0 2024-09-12T03:02:40.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4ee3400640 1 -- 172.21.15.63:0/80066526 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4ed80b1600 con 0x7f4ee41515d0 2024-09-12T03:02:40.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4ee3400640 1 -- 172.21.15.63:0/80066526 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80b19f0 con 0x7f4ee41515d0 2024-09-12T03:02:40.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4eeb600640 1 -- 172.21.15.63:0/80066526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee41515d0 msgr2=0x7f4ee41519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:40.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4eeb600640 1 --2- 172.21.15.63:0/80066526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee41515d0 0x7f4ee41519b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40ca040 tx=0x7f4ed80211c0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4eeb600640 1 -- 172.21.15.63:0/80066526 shutdown_connections 2024-09-12T03:02:40.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4eeb600640 1 --2- 172.21.15.63:0/80066526 >> v2:172.21.15.119:3300/0 conn(0x7f4ee415b850 0x7f4ee40c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4eeb600640 1 --2- 172.21.15.63:0/80066526 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee41515d0 0x7f4ee41519b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4eeb600640 1 -- 172.21.15.63:0/80066526 >> 172.21.15.63:0/80066526 conn(0x7f4ee406bcc0 msgr2=0x7f4ee406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:40.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4eeb600640 1 -- 172.21.15.63:0/80066526 shutdown_connections 2024-09-12T03:02:40.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.650+0000 7f4eeb600640 1 -- 172.21.15.63:0/80066526 wait complete. 2024-09-12T03:02:40.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 Processor -- start 2024-09-12T03:02:40.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 -- start start 2024-09-12T03:02:40.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ee41515d0 0x7f4ee41e1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:40.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee41576a0 0x7f4ee40cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:40.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee415b850 0x7f4ee41f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:40.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee40c78b0 con 0x7f4ee415b850 2024-09-12T03:02:40.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee40c75d0 con 0x7f4ee41576a0 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee40c8920 con 0x7f4ee41515d0 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee9600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee415b850 0x7f4ee41f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee9600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee415b850 0x7f4ee41f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43748/0 (socket says 172.21.15.63:43748) 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee9600640 1 -- 172.21.15.63:0/4166624083 learned_addr learned my addr 172.21.15.63:0/4166624083 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee8c00640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ee41515d0 0x7f4ee41e1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee3e00640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee41576a0 0x7f4ee40cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee9600640 1 -- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ee41515d0 msgr2=0x7f4ee41e1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee9600640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ee41515d0 0x7f4ee41e1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee9600640 1 -- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee41576a0 msgr2=0x7f4ee40cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee9600640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee41576a0 0x7f4ee40cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee9600640 1 -- 172.21.15.63:0/4166624083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee41e1bc0 con 0x7f4ee415b850 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee3e00640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee41576a0 0x7f4ee40cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:40.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee9600640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee415b850 0x7f4ee41f22d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c780 tx=0x7f4edc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:40.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee0c00640 1 -- 172.21.15.63:0/4166624083 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc004b70 con 0x7f4ee415b850 2024-09-12T03:02:40.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee0c00640 1 -- 172.21.15.63:0/4166624083 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4edc004d10 con 0x7f4ee415b850 2024-09-12T03:02:40.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee4155f60 con 0x7f4ee415b850 2024-09-12T03:02:40.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4ee0c00640 1 -- 172.21.15.63:0/4166624083 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00aab0 con 0x7f4ee415b850 2024-09-12T03:02:40.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee41f1ad0 con 0x7f4ee415b850 2024-09-12T03:02:40.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.654+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee40c3690 con 0x7f4ee415b850 2024-09-12T03:02:40.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.658+0000 7f4ee0c00640 1 -- 172.21.15.63:0/4166624083 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4edc00ac50 con 0x7f4ee415b850 2024-09-12T03:02:40.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.658+0000 7f4ee0c00640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ec40678c0 0x7f4ec4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:40.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.658+0000 7f4ee0c00640 1 -- 172.21.15.63:0/4166624083 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6861+0+0 (secure 0 0 0) 0x7f4edc0864b0 con 0x7f4ee415b850 2024-09-12T03:02:40.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.658+0000 7f4ee8c00640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ec40678c0 0x7f4ec4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:40.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.658+0000 7f4ee8c00640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ec40678c0 0x7f4ec4069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80b3000 tx=0x7f4ed80ac000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:40.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.662+0000 7f4ee0c00640 1 -- 172.21.15.63:0/4166624083 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4edc020070 con 0x7f4ee415b850 2024-09-12T03:02:40.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:40.830+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4ee40c5810 con 0x7f4ee415b850 2024-09-12T03:02:41.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.430+0000 7f4ee0c00640 1 -- 172.21.15.63:0/4166624083 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) ==== 181+0+0 (secure 0 0 0) 0x7f4ee41e1bc0 con 0x7f4ee415b850 2024-09-12T03:02:41.433 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-09-12T03:02:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ec40678c0 msgr2=0x7f4ec4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ec40678c0 0x7f4ec4069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ed80b3000 tx=0x7f4ed80ac000 comp rx=0 tx=0).stop 2024-09-12T03:02:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee415b850 msgr2=0x7f4ee41f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:41.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee415b850 0x7f4ee41f22d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00c780 tx=0x7f4edc00cc40 comp rx=0 tx=0).stop 2024-09-12T03:02:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 shutdown_connections 2024-09-12T03:02:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee415b850 0x7f4ee41f22d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ee41576a0 0x7f4ee40cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f4ec40678c0 0x7f4ec4069d80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 --2- 172.21.15.63:0/4166624083 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4ee41515d0 0x7f4ee41e1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 >> 172.21.15.63:0/4166624083 conn(0x7f4ee406bcc0 msgr2=0x7f4ee40c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:41.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 shutdown_connections 2024-09-12T03:02:41.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.434+0000 7f4eeb600640 1 -- 172.21.15.63:0/4166624083 wait complete. 2024-09-12T03:02:41.460 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T03:02:41.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f657c800640 1 Processor -- start 2024-09-12T03:02:41.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f657c800640 1 -- start start 2024-09-12T03:02:41.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f657c800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f657414f060 0x7f65740c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:41.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f657c800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657415c000 0x7f657415c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f657c800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6574152db0 con 0x7f65740cbc80 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f657c800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f65740ca860 con 0x7f657414f060 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f657c800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f65740cad90 con 0x7f657415c000 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f6579e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f657414f060 0x7f65740c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f6579e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f657414f060 0x7f65740c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43750/0 (socket says 172.21.15.63:43750) 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f6579e00640 1 -- 172.21.15.63:0/240195984 learned_addr learned my addr 172.21.15.63:0/240195984 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f657a800640 1 --2- 172.21.15.63:0/240195984 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657415c000 0x7f657415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f6579e00640 1 -- 172.21.15.63:0/240195984 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657415c000 msgr2=0x7f657415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f6579e00640 1 --2- 172.21.15.63:0/240195984 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657415c000 0x7f657415c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f6579e00640 1 -- 172.21.15.63:0/240195984 >> v1:172.21.15.63:6789/0 conn(0x7f65740cbc80 legacy=0x7f65740717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f6579e00640 1 -- 172.21.15.63:0/240195984 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65741591c0 con 0x7f657414f060 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f657a800640 1 --2- 172.21.15.63:0/240195984 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657415c000 0x7f657415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:02:41.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.606+0000 7f6578a00640 1 -- 172.21.15.63:0/240195984 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1153961621 0 0) 0x7f6564001120 con 0x7f65740cbc80 2024-09-12T03:02:41.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f6579e00640 1 --2- 172.21.15.63:0/240195984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f657414f060 0x7f65740c97f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6568009870 tx=0x7f656801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78e781d96a92e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:41.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f6578a00640 1 -- 172.21.15.63:0/240195984 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65680aa430 con 0x7f657414f060 2024-09-12T03:02:41.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f6578a00640 1 -- 172.21.15.63:0/240195984 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f65680af070 con 0x7f657414f060 2024-09-12T03:02:41.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f6578a00640 1 -- 172.21.15.63:0/240195984 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65680aa810 con 0x7f657414f060 2024-09-12T03:02:41.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f657c800640 1 -- 172.21.15.63:0/240195984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f657414f060 msgr2=0x7f65740c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:41.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f657c800640 1 --2- 172.21.15.63:0/240195984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f657414f060 0x7f65740c97f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6568009870 tx=0x7f656801c4d0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f657c800640 1 -- 172.21.15.63:0/240195984 shutdown_connections 2024-09-12T03:02:41.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f657c800640 1 --2- 172.21.15.63:0/240195984 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657415c000 0x7f657415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f657c800640 1 --2- 172.21.15.63:0/240195984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f657414f060 0x7f65740c97f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f657c800640 1 -- 172.21.15.63:0/240195984 >> 172.21.15.63:0/240195984 conn(0x7f6574071030 msgr2=0x7f657406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:41.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f657c800640 1 -- 172.21.15.63:0/240195984 shutdown_connections 2024-09-12T03:02:41.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.610+0000 7f657c800640 1 -- 172.21.15.63:0/240195984 wait complete. 2024-09-12T03:02:41.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 Processor -- start 2024-09-12T03:02:41.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 -- start start 2024-09-12T03:02:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65740cbc80 0x7f657414a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657414f060 0x7f6574162460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f657415c000 0x7f657414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f657414f440 con 0x7f65740cbc80 2024-09-12T03:02:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f65740c9370 con 0x7f657415c000 2024-09-12T03:02:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f65740c8fc0 con 0x7f657414f060 2024-09-12T03:02:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65740cbc80 0x7f657414a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65740cbc80 0x7f657414a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43762/0 (socket says 172.21.15.63:43762) 2024-09-12T03:02:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579e00640 1 -- 172.21.15.63:0/2940039127 learned_addr learned my addr 172.21.15.63:0/2940039127 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657a800640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f657415c000 0x7f657414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579400640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657414f060 0x7f6574162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579e00640 1 -- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657414f060 msgr2=0x7f6574162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579e00640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657414f060 0x7f6574162460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579e00640 1 -- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f657415c000 msgr2=0x7f657414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579e00640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f657415c000 0x7f657414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579e00640 1 -- 172.21.15.63:0/2940039127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65741472b0 con 0x7f65740cbc80 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579400640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657414f060 0x7f6574162460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657a800640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f657415c000 0x7f657414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:02:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f6579e00640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65740cbc80 0x7f657414a110 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f656801a100 tx=0x7f656801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:41.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f656e000640 1 -- 172.21.15.63:0/2940039127 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65680b9070 con 0x7f65740cbc80 2024-09-12T03:02:41.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f656e000640 1 -- 172.21.15.63:0/2940039127 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6568004020 con 0x7f65740cbc80 2024-09-12T03:02:41.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657414c2b0 con 0x7f65740cbc80 2024-09-12T03:02:41.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f656e000640 1 -- 172.21.15.63:0/2940039127 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65680aae60 con 0x7f65740cbc80 2024-09-12T03:02:41.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657414c870 con 0x7f65740cbc80 2024-09-12T03:02:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.614+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657414b740 con 0x7f65740cbc80 2024-09-12T03:02:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.618+0000 7f656e000640 1 -- 172.21.15.63:0/2940039127 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6568003620 con 0x7f65740cbc80 2024-09-12T03:02:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.618+0000 7f656e000640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f65580678f0 0x7f6558069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.618+0000 7f656e000640 1 -- 172.21.15.63:0/2940039127 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 6423+0+0 (secure 0 0 0) 0x7f65681206d0 con 0x7f65740cbc80 2024-09-12T03:02:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.618+0000 7f6579400640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f65580678f0 0x7f6558069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:41.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.618+0000 7f6579400640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f65580678f0 0x7f6558069db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f65740cf5a0 tx=0x7f6564009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:41.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.622+0000 7f656e000640 1 -- 172.21.15.63:0/2940039127 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f65680c2060 con 0x7f65740cbc80 2024-09-12T03:02:41.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:41.786+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f657414b460 con 0x7f65740cbc80 2024-09-12T03:02:42.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.442+0000 7f656e000640 1 -- 172.21.15.63:0/2940039127 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) ==== 169+0+0 (secure 0 0 0) 0x7f6568016150 con 0x7f65740cbc80 2024-09-12T03:02:42.442 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-09-12T03:02:42.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.442+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f65580678f0 msgr2=0x7f6558069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:42.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.442+0000 7f657c800640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f65580678f0 0x7f6558069db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f65740cf5a0 tx=0x7f6564009040 comp rx=0 tx=0).stop 2024-09-12T03:02:42.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.442+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65740cbc80 msgr2=0x7f657414a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:42.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.442+0000 7f657c800640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65740cbc80 0x7f657414a110 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f656801a100 tx=0x7f656801ad10 comp rx=0 tx=0).stop 2024-09-12T03:02:42.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.446+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 shutdown_connections 2024-09-12T03:02:42.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.446+0000 7f657c800640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f657415c000 0x7f657414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:42.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.446+0000 7f657c800640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f65580678f0 0x7f6558069db0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:42.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.446+0000 7f657c800640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f657414f060 0x7f6574162460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:42.446 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.446+0000 7f657c800640 1 --2- 172.21.15.63:0/2940039127 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65740cbc80 0x7f657414a110 secure :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f656801a100 tx=0x7f656801ad10 comp rx=0 tx=0).stop 2024-09-12T03:02:42.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.446+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 >> 172.21.15.63:0/2940039127 conn(0x7f6574071030 msgr2=0x7f65740717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:42.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.446+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 shutdown_connections 2024-09-12T03:02:42.447 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.446+0000 7f657c800640 1 -- 172.21.15.63:0/2940039127 wait complete. 2024-09-12T03:02:42.468 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T03:02:42.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.610+0000 7f50ac400640 1 Processor -- start 2024-09-12T03:02:42.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.610+0000 7f50ac400640 1 -- start start 2024-09-12T03:02:42.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50ac400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:42.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50ac400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50a415e110 0x7f50a415e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:42.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50ac400640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a40c92d0 con 0x7f50a40c52e0 2024-09-12T03:02:42.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50ac400640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 -- 0x7f50a415eb00 con 0x7f50a415e110 2024-09-12T03:02:42.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50ac400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f50a415ac20 con 0x7f50a40cbc80 2024-09-12T03:02:42.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50a9000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:42.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50aa400640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50a415e110 0x7f50a415e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:42.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50a9000640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.63:41004/0 (socket says 172.21.15.63:41004) 2024-09-12T03:02:42.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50a9000640 1 -- 172.21.15.63:0/481808407 learned_addr learned my addr 172.21.15.63:0/481808407 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:42.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50a9000640 1 -- 172.21.15.63:0/481808407 >> v2:172.21.15.119:3300/0 conn(0x7f50a415e110 msgr2=0x7f50a415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:02:42.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50a9000640 1 --2- 172.21.15.63:0/481808407 >> v2:172.21.15.119:3300/0 conn(0x7f50a415e110 0x7f50a415e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:42.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50a9000640 1 -- 172.21.15.63:0/481808407 >> v1:172.21.15.119:6789/0 conn(0x7f50a40c52e0 legacy=0x7f50a40ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:42.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.614+0000 7f50a9000640 1 -- 172.21.15.63:0/481808407 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a415af00 con 0x7f50a40cbc80 2024-09-12T03:02:42.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50a9000640 1 --2- 172.21.15.63:0/481808407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40c97f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5090009870 tx=0x7f509001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a587bb77ce2d0e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:42.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50a3e00640 1 -- 172.21.15.63:0/481808407 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50900b5070 con 0x7f50a40cbc80 2024-09-12T03:02:42.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50a3e00640 1 -- 172.21.15.63:0/481808407 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f50900a8a50 con 0x7f50a40cbc80 2024-09-12T03:02:42.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50a3e00640 1 -- 172.21.15.63:0/481808407 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50900a8e40 con 0x7f50a40cbc80 2024-09-12T03:02:42.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50ac400640 1 -- 172.21.15.63:0/481808407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 msgr2=0x7f50a40c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:42.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50ac400640 1 --2- 172.21.15.63:0/481808407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40c97f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5090009870 tx=0x7f509001ed50 comp rx=0 tx=0).stop 2024-09-12T03:02:42.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50ac400640 1 -- 172.21.15.63:0/481808407 shutdown_connections 2024-09-12T03:02:42.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50ac400640 1 --2- 172.21.15.63:0/481808407 >> v2:172.21.15.119:3300/0 conn(0x7f50a415e110 0x7f50a415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:42.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50ac400640 1 --2- 172.21.15.63:0/481808407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40c97f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:42.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50ac400640 1 -- 172.21.15.63:0/481808407 >> 172.21.15.63:0/481808407 conn(0x7f50a4071030 msgr2=0x7f50a406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:42.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50ac400640 1 -- 172.21.15.63:0/481808407 shutdown_connections 2024-09-12T03:02:42.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.618+0000 7f50ac400640 1 -- 172.21.15.63:0/481808407 wait complete. 2024-09-12T03:02:42.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 Processor -- start 2024-09-12T03:02:42.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 -- start start 2024-09-12T03:02:42.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a40c52e0 0x7f50a40c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:42.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:42.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50a415e110 0x7f50a40b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:42.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f50a415b7a0 con 0x7f50a415e110 2024-09-12T03:02:42.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f50a415b4c0 con 0x7f50a40c52e0 2024-09-12T03:02:42.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 -- 0x7f50a40c8fc0 con 0x7f50a40cbc80 2024-09-12T03:02:42.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50aa400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50a415e110 0x7f50a40b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:42.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50aa400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50a415e110 0x7f50a40b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43766/0 (socket says 172.21.15.63:43766) 2024-09-12T03:02:42.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50aa400640 1 -- 172.21.15.63:0/1685004835 learned_addr learned my addr 172.21.15.63:0/1685004835 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-12T03:02:42.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50a9000640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50a9a00640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a40c52e0 0x7f50a40c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50aa400640 1 -- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 msgr2=0x7f50a40ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50aa400640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50aa400640 1 -- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a40c52e0 msgr2=0x7f50a40c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50aa400640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a40c52e0 0x7f50a40c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50aa400640 1 -- 172.21.15.63:0/1685004835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a40684b0 con 0x7f50a415e110 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50a9a00640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a40c52e0 0x7f50a40c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50aa400640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50a415e110 0x7f50a40b3ba0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f509c00e930 tx=0x7f509c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50a1600640 1 -- 172.21.15.63:0/1685004835 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c017070 con 0x7f50a415e110 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50a1600640 1 -- 172.21.15.63:0/1685004835 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f509c00c8e0 con 0x7f50a415e110 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50a1600640 1 -- 172.21.15.63:0/1685004835 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c00ccd0 con 0x7f50a415e110 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a40b36f0 con 0x7f50a415e110 2024-09-12T03:02:42.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a41580e0 con 0x7f50a415e110 2024-09-12T03:02:42.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.622+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a415a8d0 con 0x7f50a415e110 2024-09-12T03:02:42.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.626+0000 7f50a1600640 1 -- 172.21.15.63:0/1685004835 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f509c01a070 con 0x7f50a415e110 2024-09-12T03:02:42.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.626+0000 7f50a1600640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f50840678f0 0x7f5084069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:02:42.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.626+0000 7f50a1600640 1 -- 172.21.15.63:0/1685004835 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5893+0+0 (secure 0 0 0) 0x7f509c085d70 con 0x7f50a415e110 2024-09-12T03:02:42.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.626+0000 7f50a9a00640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f50840678f0 0x7f5084069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:02:42.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.626+0000 7f50a9a00640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f50840678f0 0x7f5084069db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f50980012f0 tx=0x7f5098009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:02:42.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.630+0000 7f50a1600640 1 -- 172.21.15.63:0/1685004835 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f509c056100 con 0x7f50a415e110 2024-09-12T03:02:42.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:42.798+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f50a4158950 con 0x7f50a415e110 2024-09-12T03:02:43.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.450+0000 7f50a1600640 1 -- 172.21.15.63:0/1685004835 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v85) ==== 178+0+0 (secure 0 0 0) 0x7f509c05a400 con 0x7f50a415e110 2024-09-12T03:02:43.452 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data_ec' removed 2024-09-12T03:02:43.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f50840678f0 msgr2=0x7f5084069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:43.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f50840678f0 0x7f5084069db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f50980012f0 tx=0x7f5098009040 comp rx=0 tx=0).stop 2024-09-12T03:02:43.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50a415e110 msgr2=0x7f50a40b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:02:43.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50a415e110 0x7f50a40b3ba0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f509c00e930 tx=0x7f509c00edf0 comp rx=0 tx=0).stop 2024-09-12T03:02:43.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 shutdown_connections 2024-09-12T03:02:43.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50a415e110 0x7f50a40b3ba0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:43.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:6832/57260755,v1:172.21.15.119:6833/57260755] conn(0x7f50840678f0 0x7f5084069db0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:43.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50a40cbc80 0x7f50a40ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:43.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 --2- 172.21.15.63:0/1685004835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50a40c52e0 0x7f50a40c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:02:43.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 >> 172.21.15.63:0/1685004835 conn(0x7f50a4071030 msgr2=0x7f50a415ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:02:43.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 shutdown_connections 2024-09-12T03:02:43.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-12T03:02:43.454+0000 7f50ac400640 1 -- 172.21.15.63:0/1685004835 wait complete. 2024-09-12T03:02:43.479 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T03:02:43.480 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T03:02:43.480 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:43.493 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T03:02:43.493 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T03:02:43.493 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:43.549 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T03:02:43.549 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-12T03:02:43.549 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:43.601 INFO:tasks.ceph.mds.e:Stopped 2024-09-12T03:02:43.601 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T03:02:43.601 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:43.617 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T03:02:43.618 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T03:02:43.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:43.678 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T03:02:43.679 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-12T03:02:43.679 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:43.737 INFO:tasks.ceph.mds.f:Stopped 2024-09-12T03:02:43.737 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T03:02:43.737 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T03:02:43.737 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:43.805 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T03:02:43.805 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T03:02:43.805 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:47.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-12T03:02:49.907 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T03:02:49.907 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T03:02:49.908 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:49.992 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T03:02:49.992 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T03:02:49.992 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:50.080 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T03:02:50.080 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T03:02:50.080 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:50.163 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T03:02:50.163 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T03:02:50.164 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:53.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T03:02:53.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-12T03:02:56.265 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T03:02:56.266 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T03:02:56.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:56.318 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T03:02:56.318 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T03:02:56.318 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:56.418 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T03:02:56.418 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T03:02:56.418 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T03:02:56.418 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:56.476 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T03:02:56.477 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T03:02:56.477 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:56.507 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T03:02:56.507 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T03:02:56.507 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T03:02:56.507 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:56.527 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T03:02:56.527 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T03:02:56.527 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:56.563 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T03:02:56.564 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T03:02:56.564 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:02:56.623 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T03:02:56.623 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T03:02:56.623 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v MDS_SLOW_METADATA_IO | egrep -v MDS_TRIM | head -n 1 2024-09-12T03:02:56.678 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T03:02:56.678 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T03:02:56.907 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T03:02:56.907 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T03:02:57.212 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T03:02:57.212 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T03:02:57.436 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T03:02:57.437 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T03:02:57.645 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T03:02:57.645 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T03:02:57.900 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T03:02:57.900 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T03:02:58.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T03:02:58.131 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T03:02:58.131 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T03:02:58.289 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T03:02:58.289 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T03:02:58.448 INFO:tasks.ceph:Archiving mon data... 2024-09-12T03:02:58.450 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642/data/mon.a.tgz 2024-09-12T03:02:58.450 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-12T03:02:58.459 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.WS7gD26NUh 2024-09-12T03:02:58.460 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WS7gD26NUh 2024-09-12T03:02:58.612 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.WS7gD26NUh 2024-09-12T03:02:58.690 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.WS7gD26NUh is 399KB 2024-09-12T03:02:58.756 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.WS7gD26NUh 2024-09-12T03:02:58.764 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642/data/mon.b.tgz 2024-09-12T03:02:58.764 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-12T03:02:58.770 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.5CRMWUp68v 2024-09-12T03:02:58.771 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5CRMWUp68v 2024-09-12T03:02:58.947 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.5CRMWUp68v 2024-09-12T03:02:59.013 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.5CRMWUp68v is 549KB 2024-09-12T03:02:59.075 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.5CRMWUp68v 2024-09-12T03:02:59.081 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642/data/mon.c.tgz 2024-09-12T03:02:59.081 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-12T03:02:59.129 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.l2ch5W9oIp 2024-09-12T03:02:59.130 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.l2ch5W9oIp 2024-09-12T03:02:59.304 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.l2ch5W9oIp 2024-09-12T03:02:59.365 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.l2ch5W9oIp is 549KB 2024-09-12T03:02:59.467 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.l2ch5W9oIp 2024-09-12T03:02:59.473 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T03:02:59.473 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T03:02:59.477 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T03:02:59.546 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T03:02:59.577 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T03:02:59.577 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T03:02:59.579 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642/remote/smithi063/crash 2024-09-12T03:02:59.580 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T03:02:59.610 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642/remote/smithi119/crash 2024-09-12T03:02:59.611 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T03:02:59.633 INFO:tasks.ceph:Shutting down logrotate 2024-09-12T03:02:59.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:02:59.660 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:02:59.711 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T03:02:59.770 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T03:02:59.783 INFO:tasks.ceph:Compressing logs... 2024-09-12T03:02:59.783 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T03:02:59.816 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T03:02:59.842 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37719.log 2024-09-12T03:02:59.843 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35894.log 2024-09-12T03:02:59.844 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40637.log 2024-09-12T03:02:59.844 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37719.log.gz 2024-09-12T03:02:59.844 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34529.log 2024-09-12T03:02:59.845 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35894.log.gz 2024-09-12T03:02:59.845 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35466.log 2024-09-12T03:02:59.846 INFO:teuthology.orchestra.run.smithi063.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40637.log.gz 2024-09-12T03:02:59.846 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39768.log 2024-09-12T03:02:59.846 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34529.log.gz 2024-09-12T03:02:59.847 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41673.log 2024-09-12T03:02:59.847 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35466.log.gz 2024-09-12T03:02:59.848 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29448.log 2024-09-12T03:02:59.849 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29472.log 2024-09-12T03:02:59.849 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.29448.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.35996.log 2024-09-12T03:02:59.849 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39216.log 2024-09-12T03:02:59.850 INFO:teuthology.orchestra.run.smithi063.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39768.log.gz 2024-09-12T03:02:59.850 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2024-09-12T03:02:59.850 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41673.log.gz 2024-09-12T03:02:59.850 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36658.log 2024-09-12T03:02:59.852 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39216.log.gz 2024-09-12T03:02:59.852 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37056.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T03:02:59.852 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2024-09-12T03:02:59.853 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34477.log 2024-09-12T03:02:59.853 INFO:teuthology.orchestra.run.smithi063.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36658.log.gz 2024-09-12T03:02:59.853 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37175.log 2024-09-12T03:02:59.855 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29448.log.gz 2024-09-12T03:02:59.855 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T03:02:59.855 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.29472.log: /var/log/ceph/objectstore_tool.35996.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T03:02:59.855 INFO:teuthology.orchestra.run.smithi119.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29472.log.gz 2024-09-12T03:02:59.855 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29544.log 2024-09-12T03:02:59.855 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29400.log 2024-09-12T03:02:59.855 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.29544.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T03:02:59.855 INFO:teuthology.orchestra.run.smithi119.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29544.log.gz 2024-09-12T03:02:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.37520.log 2024-09-12T03:02:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.29400.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29496.log 2024-09-12T03:02:59.856 INFO:teuthology.orchestra.run.smithi119.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29400.log.gz 2024-09-12T03:02:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/objectstore_tool.37520.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T03:02:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.29496.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-09-12T03:02:59.856 INFO:teuthology.orchestra.run.smithi119.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29496.log.gz 2024-09-12T03:02:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T03:02:59.856 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29520.log 2024-09-12T03:02:59.859 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-09-12T03:02:59.859 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.35216.log 2024-09-12T03:02:59.859 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.29520.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29520.log.gz 2024-09-12T03:02:59.859 INFO:teuthology.orchestra.run.smithi119.stderr: 92.2%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T03:02:59.859 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T03:02:59.859 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/objectstore_tool.35216.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.36740.log 2024-09-12T03:02:59.862 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41033.log 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34477.log.gz 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41319.log 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37175.log.gz 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36628.log 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41033.log.gz 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34310.log 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41319.log.gz 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36863.log 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36628.log.gz 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2024-09-12T03:02:59.863 INFO:teuthology.orchestra.run.smithi063.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34310.log.gz 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41807.log 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36863.log.gz 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37442.log 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39657.log 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41807.log.gz 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37442.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37442.log.gz 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34687.log 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39657.log.gz 2024-09-12T03:02:59.864 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41449.log 2024-09-12T03:02:59.866 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2024-09-12T03:02:59.866 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34687.log.gz 2024-09-12T03:02:59.866 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38624.log 2024-09-12T03:02:59.866 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41449.log.gz 2024-09-12T03:02:59.866 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40080.log 2024-09-12T03:02:59.866 INFO:teuthology.orchestra.run.smithi063.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2024-09-12T03:02:59.866 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39924.log 2024-09-12T03:02:59.867 INFO:teuthology.orchestra.run.smithi063.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38624.log.gz 2024-09-12T03:02:59.867 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35088.log 2024-09-12T03:02:59.867 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40080.log.gz 2024-09-12T03:02:59.868 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40233.log 2024-09-12T03:02:59.868 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39924.log.gz 2024-09-12T03:02:59.869 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38226.log 2024-09-12T03:02:59.869 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35088.log.gz 2024-09-12T03:02:59.870 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.c.log: 93.7% -- replaced with /var/log/ceph/objectstore_tool.35996.log.gz 2024-09-12T03:02:59.870 INFO:teuthology.orchestra.run.smithi119.stderr: 93.5% -- replaced with /var/log/ceph/objectstore_tool.37520.log.gz 2024-09-12T03:02:59.870 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T03:02:59.871 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/objectstore_tool.36740.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-12T03:02:59.872 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40106.log 2024-09-12T03:02:59.872 INFO:teuthology.orchestra.run.smithi063.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40233.log.gz 2024-09-12T03:02:59.872 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41345.log 2024-09-12T03:02:59.872 INFO:teuthology.orchestra.run.smithi063.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38226.log.gz 2024-09-12T03:02:59.872 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41535.log 2024-09-12T03:02:59.872 INFO:teuthology.orchestra.run.smithi063.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40106.log.gz 2024-09-12T03:02:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36227.log 2024-09-12T03:02:59.873 INFO:teuthology.orchestra.run.smithi063.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41345.log.gz 2024-09-12T03:02:59.873 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28845.log 2024-09-12T03:02:59.875 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T03:02:59.875 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-12T03:02:59.876 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41535.log.gz 2024-09-12T03:02:59.876 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.36227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38699.log 2024-09-12T03:02:59.876 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36227.log.gz 2024-09-12T03:02:59.876 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37828.log 2024-09-12T03:02:59.876 INFO:teuthology.orchestra.run.smithi063.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28845.log.gz 2024-09-12T03:02:59.876 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41007.log 2024-09-12T03:02:59.878 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.d.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-12T03:02:59.878 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T03:02:59.879 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37828.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.38699.log.gz 2024-09-12T03:02:59.879 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41859.log 2024-09-12T03:02:59.879 INFO:teuthology.orchestra.run.smithi063.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37828.log.gz 2024-09-12T03:02:59.879 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39950.log 2024-09-12T03:02:59.879 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41007.log.gz 2024-09-12T03:02:59.879 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37995.log 2024-09-12T03:02:59.880 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.b.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-12T03:02:59.880 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T03:02:59.881 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41859.log.gz 2024-09-12T03:02:59.881 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39846.log 2024-09-12T03:02:59.881 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39950.log.gz 2024-09-12T03:02:59.881 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35479.log 2024-09-12T03:02:59.881 INFO:teuthology.orchestra.run.smithi063.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37995.log.gz 2024-09-12T03:02:59.882 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35034.log 2024-09-12T03:02:59.882 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39846.log.gz 2024-09-12T03:02:59.883 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38458.log 2024-09-12T03:02:59.883 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35479.log.gz 2024-09-12T03:02:59.883 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39872.log 2024-09-12T03:02:59.883 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35034.log.gz 2024-09-12T03:02:59.884 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34200.log 2024-09-12T03:02:59.885 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39872.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38458.log.gz 2024-09-12T03:02:59.885 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36321.log 2024-09-12T03:02:59.885 INFO:teuthology.orchestra.run.smithi063.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39872.log.gz 2024-09-12T03:02:59.886 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40028.log 2024-09-12T03:02:59.886 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34200.log.gz 2024-09-12T03:02:59.887 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40860.log 2024-09-12T03:02:59.887 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36321.log.gz 2024-09-12T03:02:59.888 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36347.log 2024-09-12T03:02:59.888 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40028.log.gz 2024-09-12T03:02:59.889 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35472.log 2024-09-12T03:02:59.889 INFO:teuthology.orchestra.run.smithi063.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40860.log.gz 2024-09-12T03:02:59.890 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35671.log 2024-09-12T03:02:59.890 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36347.log.gz 2024-09-12T03:02:59.891 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.b.log: 93.5% -- replaced with /var/log/ceph/objectstore_tool.36740.log.gz 2024-09-12T03:02:59.891 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29376.log 2024-09-12T03:02:59.892 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35472.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T03:02:59.892 INFO:teuthology.orchestra.run.smithi063.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35472.log.gz 2024-09-12T03:02:59.892 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35669.log 2024-09-12T03:02:59.892 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35671.log.gz 2024-09-12T03:02:59.892 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41590.log 2024-09-12T03:02:59.893 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41956.log 2024-09-12T03:02:59.893 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35669.log.gz 2024-09-12T03:02:59.894 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37802.log 2024-09-12T03:02:59.894 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41590.log.gz 2024-09-12T03:02:59.895 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37010.log 2024-09-12T03:02:59.895 INFO:teuthology.orchestra.run.smithi063.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41956.log.gz 2024-09-12T03:02:59.896 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37802.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.41833.log -- replaced with /var/log/ceph/ceph-client.admin.37802.log.gz 2024-09-12T03:02:59.896 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T03:02:59.897 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41163.log 2024-09-12T03:02:59.897 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37010.log.gz 2024-09-12T03:02:59.898 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37920.log 2024-09-12T03:02:59.898 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41833.log.gz 2024-09-12T03:02:59.899 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41163.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T03:02:59.899 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41163.log.gz 2024-09-12T03:02:59.900 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41781.log 2024-09-12T03:02:59.900 INFO:teuthology.orchestra.run.smithi063.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.37920.log.gz 2024-09-12T03:02:59.901 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.24022.log 2024-09-12T03:02:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41781.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41781.log.gz 2024-09-12T03:02:59.902 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40651.log 2024-09-12T03:02:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41982.log 2024-09-12T03:02:59.903 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.tmp-client.admin.24022.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.24022.log.gz 2024-09-12T03:02:59.905 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36024.log 2024-09-12T03:02:59.905 INFO:teuthology.orchestra.run.smithi063.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40651.log.gz 2024-09-12T03:02:59.905 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29424.log 2024-09-12T03:02:59.906 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39139.log 2024-09-12T03:02:59.906 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41982.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41982.log.gz 2024-09-12T03:02:59.906 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.29376.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29376.log.gz 2024-09-12T03:02:59.907 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35692.log 2024-09-12T03:02:59.907 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36024.log.gz 2024-09-12T03:02:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35192.log 2024-09-12T03:02:59.908 INFO:teuthology.orchestra.run.smithi119.stderr: 94.3% -- replaced with /var/log/ceph/objectstore_tool.35216.log.gz 2024-09-12T03:02:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35692.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39139.log.gz 2024-09-12T03:02:59.908 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41137.log 2024-09-12T03:02:59.909 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35692.log.gz 2024-09-12T03:02:59.909 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.29424.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29424.log.gz 2024-09-12T03:02:59.910 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34503.log 2024-09-12T03:02:59.910 INFO:teuthology.orchestra.run.smithi063.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35192.log.gz 2024-09-12T03:02:59.911 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38576.log 2024-09-12T03:02:59.911 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34503.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41137.log.gz 2024-09-12T03:02:59.912 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38454.log 2024-09-12T03:02:59.912 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34503.log.gz 2024-09-12T03:02:59.913 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41563.log 2024-09-12T03:02:59.913 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38576.log.gz 2024-09-12T03:02:59.915 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29050.log 2024-09-12T03:02:59.915 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38454.log.gz 2024-09-12T03:02:59.915 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37890.log 2024-09-12T03:02:59.915 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41563.log.gz 2024-09-12T03:02:59.916 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.29050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37292.log 2024-09-12T03:02:59.916 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29050.log.gz 2024-09-12T03:02:59.917 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36522.log 2024-09-12T03:02:59.918 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37890.log: /var/log/ceph/ceph-client.admin.37292.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37890.log.gz 2024-09-12T03:02:59.918 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35062.log 2024-09-12T03:02:59.919 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37292.log.gz 2024-09-12T03:02:59.920 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36897.log 2024-09-12T03:02:59.920 INFO:teuthology.orchestra.run.smithi063.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36522.log.gz 2024-09-12T03:02:59.920 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41397.log 2024-09-12T03:02:59.921 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35062.log.gz 2024-09-12T03:02:59.922 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34555.log 2024-09-12T03:02:59.922 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36897.log.gz 2024-09-12T03:02:59.923 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41505.log 2024-09-12T03:02:59.923 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41397.log.gz 2024-09-12T03:02:59.924 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38784.log 2024-09-12T03:02:59.924 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34555.log.gz 2024-09-12T03:02:59.925 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41085.log 2024-09-12T03:02:59.925 INFO:teuthology.orchestra.run.smithi063.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41505.log.gz 2024-09-12T03:02:59.926 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35675.log 2024-09-12T03:02:59.926 INFO:teuthology.orchestra.run.smithi063.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.38784.log.gz 2024-09-12T03:02:59.927 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34982.log 2024-09-12T03:02:59.927 INFO:teuthology.orchestra.run.smithi063.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41085.log.gz 2024-09-12T03:02:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28954.log 2024-09-12T03:02:59.928 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35675.log.gz 2024-09-12T03:02:59.929 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35218.log 2024-09-12T03:02:59.929 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34982.log.gz 2024-09-12T03:02:59.930 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.28954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34451.log 2024-09-12T03:02:59.931 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35218.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28954.log.gz 2024-09-12T03:02:59.931 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35218.log.gz 2024-09-12T03:02:59.931 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41267.log 2024-09-12T03:02:59.933 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40652.log 2024-09-12T03:02:59.933 INFO:teuthology.orchestra.run.smithi063.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34451.log.gz 2024-09-12T03:02:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37253.log 2024-09-12T03:02:59.937 INFO:teuthology.orchestra.run.smithi063.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41267.log.gz 2024-09-12T03:02:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38967.log 2024-09-12T03:02:59.937 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40652.log.gz 2024-09-12T03:02:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37553.log 2024-09-12T03:02:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37253.log: /var/log/ceph/ceph-client.admin.38967.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37253.log.gz 2024-09-12T03:02:59.937 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37354.log 2024-09-12T03:02:59.937 INFO:teuthology.orchestra.run.smithi063.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.38967.log.gz 2024-09-12T03:02:59.938 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35660.log 2024-09-12T03:02:59.938 INFO:teuthology.orchestra.run.smithi063.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.37553.log.gz 2024-09-12T03:02:59.939 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37475.log 2024-09-12T03:02:59.939 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37354.log.gz 2024-09-12T03:02:59.940 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39442.log 2024-09-12T03:02:59.940 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35660.log.gz 2024-09-12T03:02:59.941 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33808.log 2024-09-12T03:02:59.941 INFO:teuthology.orchestra.run.smithi063.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37475.log.gz 2024-09-12T03:02:59.942 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34581.log 2024-09-12T03:02:59.943 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39442.log.gz 2024-09-12T03:02:59.943 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33808.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T03:02:59.944 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33808.log.gz 2024-09-12T03:02:59.945 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34581.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34581.log.gz -5 2024-09-12T03:02:59.945 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38937.log 2024-09-12T03:02:59.945 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35462.log 2024-09-12T03:02:59.947 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34633.log 2024-09-12T03:02:59.947 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38937.log.gz 2024-09-12T03:02:59.948 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41059.log 2024-09-12T03:02:59.948 INFO:teuthology.orchestra.run.smithi063.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35462.log.gz 2024-09-12T03:02:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35471.log 2024-09-12T03:02:59.950 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34633.log: /var/log/ceph/ceph-client.admin.41059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40446.log 2024-09-12T03:02:59.950 INFO:teuthology.orchestra.run.smithi063.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34633.log.gz 2024-09-12T03:02:59.950 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41059.log.gz 2024-09-12T03:02:59.951 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T03:02:59.951 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40237.log 2024-09-12T03:02:59.951 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35471.log.gz 2024-09-12T03:02:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38512.log 2024-09-12T03:02:59.952 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40446.log.gz 2024-09-12T03:02:59.953 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41475.log 2024-09-12T03:02:59.954 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40237.log.gz 2024-09-12T03:02:59.954 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35114.log 2024-09-12T03:02:59.955 INFO:teuthology.orchestra.run.smithi063.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38512.log.gz 2024-09-12T03:02:59.955 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35683.log 2024-09-12T03:02:59.956 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41475.log.gz 2024-09-12T03:02:59.956 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40223.log 2024-09-12T03:02:59.957 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35114.log.gz 2024-09-12T03:02:59.958 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39898.log 2024-09-12T03:02:59.958 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35683.log.gz 2024-09-12T03:02:59.959 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41757.log 2024-09-12T03:02:59.959 INFO:teuthology.orchestra.run.smithi063.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40223.log.gz 2024-09-12T03:02:59.960 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38131.log 2024-09-12T03:02:59.960 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39898.log.gz 2024-09-12T03:02:59.961 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40428.log 2024-09-12T03:02:59.961 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2024-09-12T03:02:59.962 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38131.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T03:02:59.962 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38131.log.gz 2024-09-12T03:02:59.963 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37212.log 2024-09-12T03:02:59.963 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40428.log.gz 2024-09-12T03:02:59.964 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40184.log 2024-09-12T03:02:59.966 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40234.log 2024-09-12T03:02:59.966 INFO:teuthology.orchestra.run.smithi063.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.37212.log.gz 2024-09-12T03:02:59.967 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40445.log 2024-09-12T03:02:59.967 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40184.log.gz 2024-09-12T03:02:59.968 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40234.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40234.log.gz 2024-09-12T03:02:59.968 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37127.log 2024-09-12T03:02:59.969 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40445.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40445.log.gz 2024-09-12T03:02:59.970 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35998.log 2024-09-12T03:02:59.971 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40425.log 2024-09-12T03:02:59.971 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37127.log.gz 2024-09-12T03:02:59.972 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34873.log 2024-09-12T03:02:59.972 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35998.log.gz 2024-09-12T03:02:59.973 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38185.log 2024-09-12T03:02:59.974 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40425.log.gz 2024-09-12T03:02:59.975 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34873.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34873.log.gz 2024-09-12T03:02:59.975 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40429.log 2024-09-12T03:02:59.976 INFO:teuthology.orchestra.run.smithi063.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38185.log.gz 2024-09-12T03:02:59.977 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35008.log 2024-09-12T03:02:59.978 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35257.log 2024-09-12T03:02:59.978 INFO:teuthology.orchestra.run.smithi063.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40429.log.gz 2024-09-12T03:02:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35008.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35008.log.gz 2024-09-12T03:02:59.979 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34930.log 2024-09-12T03:02:59.980 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39976.log 2024-09-12T03:02:59.981 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35257.log.gz 2024-09-12T03:02:59.981 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36587.log 2024-09-12T03:02:59.982 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34930.log.gz 2024-09-12T03:02:59.983 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38341.log 2024-09-12T03:02:59.983 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39976.log.gz 2024-09-12T03:02:59.984 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36587.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.36587.log.gz 2024-09-12T03:02:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34815.log 2024-09-12T03:02:59.985 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38341.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38341.log.gz 2024-09-12T03:02:59.986 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40955.log 2024-09-12T03:02:59.987 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35140.log 2024-09-12T03:02:59.988 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40955.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40955.log.gz 2024-09-12T03:02:59.989 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35140.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.34815.log.gz 2024-09-12T03:02:59.989 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35140.log.gz 2024-09-12T03:02:59.990 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41703.log 2024-09-12T03:02:59.991 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39064.log 2024-09-12T03:02:59.992 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39271.log 2024-09-12T03:02:59.993 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41703.log.gz 2024-09-12T03:02:59.994 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40442.log 2024-09-12T03:02:59.994 INFO:teuthology.orchestra.run.smithi063.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39064.log.gz 2024-09-12T03:02:59.995 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34900.log 2024-09-12T03:02:59.995 INFO:teuthology.orchestra.run.smithi063.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.39271.log.gz 2024-09-12T03:02:59.996 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37588.log 2024-09-12T03:02:59.996 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40442.log.gz 2024-09-12T03:02:59.998 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34252.log 2024-09-12T03:02:59.998 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34900.log.gz 2024-09-12T03:02:59.999 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38886.log 2024-09-12T03:02:59.999 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37588.log.gz 2024-09-12T03:03:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34252.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34252.log.gz 2024-09-12T03:03:00.001 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34607.log 2024-09-12T03:03:00.002 INFO:teuthology.orchestra.run.smithi063.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38886.log.gz 2024-09-12T03:03:00.003 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34607.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34607.log.gz 2024-09-12T03:03:00.004 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34078.log 2024-09-12T03:03:00.005 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35263.log 2024-09-12T03:03:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34078.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34078.log.gz 2024-09-12T03:03:00.007 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35263.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35263.log.gz 2024-09-12T03:03:00.008 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34370.log 2024-09-12T03:03:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40886.log 2024-09-12T03:03:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34370.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34370.log.gz 2024-09-12T03:03:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40886.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40886.log.gz 2024-09-12T03:03:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40630.log 2024-09-12T03:03:00.013 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40430.log 2024-09-12T03:03:00.015 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40630.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40630.log.gz 2024-09-12T03:03:00.015 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40430.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40430.log.gz 2024-09-12T03:03:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40629.log 2024-09-12T03:03:00.017 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T03:03:00.019 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40629.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40629.log.gz 2024-09-12T03:03:00.021 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.log: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T03:03:00.022 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39683.log 2024-09-12T03:03:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40653.log 2024-09-12T03:03:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39683.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39683.log.gz 2024-09-12T03:03:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40653.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40653.log.gz 2024-09-12T03:03:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41189.log 2024-09-12T03:03:00.027 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34282.log 2024-09-12T03:03:00.029 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41189.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41189.log.gz 2024-09-12T03:03:00.029 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34282.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34282.log.gz 2024-09-12T03:03:00.030 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36929.log 2024-09-12T03:03:00.031 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40914.log 2024-09-12T03:03:00.033 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36929.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.36929.log.gz 2024-09-12T03:03:00.033 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40914.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40914.log.gz 2024-09-12T03:03:00.034 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35465.log 2024-09-12T03:03:00.035 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41911.log 2024-09-12T03:03:00.037 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35465.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35465.log.gz 2024-09-12T03:03:00.037 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41911.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41911.log.gz 2024-09-12T03:03:00.038 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38826.log 2024-09-12T03:03:00.039 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39212.log 2024-09-12T03:03:00.041 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38826.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38826.log.gz 2024-09-12T03:03:00.042 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39026.log 2024-09-12T03:03:00.043 INFO:teuthology.orchestra.run.smithi063.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39212.log.gz 2024-09-12T03:03:00.044 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35266.log 2024-09-12T03:03:00.045 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39026.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39026.log.gz 2024-09-12T03:03:00.045 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35266.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35266.log.gz 2024-09-12T03:03:00.046 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40158.log 2024-09-12T03:03:00.047 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36377.log 2024-09-12T03:03:00.049 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40158.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40158.log.gz 2024-09-12T03:03:00.050 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36377.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.36377.log.gz 2024-09-12T03:03:00.050 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39742.log 2024-09-12T03:03:00.051 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-09-12T03:03:00.053 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39742.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39742.log.gz 2024-09-12T03:03:00.054 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34424.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz 2024-09-12T03:03:00.054 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39115.log 2024-09-12T03:03:00.055 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39820.log 2024-09-12T03:03:00.057 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39115.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39115.log.gz 2024-09-12T03:03:00.058 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39820.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39820.log.gz 2024-09-12T03:03:00.058 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41646.log 2024-09-12T03:03:00.060 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38256.log 2024-09-12T03:03:00.061 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41646.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41646.log.gz 2024-09-12T03:03:00.062 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38256.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38256.log.gz 2024-09-12T03:03:00.063 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40443.log 2024-09-12T03:03:00.064 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T03:03:00.065 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40054.log 2024-09-12T03:03:00.066 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40443.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40443.log.gz 2024-09-12T03:03:00.066 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40054.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40054.log.gz 2024-09-12T03:03:00.067 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42008.log 2024-09-12T03:03:00.068 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38078.log 2024-09-12T03:03:00.070 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42008.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42008.log.gz 2024-09-12T03:03:00.071 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38078.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.38078.log.gz 2024-09-12T03:03:00.071 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36736.log 2024-09-12T03:03:00.072 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38552.log 2024-09-12T03:03:00.074 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36736.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36736.log.gz 2024-09-12T03:03:00.075 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38552.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38552.log.gz 2024-09-12T03:03:00.075 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35267.log 2024-09-12T03:03:00.077 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36794.log 2024-09-12T03:03:00.078 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35267.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35267.log.gz 2024-09-12T03:03:00.079 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36794.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.36794.log.gz 2024-09-12T03:03:00.080 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35258.log 2024-09-12T03:03:00.081 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36111.log 2024-09-12T03:03:00.083 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35258.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35258.log.gz 2024-09-12T03:03:00.083 INFO:teuthology.orchestra.run.smithi119.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T03:03:00.084 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36111.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36111.log.gz 2024-09-12T03:03:00.084 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35461.log 2024-09-12T03:03:00.085 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35920.log 2024-09-12T03:03:00.087 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35461.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35461.log.gz 2024-09-12T03:03:00.088 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35920.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35920.log.gz 2024-09-12T03:03:00.088 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40224.log 2024-09-12T03:03:00.089 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40238.log 2024-09-12T03:03:00.091 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40224.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40224.log.gz 2024-09-12T03:03:00.092 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40238.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40238.log.gz 2024-09-12T03:03:00.092 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34344.log 2024-09-12T03:03:00.093 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37081.log 2024-09-12T03:03:00.095 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34344.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34344.log.gz 2024-09-12T03:03:00.096 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37081.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37081.log.gz 2024-09-12T03:03:00.096 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41371.log 2024-09-12T03:03:00.098 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T03:03:00.099 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41371.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41371.log.gz 2024-09-12T03:03:00.102 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-12T03:03:00.102 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T03:03:00.103 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T03:03:00.107 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-mds.a.log: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-12T03:03:00.107 INFO:teuthology.orchestra.run.smithi063.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T03:03:00.108 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41729.log 2024-09-12T03:03:00.109 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40834.log 2024-09-12T03:03:00.110 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41729.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41729.log.gz 2024-09-12T03:03:00.111 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40834.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40834.log.gz 2024-09-12T03:03:00.111 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36825.log 2024-09-12T03:03:00.112 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38703.log 2024-09-12T03:03:00.114 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36269.log 2024-09-12T03:03:00.114 INFO:teuthology.orchestra.run.smithi063.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36825.log.gz 2024-09-12T03:03:00.115 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38703.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38703.log.gz 2024-09-12T03:03:00.116 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36269.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36269.log.gz 2024-09-12T03:03:00.116 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34226.log 2024-09-12T03:03:00.118 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34114.log 2024-09-12T03:03:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36295.log 2024-09-12T03:03:00.120 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34226.log.gz 2024-09-12T03:03:00.120 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34114.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34114.log.gz 2024-09-12T03:03:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36295.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36295.log.gz 2024-09-12T03:03:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37761.log 2024-09-12T03:03:00.123 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35684.log 2024-09-12T03:03:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40002.log 2024-09-12T03:03:00.125 INFO:teuthology.orchestra.run.smithi063.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.37761.log.gz/var/log/ceph/ceph-client.admin.35684.log: 2024-09-12T03:03:00.125 INFO:teuthology.orchestra.run.smithi063.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35684.log.gz 2024-09-12T03:03:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40002.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40002.log.gz 2024-09-12T03:03:00.127 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40638.log 2024-09-12T03:03:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37397.log 2024-09-12T03:03:00.129 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37999.log 2024-09-12T03:03:00.130 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40638.log.gz 2024-09-12T03:03:00.131 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37397.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.37397.log.gz 2024-09-12T03:03:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37999.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.37999.log.gz 2024-09-12T03:03:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41215.log 2024-09-12T03:03:00.134 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36050.log 2024-09-12T03:03:00.135 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35676.log 2024-09-12T03:03:00.135 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41215.log.gz 2024-09-12T03:03:00.136 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35480.log 2024-09-12T03:03:00.137 INFO:teuthology.orchestra.run.smithi063.stderr: 91.1%/var/log/ceph/ceph-client.admin.35676.log: -- replaced with /var/log/ceph/ceph-client.admin.36050.log.gz 2024-09-12T03:03:00.137 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35676.log.gz 2024-09-12T03:03:00.138 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36418.log 2024-09-12T03:03:00.138 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35480.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35480.log.gz 2024-09-12T03:03:00.139 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39577.log 2024-09-12T03:03:00.140 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38373.log 2024-09-12T03:03:00.141 INFO:teuthology.orchestra.run.smithi063.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.36418.log.gz 2024-09-12T03:03:00.141 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39577.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39577.log.gz 2024-09-12T03:03:00.143 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38373.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38373.log.gz 2024-09-12T03:03:00.143 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36735.log 2024-09-12T03:03:00.144 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38424.log 2024-09-12T03:03:00.145 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35254.log 2024-09-12T03:03:00.146 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36735.log.gz 2024-09-12T03:03:00.147 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38424.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38424.log.gz 2024-09-12T03:03:00.148 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35254.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35254.log.gz 2024-09-12T03:03:00.148 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34398.log 2024-09-12T03:03:00.149 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39276.log 2024-09-12T03:03:00.151 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37835.log 2024-09-12T03:03:00.151 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34398.log.gz 2024-09-12T03:03:00.152 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37598.log 2024-09-12T03:03:00.153 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39276.log.gz 2024-09-12T03:03:00.153 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-09-12T03:03:00.153 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37835.log.gz 2024-09-12T03:03:00.154 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38370.log 2024-09-12T03:03:00.155 INFO:teuthology.orchestra.run.smithi063.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37598.log.gz 2024-09-12T03:03:00.156 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36417.log 2024-09-12T03:03:00.156 INFO:teuthology.orchestra.run.smithi063.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-09-12T03:03:00.157 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39711.log 2024-09-12T03:03:00.157 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38370.log.gz 2024-09-12T03:03:00.158 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36417.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36417.log.gz 2024-09-12T03:03:00.160 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41241.log 2024-09-12T03:03:00.161 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35166.log 2024-09-12T03:03:00.162 INFO:teuthology.orchestra.run.smithi063.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.39711.log.gz 2024-09-12T03:03:00.163 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35946.log 2024-09-12T03:03:00.163 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41241.log.gz 2024-09-12T03:03:00.164 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35166.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35166.log.gz 2024-09-12T03:03:00.164 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41423.log 2024-09-12T03:03:00.165 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40981.log 2024-09-12T03:03:00.165 INFO:teuthology.orchestra.run.smithi063.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35946.log.gz 2024-09-12T03:03:00.166 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40654.log 2024-09-12T03:03:00.166 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41423.log.gz 2024-09-12T03:03:00.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40981.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40981.log.gz 2024-09-12T03:03:00.168 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37126.log 2024-09-12T03:03:00.168 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40654.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40654.log.gz 2024-09-12T03:03:00.169 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41111.log 2024-09-12T03:03:00.170 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38600.log 2024-09-12T03:03:00.170 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37126.log.gz 2024-09-12T03:03:00.171 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41111.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41111.log.gz 2024-09-12T03:03:00.172 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.38600.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38600.log.gz 2024-09-12T03:03:00.173 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35271.log 2024-09-12T03:03:00.174 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40219.log 2024-09-12T03:03:00.175 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39390.log 2024-09-12T03:03:00.176 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35271.log.gz 2024-09-12T03:03:00.176 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40219.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40219.log.gz 2024-09-12T03:03:00.178 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39794.log 2024-09-12T03:03:00.178 INFO:teuthology.orchestra.run.smithi063.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.39390.log.gz 2024-09-12T03:03:00.179 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36901.log 2024-09-12T03:03:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39794.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-09-12T03:03:00.181 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39794.log.gz 2024-09-12T03:03:00.181 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41885.log 2024-09-12T03:03:00.182 INFO:teuthology.orchestra.run.smithi063.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36901.log.gz 2024-09-12T03:03:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.41885.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41885.log.gz 2024-09-12T03:03:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37662.log 2024-09-12T03:03:00.186 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40235.log 2024-09-12T03:03:00.188 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37662.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37662.log.gz 2024-09-12T03:03:00.188 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40235.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40235.log.gz 2024-09-12T03:03:00.189 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40132.log 2024-09-12T03:03:00.190 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41293.log 2024-09-12T03:03:00.192 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.40132.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40132.log.gz 2024-09-12T03:03:00.192 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41293.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41293.log.gz 2024-09-12T03:03:00.193 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34956.log 2024-09-12T03:03:00.194 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39534.log 2024-09-12T03:03:00.196 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34956.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34956.log.gz 2024-09-12T03:03:00.197 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.39534.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.39534.log.gz 2024-09-12T03:03:00.197 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41618.log 2024-09-12T03:03:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37326.log 2024-09-12T03:03:00.200 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.41618.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41618.log.gz 2024-09-12T03:03:00.201 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37326.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37326.log.gz 2024-09-12T03:03:00.202 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35272.log 2024-09-12T03:03:00.203 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35972.log 2024-09-12T03:03:00.205 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35272.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35272.log.gz 2024-09-12T03:03:00.205 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35972.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35972.log.gz 2024-09-12T03:03:00.262 INFO:teuthology.orchestra.run.smithi063.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-09-12T03:03:00.282 INFO:teuthology.orchestra.run.smithi063.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T03:03:00.761 INFO:teuthology.orchestra.run.smithi119.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T03:03:00.800 INFO:teuthology.orchestra.run.smithi119.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T03:03:00.830 INFO:teuthology.orchestra.run.smithi063.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T03:03:00.835 INFO:teuthology.orchestra.run.smithi119.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T03:03:00.836 INFO:teuthology.orchestra.run.smithi119.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T03:03:00.838 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-12T03:03:00.838 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m1.009s 2024-09-12T03:03:00.838 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m4.296s 2024-09-12T03:03:00.838 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.161s 2024-09-12T03:03:00.927 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T03:03:00.935 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T03:03:01.061 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T03:03:01.063 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-12T03:03:01.063 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m1.243s 2024-09-12T03:03:01.063 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m4.532s 2024-09-12T03:03:01.063 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m0.782s 2024-09-12T03:03:01.064 INFO:tasks.ceph:Archiving logs... 2024-09-12T03:03:01.064 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642/remote/smithi063/log 2024-09-12T03:03:01.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T03:03:01.781 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642/remote/smithi119/log 2024-09-12T03:03:01.782 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T03:03:02.302 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T03:03:02.312 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T03:03:02.312 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T03:03:02.315 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T03:03:02.389 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T03:03:02.400 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T03:03:02.400 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T03:03:02.404 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T03:03:02.417 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T03:03:02.417 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2024-09-12T03:03:02.417 INFO:teuthology.orchestra.run.smithi063.stdout:+hv01.front.sepi 67.205.162.81 3 u 53 64 377 0.088 +3.159 1.055 2024-09-12T03:03:02.417 INFO:teuthology.orchestra.run.smithi063.stdout:*hv02.front.sepi 63.231.80.2 3 u 55 64 377 0.086 -1.974 1.127 2024-09-12T03:03:02.417 INFO:teuthology.orchestra.run.smithi063.stdout:+hv03.front.sepi 74.6.168.72 3 u 46 64 377 0.080 -1.761 1.854 2024-09-12T03:03:02.417 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:03:02.419 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T03:03:02.419 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2024-09-12T03:03:02.419 INFO:teuthology.orchestra.run.smithi119.stdout:+hv01.front.sepi 67.205.162.81 3 u 55 64 377 0.089 +2.070 1.429 2024-09-12T03:03:02.419 INFO:teuthology.orchestra.run.smithi119.stdout:*hv02.front.sepi 63.231.80.2 3 u 55 64 377 0.118 -0.897 1.864 2024-09-12T03:03:02.419 INFO:teuthology.orchestra.run.smithi119.stdout:+hv03.front.sepi 74.6.168.72 3 u 53 64 377 0.087 -4.740 1.694 2024-09-12T03:03:02.419 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:03:02.419 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T03:03:02.429 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T03:03:02.429 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T03:03:02.440 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T03:03:02.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T03:03:02.466 INFO:teuthology.task.internal:Duration was 1084.248154 seconds 2024-09-12T03:03:02.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T03:03:02.477 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T03:03:02.477 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T03:03:02.481 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T03:03:02.569 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T03:03:02.569 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-09-12T03:03:02.569 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T03:03:02.590 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-09-12T03:03:02.590 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T03:03:02.600 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T03:03:02.600 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T03:03:02.640 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T03:03:02.680 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T03:03:02.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T03:03:02.728 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T03:03:02.807 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T03:03:02.818 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T03:03:02.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T03:03:02.839 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T03:03:02.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T03:03:02.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:03:02.884 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:03:02.899 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-09-12T03:03:02.902 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-09-12T03:03:02.926 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:03:02.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:03:02.964 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:03:02.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:03:02.972 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T03:03:02.982 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T03:03:02.983 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642/remote/smithi063 2024-09-12T03:03:02.983 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T03:03:03.032 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901642/remote/smithi119 2024-09-12T03:03:03.033 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T03:03:03.053 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T03:03:03.053 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T03:03:03.072 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T03:03:03.097 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T03:03:03.108 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T03:03:03.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T03:03:03.119 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T03:03:03.119 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T03:03:03.124 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T03:03:03.129 INFO:teuthology.orchestra.run.smithi063.stdout: 658153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 03:03 /home/ubuntu/cephtest 2024-09-12T03:03:03.145 INFO:teuthology.orchestra.run.smithi119.stdout: 524292 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 03:03 /home/ubuntu/cephtest 2024-09-12T03:03:03.147 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T03:03:03.158 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T03:03:03.192 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} duration: 1084.2481541633606 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T03:03:03.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T03:03:03.279 INFO:teuthology.run:pass